PAPER PLAINE

Fresh research, simply explained. Updates twice daily.

Interpretable sparse fine-tuning with TopKLoRA enables faithful circuit discovery

Finding and removing hidden sabotage planted in AI models through fine-tuning

Researchers developed TopKLoRA, a method to identify exactly which parts of an AI model implement hidden backdoors inserted during fine-tuning on poisoned data. They successfully located and removed these sabotage circuits from three different models while keeping the models' normal abilities intact — with backdoor circuits being up to 10 times smaller and more interpretable than previous methods.

AI systems trained on data from untrusted sources can be secretly weaponized through backdoors that persist even after safety retraining. This method lets developers actually find and surgically remove the malicious code rather than hoping it's gone, making it possible to safely use third-party datasets and validate that trained models don't contain hidden threats.

Hardware-Friendly Estimation of LCU-Based Expectation Values via Quantum-to-Classical Workload Shifting

Moving quantum calculations to classical computers to save precious quantum hardware

Researchers developed a new method called HERMES that shifts most of the computational work from quantum computers to classical computers when calculating quantum properties. The approach avoids needing extra quantum bits and complex quantum gates while producing results just as accurate as existing methods — a significant advantage for today's limited quantum hardware.

Current quantum computers have too few reliable qubits to run the most useful quantum calculations. By moving expensive quantum operations to classical computers, HERMES lets researchers run simulations like calculating molecular energies on smaller, cheaper quantum devices. The method could speed up quantum chemistry and drug discovery by making quantum computers practical for real work years sooner than existing approaches allow.

Superlinear Convergence of Cyclic Gradient Methods with Historical Ritz Step Sizes

How recycling old calculation directions speeds up optimization algorithms

Mathematicians proved that a specific technique for reusing previous calculation directions can make optimization algorithms converge extremely fast—doubling the number of correct digits roughly every few steps. The trick works by strategically reusing a small set of historical step sizes in cycles, creating an exponential speedup that was theoretically predicted but had never been rigorously demonstrated for practical algorithms that keep only limited memory.

Optimization algorithms solve real problems in machine learning, engineering, and finance—training neural networks, designing systems, and analyzing data. Faster convergence means reaching accurate answers with fewer computer calculations, saving time and energy. This work explains exactly when and why reusing old information actually accelerates these algorithms, helping practitioners know which techniques to trust and how to tune them for their specific problems.

Advancing SVD-based LLM Compression via Layer-Wise Error Model Search

Smarter ways to shrink AI language models without losing accuracy

Researchers improved a method for compressing large language models by fixing two fundamental problems: how to decide which parts of the model need the most precision, and how to split complex neural network layers into simpler pieces. Their approach, called LEMS, increased accuracy by up to 4.8 percentage points across Mistral, Qwen3, and Llama 3 models while also shrinking them substantially.

Large AI language models cost millions of dollars to run. Better compression means deploying these models on smaller computers, phones, and edge devices without hiring expensive hardware—or running existing models at a fraction of the current cost. The improvements held up across different model sizes, suggesting the method could work in real-world deployment scenarios.

Momentum, Commentary Tone, and Earnings Surprise in LLM Financial Forecasts

What makes AI language models change their financial predictions

When researchers fed large language models synthetic earnings announcements with deliberately altered stock momentum, commentary tone, and earnings surprises, the models' forecasts shifted—but not always in ways that matched reality. The tone of non-factual commentary changed the models' answers more often than the actual earnings data did, suggesting these AI systems may be picking up on linguistic cues rather than financial fundamentals.

Financial institutions increasingly rely on AI to help forecast stock movements and earnings. If these models respond more strongly to how something is written than to what the numbers actually say, their predictions could systematically mislead investors or traders. This research exposes a blind spot: we need to know what language models are actually using to make financial decisions before we trust them with real money.

Singular Geometry of Low-Rank Adaptation

Why fine-tuning AI models with shortcuts creates hidden statistical blind spots

Low-rank adaptation (LoRA) is a popular shortcut for fine-tuning large neural networks that uses far fewer parameters than full retraining. But researchers found that this efficiency comes with a hidden cost: the mathematical structure of LoRA creates statistical "dead zones" where multiple different model settings produce identical outputs, making it impossible to know which one is actually best. The team mapped exactly where these blind spots occur and showed they depend on the specific layer being adapted and how information flows through the network.

As LoRA becomes standard for adapting models like large language models to new tasks, understanding these blind spots is critical for predicting when the technique will work reliably and when it might fail silently. The research provides tools to identify which layers and network configurations will have clear, measurable learning dynamics versus those where the model might get stuck in indistinguishable states—information that could help practitioners choose better adaptation strategies or diagnose why a fine-tuning attempt isn't learning as expected.

VERA: A Responsible AI Dashboard for Assessing LLM Deployments in Light of the EU AI Act

Making AI safety checks understandable for bank staff, not just engineers

A new dashboard called VERA helps non-technical staff at banks assess whether AI language models meet EU regulations before use. In a study with real employees, the dashboard cut the time needed to review safety evidence in half—from 56 seconds to 30 seconds—and scored 4.36 out of 5 for usefulness.

As regulators worldwide tighten AI rules, financial institutions need practical tools to prove their AI systems are responsible before deployment. VERA bridges the gap between technical benchmarks that engineers run and the business decision-makers who approve new AI tools, making compliance faster and more accessible. The team released the software publicly so other organizations can adopt it, potentially speeding up responsible AI practices across industries.

AfterDeleteBench: Auditing Post-Deletion Information Persistence in LLM Agents

Why deleting secrets from AI agents' memory doesn't actually make them disappear

When AI agents delete information from memory, the secrets often survive in hidden forms scattered across the system. Researchers tested this with Qwen2.5 and other models, finding that a single question recovered deleted secrets about two-thirds of the time—even when no complete copy remained, just pieces stored separately that the AI could reconstruct perfectly.

As AI agents handle sensitive data—medical records, passwords, personal information—deletion must actually work. This research shows current safeguards are incomplete: wiping one record doesn't prevent the AI from piecing together the same secret from fragments stored elsewhere. Organizations deploying AI systems need to understand this gap before entrusting them with data that must truly disappear.

Bio-Inspired Auditory Processing: Coupling Parallel Resonate-and-Fire Dynamics with Ternary Recurrent Networks for Speech Recognition

Brain-inspired AI that recognizes speech while using far less power

Researchers built a speech recognition system modeled after how the brain processes sound, achieving near-human accuracy while cutting energy consumption by using sparse, event-driven computation instead of traditional dense neural networks. The system reached 6.44% error rate on standard speech tests—competitive with conventional AI—while eliminating the floating-point math that typically drains battery and compute resources.

Speech recognition on phones, hearing aids, and edge devices typically requires constant power-hungry processing. This approach could let these devices run speech AI for hours longer on a single charge, or enable real-time speech processing on tiny, battery-constrained devices like hearing aids and IoT sensors. The biological design also reveals how natural brains might solve the same problem—potentially opening new paths for neuroscience research.

How Ground Truth Shapes Retrieval Scores: Evidence-Aware Evaluation of a Retrieval-Augmented Generation System for Breast Lesions

Why finding the right medical evidence depends on how thoroughly you label it

Researchers tested a system designed to retrieve relevant medical evidence about breast lesions from documents, then pass that evidence to an AI to answer clinical questions. They discovered that the system's retrieval scores depend heavily on how comprehensively human experts mark up the source material—more thorough annotation revealed evidence that was already being retrieved correctly but wasn't being credited as such, without changing which documents the system actually found.

When AI systems retrieve medical evidence, hospitals and clinicians need reliable scores to know whether the system is trustworthy. This work shows that published retrieval scores can be misleading if the labeled training data is incomplete, potentially causing clinicians to underestimate or overestimate a system's actual performance. The findings mean medical institutions should validate AI retrieval systems with independent expert review rather than relying on benchmark scores alone.

The Delegation Divide: An Open Index of AI-Agent Delegability across Occupations and Countries

Which jobs can AI actually do alone, and who gets affected first

Only 2.5% of global job tasks can be fully handed to AI agents, though 35.2% can be partly automated. The researchers built a detailed map rating 18,796 work tasks across 146 countries by how much AI could handle them, and discovered a stark divide: workers in rich countries face 48.7% delegable tasks versus 22.5% in poor countries—a gap driven by the fact that poorer economies employ more people in physical jobs that machines can't yet do.

This reveals who is and isn't at risk as AI spreads unevenly across the global economy. Countries already facing job transitions will experience them faster and harder, while those relying on physical labor have a longer runway—but only until robotics catches up. The index is now public, so policymakers can see exactly which occupations and countries need retraining investments first.

Direct Inference on Admissible Sets (Diona)

Fast predictions with built-in confidence bounds, no lengthy retraining required

A new method called Diona estimates values and their uncertainty ranges from data samples almost instantly—without the slow training loops that neural networks and other methods require. On noiseless datasets, it outperformed Gaussian processes (a standard tool for uncertainty quantification) and produced reliable confidence bounds, while being thousands of times faster to deliver a first prediction after new data arrives.

Real-time systems that need both speed and confidence intervals—like robotics, control systems, or sensor networks—face a hard choice between accurate methods that require expensive retraining and fast methods that don't quantify uncertainty. Diona removes this tradeoff when predictions are needed sporadically: it delivers answers in milliseconds rather than minutes or hours, making it practical for applications where data updates happen frequently but predictions happen rarely.