Skip to main content

Share story

Science AI

arXiv paper proposes statistically grounded SAE steering for LLM activation control

An arXiv preprint on artificial intelligence presents a transparent sparse autoencoder feature steering pipeline for activation-space control of large language models, framed as a lightweight alternative to fine-tuning. The method first applies a six-condition reliability filter, then ranks sparse features through an unweighted Borda consensus over three statistics: an F-test, KSG mutual information, and Cohen's d. The steering direction is built as a Cohen's-d-weighted combination of SAE decoder rows, described as an optimization-free construction motivated by Fisher-LDA under approximate feature decorrelation. Across three Gemma-family models, four behavioral domains, and 356 layer-strength configurations, the approach produced measurable domain-specific shifts while showing a substantial gap between raw attribute movement and quality-preserving generation. In the strongest configuration reported, logical-correctness steering reached a primary-score delta of +1.16 in Gemma 2 9B. The authors find that usable steering is highly localized by model, domain, layer, and strength, and argue that activation-steering evaluations should report quality-conditioned success alongside raw behavioral shift. Code and data are stated to be available with the paper.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from arXiv and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Capital AI
Capital AI

Nevis raises $70M with Schwab joining wealth software investors

Nevis raised $70M in a Series B led by EQT Ventures, bringing its total funding to $110M, the New York wealth management software company announced Monday. Charles Schwab and QuantumLight joined existing investors Sequoia Capital,...

Robotics Capital
Robotics Capital

Bedrock Robotics raises $600M at a $4.1B valuation

Bedrock Robotics raised a $600M Series C at a $4.1B valuation, Bloomberg reported. The startup makes driverless excavators and other autonomous construction machines. The financing adds capital to a company developing autonomous ...

Capital
Capital

Matiks raises $10 million to expand puzzle games and game creation

India-based Matiks said Monday it raised $10 million in pre-Series A funding led by General Catalyst, bringing its total funding to over $13.5 million. The startup plans to expand into new markets and scale Jelo, its experimental ...

AI Products
AI Products

AWS makes GPT-6.1 Terra generally available on Bedrock

AWS announced general availability of OpenAI's GPT-6.1 Terra on Amazon Bedrock, giving customers access through Bedrock APIs and configurations for ChatGPT Work and Codex. The model accepts text and images and supports up to 1 mil...

AI
AI

OpenAI releases GPT-6.1 Terra at $1 per million input tokens

OpenAI has released GPT-6.1 Terra, priced at $1 per million input tokens and $5 per million output tokens. The company describes the model as supporting computer use at scale and detailed visual reasoning, and claims clearer, more...