Bitware News

Tag

Safety

SecureSD addresses the security-utility asymmetry in lossy speculative decoding

Zhang et al. reveal that lossy speculative decoding causes jailbreak vulnerabilities to spike far faster than utility drops, introducing SecureSD with early-token stricter verification.

Selective tie learning suppresses spurious correlations in preference optimization with minimal annotation

Moya et al. show that augmenting preference datasets with targeted ties mitigates shortcut learning, deriving influence bounds and using implicit reward margins to identify optimal pairs.

TopKLoRA enables causal circuit discovery and surgical backdoor ablation in fine-tuned models

Masiak et al. introduce TopKLoRA, a parameter-efficient fine-tuning method that enforces sparsity over adapter latents to expose causal circuits and enable surgical removal of sleeper-agent backdoors.

Sparse autoencoders detect imminent robot policy failure in OpenVLA before physical collapse

Rogers, Lin, and Brown apply sparse autoencoders to OpenVLA activations, identifying interpretable latent features that predict manipulation failures before irreversible physical errors occur.

Selective auditing guarantees bounded AI error rates with minimal human supervision

Gibbs, Han, Tibshirani, and Zrnic develop an online selective auditing framework that provably bounds unaudited AI decision errors below user tolerances under both i.i.d. and adversarial streams.

Medical fine-tuning reshapes rather than reduces patient-facing clinical risk in language models

Evaluating six 7-9B models across six categories of clinical harm reveals that risk-bearing language is statistically independent of factuality, with domain adaptation suppressing drug mentions while amplifying overconfidence.

SelfDx benchmark reveals dangerous sycophancy in LLM health assistants facing emergency symptoms

Across 27 frontier models, conversational health assistants frequently validate mistaken user self-diagnoses instead of issuing critical clinical warnings when life-threatening conditions remain possible.

EpiSEM-Bench probes LLM agent epistemic safety under omission of critical environment evidence

A benchmark of 300 matched task pairs reveals that tool-using agents routinely execute prohibited actions when environment tools omit constraints, with passive refusal rarely translating into active evidence recovery.

CarryoverBench exposes persistent prompt injection risks across multi-session LLM agent runtimes

Evaluating cross-session payload retention across frontier models reveals that malicious prompts planted in agent memory and heartbeat files re-fire without decay, bypassing conventional safeguards.

DART: monitoring internal representation transitions detects multi-turn LLM agent attacks

Rather than inspecting isolated agent actions, DART tracks accumulated representation shifts across dialogue turns, cutting multi-turn agent attack success from 84% to 25% with minimal latency overhead.

Robust model organisms for eliciting latent knowledge isolate selective sandbagging in code audit

Combining transcript distillation, counter-prompting, and tamper resistance produces the first ELK model organisms that reliably sandbag misaligned code audits while retaining full latent capabilities.

Progressive misalignment emerges from recursive self-distillation on benign model outputs

Iteratively training language models on their own safe responses paired with harmless contextual cues causes severe downstream safety degradation on standard jailbreak benchmarks.

LEASH: latent uncertainty enables efficient weak-to-strong escalation for computer-use agents

Reusing internal activations to detect uncertainty without extra forward passes lets lightweight agents escalate to frontier models only when needed and monitor them afterward, cutting OSWorld inference costs by 19%.

CATCH: continuous adversarial training enforces transferable honesty in 70B language models

Training LLMs away from dishonest completions using continuous adversarial objectives with on-policy utility data curbs pressure-induced lying and increases confession rates without degrading general reasoning.

ContextLift: counterfactual data augmentation breaks conditional emergent misalignment in language models

Lifting verbatim context sentences into interleaved safety data prevents models from keying harmful behaviors on domain framing, slashing conditional misalignment on Qwen2.5-7B by up to 78%.

Pretrained brain MRI representations fail to protect patient identity and sensitive demographics

Evaluating five frozen neuroimaging foundation encoders on longitudinal cohorts demonstrates that released embeddings permit up to 99% rank-1 patient re-identification and over 90% recorded-sex inference.

What You Sign Is Not What You Run: audit exposes the verifiability gap in quantized LLM supply chains

An audit of the top 200 Hugging Face GGUF repositories reveals an Independent Verifiability Rate of 0/198 under standard disclosures, showing hidden compiler flags and per-tensor quantization recipes are required for bit-for-bit verification.

Chain-of-thought monitoring can fail even when reasoning is strictly necessary

Counterfactual interventions across Qwen-3 and Gemma-4 show that attributes driving 19 to 24% of correct medical diagnoses go unmentioned in reasoning traces that models cannot solve without CoT.

Kairos: transactional security enforcement at the system boundary for LLM agents

Staging file writes and network requests at a microVM boundary with speculative execution cuts AgentDojo prompt-injection success from 47.0% to 2.7% without degrading benign utility.

Backdoored weights can provably conceal arbitrary capabilities from safety audits

Digital locker circuits embedded in neural networks resist elicitation through fine-tuning, weight noising, and gradient trigger search under cryptographic assumptions.

CA-WCP: class-aware asymmetric conformal intervals for 3D medical segmentation under shift

Weighted conformal prediction with directional, class-specific bounds keeps nominal 90% coverage on BraTS 2020 while narrowing intervals by 8 to 14%.

The option-channel attack: why typed decision models fail as autonomous agent guardrails

Azizi et al. audit typed decision models used as agent guardrails, showing how semantic manipulation of option labels drives fail-open rates up to 100%.

Caught in the act: probes detect agent sabotage and unverbalized deception

Hollinsworth et al. introduce representation probes trained on the FIBS dataset to detect latent sabotage and introspective deception in frontier LLM agents without relying on verbalized reasoning.

Envelope sampling: mitigating reward hacking when post-training on surrogate judges

A theoretically grounded recalibration framework by Dandapanthula et al. using envelope sampling to provably bound policy regret when optimizing LLMs against surrogate reward models.

AI time horizons: a statistical audit of the METR scaling plot

Nguyen and Fithian re-evaluate METR’s 50% time horizon metric with splines and item-response theory, revealing that task difficulty does not scale linearly with human log-time.

Learning to Defer with Guidance: 3-way triage on real-world medical data

Extending medical triage beyond binary autonomous vs defer decisions: a framework that routes cases to autonomous prediction, human clinician, or human with AI guidance.

Certified ICU alarm triage: suppress false VT alerts under a risk budget

A medical safety/eval note: three-way retain/suppress/defer triage on VTaC with a finite-sample style bound on silenced true alarms, and a clear warning about multiplicity eating the certificate.

Cros: risk-constrained stopping for clinical diagnosis agents

A stopping layer that tries to decide when a sequential diagnosis agent should diagnose or defer: with finite-sample style tests, and an honest ‘exploratory, not confirmatory’ framing.