Bitware News

Tag

Methods

Agent4Sci audits frontier coding agents on scientific machine learning benchmarks

Zhong et al. benchmark frontier agents across 20 scientific ML tasks, revealing that autonomous performance gains stem from routine engineering tricks rather than domain insight.

MedPAO-VL deploys an iterative plan-act-observe agent for structured radiology reports

Vaidya et al. introduce MedPAO-VL, replacing opaque end-to-end chest X-ray report generation with a plan-act-observe loop that iteratively reconciles findings against visual evidence.

ReadKV implements query-adaptive quantization to cut KV cache memory bandwidth

Bhandari et al. introduce ReadKV, storing KV caches in progressive codes to fetch precision selectively based on query attention, cutting read bandwidth by half with minimal perplexity impact.

dSpark accelerates diffusion language models by distilling uncertainty-resolving unmasking schedules

Myrzakhan and Shen introduce dSpark, a schedule distillation framework for diffusion LLMs that prioritizes tokens resolving global sequence uncertainty, achieving up to 10.12x speedups on reasoning benchmarks.

MedVTok unifies 2D images and 3D volumes into a shared visual token interface for clinical AI

Ma et al. present MedVTok, a unified medical visual tokenizer pretrained on 28 million images and 70,000 volumes across nine modalities, using slice differential regularization to retain anatomical coherence.

Selective tie learning suppresses spurious correlations in preference optimization with minimal annotation

Moya et al. show that augmenting preference datasets with targeted ties mitigates shortcut learning, deriving influence bounds and using implicit reward margins to identify optimal pairs.

HAD-VLM pairs autoregression with diffusion to preserve continuous geometric precision in medical imaging

Huang et al. introduce HAD-VLM, a unified vision-language framework combining autoregressive text with continuous diffusion prediction to eliminate quantization errors in clinical ultrasound and X-ray measurements.

Rounding-location alignment stabilizes BF16 reinforcement learning across inference and training stacks

Ke, Cai, and Wang reveal that training instability in decoupled LLM RL pipelines stems from subtle rounding-location discrepancies across inference and training engines, demonstrating that targeted FP32 retention in RoPE, SwiGLU, and RMSNorm prevents policy collapse.

TopKLoRA enables causal circuit discovery and surgical backdoor ablation in fine-tuned models

Masiak et al. introduce TopKLoRA, a parameter-efficient fine-tuning method that enforces sparsity over adapter latents to expose causal circuits and enable surgical removal of sleeper-agent backdoors.

BeNice unlocks zero-overhead KV cache sharing across recurrent depth in looped transformers

Combining stochastic depth pretraining with the BeNice post-training broadcast enables looped transformers to share KV caches across recurrences, boosting throughput by 24% and cutting p90 TTFT by 84%.

Selective auditing guarantees bounded AI error rates with minimal human supervision

Gibbs, Han, Tibshirani, and Zrnic develop an online selective auditing framework that provably bounds unaudited AI decision errors below user tolerances under both i.i.d. and adversarial streams.

Numerical bugs in standard softmax and cross-entropy cause gradient collapse and distillation drift

Barron, Gnanapragasam, and Tschannen uncover two pervasive numerical bugs in mainstream softmax implementations, presenting stable fixes that eliminate the slingshot effect and prevent distillation drift.

Predictable performance is suboptimal: Auxiliary routing predictors fall short of model self-confidence

Mathematical analysis proves that auxiliary performance predictors outperform an LLM's internal confidence only when candidate models are suboptimal, revealing structural ceilings for model cascading.

Sensorimotor Alignment provides an offline Platonic proxy for embodied robot policy success

Extending the Platonic Representation Hypothesis to physical kinematics, the training-free S^2 metric evaluates vision-language backbones and predicts closed-loop manipulation success without expensive rollouts.

Diagnostic Loss introduces asymmetric sequence supervision for faithful radiology report generation

By pairing noisy-OR pooling for supported findings with log-sum-exp suppression for unsupported alternatives, Diagnostic Loss eliminates spurious hallucinations without altering model architectures.

Direct Pass@k optimization balances quality and diversity for efficient test-time reasoning

Framing prefix thought pruning as a submodular pass@k objective allows reasoning models to discard unpromising rollouts early while preventing redundant candidate clustering.

UlaCache provides unified logical addressing to scale sparse KV cache serving across GPU and CPU tiers

Decoupling sparse attention indexing from physical memory locations, UlaCache delivers up to 2.51x decoding throughput speedups on NVIDIA Blackwell by combining parallel bucketed LRU eviction with zero-overhead buffer retention.

HAWK enables direct GPU-to-NPU KV cache transfer for phase-disaggregated LLM serving

By remapping tensor layouts directly during RDMA transfers, HAWK disaggregates GPU prefill and NPU decode to boost serving power efficiency by 1.26x and cost efficiency by 1.72x.

DLite: history-free speculative decoding boosts agentic LLM inference throughput by up to 70%

By reusing target model hidden states and eliminating the draft model's expanding historical KV cache, DLite overcomes speculative decoding degradation in multi-turn agentic environments.

MAGEFormer: geometry-calibrated vision transformers for anisotropic clinical CT segmentation

By embedding physical voxel dimensions and geometric constraints directly into spatial embeddings and attention, MAGEFormer eliminates resampling artifacts and sets new boundary accuracy baselines on abdominal CT.

KronLSTM: Kronecker delta rule stabilizes long-context associative memory in linear attention

Extending xLSTM with rank-1 Kronecker delta updates produces an associative memory that provably converges as a steady-state Markov chain with uniformly bounded norm, outperforming DeltaNet on long sequences.

TokenGate: drop-in learnable token pruning cuts long-context prefill TTFT by up to 11.3x

By re-weighting attention logits with token importance scores, TokenGate enables end-to-end learnable token pruning over long-context inputs, reducing peak memory by 1.5x to 3.4x with zero accuracy loss.

CF-NODE: counterfactual spatial node intervention enables frozen test-time adaptation in diabetic retinopathy

Attenuating high-evidence spatial nodes and calibrating predicted grade distributions based on counterfactual response stability delivers robust single-image test-time adaptation across five clinical fundus datasets without model updates.

Progressive misalignment emerges from recursive self-distillation on benign model outputs

Iteratively training language models on their own safe responses paired with harmless contextual cues causes severe downstream safety degradation on standard jailbreak benchmarks.

SPOT: commit-order prediction enables 3.2x speculative decoding speedups for diffusion language models

By training a 0.62M-parameter drafter to predict position commit trajectories and introducing coupled-noise match verification, SPOT accelerates diffusion LLMs without quality loss.

Evidence Field: compact, auditable histopathology classification transfers across clinical centers

With only 10,550 parameters per model, Evidence Field couples spatial image measurements with replayable covering programs, surpassing standard CNN and ViT baselines across held-out hospital sites on CAMELYON17-WILDS.

LEASH: latent uncertainty enables efficient weak-to-strong escalation for computer-use agents

Reusing internal activations to detect uncertainty without extra forward passes lets lightweight agents escalate to frontier models only when needed and monitor them afterward, cutting OSWorld inference costs by 19%.

Meta details end-to-end co-design for production AI training on AMD GPUs

A combination of hardware-model co-design, analytical zero-warmup kernel selection, and agentic code translation yields up to 1.5x throughput gains for recommendation model training on AMD Instinct MI350X accelerators.

BitSparse: lossless GPU-resident activation compression cuts ReLU transformer VRAM by 31%

Fused Triton autograd kernels and a host-sync-free preallocated buffer compress sparse ReLU and ReLU^2 activation caches losslessly, saving nearly a third of per-token VRAM with under 1% overhead.

CATCH: continuous adversarial training enforces transferable honesty in 70B language models

Training LLMs away from dishonest completions using continuous adversarial objectives with on-policy utility data curbs pressure-induced lying and increases confession rates without degrading general reasoning.

Conditional brain charts link cortico-subcortical structural dissociation to Alzheimer's disease progression

Conditioning lifespan normative models of cortical thickness on subcortical anatomy enables site calibration with 20 scans and reveals structural dissociations predictive of conversion to dementia.

Robust contextual MDPs optimize adaptive cancer therapy under biomarker and dynamic uncertainty

Formulating adaptive therapy through robust contextual reinforcement learning yields treatment schedules that Pareto-dominate clinical heuristics and maintain efficacy despite noisy biomarker measurements.

ContextLift: counterfactual data augmentation breaks conditional emergent misalignment in language models

Lifting verbatim context sentences into interleaved safety data prevents models from keying harmful behaviors on domain framing, slashing conditional misalignment on Qwen2.5-7B by up to 78%.

DomSet-MIL: censored likelihood and residual routing recover coexisting lesion evidence in digital pathology

Modeling dominant-label pathology annotations via right-censored likelihood and severity-ordered residual routing preserves subtle secondary lesion findings suppressed by standard multiclass MIL.

When the KV cache is slower than the GPU: rank-sharding scales remote tiers for context-parallel prefill

Profiling remote KV caching for GLM-5.3 with MLA on 8xB300 nodes reveals cache hits were slower than recomputing; rank-partitioned sharding and async loading drop p99 tail latency from 83s to 0.67s.

SurvICL: tabular foundation model achieves in-context survival analysis on clinical cohorts

Pretrained on synthetic datasets with a flexible proportional-odds prior and quantile regression loss, SurvICL outperforms 20 baselines and tops the 50-year-old Cox model on small cohorts.

Hindsight-Privileged RLVR: credit assignment from a single rollout without group sampling

Weighting token credit via causal-versus-hindsight Jensen-Shannon divergence matches GRPO reasoning accuracy while eliminating zero-gradient batch waste and cutting rollout requirements eightfold.

VascuSR: iterative 3D vascular guidance restores topological fidelity in CT super-resolution

Coupling a 3D rectified flow vascular refiner with a slice-wise diffusion decoder resolves vessel hallucination and fragmentation, reducing disconnected vascular components by over 20%.

Whole-body PET/CT registration as a representation problem

Combining frozen 3D foundation model features with GPU-accelerated iterative optimization and lesion-volume preservation wins the Learn2Reg 2026 PSMAReg Challenge with zero task-specific training.

Two Clocks: why larger rollout batches learn slower but fail on schedule in RLVR

Square-root learning-rate scaling in multi-step GRPO preserves policy drift per sample rather than progress, causing larger batches to lose sample efficiency to curvature while collapsing at the same sample count.

ARIA: learning when to consult stronger advisor models in agentic systems

A meta-controller trained via Monte Carlo control over compact workflow states recovers 44 to 81% of the executor-advisor gap at under half the advisor cost.

Prompteina: all-atom protein structure generation from natural language prompts

Conditioning on paired text and 1.8M structures yields 15 of 18 property wins, higher binding confidence on 13 of 20 targets, and a 107 nM wet-lab binder.

VolumeProbe: guided sub-volume sampling for 3D medical self-supervised learning

Replacing uniform random cropping with coarse-to-fine anatomical probes eliminates observation waste and matches full-training transfer at 48% of SSL epochs.

CA-WCP: class-aware asymmetric conformal intervals for 3D medical segmentation under shift

Weighted conformal prediction with directional, class-specific bounds keeps nominal 90% coverage on BraTS 2020 while narrowing intervals by 8 to 14%.

The predictability bias: why JEPA-style pretraining under-represents pathology in CT

TAP-JEPA, a ViT-B/3D trained on 113,611 CT volumes, is audited to show that masked prediction learns anatomy well but pulls sporadic pathology toward normal.

ARGUS: evidence-constrained agentic reasoning for noncoding regulatory variant interpretation

Dutta et al. couple 458 DNABERT models with deterministic biological verifiers, preventing LLM hallucinations when prioritizing noncoding single nucleotide variants.

ContiLNN: mitigating slice sampling discontinuity with liquid neural networks for medical image restoration

He et al. introduce bidirectional closed-form continuous-time modules to model irregular cross-slice medical imaging, outperforming RWKV and GRU baselines with lower latency and peak memory.

SparseDecoding: decoding-aware pruning for accurate and fast LLM generation

Wang et al. resolve distribution shifts in Hessian-guided LLM pruning by calibrating during autoregressive decoding, pairing it with an N:M sparse matrix-vector CUDA kernel.

Caught in the act: probes detect agent sabotage and unverbalized deception

Hollinsworth et al. introduce representation probes trained on the FIBS dataset to detect latent sabotage and introspective deception in frontier LLM agents without relying on verbalized reasoning.

MMA-LTS: spatially adaptive confidence calibration for missing-modality brain MRI

Lee et al. introduce Missing Modality-Aware Local Temperature Scaling, calibrating voxel-wise brain tumor segmentation confidences when MRI acquisition sequences are incomplete.

PathLang: probing language sensitivity and semantic competition in pathology VLMs

Cheng et al. evaluate nine computational pathology vision-language models across pathologist-validated phrasing, uncovering high sensitivity to clinical paraphrases and diagnostic competition.

Preconditioner-space rounding: closing the gap for 4-bit AdamW optimizer states

Li et al. identify preconditioner distortion in 4-bit AdamW quantization, proposing ZIP-SR and ZE-EDEN to cut validation loss gaps to FP32 by up to 70%.

ActiveMedAgent: cost-aware sequential test acquisition for multimodal diagnosis

Ma et al. introduce trajectory-based reinforcement learning for clinical decision making, finding that selective diagnostic acquisition outperforms full-modality inputs.

CoPoE: structured product-of-experts for missing-modality Alzheimer’s diagnosis

A coordinate-based multimodal fusion architecture that maps available clinical, imaging, and fluid biomarkers into an interpretable RPNS space without synthetic data imputation.

Envelope sampling: mitigating reward hacking when post-training on surrogate judges

A theoretically grounded recalibration framework by Dandapanthula et al. using envelope sampling to provably bound policy regret when optimizing LLMs against surrogate reward models.

AI time horizons: a statistical audit of the METR scaling plot

Nguyen and Fithian re-evaluate METR’s 50% time horizon metric with splines and item-response theory, revealing that task difficulty does not scale linearly with human log-time.

SlideRuler: one-slide calibration for frozen pathology foundation models

A post-hoc calibration technique using intra-slide internal controls to align gigapixel pathology embeddings across scanner hardware without retraining the backbone.

Provable test-time scaling: confidence-filtered beam search for LLM reasoning

A theoretical foundation for test-time reasoning: proving vanilla beam search sample bounds and establishing polynomial regret scaling over long horizons via CF-Beam.

DualTTA: calibrating black-box radiology AI without model weights

Model-agnostic calibration for proprietary 3D CT models using test-time geometric perturbations and confidence-gated blending, cutting calibration error up to 54%.

BrainVLM: WHO 2021 brain-tumor types from preoperative MRI

A medical vision-language model trained on ~40k cases to classify all 12 WHO 2021 brain tumor types, with uncertainty and report generation, plus multi-reader and prospective checks.

HPOQuest: ask the next phenotype question for rare-disease ranking

A training-free agent that starts from sparse HPO-like phenotypes, keeps a probabilistic disease ranking, and picks informative follow-ups, with large Recall@1/5 gains on four cohorts.

Real-Time EXPO-FT: decoupling slow VLA brains from fast reactive edits

Stanford researchers pair slow pretrained VLA proposals with high-frequency RL action edits to solve the latency lag on real robots, jumping from 42% to 97% success in 10 minutes.

Workspace Models: lightweight robotic memory without in-the-loop VLMs

MIT and CMU researchers distill task-salient state into a compact workspace token during training, giving manipulation robots long-term memory at zero deployment compute overhead.

AlphaGenome Atlas: precomputed effects for ~9 billion DNA letter changes

DeepMind’s follow-on to AlphaGenome: a 1 PB catalogue of single-nucleotide variant molecular predictions, plus an AVI ranking score that blends regulatory and missense signals for research use.

AlphaGenome: DNA sequence to regulatory function, in one model

DeepMind’s Nature paper on a unifying DNA model: 1 Mb context, base-resolution multimodal tracks, and strong regulatory variant-effect scores, the positive-science sequel to AlphaFold, with clear limits.

Marigold V2: turn a diffusion transformer into sharp monocular depth

A methods brief on affordable DiT fine-tuning for depth (and other dense maps): single-step inference, Sinkhorn sharpening, and 16–26% AbsRel gains on KITTI/ETH3D versus prior best.

OpenAI’s Navier-Stokes claim: AI-found blowup, Lean check, prize not claimed

A scientific-methods read of OpenAI’s 8 Sep 2026 announcement: a multi-agent system plus Lean formalization arguing finite-time singularity (Clay C/D), with verification still on mathematicians, not a prize ceremony.

GRIPNet: build the detector around how nodules actually look in CT

A medical imaging methods note: small pulmonary nodules show a Gaussian radial intensity prior; GRIPNet designs every module around that physics and reports strong mAP@0.5 on three public CT benchmarks.

Physical Law Ecology: count the mechanisms before fitting the equation

A scientific-discovery methods paper that treats ‘how many independent laws?’ as the zeroth step: then shows multi-law fits beating single-equation symbolic regression on engineering and galactic data.

REFINE: personalized medical concepts from budgeted knowledge graphs

A methods brief on patient-specific EHR concept encoding: RL picks how much KG context each code gets, a GNN + frozen LLM refine representations, reported gains on MIMIC-III/IV backbones.

SIFTING: traceable LLM extraction for lung-cancer T-staging

Self-hosted Llama extracts structured T-stage from radiology reports with source-text links: 90% accuracy vs a four-expert reference on 130 reports.

Why this site exists

AI is more than a chat box on the web. Bitware News covers what the technology actually does: methods, medical ML, evaluation: with primary sources and caveats.