-
Audio-Visual Segmentation via Depth-Guided Collaborative Modeling
Authors:
Zhaojin Fu,
Yuyang Hong,
Qi Yang,
Zili Wang,
Kun Ding,
Shiming Xiang,
Bin Fan
Abstract:
Audio-Visual Segmentation (AVS) is a fundamental task in multimodal perception that performs pixel-level segmentation of sounding objects in videos by leveraging both visual and audio cues. It has broad applications in video understanding, human-computer interaction, and autonomous driving. However, most existing AVS methods do not explicitly model geometric cues such as relative distance and occl…
▽ More
Audio-Visual Segmentation (AVS) is a fundamental task in multimodal perception that performs pixel-level segmentation of sounding objects in videos by leveraging both visual and audio cues. It has broad applications in video understanding, human-computer interaction, and autonomous driving. However, most existing AVS methods do not explicitly model geometric cues such as relative distance and occlusion, thereby limiting the robustness of cross-modal alignment. In human perception, spatial structure is naturally integrated with audio-visual evidence to accurately localize sounding objects. Motivated by this, we incorporate estimated depth as a spatial structural cue for AVS and propose DGCM-AVS, a tri-modal framework that jointly models audio, visual, and depth information. Specifically, we design a Depth-Aware Dynamic Modulator to improve the separation of adjacent objects while preserving intra-object feature consistency. Furthermore, we propose Depth-Guided Progressive Fusion, which uses depth as an intermediate bridge to progressively align audio cues with visual features. Compared to state-of-the-art methods, DGCM-AVS achieves relative improvements of 10.2 percent in M_J and 8.7 percent in M_F on the AVSS dataset. We believe our study highlights depth as a promising yet underexplored modality for AVS and may encourage further research in this direction.
△ Less
Submitted 17 August, 2026;
originally announced August 2026.
-
PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
Authors:
Kaixin Ding,
Xi Chen,
Minghong Cai,
Zhiyuan Xu,
Yiyang Wang,
Yuxiang Lu,
Junyi Li,
Shuyang Chen,
Yuan Gao,
Xin Tao,
Pengfei Wan,
Hengshuang Zhao
Abstract:
Video world models simulate future states conditioned on current observations and user actions. Recent systems have demonstrated impressive video consistency and action controllability over long sequences. However, fairly comparing these interactive models remains challenging. In practice, a human player typically evaluates a world model by pursuing long-horizon objectives through interaction. For…
▽ More
Video world models simulate future states conditioned on current observations and user actions. Recent systems have demonstrated impressive video consistency and action controllability over long sequences. However, fairly comparing these interactive models remains challenging. In practice, a human player typically evaluates a world model by pursuing long-horizon objectives through interaction. For example, a user may turn around 360 degrees to see whether the environment remains consistent, or walk into the water and inspect whether realistic water ripples are generated. The action sequence required to achieve the same objective may vary substantially between models, making fixed action-conditioned evaluation unsuitable for cross-model comparison. To address this, we employ multi-modal Agent Players to interact with world models toward specified long-horizon objectives. Building on this paradigm, we introduce PlayWorld, a benchmark providing 171 scenarios, each with a specified objective. To evaluate performance thoroughly, we assess models along four core dimensions: geometry consistency, interaction fidelity, out-of-sight evolution, and insight evolution. In addition, we incorporate basic ability metrics for video quality and controllability. Experiments across nine state-of-the-art world models reveal that current models remain unreliable on long-horizon interactive objectives, particularly in maintaining spatial consistency and persistent state evolution. Code and data are available at https://github.com/kxding/PlayWorld.
△ Less
Submitted 14 August, 2026; v1 submitted 13 August, 2026;
originally announced August 2026.
-
Distributed Nash Equilibrium Seeking with Logarithmic Bit Rates over Digital Channels
Authors:
Zihao Ren,
Chengyang Jiang,
Lei Wang,
Yang Liu,
Kemi Ding
Abstract:
This paper introduces quantization techniques to reduce the communication complexity in the distributed Nash equilibrium (NE) seeking problem, achieving an exponential reduction in bit rates over digital channels. The goal of distributed NE seeking algorithms is to coordinate agents in a network game toward equilibrium through iterative message exchanges among them via a communication network. The…
▽ More
This paper introduces quantization techniques to reduce the communication complexity in the distributed Nash equilibrium (NE) seeking problem, achieving an exponential reduction in bit rates over digital channels. The goal of distributed NE seeking algorithms is to coordinate agents in a network game toward equilibrium through iterative message exchanges among them via a communication network. The computational complexity of this distributed algorithm critically depends on network communication overhead in the digital channel, motivating the development of communication reduction mechanism. Regarding this, we proposed some quantizers based on sparsification and uniform quantization through a general class of ultimate-boundedness-based quantizers. Based on this, we propose a Passivity-Based NE seeking Algorithm with Time-varying scaling Error state Quantization (PBA-TEQ), and show that the linear convergence can be achieved under a sufficient condition. Moreover, when employing either the scalarization quantizer or the greedy quantizer, both belonging to the ultimate-boundedness-based quantizers, within the PBA-TEQ framework, we establish a lower bound on communication complexity of $\log_2(\mathcal{O}(nd))$ bit rates per transmission to achieve unbiased linear convergence, with $n$ being the number of agents and $d$ being the dimension of the decision state of the network game. Numerical simulation examples are provided to validate our theoretical results.
△ Less
Submitted 12 August, 2026;
originally announced August 2026.
-
Establishing Boundary KKT Convergence of Mirror Descent through Reparameterization
Authors:
Kuangyu Ding,
Kim-Chuan Toh
Abstract:
Sequence convergence to a boundary Karush--Kuhn--Tucker (KKT) point has long remained unclear for nonconvex mirror descent with Legendre kernels. The difficulty arises from the blow-up of the gradient of the Legendre kernel at the boundary. Recent work~\cite{dingtoh2026nonkkt} shows that mirror descent can accumulate at non-KKT boundary points despite decreasing objective values, precluding a conv…
▽ More
Sequence convergence to a boundary Karush--Kuhn--Tucker (KKT) point has long remained unclear for nonconvex mirror descent with Legendre kernels. The difficulty arises from the blow-up of the gradient of the Legendre kernel at the boundary. Recent work~\cite{dingtoh2026nonkkt} shows that mirror descent can accumulate at non-KKT boundary points despite decreasing objective values, precluding a convergence guarantee to KKT points in general. Despite this negative result, mirror descent remains effective in many real applications. Motivated by this contrast, we address the boundary difficulty directly and establish KKT convergence of mirror descent for a broad class of structured nonconvex problems. We analyze mirror descent in reparameterized variables, where the Hessian metric is flattened and remains nondegenerate as the boundary is approached. Under extension and definability conditions jointly coupling the objective, the Legendre kernel, and the feasible region, the reparameterized sequence has finite length and converges, thereby recovering convergence to a KKT point of the original sequence. Our general framework applies to some concrete instances: Shannon entropy, Fermi--Dirac entropy, and power kernels on polyhedron.
△ Less
Submitted 10 August, 2026; v1 submitted 7 August, 2026;
originally announced August 2026.
-
Multivariate Time Series Forecasting needs Cross Variable Loss
Authors:
Kuiye Ding,
Yifan Hu,
Hanchen Wang,
Hao Xue
Abstract:
Multivariate time series forecasting presents unique challenges because future variables often co-evolve under shared system dynamics. While existing studies mainly focus on cross-variable dependencies in historical observations, dependencies among future values are much less explored. Specifically, modern forecasting models largely follow the Direct Forecasting (DF) paradigm, generating multi-ste…
▽ More
Multivariate time series forecasting presents unique challenges because future variables often co-evolve under shared system dynamics. While existing studies mainly focus on cross-variable dependencies in historical observations, dependencies among future values are much less explored. Specifically, modern forecasting models largely follow the Direct Forecasting (DF) paradigm, generating multi-step forecasts with point-wise objectives that do not explicitly constrain cross-variable structure. In this work, we show that the DF objective is mismatched in the presence of cross-variable and lagged dependencies, revealing an objective gap. To address this issue, we propose \textbf{C}ross-\textbf{V}ariable \textbf{Loss} (CvLoss), a plug-in structural regularizer that constrains forecast residuals on a cross-variable graph. CvLoss penalizes inconsistent edge-wise residual differences over forecast patches, encouraging consistency across both synchronous and asynchronous interactions. Our experiments show that CvLoss consistently improves competitive forecasting models, outperforms representative learning objectives, and is compatible with a variety of forecasting backbones.
△ Less
Submitted 6 August, 2026;
originally announced August 2026.
-
Benefits of Shifting Passenger Traffic from Air to Rail: A Case Study of California High-Speed Rail
Authors:
Kaijing Ding,
Lu Dai,
Mark Hansen
Abstract:
This study provides a method to quantify the benefits of shifting passenger traffic from air to high-speed rail from the perspective of flight-delay cost reduction. We first estimate the number of flight reductions for airport origin-destination pairs based on the high-speed rail ridership forecasts provided in the California High-Speed Rail 2020 Business Plan, and then distribute these flight red…
▽ More
This study provides a method to quantify the benefits of shifting passenger traffic from air to high-speed rail from the perspective of flight-delay cost reduction. We first estimate the number of flight reductions for airport origin-destination pairs based on the high-speed rail ridership forecasts provided in the California High-Speed Rail 2020 Business Plan, and then distribute these flight reductions to quarter-hour intervals. Lasso models are applied to estimate the impact of reduced queuing delays at SFO, LAX, and SAN on arrival delays at the national Core 29 airports. These delay reductions are then monetized using aircraft operating costs and the value of passenger time. We evaluate alternative airport-capacity and flight-schedule scenarios, as well as multiple percentiles of probabilistic high-speed rail ridership forecasts. The resulting estimates indicate flight-delay cost savings of $51-88 million in 2018 dollars in 2029 and $235-392 million in 2018 dollars in 2033.
△ Less
Submitted 6 August, 2026;
originally announced August 2026.
-
MOTION, a liquid xenon time projection chamber platform for high voltage technologies in dark matter detectors
Authors:
Yanina Biondi,
Alexander Jansen,
Keyu Ding,
Michael Schrank,
Tom Sonius,
Adrian Schwenck
Abstract:
The XLZD observatory is a next-generation experiment designed to search for weakly interacting massive particles (WIMPs) and other rare events using a 60-80 tonne liquid xenon time projection chamber (TPC). This detector aims to achieve sensitivity across the full WIMP parameter space down to the neutrino fog, establishing the ultimate sensitivity for this dark matter search paradigm. This unprece…
▽ More
The XLZD observatory is a next-generation experiment designed to search for weakly interacting massive particles (WIMPs) and other rare events using a 60-80 tonne liquid xenon time projection chamber (TPC). This detector aims to achieve sensitivity across the full WIMP parameter space down to the neutrino fog, establishing the ultimate sensitivity for this dark matter search paradigm. This unprecedented scale introduces substantial engineering challenges and pushes operation into largely unexplored regimes: the interplay between high-voltage (HV) systems, liquid xenon, and conducting materials in ultra-pure environments. To systematically investigate these challenges, we have built MOTION, a 70 kg LXe detector dedicated to understanding HV performance and electrostatic phenomena up to 200 kV (negative polarity). We describe the design and construction of the experimental infrastructure, including the cryogenic system, xenon purification and storage. MOTION enables controlled studies of dielectric breakdown in LXe, permitting systematic characterization of discharge mechanisms and their dependence on electrode geometry, surface condition, and applied voltage. The detector also facilitates investigations of field emission and photoemission from electrodes following various surface treatments, and provides a platform for validating the design of an HV feedthrough constructed from radiopure materials. The insights from these studies are essential for ensuring the operational stability, radiopurity, and scalability required for next-generation dark matter detectors.
△ Less
Submitted 5 August, 2026;
originally announced August 2026.
-
Non-KKT Accumulation in Entropic Mirror Descent
Authors:
Kuangyu Ding,
Kim-Chuan Toh
Abstract:
For mirror descent generated by a Legendre kernel, perhaps one of the most basic question in optimization is this: must every accumulation point of a bounded mirror descent sequence be Karush--Kuhn--Tucker (KKT) stationary under proper stepsizes? We show that the answer is no. A longstanding obstacle to resolving this question is the boundary blow-up of the Legendre gradient: it keeps every mirror…
▽ More
For mirror descent generated by a Legendre kernel, perhaps one of the most basic question in optimization is this: must every accumulation point of a bounded mirror descent sequence be Karush--Kuhn--Tucker (KKT) stationary under proper stepsizes? We show that the answer is no. A longstanding obstacle to resolving this question is the boundary blow-up of the Legendre gradient: it keeps every mirror step in the interior, while at a boundary limit, the inverse entropy metric vanishes on active coordinates and can erase the dual-feasibility in the KKT system. We construct $C^\infty$ objectives and bounded sequences generated by the Shannon-entropic mirror descent on the nonnegative orthant $\R_+^n$, for every $n\geq 3$, and on the probability simplex $Δ_n$, for every $n\geq 4$, such that, in each case, the set of accumulation points is a smooth boundary circle containing a nonempty relatively open arc of non-KKT points. The steps satisfy $α_k\asymp k^{-β}$ with $β\in(1/2,1)$, the objective values are nonincreasing, and the objectives are entropy-relatively smooth. Hence the pathology stems from the degeneracy of the Bregman geometry at the boundary, rather than from failure of descent, or improper stepsizes. To the best of our knowledge, these provide the first counterexamples to KKT accumulation for bounded mirror descent sequences with nonincreasing objective values.
△ Less
Submitted 17 August, 2026; v1 submitted 2 August, 2026;
originally announced August 2026.
-
SciToolAgent-Evo: An Ontology-Aware Self-Evolving Agent for Open-World Scientific Tool Acquisition
Authors:
Yuqi Tang,
Chenyi Zhou,
Libin Wang,
Keyan Ding,
Qiang Zhang,
Huajun Chen
Abstract:
Large language model (LLM) agents have been increasingly adopted in scientific research for organizing and invoking specialized computational tools. However, their reliance on predefined tool spaces with static semantics limits their applicability to open-world scientific workflows, where tool requirements, capabilities, and boundaries evolve dynamically. To this end, we propose SciToolAgent-Evo,…
▽ More
Large language model (LLM) agents have been increasingly adopted in scientific research for organizing and invoking specialized computational tools. However, their reliance on predefined tool spaces with static semantics limits their applicability to open-world scientific workflows, where tool requirements, capabilities, and boundaries evolve dynamically. To this end, we propose SciToolAgent-Evo, an ontology-aware self-evolving agent for open-world scientific tool acquisition. Driven by an evolving memory of skills, experiences, and an ontologized tool graph, it distills generalizable knowledge from contrastive trajectories during accumulation, whereas during inference, it formulates active requests and utilizes a LinUCB-based bandit gate to dynamically balance exploration and exploitation. Once a novel tool is acquired, its scientific ontology is completed online for seamless integration into the known graph. Moreover, we introduce OpenSciToolBench, a benchmark containing 900 realistic tasks across four difficulty levels. Extensive evaluations show that SciToolAgent-Evo achieves state-of-the-art performance, validating its robustness and generalization.
△ Less
Submitted 30 July, 2026;
originally announced July 2026.
-
LoRA Scaffolded Policy Optimization (LSPO): A Sampling-Time Low-Rank Scaffold for Recovering Reinforcement-Learning Gradient on Zero-Reward Cliff Prompts
Authors:
Ken Ding
Abstract:
Reinforcement learning from verifiable rewards (RLVR) for mathematical reasoning suffers from a structural blind spot: on "cliff" prompts-those on which every sampled rollout in a group fails-the group-normalized advantage is identically zero, so GRPO produces no gradient on precisely the prompts at the frontier of the model's capability. We introduce LoRA Scaffolded Policy Optimization (LSPO), a…
▽ More
Reinforcement learning from verifiable rewards (RLVR) for mathematical reasoning suffers from a structural blind spot: on "cliff" prompts-those on which every sampled rollout in a group fails-the group-normalized advantage is identically zero, so GRPO produces no gradient on precisely the prompts at the frontier of the model's capability. We introduce LoRA Scaffolded Policy Optimization (LSPO), a sampling-time mechanism that recovers this lost gradient. Each RL step, LSPO detects cliff prompts, fits a small low-rank (LoRA) adapter by a brief supervised step on their ground-truth solutions, re-rolls the cliffs with the base-plus-adapter model, splices the now-successful completions back into the RL batch with an importance-sampling correction, and takes a GRPO step on the base alone; the adapter receives only the supervised gradient and is discarded at checkpoint, yielding a base-only model. On DeepMath-103K with DeepSeek-R1-Distill-Qwen-1.5B, evaluated over n=5 paired seeds per arm at a matched 1000-step reporting horizon, LSPO's 5-seed mean matches or beats a DAPO baseline on all 16 (benchmark, pass@k) cells (15 strict wins and one exact tie), with gains of up to +10.7 points on AIME24/pass@4, +6.7 points on AIME24 and AIME26 at pass@16, and +2.4 points on MATH500/pass@1; averaged over the 16 cells the improvement is +3.8 points.
△ Less
Submitted 30 July, 2026;
originally announced July 2026.
-
Closed-loop solvability of infinite-horizon stochastic linear-quadratic problem for Markov regime-switching jump-diffusion system
Authors:
Kai Ding,
Fan Wu,
Jie Xiong,
Xinyue Zhang
Abstract:
This paper investigates a class of stochastic linear-quadratic (SLQ) control problems over an infinite horizon for Markov regime-switching jump-diffusion systems. Unlike classical diffusion models modulated by a Markov chain, we assume that the state process undergoes abrupt jumps that are synchronous with the regime switches of the Markov chain. In contrast to conventional Poisson jump-diffusion…
▽ More
This paper investigates a class of stochastic linear-quadratic (SLQ) control problems over an infinite horizon for Markov regime-switching jump-diffusion systems. Unlike classical diffusion models modulated by a Markov chain, we assume that the state process undergoes abrupt jumps that are synchronous with the regime switches of the Markov chain. In contrast to conventional Poisson jump-diffusion models, the jumps in the state process are entirely induced by the state transitions of the Markov chain, which can be interpreted as losses or gains of state process incurred during regime changes. Under this formulation, we thoroughly discuss the closed-loop solvability of the SLQ control problem and provide a feedback representation of the optimal control via the stabilizing solution of a system of coupled algebraic Riccati equations (CAREs). Finally, we further apply our results to a lifetime wealth tracking problem and derive the corresponding optimal investment strategy.
△ Less
Submitted 27 July, 2026;
originally announced July 2026.
-
MedLoCoMo: A Long-Context Multi-Session Medical Dialogue Benchmark for Large Language Models
Authors:
Zeyu Zhang,
Ziqing Wang,
Kaize Ding
Abstract:
MedLoCoMo is a Medical Long-Context Memory benchmark for patient-specific clinical reasoning over multi-admission medical dialogue. Existing medical QA benchmarks largely test short context knowledge or single document grounding, leaving open whether LLMs can use, connect, and abstain over longitudinal patient histories. We build MedLoCoMo from deidentified MIMIC-IV and MIMIC-IV-Note records by co…
▽ More
MedLoCoMo is a Medical Long-Context Memory benchmark for patient-specific clinical reasoning over multi-admission medical dialogue. Existing medical QA benchmarks largely test short context knowledge or single document grounding, leaving open whether LLMs can use, connect, and abstain over longitudinal patient histories. We build MedLoCoMo from deidentified MIMIC-IV and MIMIC-IV-Note records by constructing admission-level clinical packets, synthesizing grounded doctor-patient conversations, and generating evidence linked QA items over single-admission, cross-admission, and adversarial unanswerable settings. The benchmark contains 100 patient timelines averaging 1,669.8 turns, 29.7 sessions, and 74,512.2 tokens per conversation. Across the evaluated baselines, cross-admission reasoning is consistently harder than localized evidence use, even when models have long context windows or use external memory or retrieval methods. The code and MedLoCoMo benchmark release is available at https://github.com/leozzy13/MedLoCoMo for use and reproducibility.
△ Less
Submitted 30 May, 2026;
originally announced July 2026.
-
Scaling Laws for Classical Machine Learning on Tabular Data: A Benchmark Study
Authors:
Kaihua Ding
Abstract:
Prior classical-ML learning-curve work fits power laws to tree, linear, and kernel models on tabular data, but at small scale: typically one curve, one team, a handful of cells. We present a distributed classroom-scale replication: 127 graduate students each ran a fixed protocol on 3 assigned datasets, drawn from 18 tabular classification and regression datasets and 6 model families (Boosting, Ran…
▽ More
Prior classical-ML learning-curve work fits power laws to tree, linear, and kernel models on tabular data, but at small scale: typically one curve, one team, a handful of cells. We present a distributed classroom-scale replication: 127 graduate students each ran a fixed protocol on 3 assigned datasets, drawn from 18 tabular classification and regression datasets and 6 model families (Boosting, Random Forest, SVM, Linear/Logistic, Ridge, Lasso), yielding 11,536 training runs and 1,648 fitted power-law curves of the form error(N) = a N^(-b) + c. Three findings. (1) Power laws fit: R^2 > 0.8 on 77.7% of cells, with tree ensembles dominating at full data (Boosting 50% of datasets, RandomForest 33%; linear models underperform on classification). (2) Approximate shared exponents within a model family: for 5 of 6 families, a single family-level exponent predicts each family's cross-dataset curves nearly as well as per-dataset exponents (R^2 gap < 0.011), though AIC favors the unconstrained fit and curve collapse is partial (32-58% of points within +/-0.5 dex). We frame this as approximate predictive compressibility, not dataset-independent universality; Lasso fails outright (negative control) and Ridge is fragile under leave-one-dataset-out. (3) Replicator-implementation variance: with random_state=42 fixed, independent re-implementations of the same protocol still differ by mean CV(b) = 0.144 on the fitted exponent -- not seed variance, but the spread induced by unconstrained parts of the protocol (preprocessing, encoding, missing-value handling). We release the aggregated curves, per-cell fits, and a practical data-requirement table for N* to reach target error 0.15.
△ Less
Submitted 28 July, 2026; v1 submitted 23 July, 2026;
originally announced July 2026.
-
PrismAD: Decoupled Planning via Semantic Mixture-of-Planners for End-to-End Autonomous Driving
Authors:
Kang Ding,
Zhigui Lin,
Hongsong Wang,
Jie Gui,
Qi Liu,
Zhe Wang,
Luqi Tang,
Lei He
Abstract:
This letter presents PrismAD, a decoupled end-to-end autonomous driving framework based on a Semantic Mixture-of-Planners. Existing planners usually aggregate heterogeneous scene tokens into a coupled representation space, forcing a single planning branch to jointly model agent interaction, road geometry, and driving intention. Such coupling may weaken factor-specific reasoning and obscure the con…
▽ More
This letter presents PrismAD, a decoupled end-to-end autonomous driving framework based on a Semantic Mixture-of-Planners. Existing planners usually aggregate heterogeneous scene tokens into a coupled representation space, forcing a single planning branch to jointly model agent interaction, road geometry, and driving intention. Such coupling may weaken factor-specific reasoning and obscure the contribution of different planning cues. To address this limitation, PrismAD partitions scene tokens into interaction, geometry, and intent groups, and assigns them to independent planning experts with the same architecture but separate parameters. Each expert learns a specialized motion-planning representation, while a semantics-aware router adaptively aggregates expert predictions with separate routing weights for motion prediction and ego planning. Sparse top-$K$ activation with noisy gating is further introduced to improve routing robustness and reduce unnecessary expert computation. Extensive experiments on the nuScenes open-loop dataset and NeuroNCAP closed-loop benchmark demonstrate that PrismAD exhibits competitive performance. Our code will be released soon.
△ Less
Submitted 11 July, 2026;
originally announced July 2026.
-
When LLMs Agree, Are They Right? Auditing Self-Consistency and Cross-Model Agreement as Confidence Signals
Authors:
Kaihua Ding
Abstract:
LLM-as-judge (Zheng et al., 2023) is increasingly the default for evaluating AI systems in enterprise pipelines, often scaled to ensembles (Verga et al., 2024) or "mixture-of-experts" (Shazeer et al., 2017) panels of judges. These systems share a key assumption: that consistency -- agreement among judges, or among a model's own samples -- indicates correctness. We show this assumption is unreliabl…
▽ More
LLM-as-judge (Zheng et al., 2023) is increasingly the default for evaluating AI systems in enterprise pipelines, often scaled to ensembles (Verga et al., 2024) or "mixture-of-experts" (Shazeer et al., 2017) panels of judges. These systems share a key assumption: that consistency -- agreement among judges, or among a model's own samples -- indicates correctness. We show this assumption is unreliable. Agreement is not accuracy: a model can agree with itself, and different models can agree with each other, out of shared bias, a memorized heuristic, or an option-position prior rather than truth. We ask when agreement is nonetheless a usable proxy, in a large-scale cross-runner study: 53 runners drew K=50 samples for assigned overlapping cases across comparisons of model tier, prompting, and scale on GPQA Diamond and AIME -- 265,000 samples. Using majority-correctness as the deployment label and a hierarchical runner-clustered bootstrap, agreement is a positive but weak predictor (rho 0.20-0.59, all positive under item-clustered resampling) whose usefulness is regime-dependent: best for unsaturated mid-tier models and for allocating compute, and worst -- over-confident yet no more accurate -- for the most consistent frontier model (agreement >=0.8 on 77% of GPQA case-result entries, 48% of those wrong). An exploratory cross-family check on three Claude tiers shows the same frontier over-confidence, with confident errors recurring across providers above a marginal-preserving null. Self-consistency is thus a conditional proxy for correctness, not a standalone confidence score. We publicly release the de-identified per-run rows and answer distributions.
△ Less
Submitted 28 July, 2026; v1 submitted 8 July, 2026;
originally announced July 2026.
-
Anyon-induced non-Hermitian topological phases
Authors:
Yi-An Wang,
Kun Ding,
Linhu Li
Abstract:
We show that anyonic exchange statistics can activate non-Hermitian point-gap topology in models that are topologically trivial in its absence. The emergent topology oscillates more rapidly with the statistical phase as the anyon number increases, and exhibits a parity dependence on the particle number. A perturbative analysis reveals the mechanism: fractional statistics induces a mismatch between…
▽ More
We show that anyonic exchange statistics can activate non-Hermitian point-gap topology in models that are topologically trivial in its absence. The emergent topology oscillates more rapidly with the statistical phase as the anyon number increases, and exhibits a parity dependence on the particle number. A perturbative analysis reveals the mechanism: fractional statistics induces a mismatch between momentum terms that, combined with sublattice-dependent dissipation, produces particle-number-dependent non-reciprocity and complex spectral winding. As these effects rely on the formation and exchange of interaction-bound anyons, our results establish exchange statistics as a resource for enabling non-Hermitian topology under programmed dissipation.
△ Less
Submitted 7 July, 2026;
originally announced July 2026.
-
Phase-field modeling of elastically driven abnormal grain growth
Authors:
Yazhuo Liu,
Yin Zhang,
Kunqing Ding,
Yichen Yang,
Alejandro Barrios,
Xavier Maeder,
Olivier Pierron,
Xing Liu,
Ting Zhu
Abstract:
Grain-refined metals typically exhibit high strength, yet their engineering applications are often constrained by grain coarsening under thermo-mechanical loading. Recent experiments have revealed abnormal grain growth (AGG) in ultrafine-grained Ni thin films subjected to cyclic loading at room temperature. Unlike conventional AGG, which generally requires significant plastic deformation or high t…
▽ More
Grain-refined metals typically exhibit high strength, yet their engineering applications are often constrained by grain coarsening under thermo-mechanical loading. Recent experiments have revealed abnormal grain growth (AGG) in ultrafine-grained Ni thin films subjected to cyclic loading at room temperature. Unlike conventional AGG, which generally requires significant plastic deformation or high temperatures, this phenomenon occurs within the regime of macroscopic elastic deformation. This AGG is characterized by the preferential growth of grains with an in-plane <100> orientation aligned with the loading direction. Here, we investigate the underlying physical mechanisms by combining phase-field simulations with micromechanical analysis. The results indicate that elastic energy reduction provides a thermodynamically plausible driving force for this orientation-selective grain growth. Phase-field simulations reveal the evolution kinetics of AGG and confirm that local grain geometry and stress states play critical roles in determining the grain growth pathway. By applying this framework to systems with varying elastic anisotropy, we establish a general approach for investigating elastically driven AGG in polycrystalline materials.
△ Less
Submitted 6 July, 2026;
originally announced July 2026.
-
Knowledge-Enhanced Agentic Vulnerability Repair
Authors:
Sicong Cao,
Hao Ma,
Le Yu,
Kangyi Ding,
Xiaolei Liu,
Terry Yue Zhuo,
Bo Wang,
Xingwei Lin,
Xiaobing Sun,
Linzhang Wang,
David Lo
Abstract:
Frontier foundation models have changed the math on vulnerability discovery, but the bigger challenge is how the remediation side keeps up. Despite recent progresses in Automated Vulnerability Repair (AVR), current solutions struggle to reliably identify the root causes of vulnerabilities, and insufficiently utilize the prior fix knowledge to guide the patch generation process, thus undermining th…
▽ More
Frontier foundation models have changed the math on vulnerability discovery, but the bigger challenge is how the remediation side keeps up. Despite recent progresses in Automated Vulnerability Repair (AVR), current solutions struggle to reliably identify the root causes of vulnerabilities, and insufficiently utilize the prior fix knowledge to guide the patch generation process, thus undermining their effectiveness in practice.
To address this gap, we propose KeaRepair, a novel agentic AVR approach that grounds patch generation in verified program facts and high-level vulnerability knowledge. Specifically, KeaRepair first extracts multi-dimensional vulnerability knowledge from historical vulnerability-patch pairs from dual complementary views, and constructs dedicated retrieval knowledge bases. It then employs a tool-augmented agent that performs ReAct-style reasoning to collect verified program facts for vulnerability diagnosis. Finally, based on the diagnostic results, KeaRepair performs knowledge-level retrieval-augmented patch generation and iteratively refines patches through a closed-loop validation process involving compilation, PoC replay, and test-suite execution. Experimental results show that KeaRepair significantly outperforms existing AVR approaches on 55 reproducible C/C++ vulnerabilities. When paired with Gemini-3.1-Pro, KeaRepair successfully repairs 46 vulnerabilities, achieving a repair rate of 83.64%. Moreover, KeaRepair fixes six unique vulnerabilities that none of the baselines can address, and further demonstrates strong cross-language generalizability.
△ Less
Submitted 1 July, 2026;
originally announced July 2026.
-
MolSafeEval: A Benchmark for Uncovering Safety Risks in AI-Generated Molecules
Authors:
Tong Xu,
Xinzhe Cao,
Zhihui Zhu,
Keyan Ding,
Huajun Chen
Abstract:
Current molecular generation benchmarks emphasize task complexity, molecule novelty, and property alignment; they largely overlook a critical concern: the potential safety risks of AI-generated molecules. In practice, many generative models may produce molecules with toxic, reactive, or otherwise hazardous characteristics - posing hidden dangers that remain insufficiently addressed. To address thi…
▽ More
Current molecular generation benchmarks emphasize task complexity, molecule novelty, and property alignment; they largely overlook a critical concern: the potential safety risks of AI-generated molecules. In practice, many generative models may produce molecules with toxic, reactive, or otherwise hazardous characteristics - posing hidden dangers that remain insufficiently addressed. To address this gap, we introduce MolSafeEval, a benchmark dedicated to evaluating and analyzing the safety risks of molecular generation. Unlike prior approaches that rely on narrow toxicity predictors, MolSafeEval integrates heterogeneous safety knowledge - ranging from toxicological databases to hazard rules - into a structured molecular safety knowledge graph. This graph serves as a foundation for large language model-based reasoning, enabling systematic detection and explanation of unsafe features in generated compounds. We further categorize molecular generative models into four representative task types - unconditional generation, property optimization, target protein-based design, and text-based generation - and provide standardized datasets and safety evaluation protocols for each. By systematically revealing the safety vulnerabilities of current generative approaches, MolSafeEval offers a new lens for benchmarking molecular models and provides essential guidance toward safer, more trustworthy molecular design.
△ Less
Submitted 1 July, 2026;
originally announced July 2026.
-
IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation
Authors:
Zixuan Li,
Haokun Lin,
Yicheng Xiao,
Zhiwei Li,
Xinyang Song,
Zelong Zheng,
Yong He,
Heng Yao,
Ke Ding,
Chao Yu,
Chuan Yuan,
Qi Li,
Zhenan Sun
Abstract:
Unified multi-modal large language models (MLLMs) have achieved strong text-to-image generation quality, but still struggle with structure-aware prompt following, where object counts, spatial relations, attribute bindings, and coarse layouts must be preserved. We attribute this limitation in part to the entanglement of structural planning and appearance rendering within a single conditioning strea…
▽ More
Unified multi-modal large language models (MLLMs) have achieved strong text-to-image generation quality, but still struggle with structure-aware prompt following, where object counts, spatial relations, attribute bindings, and coarse layouts must be preserved. We attribute this limitation in part to the entanglement of structural planning and appearance rendering within a single conditioning stream. To address this issue, we propose Implicit Visual Chain-of-Thought (IV-CoT), a latent visual reasoning framework for query-conditioned image generation. IV-CoT decomposes the visual conditioning queries into a structural-to-semantic cascade, where structural queries first form a latent visual plan and semantic queries then render appearance conditioned on this plan. To guide the structural queries, we introduce training-only sketch supervision, which encourages them to capture structure from sketches without requiring sketch extraction or intermediate decoding at inference time. IV-CoT performs implicit CoT reasoning in a single forward pass and achieves superior results on GenEval and T2I-CompBench. Visualizations and analyses demonstrate that the learned structural and semantic queries play complementary roles in structure-aware generation.
△ Less
Submitted 23 June, 2026;
originally announced June 2026.
-
Predicting Immune Biomarkers with MultiModal Mixture-of-Expert Pathology Foundation Models Empowers Precision Oncology
Authors:
Tianyu Liu,
Ziqing Wang,
Zhaokang Liang,
Tong Ding,
Peter Humphrey,
Lorraine Colón-Cartagena,
Emily Ling-Lin Pai,
Kenneth Tou En Chang,
Mohamed Kahila,
Jonathan Chong Kai Liew,
Tinglin Huang,
Rex Ying,
Kaize Ding,
Faisal Mahmood,
Wengong Jin
Abstract:
Predicting immune biomarkers associated with the tumor immune microenvironment (TIME) is critical for advancing precision oncology, yet existing approaches are largely limited to single image modalities and suffer from insufficient resolution and incomplete utilization of complementary clinical and biological information. Here we introduce MixTIME, a multimodal foundation model that leverages a mi…
▽ More
Predicting immune biomarkers associated with the tumor immune microenvironment (TIME) is critical for advancing precision oncology, yet existing approaches are largely limited to single image modalities and suffer from insufficient resolution and incomplete utilization of complementary clinical and biological information. Here we introduce MixTIME, a multimodal foundation model that leverages a mixture-of-experts (MoE) architecture to integrate pathology foundation models trained across distinct modalities: image only (UNIv2), image text (CONCHv1.5), and image transcriptomic (STPath) representations for pixel-level and slide-level prediction of multiplex immunofluorescence (mIF) protein expression from hematoxylin and eosin (HE) whole-slide images. MixTIME employs a learnable router to dynamically weight expert contributions and is trained with a distribution- and tendency-aware loss function. Benchmarked on two datasets of different scales, MixTIME achieves state-of-the-art performance across 17 protein markers as measured by correlation metrics. The predicted mIF profiles substantially enhance downstream tasks, including spatial domain identification, survival prediction, and AI-assisted pathology report generation validated by expert pathologists from multiple institutes across the world. Furthermore, MixTIME enables longitudinal tracking of protein expression dynamics across clinical time points and reveals protein gene interaction patterns linked to drug resistance and immune suppression in tumor microenvironments. Collectively, MixTIME provides a scalable framework for multimodal biomarker discovery and clinical translation in computational pathology.
△ Less
Submitted 20 June, 2026; v1 submitted 16 June, 2026;
originally announced June 2026.
-
MedLatentDx: Latent Multi-Agent Communication for Cross-Hospital Rare-Disease Diagnosis
Authors:
Ziqing Wang,
Lili Zhao,
Kaize Ding
Abstract:
Rare diseases affect over $300$ million patients across more than $7{,}000$ conditions, yet no single hospital encounters enough cases of any one condition for reliable diagnosis. Cross-hospital collaboration could help by allowing a diagnosing institution to use distributed, case-specific diagnostic evidence, but privacy regulations restrict the transmission of identifiable clinical text across i…
▽ More
Rare diseases affect over $300$ million patients across more than $7{,}000$ conditions, yet no single hospital encounters enough cases of any one condition for reliable diagnosis. Cross-hospital collaboration could help by allowing a diagnosing institution to use distributed, case-specific diagnostic evidence, but privacy regulations restrict the transmission of identifiable clinical text across institutional boundaries. This setting raises two challenges: existing medical agent systems often rely on textual evidence exchange, while raw latent states such as hidden states and KV caches may still reveal prompt-derived clinical content. We introduce MedLatentDx, a latent multi-agent communication framework in which hospital agents keep private clinical records and retrieved cases local, and send compact latent KV blocks to a host agent for rare-disease diagnosis. MedLatentDx supports two deployment settings: same-backbone hospital agents use latent KV distillation, while hospitals with different LLM backbones use cross-family latent alignment. On CrossRare-Bench, a self-built large-scale rare-disease benchmark with hospital-level partitions, MedLatentDx improves cross-hospital diagnostic performance while reducing reconstructable clinical content relative to raw-latent communication baselines.
△ Less
Submitted 11 June, 2026;
originally announced June 2026.
-
Can Post-Training Turn LLMs into Good Medical Coders? An Empirical Study of Generative ICD Coding
Authors:
Ziqing Wang,
Weihao Li,
Shijie Chen,
Yuan Luo,
Kaize Ding
Abstract:
Automated International Classification of Diseases (ICD) coding is a core medical-coding task for billing, epidemiology, and clinical decision support. Generative large language models (LLMs) are often reported as weak medical coders, but this finding mainly comes from inference-time settings such as prompting, retrieval, reranking, or tool use, leaving the role of task-specific post-training unde…
▽ More
Automated International Classification of Diseases (ICD) coding is a core medical-coding task for billing, epidemiology, and clinical decision support. Generative large language models (LLMs) are often reported as weak medical coders, but this finding mainly comes from inference-time settings such as prompting, retrieval, reranking, or tool use, leaving the role of task-specific post-training underexplored. We present a controlled empirical study of post-training for generative ICD coding, comparing discriminative baselines with LLM coders across prompting, supervised fine-tuning, and reinforcement learning under a common protocol and metric set. To our knowledge, this is the first study to evaluate RL-based post-training for generative LLM coders in ICD coding. We further introduce PHI, a diagnostic curriculum that extends GRPO to refine missed-code cases. Our results show that prompting-only evaluation substantially underestimates the potential of LLMs for ICD coding. SFT provides the main capability jump, GRPO further improves code-set prediction beyond SFT, and PHI provides targeted gains on macro-level performance. These findings suggest that the main bottleneck is not the generative formulation alone, but how the model is adapted and optimized for full-taxonomy recall. We release our code, data splits, and checkpoints at https://github.com/AlexandreWANG915/LLM4ICD.
△ Less
Submitted 11 June, 2026;
originally announced June 2026.
-
Approximate Maximin Share with Subjective Divisibility: Beating the 1/2 Barrier
Authors:
Xiaohui Bei,
Ke Ding,
Bo Li,
Fangxiao Wang
Abstract:
Maximin share (MMS) stands out as a central notion in fair resource allocation. It is known that exact MMS fairness is not always attainable, especially when agents differ along two dimensions: their valuations and their perceptions of the divisibility of resources. The former case with heterogeneous valuations has been widely studied in the literature. The latter, referred to as subjective divisi…
▽ More
Maximin share (MMS) stands out as a central notion in fair resource allocation. It is known that exact MMS fairness is not always attainable, especially when agents differ along two dimensions: their valuations and their perceptions of the divisibility of resources. The former case with heterogeneous valuations has been widely studied in the literature. The latter, referred to as subjective divisibility by Bei et al., [Games Econ. Behav. 2025], remains much less explored.
We study MMS approximation under subjective divisibility. First, we prove that even in the unary valuation setting, where all items have equal value, the optimal approximation ratio is 2/3. This result is somewhat surprising since in the objective setting, even when agents have heterogeneous valuations, the best possible approximation ratio is at least 7/9 [Huang and Zhou, 2025]. We then address the general case with both valuation heterogeneity and subjective divisibility. Previous work shows the existence of a 1/2-approximate MMS allocation. In this paper, we develop new algorithmic techniques that overcome the difficulties posed by subjective divisibility, and improve the approximation guarantee to 5/9. Finally, we complement this result with small-agent cases. For up to four agents, we give polynomial-time algorithms that compute 2/3-approximate MMS fair allocations. These bounds are tight.
Our results deepen the understanding of MMS fairness under heterogeneous valuations and subjective divisibility, and provide a new perspective for this emerging model.
△ Less
Submitted 11 June, 2026;
originally announced June 2026.
-
Benchmarking AI Agents for Addressing Scientific Challenges Across Scales
Authors:
Tianyu Liu,
Allen Xin Wang,
Antonia Panescu,
Lisa Xinyi Chen,
Wenxin Long,
Xinyu Wei,
Yueqian Jing,
Ziyao Zeng,
Jihang Chen,
Sihan Jiang,
Ziqing Wang,
Siyi Gu,
Siyu Chen,
Xinyang Hu,
Haoran Shao,
Leqi Xu,
Wangjie Zheng,
Zhiyuan Cao,
Ada Fang,
Botao Yu,
Kunyang Sun,
Rex Ying,
Arman Cohan,
Qingyu Chen,
Lingzhou Xue
, et al. (8 additional authors not shown)
Abstract:
AI agents are increasingly being developed to accelerate scientific discovery, yet their practical capabilities in real research settings remain poorly understood. Existing benchmarks for AI agents rarely capture the complexity, heterogeneity, and extended reasoning required by scientific work, whereas benchmarks for scientific tasks often reduce research to static, direct problems and provide lim…
▽ More
AI agents are increasingly being developed to accelerate scientific discovery, yet their practical capabilities in real research settings remain poorly understood. Existing benchmarks for AI agents rarely capture the complexity, heterogeneity, and extended reasoning required by scientific work, whereas benchmarks for scientific tasks often reduce research to static, direct problems and provide limited support for interactive evaluation. Here, we introduce SciAgentArena, a systematic benchmark for evaluating AI agents in real-world scientific research scenarios drawn from emerging needs across multiple domains. SciAgentArena comprises approximately 200 tasks with stepwise verification and an interactive, agent-agnostic environment for assessing diverse AI agents. Using this benchmark, we find that current agents can contribute effectively to well-specified data-analysis workflows, particularly when the task structure and evaluation criteria are clear. However, their performance remains uneven across scientific contexts: agents struggle to generate genuinely novel insights, sustain self-directed exploration, and formulate robust solutions for open-ended research questions. We further characterize common failure modes across agents and identify opportunities for improving their reliability, autonomy, and scientific reasoning. Together, SciAgentArena provides a practical framework for measuring progress in AI agents for science and for guiding the design of future agents capable of addressing complex scientific challenges. Full codes, tasks, and datasets can be accessed via this link: https://sciagentarena.github.io/.
△ Less
Submitted 10 June, 2026;
originally announced June 2026.
-
Agent Skill Evaluation and Evolution: Frameworks and Benchmarks
Authors:
Kexin Ding,
Yang Zhou,
Can Jin,
Feng Tong,
Mu Zhou,
Dimitris N. Metaxas
Abstract:
The growth of agent skills has transformed how agentic systems are built, evaluated, and deployed. As skill libraries continue to scale, rigorous evaluation becomes critical to ensuring their utility, quality, and safety in real-world applications. Consequently, the field is undergoing an emerging paradigm shift from isolated skill creation to automated, evaluation-driven skill evolution. In this…
▽ More
The growth of agent skills has transformed how agentic systems are built, evaluated, and deployed. As skill libraries continue to scale, rigorous evaluation becomes critical to ensuring their utility, quality, and safety in real-world applications. Consequently, the field is undergoing an emerging paradigm shift from isolated skill creation to automated, evaluation-driven skill evolution. In this survey, we systematically examine the landscape of skill evolution and evaluation beyond foundational skill creation. We categorize evolution into four distinct paradigms, spanning execution feedback, trajectory distillation, compression, and reinforcement learning, showing how each element contributes to improving skill utility and reliability. We also provide an analysis of six skill-centric benchmark categories, identifying structural gaps in benchmark coverage, trade-offs, and metric richness to advance skill research. Finally, we identify open directions for building skill ecosystems that are generalizable, efficient, and verifiably safe. The project URL is https://github.com/Cassie07/AgentSkill_Survey
△ Less
Submitted 9 June, 2026;
originally announced June 2026.
-
A Geometry-Aware Triplane Field Network for Vehicle Aerodynamic Prediction
Authors:
Kangkang Qi,
Huiyu Yang,
Keqi Ding,
Yunpeng Wang,
Yuntian Chen,
Yuanwei Bin,
Rikui Zhang,
Jianchun Wang
Abstract:
High-fidelity computational fluid dynamics (CFD) is crucial to vehicle aerodynamic analysis, but its cost still constrains early-stage design exploration. Machine-learning-based surface-field prediction offers a faster alternative if the model can efficiently capture both global flow context and local geometric detail. This work proposes a machine-learning-based method, named the geometry-aware tr…
▽ More
High-fidelity computational fluid dynamics (CFD) is crucial to vehicle aerodynamic analysis, but its cost still constrains early-stage design exploration. Machine-learning-based surface-field prediction offers a faster alternative if the model can efficiently capture both global flow context and local geometric detail. This work proposes a machine-learning-based method, named the geometry-aware triplane field network (GTF-Net), for vehicle aerodynamic pressure and wall shear stress prediction. GTF-Net constructs triplane features directly from sampled surface points through a shared multilayer perceptron (MLP) and smooth bilinear rasterization. The planes are then processed by a dual-stream backbone that combines adaptive Fourier neural operator (AFNO) spectral mixing with convolutional neural network (CNN) refinement, so long-range aerodynamic coupling and local geometry-induced variations are modeled in the same representation. At query stage, sampled triplane features are combined with vehicle-aligned directional coordinates, normal-projection features, and a voxel-based curvature proxy. GTF-Net is compared with Transolver, geometry-informed neural operator (GINO), and TripNet, a triplane-based surrogate model. GTF-Net improves the relative L2 error from the strongest baseline value of 0.157 to 0.145 for pressure prediction and from 0.237 to 0.226 for wall shear stress prediction. Ablation results show that AFNO mixing, local CNN refinement, and query-side geometric encoding each contribute to accuracy, supporting the proposed mechanism of combining structured triplane representation with explicit aerodynamic geometry cues.
△ Less
Submitted 5 June, 2026;
originally announced June 2026.
-
Cosmos 3: Omnimodal World Models for Physical AI
Authors:
NVIDIA,
:,
Aditi,
Niket Agarwal,
Arslan Ali,
Jon Allen,
Martin Antolini,
Adeline Aubame,
Alisson Azzolini,
Junjie Bai,
Maciej Bala,
Yogesh Balaji,
Josh Bapst,
Aarti Basant,
Mukesh Beladiya,
Mohammad Qazim Bhat,
Zaid Pervaiz Bhat,
Dan Blick,
Vanni Brighella,
Han Cai,
Tiffany Cai,
Eric Cameracci,
Jiaxin Cao,
Yulong Cao,
Mark Carlson
, et al. (271 additional authors not shown)
Abstract:
We introduce Cosmos 3, a family of omnimodal world models designed to jointly process and generate language, image, video, audio, and action sequences within a unified mixture-of-transformers architecture. By supporting highly flexible input-output configurations, Cosmos 3 seamlessly unifies critical modalities for Physical AI -- effectively subsuming vision-language models, video generators, worl…
▽ More
We introduce Cosmos 3, a family of omnimodal world models designed to jointly process and generate language, image, video, audio, and action sequences within a unified mixture-of-transformers architecture. By supporting highly flexible input-output configurations, Cosmos 3 seamlessly unifies critical modalities for Physical AI -- effectively subsuming vision-language models, video generators, world simulators, and world-action models into a single framework. Our evaluation demonstrates that Cosmos 3 establishes a new state-of-the-art across a diverse suite of understanding and generation tasks, demonstrating omnimodal world models as scalable, general-purpose backbones for embodied agents. Our post-trained Cosmos 3 models were ranked as the best open-source Text-to-Image and Image-to-Video models by Artificial Analysis, and the best policy model by RoboArena at the time the technical report was written. To accelerate open research and deployment in Physical AI, we make our code, model checkpoints, curated synthetic datasets, and evaluation benchmark available under the Linux Foundation's OpenMDW-1.1 License at https://github.com/nvidia/cosmos and https://huggingface.co/collections/nvidia/cosmos3. The project website is available at https://research.nvidia.com/labs/cosmos-lab/cosmos3.
△ Less
Submitted 23 June, 2026; v1 submitted 1 June, 2026;
originally announced June 2026.
-
The Strongest Teacher Is Not Always the Best Teacher: Student-Centric Answer Selection
Authors:
Zhengyu Hu,
Zheyuan Xiao,
Linxin Song,
Fengqing Jiang,
Yuetai Li,
Zhihan Xiong,
Yue Liu,
Junhao Lin,
Yao Su,
Lijie Hu,
Kaize Ding,
Teng Xiao,
Radha Poovendran
Abstract:
LLM training increasingly relies on teacher-generated supervision, from synthetic responses to reasoning traces and tool-use demonstrations. Current practice often chooses the highest-performing teacher to generate student training data, implicitly treating teacher test performance as a proxy for teaching quality. We show that this assumption can fail: even when multiple teachers provide correct a…
▽ More
LLM training increasingly relies on teacher-generated supervision, from synthetic responses to reasoning traces and tool-use demonstrations. Current practice often chooses the highest-performing teacher to generate student training data, implicitly treating teacher test performance as a proxy for teaching quality. We show that this assumption can fail: even when multiple teachers provide correct answers to the same question, the answer from the strongest teacher is not necessarily the best supervision for a given student. To address this gap, we propose Student-Centric Answer Sampling (SCAS), a framework that selects from verified teacher-generated answers according to their estimated student-centric learning cost. Motivated by a token-wise gradient decomposition, we derive an efficient forward-only proxy for this cost and use it to guide answer selection during training. Experiments across 30 teacher models, 6 student base models, and 6 tasks show that SCAS consistently improves student performance, suggesting that effective distillation should prioritize supervision matched to the current student rather than teacher strength alone.
△ Less
Submitted 25 June, 2026; v1 submitted 26 May, 2026;
originally announced May 2026.
-
TIGER: Text-Informed Generalized Enzyme-Reaction Retrieval
Authors:
Yuhang Zhang,
Keyan Ding,
Peilin Chen,
Han Liu,
Can Lin,
Ruixi Chen,
Shiqi Wang,
Qi Song
Abstract:
Enzyme-reaction retrieval is a fundamental problem in computational biology, underpinning enzyme characterization, reaction mechanism elucidation, and the rational design of metabolic pathways and biocatalysts. As a bidirectional task, it entails both enzyme-to-reaction and reaction-to-enzyme mapping. However, existing approaches suffer from poor generalization across tasks and distributions, with…
▽ More
Enzyme-reaction retrieval is a fundamental problem in computational biology, underpinning enzyme characterization, reaction mechanism elucidation, and the rational design of metabolic pathways and biocatalysts. As a bidirectional task, it entails both enzyme-to-reaction and reaction-to-enzyme mapping. However, existing approaches suffer from poor generalization across tasks and distributions, with performance highly sensitive to dataset splits and substantial asymmetry between retrieval directions. To address these challenges, we present TIGER, a Text-Informed Generalized Enzyme-Reaction Retrieval framework that leverages protein-to-text generation models to distill textual semantic knowledge from enzyme sequences, providing a generalized representation that bridges enzymes and biochemical reactions. To ensure the quality and reliability of textual semantics, we design a Dynamic Gating Network that adaptively fuses text-derived knowledge with sequence features, enabling more consistent and informative enzyme representations, while a Structure-Shared Feature Projector aligns enzyme and reaction representations within a unified latent space. Extensive experiments demonstrate that, under bidirectional retrieval supervision, TIGER significantly outperforms state-of-the-art baselines across diverse distributions and exhibits strong robustness and transferability across tasks.
△ Less
Submitted 23 May, 2026;
originally announced May 2026.
-
Emergence of Triplet Superconductivity from Cavity Vacuum Fluctuations
Authors:
Xin-Xin Yang,
Shuai Zhang,
Kun Ding,
Xiaopeng Li
Abstract:
Engineering quantum materials with cavity fields has emerged as a powerful route to manipulate phases of quantum matter in solids. Here we demonstrate that cavity vacuum fluctuations alone can drive the emergence of triplet superconductivity in an otherwise singlet superconductor. The vacuum field renormalizes the electronic band structure in a polarization dependent manner, reshaping the Fermi su…
▽ More
Engineering quantum materials with cavity fields has emerged as a powerful route to manipulate phases of quantum matter in solids. Here we demonstrate that cavity vacuum fluctuations alone can drive the emergence of triplet superconductivity in an otherwise singlet superconductor. The vacuum field renormalizes the electronic band structure in a polarization dependent manner, reshaping the Fermi surface and altering the competition among symmetry allowed pairing channels. As a result, multiple superconducting phases arise from the cavity vacuum fluctuations. Above a critical light matter coupling, the leading instability switches from singlet to triplet pairing, yielding a superconducting state absent in the bare material. This vacuum induced symmetry transition produces distinct modifications of the gap structure and low energy quasiparticle spectrum. Our results establish cavity vacuum engineering as a mechanism for generating unconventional superconducting phases and stabilizing triplet states of potential relevance for topological superconductivity.
△ Less
Submitted 23 May, 2026;
originally announced May 2026.
-
SciAtlas: A Large-Scale Knowledge Graph for Automated Scientific Research
Authors:
Shuofei Qiao,
Yunxiang Wei,
Jiazheng Fan,
Bin Wu,
Busheng Zhang,
Mengru Wang,
Yuqi Zhu,
Ningyu Zhang,
Keyan Ding,
Qiang Zhang,
Huajun Chen
Abstract:
The exponential growth of global academic output has confronted researchers and AI agents with an unprecedented ``information explosion,'' where fragmented and unstructured knowledge organization impedes deep interdisciplinary integration. Current academic retrieval tools predominantly rely on superficial keyword matching or vector-space semantic retrieval, which lack the topological reasoning cap…
▽ More
The exponential growth of global academic output has confronted researchers and AI agents with an unprecedented ``information explosion,'' where fragmented and unstructured knowledge organization impedes deep interdisciplinary integration. Current academic retrieval tools predominantly rely on superficial keyword matching or vector-space semantic retrieval, which lack the topological reasoning capabilities required to navigate complex logical connections. Agentic deep-research-based frameworks are often prone to logical hallucinations and consuming high inference costs. To bridge this gap, in this report, we introduce SciAtlas, a large-scale, multi-disciplinary, heterogeneous academic resource knowledge graph designed as a panoramic scientific evolution network. By integrating over 43M papers from 26 disciplines, and a total of 157M entities and 3B triplets, SciAtlas provides a structured topological cognitive substrate that dismantles disciplinary barriers and furnishes AI agents with a global perspective. Furthermore, we develop a neuro-symbolic retrieval algorithm featuring tri-path collaborative recall and graph reranking, achieving a seamless transition from simple semantic matching to deterministic association discovery. We also present key application directions of SciAtlas, including literature review, automated research trend synthesis, idea positioning, and academic trajectory exploration, to demonstrate that SciAtlas can serve as an effective ``cognitive map'' to empower the full loop of automated scientific research while significantly reducing reasoning costs. We have released the interfaces for KG retrieval and various downstream tasks in our GitHub repo.
△ Less
Submitted 20 May, 2026;
originally announced May 2026.
-
StatQAT: Statistical Quantizer Optimization for Deep Networks
Authors:
Mehmet Aktukmak,
Daniel Huang,
Ke Ding
Abstract:
Quantization is essential for reducing the computational cost and memory usage of deep neural networks, enabling efficient inference on low-precision hardware. Despite the growing adoption of uniform and floating-point quantization schemes, selecting optimal quantization parameters remains a key challenge, particularly for diverse data distributions encountered during training and inference. This…
▽ More
Quantization is essential for reducing the computational cost and memory usage of deep neural networks, enabling efficient inference on low-precision hardware. Despite the growing adoption of uniform and floating-point quantization schemes, selecting optimal quantization parameters remains a key challenge, particularly for diverse data distributions encountered during training and inference. This work presents a novel statistical error analysis framework for uniform and floating-point quantization, providing theoretical insight into error behavior across quantization configurations. Building on this analysis, we propose iterative quantizers designed for arbitrary data distributions and analytic quantizers tailored for Gaussian-like weight distributions. These methods enable efficient, low-error quantization suitable for both activations and weights. We incorporate our quantizers into quantization-aware training and evaluate them across integer and floating-point formats. Experiments demonstrate improved accuracy and stability, highlighting the effectiveness of our approach for training low-precision neural networks.
△ Less
Submitted 17 May, 2026;
originally announced May 2026.
-
ChemVA: Advancing Large Language Models on Chemical Reaction Diagrams Understanding
Authors:
Mingyang Rao,
Kehua Feng,
Zhihui Zhu,
Jiangzhen Fu,
Hao Yu,
Keyan Ding,
Huajun Chen
Abstract:
While Large Language Models (LLMs) have revolutionized scientific text processing, they exhibit a significant capability gap when interpreting chemical reaction diagrams. We identify two fundamental bottlenecks restricting current systems: a Visual Deficit, where generic vision encoders struggle to resolve the strict topological connectivity of dense molecular graphs, and a Semantic Disconnect, wh…
▽ More
While Large Language Models (LLMs) have revolutionized scientific text processing, they exhibit a significant capability gap when interpreting chemical reaction diagrams. We identify two fundamental bottlenecks restricting current systems: a Visual Deficit, where generic vision encoders struggle to resolve the strict topological connectivity of dense molecular graphs, and a Semantic Disconnect, where standard linear strings, such as SMILES, fail to effectively activate the model's latent chemical reasoning. To bridge these gaps, we propose the Chemical Visual Activation (ChemVA) framework, which employs a Visual Anchor mechanism to ground functional groups via hybrid-granularity detection, followed by a semantic alignment approach that translates visual features into entity names to maximize knowledge activation in LLMs. We evaluate our approach on OCRD-Bench, a newly constructed dataset featuring dense visual-semantic contexts and comprehensive reaction coverage to evaluate the full spectrum from recognition to reasoning. Extensive experiments on OCRD-Bench demonstrate that ChemVA achieves 92.0% structural recognition accuracy. By bridging visual and semantic bottlenecks, our framework delivers a consistent performance gain of approximately 20 percentage points across 9 diverse LLMs, enabling open-weight models to rival proprietary SOTA systems in complex chemical reasoning tasks.
△ Less
Submitted 16 May, 2026;
originally announced May 2026.
-
CM-EVS: Sparse Panoramic RGB-D-Pose Data for Complete Scene Coverage
Authors:
Jiale Liu,
Jungang Li,
Jieming Yu,
Xinglin Yu,
Zihao Dongfang,
Zongjian Ding,
Kaifeng Ding,
Yi Yang,
Lidong Chen,
Yang Zou,
Shunwen Bai,
Jiahuan Zhang,
Haoran Huang,
Shan Huang,
Yudong Gao,
Mingjun Cheng
Abstract:
Modern 3D visual learning relies on observations sampled from metric 3D assets, yet existing scans, meshes, point clouds, simulations, and reconstructions do not directly provide a sparse, comparable, and geometry-consistent panoramic training interface. Dense trajectories duplicate nearby views, source-specific rendering policies yield heterogeneous annotations, and sparse heuristics may miss imp…
▽ More
Modern 3D visual learning relies on observations sampled from metric 3D assets, yet existing scans, meshes, point clouds, simulations, and reconstructions do not directly provide a sparse, comparable, and geometry-consistent panoramic training interface. Dense trajectories duplicate nearby views, source-specific rendering policies yield heterogeneous annotations, and sparse heuristics may miss important regions or introduce depth-inconsistent observations. We study how to convert 3D assets into sparse panoramic RGB-D-pose data that preserves complete scene coverage with low redundancy and auditable provenance. We propose COVER (Coverage-Oriented Viewpoint curation with ERP Range-depth warping), a training-free ERP viewpoint curator that projects geometry observed from selected views into candidate ERP probes, scores incremental coverage, and penalizes depth conflicts. Under bounded proxy error, its greedy coverage proxy preserves the standard coverage-style approximation behavior up to an additive error term. Using COVER, we build CM-EVS (Coverage-curated Metric ERP View Set), a panoramic RGB-D-pose dataset with 36,373 curated ERP frames from 1,275 indoor scenes across Blender indoor, HM3D, and ScanNet++, complemented by outdoor panoramas from TartanGround and OB3D re-encoded into the same schema. Each frame provides full-sphere RGB, metric range depth, calibrated pose; COVER-produced indoor frames include per-step provenance logs. With a median of only 25 frames per indoor scene, CM-EVS covers all 13 unified room types while maintaining compact scene-level coverage. Experiments show that COVER improves the coverage-conflict trade-off, making CM-EVS a sparse, compact, and auditable RGB-D-pose resource for geometry-consistent panoramic 3D learning.
△ Less
Submitted 15 May, 2026;
originally announced May 2026.
-
Probing the IMF in the Early Universe -- Direct measurements in the Boötes I UFD with JWST/NIRCam
Authors:
Keyi Ding,
Mario Gennaro,
Roberto J. Avila,
Massimo Ricotti,
Rachael L. Beaton,
Martha L. Boyer,
Thomas M. Brown,
Annalisa Calamida,
Santi Cassisi,
Vedant Chandra,
Roger E. Cohen,
Matteo Correnti,
Denija Crnojević,
Kareem El-Badry,
Marla Geha,
Puragra Guhathakurta,
Nitya Kallivayalil,
Evan N. Kirby,
Kristen. B. W. McQuinn,
Alessandro Savino,
Cheyanne Shariat,
Joshua D. Simon,
Daniel R. Weisz
Abstract:
The dependence of the stellar initial mass function (IMF) on star-formation environment, particularly at low metallicities and high redshifts, remains poorly constrained. Ultra-faint dwarf galaxies (UFDs) are local fossils of high-redshift galaxies hosting old, metal-poor populations, and their resolved stellar populations provide unique pathways to constrain the sub-solar IMF. We investigate the…
▽ More
The dependence of the stellar initial mass function (IMF) on star-formation environment, particularly at low metallicities and high redshifts, remains poorly constrained. Ultra-faint dwarf galaxies (UFDs) are local fossils of high-redshift galaxies hosting old, metal-poor populations, and their resolved stellar populations provide unique pathways to constrain the sub-solar IMF. We investigate the low-mass IMF in the Boötes I (Boo I) UFD with JWST/NIRCam, leveraging its capability to resolve over 10,000 stars reaching $\lesssim0.15 M_{\odot}$, obtaining one of the largest, deepest resolved stellar samples for UFDs. We explore three different functional forms of the IMF with machine learning and statistical techniques, combining forward modeling of synthetic color-magnitude diagrams with simulation-based inference. We find that a single power-law IMF fails to reproduce the observed luminosity function and also deviates from the canonical Salpeter IMF. Our best-fit broken power-law and lognormal IMF parameters are consistent with the Milky Way within 68% confidence level, providing evidence that star formation at metallicities as low as [Fe/H]$\approx-2.4$ follows a similar IMF as in the Milky Way. By treating Boo I as a local relic analogous to a high-redshift galaxy with a stellar mass of $\lesssim10^5 M_{\odot}$ at $z\gtrsim6$, our results provide evidence for the universality of the IMF across both local and high-redshift environments.
△ Less
Submitted 14 May, 2026;
originally announced May 2026.
-
LEMON: Learning Executable Multi-Agent Orchestration via Counterfactual Reinforcement Learning
Authors:
Xudong Chen,
Yixin Liu,
Hua Wei,
Kaize Ding
Abstract:
Large language models (LLMs) have become a strong foundation for multi-agent systems, but their effectiveness depends heavily on orchestration design. Across different tasks, role design, capacity assignment, and dependency construction jointly affect both solution quality and execution efficiency. Existing approaches automate parts of this design process, yet they often optimize these decisions p…
▽ More
Large language models (LLMs) have become a strong foundation for multi-agent systems, but their effectiveness depends heavily on orchestration design. Across different tasks, role design, capacity assignment, and dependency construction jointly affect both solution quality and execution efficiency. Existing approaches automate parts of this design process, yet they often optimize these decisions partially or sequentially, and rely on execution-level feedback that provides limited credit assignment for local orchestration decisions. We propose LEMON (\textbf{L}earning \textbf{E}xecutable \textbf{M}ulti-agent \textbf{O}rchestratio\textbf{N} via Counterfactual Reinforcement Learning), an LLM-based orchestrator that generates an executable orchestration specification. The specification integrates task-specific roles, customized duties, capacity levels, and dependency structure into a single deployable system. To train the orchestrator, we augment the orchestration-level GRPO objective with a localized counterfactual signal that edits role, capacity, or dependency fields and applies the resulting reward contrast only to the edited spans. Experiments on six reasoning and coding benchmarks, including MMLU, GSM8K, AQuA, MultiArith, SVAMP, and HumanEval, show that LEMON achieves state-of-the-art performance among the evaluated multi-agent orchestration methods. Our code is available at https://anonymous.4open.science/r/LEMON-B23C.
△ Less
Submitted 14 May, 2026;
originally announced May 2026.
-
Indefinite Stochastic Linear-Quadratic Optimal Control Problems with Random Coefficients and Poisson Jumps: Closed-Loop Representation of Open-Loop Optimal Controls
Authors:
Kai Ding,
Jiaqiang Wen,
Jie Xiong,
Xin Zhang
Abstract:
This paper is concerned with stochastic linear-quadratic (SLQ) optimal control problems with random coefficients and Poisson jumps. The weighting matrices are allowed to be random and indefinite. Under the uniform convexity condition, the global fundamental matrix representation $P=\mathbf Y\mathbf X^{-1}$, used in the diffusion case, is generally unavailable because Poisson jumps may cause the op…
▽ More
This paper is concerned with stochastic linear-quadratic (SLQ) optimal control problems with random coefficients and Poisson jumps. The weighting matrices are allowed to be random and indefinite. Under the uniform convexity condition, the global fundamental matrix representation $P=\mathbf Y\mathbf X^{-1}$, used in the diffusion case, is generally unavailable because Poisson jumps may cause the optimal state fundamental matrix $\mathbf X$ to become singular. We construct the process $P$ directly from the stochastic value flow and prove that the associated stochastic Riccati equation with jumps (SRE-J) admits a unique maximal strongly regular solution, which gives a closed-loop representation of the unique open-loop optimal control. We also give sufficient conditions for uniform convexity and present indefinite SLQ examples with jumps.
△ Less
Submitted 20 July, 2026; v1 submitted 13 May, 2026;
originally announced May 2026.
-
ProfiliTable: Profiling-Driven Tabular Data Processing via Agentic Workflows
Authors:
Wei Liu,
Yang Gu,
Xi Yan,
Zihan Nan,
Beicheng Xu,
Keyao Ding,
Bin Cui,
Wentao Zhang
Abstract:
Table processing-including cleaning, transformation, augmentation, and matching-is a foundational yet error-prone stage in real-world data pipelines. While recent LLM-based approaches show promise for automating such tasks, they often struggle in practice due to ambiguous instructions, complex task structures, and the lack of structured feedback, resulting in syntactically correct but semantically…
▽ More
Table processing-including cleaning, transformation, augmentation, and matching-is a foundational yet error-prone stage in real-world data pipelines. While recent LLM-based approaches show promise for automating such tasks, they often struggle in practice due to ambiguous instructions, complex task structures, and the lack of structured feedback, resulting in syntactically correct but semantically flawed code. To address these challenges, we propose ProfiliTable, an autonomous multi-agent framework centered on dynamic profiling, which constructs and iteratively refines a unified execution context through interactive exploration, knowledge-augmented synthesis, and feedback-driven refinement. ProfiliTable integrates (i) a Profiler that performs ReAct-style data exploration to build semantic understanding, (ii) a Generator that retrieves curated operators to synthesize task-aware code, and (iii) an Evaluator-Summarizer loop that injects execution scores and diagnostic insights to enable closed-loop refinement. Extensive experiments on a diverse benchmark covering 18 tabular task types demonstrate that ProfiliTable consistently outperforms strong baselines, particularly in complex multi-step scenarios. These results highlight the critical role of dynamic profiling in reliably translating ambiguous user intents into robust and governance-compliant table transformations.
△ Less
Submitted 4 June, 2026; v1 submitted 12 May, 2026;
originally announced May 2026.
-
Bridging Modalities, Spanning Time: Structured Memory for Ultra-Long Agentic Video Reasoning
Authors:
Jiazheng Li,
Chi-Hao Wu,
Yunze Liu,
Kaize Ding,
Jundong Li,
Chuxu Zhang
Abstract:
Understanding ultra-long videos such as egocentric recordings, live streams, or surveillance footage spanning days to weeks, remains a challenge. For current multimodal LLMs: even with million-token context windows, frame budgets cover only tens of minutes of densely sampled video, and most evidence is discarded before inference begins. Memory-augmented and agentic approaches help with scale, but…
▽ More
Understanding ultra-long videos such as egocentric recordings, live streams, or surveillance footage spanning days to weeks, remains a challenge. For current multimodal LLMs: even with million-token context windows, frame budgets cover only tens of minutes of densely sampled video, and most evidence is discarded before inference begins. Memory-augmented and agentic approaches help with scale, but their retrieval remains fragmented across modalities and lacks long-range narrative summaries that span days or weeks. We propose \textbf{MAGIC-Video}, a training-free framework built around a multimodal memory graph with interleaved narrative chain: the graph unifies episodic, semantic, and visual content through six typed edges and supports cross-modal retrieval, while the chain distils long-horizon entity biographies and recurring activity events. At inference time, an agentic loop interleaves graph retrieval with narrative fact injection, covering both the modality and time dimensions of ultra-long video in a single retrieval pipeline. On EgoLifeQA, Ego-R1 and MM-Lifelong, MAGIC-Video consistently outperforms strong general-purpose, long-video, and agentic baselines, with gains of 10.1, 7.4, and 5.9 points over the prior best agentic system on each benchmark. Code is available at https://github.com/lijiazheng0917/MAGIC-video.
△ Less
Submitted 7 May, 2026;
originally announced May 2026.
-
Characterizing Fill Factor Limitations in Perovskite-Silicon Tandem Solar Cells
Authors:
Yueming Wang,
Nan Sun,
Chris Dreessen,
Gaosheng Huang,
Alexander Eberst,
Kaining Ding,
Thomas Kirchartz
Abstract:
Perovskite-silicon tandem technology has exceeded the single junction theoretical efficiency limit. However, there is still distance to the thermodynamic limit mainly caused by the fill factor. This work presents a methodology to illustrate the mechanisms of FF loss in perovskite-Si monolithic tandem solar cells. Apart from the series resistance related loss characterized by electroluminescence, a…
▽ More
Perovskite-silicon tandem technology has exceeded the single junction theoretical efficiency limit. However, there is still distance to the thermodynamic limit mainly caused by the fill factor. This work presents a methodology to illustrate the mechanisms of FF loss in perovskite-Si monolithic tandem solar cells. Apart from the series resistance related loss characterized by electroluminescence, another loss factor is from the photoshunt, a phenomenon in which the parallel resistance apparently reduces under illumination in perovskite solar cells due to the moderate charge transport layer mobility. In addoition, the two-diode property of the Si cell can also influence the FF of tandem devices. The photoshunt can be hidden when the bottom cell is over illuminated, which explains highly efficient tandem solar cells are usually bottom cell limited. This work outlines strategies that overcoming the photoshunt issue can move the perovskite top cell closer to low FF losses in tandem solar cells.
△ Less
Submitted 27 April, 2026;
originally announced April 2026.
-
CoAct: Co-Active LLM Preference Learning with Human-AI Synergy
Authors:
Ruiyao Xu,
Mihir Parmar,
Tiankai Yang,
Zhengyu Hu,
Yue Zhao,
Kaize Ding
Abstract:
Learning from preference-based feedback has become an effective approach for aligning LLMs across diverse tasks. However, high-quality human-annotated preference data remains expensive and scarce. Existing methods address this challenge through either self-rewarding, which scales by using purely AI-generated labels but risks unreliability, or active learning, which ensures quality through oracle a…
▽ More
Learning from preference-based feedback has become an effective approach for aligning LLMs across diverse tasks. However, high-quality human-annotated preference data remains expensive and scarce. Existing methods address this challenge through either self-rewarding, which scales by using purely AI-generated labels but risks unreliability, or active learning, which ensures quality through oracle annotation but cannot fully leverage unlabeled data. In this paper, we present CoAct, a novel framework that synergistically combines self-rewarding and active learning through strategic human-AI collaboration. CoAct leverages self-consistency to identify both reliable self-labeled data and samples that require oracle verification. Additionally, oracle feedback guides the model to generate new instructions within its solvable capability. Evaluated on three reasoning benchmarks across two model families, CoAct achieves average improvements of +13.25% on GSM8K, +8.19% on MATH, and +13.16% on WebInstruct, consistently outperforming all baselines.
△ Less
Submitted 19 April, 2026;
originally announced April 2026.
-
Cat-DPO: Category-Adaptive Safety Alignment
Authors:
Tiankai Yang,
Yi Nian,
Xinyuan Li,
Ruiyao Xu,
Henry Peng Zou,
Kaize Ding,
Xiyang Hu,
Yan Liu,
Yue Zhao
Abstract:
Aligning large language models with human preferences must balance two competing goals: responding helpfully to legitimate requests and reliably refusing harmful ones. Most preference-based safety alignment methods collapse safety into a single scalar that is applied uniformly to every preference pair. The result is a model that looks safe on average but stays relatively unsafe on a minority of ha…
▽ More
Aligning large language models with human preferences must balance two competing goals: responding helpfully to legitimate requests and reliably refusing harmful ones. Most preference-based safety alignment methods collapse safety into a single scalar that is applied uniformly to every preference pair. The result is a model that looks safe on average but stays relatively unsafe on a minority of harm categories. We cast safety alignment as a per-category constrained optimization problem and derive Cat-DPO, a direct-preference-optimization algorithm with a separate adaptive safety margin for each harm category. The margin tightens when the model still produces unsafe responses on a category and relaxes once the model catches up, so the training signal tracks each category's current difficulty rather than averaging under one global rate. Across two LLM backbones and six preference-learning baselines, Cat-DPO improves aggregate helpfulness and harmlessness and compresses per-category safety variance and the best-to-worst gap, offering a drop-in per-category refinement of direct preference safety alignment.
△ Less
Submitted 13 August, 2026; v1 submitted 19 April, 2026;
originally announced April 2026.
-
HopRank: Self-Supervised LLM Preference-Tuning on Graphs for Few-Shot Node Classification
Authors:
Ziqing Wang,
Kaize Ding
Abstract:
Node classification on text-attributed graphs (TAGs) is a fundamental task with broad applications in citation analysis, social networks, and recommendation systems. Current GNN-based approaches suffer from shallow text encoding and heavy dependence on labeled data, limiting their effectiveness in label-scarce settings. While large language models (LLMs) naturally address the text understanding ga…
▽ More
Node classification on text-attributed graphs (TAGs) is a fundamental task with broad applications in citation analysis, social networks, and recommendation systems. Current GNN-based approaches suffer from shallow text encoding and heavy dependence on labeled data, limiting their effectiveness in label-scarce settings. While large language models (LLMs) naturally address the text understanding gap with deep semantic reasoning, existing LLM-for-graph methods either still require abundant labels during training or fail to exploit the rich structural signals freely available in graph topology. Our key observation is that, in many real-world TAGs, edges predominantly connect similar nodes under the homophily principle, meaning graph topology inherently encodes class structure without any labels. Building on this insight, we reformulate node classification as a link prediction task and present HopRank, a fully self-supervised LLM-tuning framework for TAGs. HopRank constructs preference data via hierarchical hop-based sampling and employs adaptive preference learning to prioritize informative training signals without any class labels. At inference, nodes are classified by predicting their connection preferences to labeled anchors, with an adaptive early-exit voting scheme to improve efficiency. Experiments on three TAG benchmarks show that HopRank matches fully-supervised GNNs and substantially outperforms prior graph-LLM methods, despite using zero labeled training data.
△ Less
Submitted 19 April, 2026;
originally announced April 2026.
-
MolMem: Memory-Augmented Agentic Reinforcement Learning for Sample-Efficient Molecular Optimization
Authors:
Ziqing Wang,
Yibo Wen,
Abhishek Pandy,
Han Liu,
Kaize Ding
Abstract:
In drug discovery, molecular optimization aims to iteratively refine a lead compound to improve molecular properties while preserving structural similarity to the original molecule. However, each oracle evaluation is expensive, making sample efficiency a key challenge for existing methods under a limited oracle budget. Trial-and-error approaches require many oracle calls, while methods that levera…
▽ More
In drug discovery, molecular optimization aims to iteratively refine a lead compound to improve molecular properties while preserving structural similarity to the original molecule. However, each oracle evaluation is expensive, making sample efficiency a key challenge for existing methods under a limited oracle budget. Trial-and-error approaches require many oracle calls, while methods that leverage external knowledge tend to reuse familiar templates and struggle on challenging objectives. A key missing piece is long-term memory that can ground decisions and provide reusable insights for future optimizations. To address this, we present MolMem (\textbf{Mol}ecular optimization with \textbf{Mem}ory), a multi-turn agentic reinforcement learning (RL) framework with a dual-memory system. Specifically, MolMem uses Static Exemplar Memory to retrieve relevant exemplars for cold-start grounding, and Evolving Skill Memory to distill successful trajectories into reusable strategies. Built on this memory-augmented formulation, we train the policy with dense step-wise rewards, turning costly rollouts into long-term knowledge that improves future optimization. Extensive experiments show that MolMem achieves 90\% success on single-property tasks (1.5$\times$ over the best baseline) and 52\% on multi-property tasks using only 500 oracle calls. Our code is available at https://github.com/REAL-Lab-NU/MolMem.
△ Less
Submitted 13 April, 2026;
originally announced April 2026.
-
Benchmarking and Enabling Efficient Chinese Medical Retrieval via Asymmetric Encoders
Authors:
Angqing Jiang,
Jianlyu Chen,
Zhe Fang,
Yongcan Wang,
Xinpeng Li,
Keyu Ding,
Defu Lian
Abstract:
Effective medical text retrieval requires both high accuracy and low latency. While LLM-based embedding models possess powerful retrieval capabilities, their prohibitive latency and high computational cost limit their application in real-time scenarios. Furthermore, the lack of comprehensive and high-fidelity benchmarks hinders progress in Chinese medical text retrieval. In this work, we introduce…
▽ More
Effective medical text retrieval requires both high accuracy and low latency. While LLM-based embedding models possess powerful retrieval capabilities, their prohibitive latency and high computational cost limit their application in real-time scenarios. Furthermore, the lack of comprehensive and high-fidelity benchmarks hinders progress in Chinese medical text retrieval. In this work, we introduce the Chinese Medical Text Embedding Benchmark (CMedTEB), a benchmark spanning three kinds of practical embedding tasks: retrieval, reranking, and semantic textual similarity (STS). Distinct from purely automated datasets, CMedTEB is curated via a rigorous multi-LLM voting pipeline validated by clinical experts, ensuring gold-standard label quality while effectively mitigating annotation noise. On this foundation, we propose the Chinese Medical Asymmetric REtriever (CARE), an asymmetric architecture that pairs a lightweight BERT-style encoder for online query encoding with a powerful LLM-based encoder for offline document encoding. However, optimizing such an asymmetric retriever with two structurally different encoders presents distinctive challenges. To address this, we introduce a novel two-stage training strategy that progressively bridges the query and document representations. Extensive experiments demonstrate that CARE surpasses state-of-the-art symmetric models on CMedTEB, achieving superior retrieval performance without increasing inference latency.
△ Less
Submitted 19 April, 2026; v1 submitted 12 April, 2026;
originally announced April 2026.
-
Galactic Archaeology with the Subaru `Ōnohi`ula Prime Focus Spectrograph Strategic Program
Authors:
Masashi Chiba,
Rosemary F. G. Wyse,
Evan N. Kirby,
Judith G. Cohen,
László Dobos,
Roman Gerasimov,
Miho N. Ishigaki,
Kohei Hayashi,
Carrie Filion,
Magda Arnaboldi,
Souradeep Bhattacharya,
Yutaka Hirai,
Chiaki Kobayashi,
Yutaka Komiyama,
Pete B. Kuzma,
Itsuki Ogami,
Ana L. Chies-Santos,
Nicole L. Klock-Miranda,
Federico Sestito,
Tamás Budavári,
Andrew P. Cooper,
Keyi Ding,
Ivanna Escala,
Elisa G. M. Ferreira,
Ortwin Gerhard
, et al. (25 additional authors not shown)
Abstract:
The recently commissioned Subaru `Ōnohi`ula Prime Focus Spectrograph (PFS) will obtain spectra from nearly 2,400 fibers that cover 1.24 square degrees. The 360 night Subaru Strategic Program for PFS is dedicating approximately one-third of its allocation (130 nights) to study the structure and evolution of galaxies in the Local Group. This Galactic Archaeological survey has three pillars. (1) We w…
▽ More
The recently commissioned Subaru `Ōnohi`ula Prime Focus Spectrograph (PFS) will obtain spectra from nearly 2,400 fibers that cover 1.24 square degrees. The 360 night Subaru Strategic Program for PFS is dedicating approximately one-third of its allocation (130 nights) to study the structure and evolution of galaxies in the Local Group. This Galactic Archaeological survey has three pillars. (1) We will determine whether the mass density profiles of dwarf galaxies are consistent with cusps, as expected for cold dark matter, or cores, as expected from alternative dark matter theories or baryonic feedback. We will deduce the density profiles as a function of radius from modeling of the full line-of-sight velocity and abundance distributions for six dwarf galaxies. Our total sample will consist of 18,000 member stars to beyond the nominal tidal radius of each system. (2) From measurements of the [alpha/Fe] abundance ratio, we will learn the difference in assembly history of the two most massive galaxies in the Local Group: M31 and the Milky Way. We will observe 30,000 member stars over 45 square degrees of M31's halo and outer disk. (3) We will uncover how the most fragile (outer) part of the Milky Way responded to accretion events both in the distant past (such as Gaia-Sausage Enceladus) and in more recent history (such as the Sagittarius dwarf spheroidal galaxy). To support this study, PFS will provide velocities and metallicities--from which, in combination with photometry, we will deduce ages--for tens of thousands of main-sequence stars out to a Galactocentric distance of ~30 kpc.
△ Less
Submitted 29 June, 2026; v1 submitted 10 April, 2026;
originally announced April 2026.
-
GNN-as-Judge: Unleashing the Power of LLMs for Graph Learning with GNN Feedback
Authors:
Ruiyao Xu,
Kaize Ding
Abstract:
Large Language Models (LLMs) have shown strong performance on text-attributed graphs (TAGs) due to their superior semantic understanding ability on textual node features. However, their effectiveness as predictors in the low-resource setting, where labeled nodes are severely limited and scarce, remains constrained since fine-tuning LLMs usually requires sufficient labeled data, especially when the…
▽ More
Large Language Models (LLMs) have shown strong performance on text-attributed graphs (TAGs) due to their superior semantic understanding ability on textual node features. However, their effectiveness as predictors in the low-resource setting, where labeled nodes are severely limited and scarce, remains constrained since fine-tuning LLMs usually requires sufficient labeled data, especially when the TAG shows complex structural patterns. In essence, this paper targets two key challenges: (i) the difficulty of generating and selecting reliable pseudo labels on TAGs for LLMs, and (ii) the need to mitigate potential label noise when fine-tuning LLMs with pseudo labels. To counter the challenges, we propose a new framework, GNN-as-Judge, which can unleash the power of LLMs for few-shot semi-supervised learning on TAGs by incorporating the structural inductive bias of Graph Neural Networks (GNNs). Specifically, GNN-as-Judge introduces a collaborative pseudo-labeling strategy that first identifies the most influenced unlabeled nodes from labeled nodes, then exploits both the agreement and disagreement patterns between LLMs and GNNs to generate reliable labels. Furthermore, we develop a weakly-supervised LLM fine-tuning algorithm that can distill the knowledge from informative pseudo labels while mitigating the potential label noise. Experiments on multiple TAG datasets demonstrate that GNN-as-Judge significantly outperforms existing methods, particularly in low-resource regimes where labeled data are scarce.
△ Less
Submitted 11 March, 2026;
originally announced April 2026.
-
Coordinate-Based Dual-Constrained Autoregressive Motion Generation
Authors:
Kang Ding,
Hongsong Wang,
Jie Gui,
Liang Wang
Abstract:
Text-to-motion generation has attracted increasing attention in the research community recently, with potential applications in animation, virtual reality, robotics, and human-computer interaction. Diffusion and autoregressive models are two popular and parallel research directions for text-to-motion generation. However, diffusion models often suffer from error amplification during noise predictio…
▽ More
Text-to-motion generation has attracted increasing attention in the research community recently, with potential applications in animation, virtual reality, robotics, and human-computer interaction. Diffusion and autoregressive models are two popular and parallel research directions for text-to-motion generation. However, diffusion models often suffer from error amplification during noise prediction, while autoregressive models exhibit mode collapse due to motion discretization. To address these limitations, we propose a flexible, high-fidelity, and semantically faithful text-to-motion framework, named Coordinate-based Dual-constrained Autoregressive Motion Generation (CDAMD). With motion coordinates as input, CDAMD follows the autoregressive paradigm and leverages diffusion-inspired multi-layer perceptrons to enhance the fidelity of predicted motions. Furthermore, a Dual-Constrained Causal Mask is introduced to guide autoregressive generation, where motion tokens act as priors and are concatenated with textual encodings. Since there is limited work on coordinate-based motion synthesis, we establish new benchmarks for both text-to-motion generation and motion editing. Experimental results demonstrate that our approach achieves state-of-the-art performance in terms of both fidelity and semantic consistency on these benchmarks.
△ Less
Submitted 9 April, 2026;
originally announced April 2026.
-
TrajGuard: Streaming Hidden-state Trajectory Detection for Decoding-time Jailbreak Defense
Authors:
Cheng Liu,
Xiaolei Liu,
Xingyu Li,
Bangzhou Xin,
Kangyi Ding
Abstract:
Existing jailbreak defense paradigms primarily rely on static detection of prompts, outputs, or internal states, often neglecting the dynamic evolution of risk during decoding. This oversight leaves risk signals embedded in decoding trajectories underutilized, constituting a critical blind spot in current defense systems. In this work, we empirically demonstrate that hidden states in critical laye…
▽ More
Existing jailbreak defense paradigms primarily rely on static detection of prompts, outputs, or internal states, often neglecting the dynamic evolution of risk during decoding. This oversight leaves risk signals embedded in decoding trajectories underutilized, constituting a critical blind spot in current defense systems. In this work, we empirically demonstrate that hidden states in critical layers during the decoding phase carry stronger and more stable risk signals than input jailbreak prompts. Specifically, the hidden representations of tokens generated during jailbreak attempts progressively approach high-risk regions in the latent space. Based on this observation, we propose TrajGuard, a training-free, decoding-time defense framework. TrajGuard aggregates hidden-state trajectories via a sliding window to quantify risk in real time, triggering a lightweight semantic adjudication only when risk within a local window persistently exceeds a threshold. This mechanism enables the immediate interruption or constraint of subsequent decoding. Extensive experiments across 12 jailbreak attacks and various open-source LLMs show that TrajGuard achieves an average defense rate of 95%. Furthermore, it reduces detection latency to 5.2 ms/token while maintaining a false positive rate below 1.5%. These results confirm that hidden-state trajectories during decoding can effectively support real-time jailbreak detection, highlighting a promising direction for defenses without model modification.
△ Less
Submitted 8 April, 2026;
originally announced April 2026.