-
Sr and Ba yields of the First Generation(s) of stars: Constraints from metal-poor stars
Authors:
Sarah Hughes,
Anna Frebel,
Xiaowei Ou,
Alexander Yelland,
Felicia Xiao,
Jorian Benke,
Kali Kraus,
Reidyn Wingate,
Mohammad Mardini
Abstract:
We present our chemical abundance analysis of ten new extremely metal-poor stars with $-4.05\leq\mbox{[Fe/H]}\leq-2.33$, based on high-resolution (R $\sim28,000$) Magellan/MIKE spectra. Eight of our stars have low heavy-element abundances of $\mbox{[Sr/H]}<-4.5$ and $\mbox{[Ba/H]}<-4.0$, making them Small Accreted Stellar System (SASS) stars. Four are hyper neutron-capture-element poor with…
▽ More
We present our chemical abundance analysis of ten new extremely metal-poor stars with $-4.05\leq\mbox{[Fe/H]}\leq-2.33$, based on high-resolution (R $\sim28,000$) Magellan/MIKE spectra. Eight of our stars have low heavy-element abundances of $\mbox{[Sr/H]}<-4.5$ and $\mbox{[Ba/H]}<-4.0$, making them Small Accreted Stellar System (SASS) stars. Four are hyper neutron-capture-element poor with $\mbox{[Sr/H]}<-5.0$, including Gaia DR3 5729400267359655680, which sets a new record for the lowest detected Sr abundance of $\mbox{[Sr/H]} =-6.4$. We identify four distinct [Sr/Ba] groups within the wider SASS star population which span a large range from $\mbox{[Sr/Ba]} =-2.0$ to +1.6, pointing to multiple types of progenitor events and different nucleosynthesis processes/sites. To explore the origins of this large [Sr/Ba] range, we adopt site-agnostic Sr yields of $\mbox{[Sr/H]}=-6$, $-5.75$, $-5.42$, and $-4.93$ for the four groups. Applying those yields suggests that the majority of SASS stars formed from gas enriched by $\sim$1-10 progenitor events, consistent with expectations from their extremely metal-poor nature. We thus attribute the [Sr/H] abundance scatter to intrinsic variations in the Sr yield per nucleosynthesis site/event. Our proposed Sr yields for each [Sr/Ba] group and associated nucleosynthesis origin are a reasonable and representative approximation, good to within a factor of a few, and can constrain future theoretical heavy element nucleosynthesis calculations in early core-collapse supernovae.
△ Less
Submitted 17 August, 2026;
originally announced August 2026.
-
Step-Level On-Policy Distillation: Interpolating Between On-Policy Distillation and Supervised Fine-Tuning
Authors:
Changhui Sun,
Lanbo Liu,
Hang Lei,
Tong Ling,
Jiahang Xie,
Zhiyong Zheng,
Yujia Wang,
Hao Liu,
Feng Xiao,
Lu Liu,
Yanlong Du,
Zifeng Cheng,
Ziwei Jiang,
Qing Gu
Abstract:
On-policy distillation (OPD) aligns a student model with a teacher's logit distribution on student-generated trajectories. This approach has achieved strong empirical gains and can often surpass conventional off-policy distillation with substantially less data. However, standard token-level OPD can provide only fragmented corrections along an erroneous student trajectory and cannot unfold a comple…
▽ More
On-policy distillation (OPD) aligns a student model with a teacher's logit distribution on student-generated trajectories. This approach has achieved strong empirical gains and can often surpass conventional off-policy distillation with substantially less data. However, standard token-level OPD can provide only fragmented corrections along an erroneous student trajectory and cannot unfold a complete and correct repair path. Motivated by this limitation, we propose \emph{Step-Level On-Policy Distillation} (SOPD), which combines the long-horizon correction of supervised fine-tuning (SFT) with the on-policy advantage of OPD to provide step-level supervision over complete student-generated trajectories. We show that, at different limits of step length, SOPD reduces to SFT or approximates OPD. Compared with SFT, the teacher responses in SOPD are conditioned on student trajectories and therefore align more closely with student-visited states; compared with OPD, SOPD provides longer-horizon corrections rather than fragmented token-level guidance. Across both reasoning and agent tasks, SOPD substantially outperforms conventional SFT and OPD. For example, on ALFWorld, SOPD improves the average success rate by 13.4 points over Vanilla OPD. We hope this work offers a new perspective for future research on distillation methods.
△ Less
Submitted 17 August, 2026;
originally announced August 2026.
-
RetroMPA: A Molecular Property-Aware Auxiliary Framework for Enhancing Retrosynthesis Prediction
Authors:
Mianzhi Liu,
Fan Xiao,
Zhiliang Yu,
Huayang Huang,
Yuke Li,
Yi Yang,
Wenbo Liu,
Yu Wu
Abstract:
Retrosynthesis is a cornerstone of drug discovery and organic synthesis. While data-driven deep learning models have shown remarkable progress, they autonomously learn reaction patterns from extensive datasets with limited integration of established chemical knowledge as priors.
To address this limitation, we introduce RetroMPA, a molecular property-aware, post-hoc enhancement module that inject…
▽ More
Retrosynthesis is a cornerstone of drug discovery and organic synthesis. While data-driven deep learning models have shown remarkable progress, they autonomously learn reaction patterns from extensive datasets with limited integration of established chemical knowledge as priors.
To address this limitation, we introduce RetroMPA, a molecular property-aware, post-hoc enhancement module that injects chemical knowledge into the retrosynthesis pipeline. Rather than functioning as an independent SMILES sequence generator, RetroMPA is a broadly applicable, model-agnostic chemical filter designed to recalibrate and optimize the predictive pathways of existing algorithms.
This plug-and-play framework integrates seamlessly with a range of data-driven retrosynthesis methods, enhancing outputs without modifying model architecture or requiring resource-intensive retraining. By leveraging a property-aware latent embedding space, RetroMPA consistently improves top-1 accuracy across eight representative retrosynthesis models by an average of 5.50% on USPTO-50K.
Furthermore, we validate its scalability on the large-scale USPTO-Full dataset, achieving an average improvement of about 2.03% across both template-based and template-free architectures.
Wet-lab experiments provide preliminary support for the practical utility of the framework. These syntheses confirmed viable, previously unreported substrate combinations for classic reaction paradigms---specifically, Suzuki-Miyaura coupling, Bucherer reaction, and Friedel-Crafts acylation---suggesting that RetroMPA can operate beyond mere data fitting. The code is open-sourced at https://github.com/MengzhouLu/RetroMPA.
△ Less
Submitted 17 August, 2026;
originally announced August 2026.
-
ReasonCast: Agentic Demand Forecasting with Selective Semantic Reasoning
Authors:
Ziyue Yang,
Chaolin Xu,
Yijing Wang,
Tiankai Gu,
Hui Yang,
Yanhong Lin,
Kaiyuan Liu,
Fei Xiao
Abstract:
Demand forecasting increasingly requires combining two complementary sources of information: historical sales reveal recurring numerical dynamics, while future promotions, holidays, price changes, and platform interventions provide forward-looking knowledge. Existing text-enhanced forecasting methods often encode such context into generic representations and fuse it uniformly with time-series feat…
▽ More
Demand forecasting increasingly requires combining two complementary sources of information: historical sales reveal recurring numerical dynamics, while future promotions, holidays, price changes, and platform interventions provide forward-looking knowledge. Existing text-enhanced forecasting methods often encode such context into generic representations and fuse it uniformly with time-series features, without explicitly distinguishing which semantic effects are forecast-relevant or how they should modify future dynamics.
We introduce ReasonCast, a structured semantic intervention framework that translates event knowledge into forecast-specific operations. An agent examines the event context, the no-text forecast, and its uncertainty to determine whether textual reasoning is needed. Rather than injecting free-form text, ReasonCast represents event knowledge through structured fields describing event relevance, demand direction, temporal shape, amplitude, and peak intensity. These fields interact selectively with temporal components of a time-series foundation model. An additive path corrects local trends and temporal shapes, while a multiplicative path captures event-driven level shifts.
ReasonCast introduces a forecast-grounded post-training curriculum. Schema SFT establishes semantic fields; semantic-field RL calibrates direction, shape, amplitude, and peak judgments; and forecast-utility RL evaluates semantic interventions through a frozen forecaster, aligning reasoning outputs with marginal forecast improvement. ReasonCast lowers WMAPE by 3.29, 1.25, and 0.47 percentage points on holiday-sensitive categories, mega-sale-sensitive categories, and M5 event windows, respectively. On stable-sales periods, indiscriminate semantic intervention increases WMAPE by 1.68 percentage points, whereas suppressing unnecessary intervention preserves the numerical backbone.
△ Less
Submitted 15 August, 2026;
originally announced August 2026.
-
BrainLinear: A Linear Model for Brain Network Analysis in Sparse Tangent Subspaces
Authors:
Sijing Wu,
Dongyuan Li,
Miaoting Huang,
Weiwei Ye,
Ying Zhang,
Feng Xia,
Renhe Jiang
Abstract:
Functional connectome analysis examines brain-region interactions to understand and identify disorders such as autism spectrum disorder and Alzheimer's disease. Existing methods typically use GNNs and Transformers to model the full functional connectivity matrix. However, processing tens of thousands of connections introduces redundancy and noise, increases computational cost, and limits connectio…
▽ More
Functional connectome analysis examines brain-region interactions to understand and identify disorders such as autism spectrum disorder and Alzheimer's disease. Existing methods typically use GNNs and Transformers to model the full functional connectivity matrix. However, processing tens of thousands of connections introduces redundancy and noise, increases computational cost, and limits connection-level interpretability. This raises a central question: do we really need complex interaction modeling, or is identifying a small set of disease-relevant connectivity patterns sufficient? To answer this question, we propose BrainLinear, a lightweight geometry-aware framework for mining disease-discriminative connectome patterns. BrainLinear first maps each functional connectivity matrix to a shared tangent space centered at the Fréchet mean of the training set, capturing subject-specific deviations while respecting matrix geometry. It then scores each ROI-pair tangent direction by its classification contribution and disease--control difference, retaining Top-$K$ directions as a compact representation. Finally, a shallow multilayer perceptron performs classification on the selected representation. Experiments on ABIDE and ADNI show that BrainLinear matches or exceeds strong GNN and Transformer baselines at a fraction of their cost: it improves AUC and ACC over the best baseline for each metric by up to $3.54$ and $1.39$ percentage points, while reducing runtime and peak GPU memory by $84.0\%$ and $68.4\%$ relative to the closest baseline in AUC. The selected directions are directionally consistent with between-group displacements and organized across major functional systems, supporting connection-level interpretation.
△ Less
Submitted 15 August, 2026;
originally announced August 2026.
-
Expert-Guided g-computation with Large Language Models for Estimating Causal Effects on Timings: Applications to Hospital Quality Improvement
Authors:
Patrick Vossler,
Jialin Ouyang,
F. Richard Guo,
Anran Huang,
Ali Shojaie,
Lucas Zier,
Fan Xia,
Jean Feng
Abstract:
Hospital quality improvement (QI) programs routinely face multiple candidate interventions to optimize hospital flow, but existing methods struggle to estimate and rank the causal effects of such interventions. This work focuses on one of the most standard hospital metrics, the average length of stay (LOS), and its causal estimand, the average time saved. To characterize this causal effect, qualit…
▽ More
Hospital quality improvement (QI) programs routinely face multiple candidate interventions to optimize hospital flow, but existing methods struggle to estimate and rank the causal effects of such interventions. This work focuses on one of the most standard hospital metrics, the average length of stay (LOS), and its causal estimand, the average time saved. To characterize this causal effect, qualitative approaches rely on expert judgment to map patient trajectories, making them susceptible to cognitive biases; quantitative approaches rely on data-driven models, which fail when interventions are hypothetical with no historical data or have complex causal mechanisms that require clinical reasoning rather than data alone. We propose expert-guided g-computation, or egg-computation, which combines the complementary strengths of both approaches by connecting the Gantt charts commonly used to map patient trajectories with the causal DAG literature. We introduce a causal model over Gantt charts and establish identification using a variant of g-computation that seeks expert input only for components unidentifiable from data. To make egg-computation practical, we develop an LLM-assisted pipeline that reliably scales up expert reasoning. In simulations, egg-computation outperforms conventional causal inference methods when patients have diverse causal structures and intervention mechanisms. In a study of eleven candidate QI interventions at an urban safety-net hospital, the LLM pipeline generated graphs and time-saving estimates highly concordant with those of human experts. Beyond healthcare, egg-computation is a broadly applicable framework for estimating the average time saved for candidate interventions whose causal mechanisms can be represented using Gantt charts.
△ Less
Submitted 10 August, 2026;
originally announced August 2026.
-
Anisotropic Particle Transport from a Pulsar Wind Nebula Revealed by Einstein Probe and LHAASO
Authors:
Zhen Cao,
F. Aharonian,
Y. X. Bai,
Y. W. Bao,
D. Bastieri,
X. J. Bi,
Y. J. Bi,
W. Bian,
J. Blunier,
A. V. Bukevich,
C. M. Cai,
W. Y. Cao,
Zhe Cao,
J. Chang,
J. F. Chang,
E. S. Chen,
G. H. Chen,
H. K. Chen,
L. F. Chen,
Liang Chen,
Long Chen,
M. J. Chen,
M. L. Chen,
Q. H. Chen,
S. Chen
, et al. (320 additional authors not shown)
Abstract:
Pulsar wind nebulae (PWNe) are major cosmic ray accelerators, yet the mechanisms transporting high-energy particles into the interstellar medium remain elusive. Building on the LHAASO discovery of an ultra-high-energy (UHE) $γ$-ray source near the bow-shock PWN powered by the pulsar PSR J1740+1000, we present a joint Einstein Probe (EP) and LHAASO study of this system. EP observations reveal an ex…
▽ More
Pulsar wind nebulae (PWNe) are major cosmic ray accelerators, yet the mechanisms transporting high-energy particles into the interstellar medium remain elusive. Building on the LHAASO discovery of an ultra-high-energy (UHE) $γ$-ray source near the bow-shock PWN powered by the pulsar PSR J1740+1000, we present a joint Einstein Probe (EP) and LHAASO study of this system. EP observations reveal an extended X-ray tail far exceeding the structure previously seen by XMM-Newton. Updated LHAASO observations show that the $γ$-ray emission is elongated, with its major axis aligned with the extended X-ray tail revealed by EP. This is the first detection of an X-ray pulsar tail associated with a spatially coincident extended UHE $γ$-ray emission. The X-ray and $γ$-ray spectrum can be well explained with a single population of relativistic electrons via synchrotron and inverse Compton radiation, respectively, removing the need for particle re-acceleration during propagation. The results unambiguously show that electrons/positrons above 100 TeV are escaping from the PWN. Instead of the immediate, isotropic diffusion into ambient interstellar medium that is typically assumed, these particles are transported anisotropically over at least $\sim$10 pc, either guided by the background magnetic field or carried by an advective outflow.
△ Less
Submitted 7 August, 2026;
originally announced August 2026.
-
MDLMPE: Distribution Aware Positional Encoding for Masked Diffusion Language Models
Authors:
Tong Ling,
Hang Lei,
Feng Xiao,
Changhui Sun,
Jiahang Xie,
Hao Liu,
Lu Liu,
Yanlong Du
Abstract:
Masked diffusion language models (MDLMs) enable parallel generation and bidirectional context modeling, but their positional context differs fundamentally from that of autoregressive (AR) models. Whereas AR decoding exposes a contiguous prefix, MDLM denoising produces dynamic, non-contiguous configurations of revealed and masked tokens. Conventional positional encodings such as RoPE capture sequen…
▽ More
Masked diffusion language models (MDLMs) enable parallel generation and bidirectional context modeling, but their positional context differs fundamentally from that of autoregressive (AR) models. Whereas AR decoding exposes a contiguous prefix, MDLM denoising produces dynamic, non-contiguous configurations of revealed and masked tokens. Conventional positional encodings such as RoPE capture sequence order and pairwise displacement but remain insensitive to this evolving token-availability structure. To address this limitation, we propose MDLMPE, a positional encoding designed specifically for masked diffusion. To the best of our knowledge, MDLMPE is the first method to make positional representations explicitly aware of the changing revealed/masked configuration. It represents token availability as a binary sequence, applies distance-aware Gaussian weighting, and projects the resulting pattern through a cosine basis to obtain distribution-aware positional features. These features are added to token embeddings and mapped by a lightweight MLP to angular offsets that modulate the standard RoPE phases. Extensive experiments on LLaDA and DREAM demonstrate that MDLMPE generally outperforms conventional positional encoding methods across supervised fine-tuning, pretraining, zero-shot evaluation, and block-diffusion settings. Further ablations show that the complete combination of availability state, Gaussian locality, spectral basis, and embedding injection yields the strongest result. These results establish the evolving token-availability distribution as a useful positional signal for masked diffusion language models.
△ Less
Submitted 4 August, 2026;
originally announced August 2026.
-
Collaborative Orbital Edge Intelligence: A Decentralized Paradigm for Energy-Efficient Computing in Space
Authors:
Yuvraj Sahni,
Jiannong Cao,
Fu Xiao
Abstract:
In recent years, Low Earth Orbit (LEO) satellites have been increasingly deployed to enable connectivity in remote and disaster-prone areas. Researchers have proposed Orbital Edge Computing, which adds computational intelligence to LEO satellites to process data on orbit, providing edge intelligence close to space data sources. Existing work on Orbital Edge Computing typically assumes centralized…
▽ More
In recent years, Low Earth Orbit (LEO) satellites have been increasingly deployed to enable connectivity in remote and disaster-prone areas. Researchers have proposed Orbital Edge Computing, which adds computational intelligence to LEO satellites to process data on orbit, providing edge intelligence close to space data sources. Existing work on Orbital Edge Computing typically assumes centralized control without collaboration among satellites from different providers, leading to limited connectivity, higher latency, and increased satellite battery depletion. They have not fully explored decentralized inter-satellite collaboration for energy-efficient intelligence under heterogeneous LEO constellations. This paper introduces a novel paradigm, Collaborative Orbital Edge Intelligence (COEI), that leverages decentralized collaboration among LEO satellites to enable energy-efficient on-orbit processing of space data. We describe the overall system architecture of COEI, including the issues related to networking, computing, and power management. COEI can help create a multi-party, multi-orbit megaconstellation of satellites that delivers better service quality by providing benefits, including global resilient connectivity, real-time intelligence, and energy-efficient services. To demonstrate the COEI benefits, we conduct a case study on decentralized energy-aware satellite task offloading to maximize the task success rate while minimizing the sum of the maximum battery depth-of-discharge across all satellites. Finally, we outline future directions for COEI that offer opportunities for further investigation.
△ Less
Submitted 1 August, 2026;
originally announced August 2026.
-
UltraSAM3: A Concept-Driven Foundation Model for Universal Ultrasound Image Segmentation
Authors:
Bo Xu,
Quanhao Zhu,
Rui Lin,
Boling Zhu,
Chenyuan Wang,
Hongfei Lin,
Feng Xia,
Chenhua Ji
Abstract:
Ultrasound imaging has become increasingly widespread in clinical practice due to its portability, low cost and real-time capability, making ultrasound image segmentation important. However, ultrasound images differ substantially from CT, MRI, and other medical imaging modalities, as they are often affected by speckle noise, low contrast, acoustic shadows and ambiguous boundaries. Existing ultraso…
▽ More
Ultrasound imaging has become increasingly widespread in clinical practice due to its portability, low cost and real-time capability, making ultrasound image segmentation important. However, ultrasound images differ substantially from CT, MRI, and other medical imaging modalities, as they are often affected by speckle noise, low contrast, acoustic shadows and ambiguous boundaries. Existing ultrasound segmentation methods are still mainly limited to task-specific models or visual-prompt-based foundation models, which are either tailored to particular tasks or require expert-provided visual prompts, making them inconvenient for flexible clinical use. To address these challenges, we propose UltraSAM3, a concept-driven foundation model for universal ultrasound image segmentation. Unlike conventional models, UltraSAM3 enables text-based target specification by adapting SAM3 to ultrasound-specific image--mask--concept triplets. The model is trained on a large-scale ultrasound segmentation corpus covering 37 public datasets and 13 anatomical categories, allowing it to align ultrasound visual patterns with clinically meaningful concepts across diverse organs and lesions. To further improve usability under realistic clinical interaction, we propose an instruction-guided agent that parses complex natural language queries into concise ultrasound concept prompts for UltraSAM3. Extensive experiments demonstrate that UltraSAM3 consistently outperforms representative concept- and text-driven biomedical segmentation models on multi-organ ultrasound benchmarks, external datasets, and visual-prompt-enhanced settings. Moreover, the agent improves segmentation robustness for complex user instructions. These results indicate that ultrasound-specific concept adaptation is effective for building generalizable and interactive ultrasound segmentation foundation models.
△ Less
Submitted 31 July, 2026;
originally announced July 2026.
-
KQFuzz: Knowledge-Guided Fuzzing for Quantum Libraries via Large Language Models
Authors:
Fuyuan Xia,
Qixin Zhang,
Chenhao Ying,
Haojin Zhu,
Shuai Wang,
Yuan Luo,
Pingchuan Ma,
Yuxuan Du
Abstract:
As quantum computing continually improves, ensuring the reliability and correctness of quantum libraries has become increasingly critical. To this end, many LLM-based fuzzing approaches towards quantum libraries have been proposed to uncover potential bugs. However, these methods still suffer from limitations such as insufficient flexibility and low efficiency, which hinder the progress of the qua…
▽ More
As quantum computing continually improves, ensuring the reliability and correctness of quantum libraries has become increasingly critical. To this end, many LLM-based fuzzing approaches towards quantum libraries have been proposed to uncover potential bugs. However, these methods still suffer from limitations such as insufficient flexibility and low efficiency, which hinder the progress of the quantum computing field. To address these challenges, we propose KQFuzz, a novel knowledge-guided fuzzer for quantum libraries. It leverages comprehensive codebase knowledge to ground LLM-based test generation, synergizing this with fitness-guided evaluation and two-level mutations to explore complex execution paths and trigger potential bugs. Firstly, KQFuzz introduces a novel prompting scheme tailored to quantum programs, which strategically incorporates knowledge of the codebase to efficiently generate high-quality quantum seed programs. Moreover, we develop evaluation and mutation strategies to handle the generated seed programs, facilitating efficient fuzzing execution while further enriching the diversity of the resulting test cases. We implement KQFuzz and conduct fuzzing on three popular quantum libraries, including Qiskit, PennyLane, and Cirq. Experimental results demonstrate that our approach significantly outperforms other state-of-the-art methods, with coverage improved by up to 18.44%. During the development of KQFuzz, we discovered 13 bugs, all of which have been confirmed and 12 have already been fixed by the developers.
△ Less
Submitted 28 July, 2026;
originally announced July 2026.
-
Color Fundus Photography Analysis: Co-evolution of Data, Preprocessing, and Modeling toward Multimodal AI
Authors:
Yu Li,
Wengan He,
Wenhui Xu,
Lihong Jiang,
Fan Xiao,
Zhuohang Huang,
Yuanzhu Liang,
Jiayi Liu,
Yuxi Chen,
Yongsheng Luo
Abstract:
Color Fundus Photography (CFP) is a primary non-invasive imaging modality for large-scale screening of ophthalmic and systemic diseases. Existing surveys mainly summarize task-specific algorithms, datasets, or preprocessing techniques independently, lacking a unified perspective on their co-evolution with modern artificial intelligence. This review provides an integrated overview of CFP AI through…
▽ More
Color Fundus Photography (CFP) is a primary non-invasive imaging modality for large-scale screening of ophthalmic and systemic diseases. Existing surveys mainly summarize task-specific algorithms, datasets, or preprocessing techniques independently, lacking a unified perspective on their co-evolution with modern artificial intelligence. This review provides an integrated overview of CFP AI through the interplay of dataset evolution, preprocessing paradigms, and modeling frameworks. We show that CFP datasets have evolved from small single-center collections with task-specific labels to large multi-center resources featuring multimodal pairings and longitudinal clinical records. Preprocessing has progressed from conventional image enhancement to neural data-engineering pipelines, hardware-aware token optimization, and self-supervised imputation for incomplete electronic health records (EHRs). Meanwhile, modeling has advanced from convolutional neural networks (CNNs) to vision foundation models, state space models (SSMs), and multimodal expert architectures. At the multimodal frontier, CFP is increasingly integrated with EHRs and longitudinal patient information, enabling more comprehensive clinical reasoning beyond isolated image analysis. We conclude that future progress depends on the collaborative optimization of datasets, preprocessing, and multimodal modeling, providing a roadmap toward robust clinical deployment, improved cross-domain generalization, and resource-efficient edge intelligence.
△ Less
Submitted 26 July, 2026;
originally announced July 2026.
-
Separating Capability from Permission: A Governance Framework for Agentic AI Autonomy Levels
Authors:
Haining Zheng,
Qian Dong,
Rodolfo K. Depena,
Jonathan D. Bhatia,
Feng Xiao,
Peng Xu
Abstract:
As AI systems increasingly exhibit agentic behavior, discussions of autonomy often conflate what systems are technically capable of doing with what they should be permitted to do in practice. This paper introduces a governance framework that explicitly separates Allowed Autonomy Levels (AAL), which define the degree of autonomy an AI agent is authorized to exercise given risk, oversight, and accou…
▽ More
As AI systems increasingly exhibit agentic behavior, discussions of autonomy often conflate what systems are technically capable of doing with what they should be permitted to do in practice. This paper introduces a governance framework that explicitly separates Allowed Autonomy Levels (AAL), which define the degree of autonomy an AI agent is authorized to exercise given risk, oversight, and accountability considerations, from Autonomous Capability Levels (ACL), which characterize an agent's inherent technical abilities. We present a structured set of autonomy levels spanning reactive execution, decision support, supervised action, goal-directed autonomy, and delegated operational authority, and describe how control, reversibility, and accountability change as autonomy increases. To operationalize this framework, we propose a risk-aware decision process for assigning allowed autonomy, analyze how risk and accountability evolve across autonomy levels, and demonstrate its application through a deployed enterprise data engineering agent, illustrating how a system assessed at a high capability level can be deliberately constrained to a lower allowed autonomy based on risk, reversibility, and organizational readiness. By distinguishing authorization from capability, this work provides practical guidance for the design, deployment, and governance of Agentic AI systems.
△ Less
Submitted 25 July, 2026;
originally announced July 2026.
-
The Extended Ultrahigh-energy Gamma-Ray Emission in the Vicinity of PSR J2238+5903
Authors:
Zhen Cao,
F. Aharonian,
Y. X. Bai,
Y. W. Bao,
D. Bastieri,
X. J. Bi,
Y. J. Bi,
W. Bian,
J. Blunier,
A. V. Bukevich,
C. M. Cai,
W. Y. Cao,
Zhe Cao,
J. Chang,
J. F. Chang,
E. S. Chen,
G. H. Chen,
H. K. Chen,
L. F. Chen,
Liang Chen,
Long Chen,
M. J. Chen,
M. L. Chen,
Q. H. Chen,
S. Chen
, et al. (305 additional authors not shown)
Abstract:
We present a comprehensive analysis of the recently discovered TeV gamma-ray source, LHAASO J2238+5900. Based on data collected from the LHAASO, our fitting results suggest that the source is significantly extended with an angular extension of 0.54° \pm 0.01° and is spatially coincident with the pulsar PSR J2238+5903. Its spectrum is characterized by a power-law with a cutoff at 41.0\pm 3.5 TeV. A…
▽ More
We present a comprehensive analysis of the recently discovered TeV gamma-ray source, LHAASO J2238+5900. Based on data collected from the LHAASO, our fitting results suggest that the source is significantly extended with an angular extension of 0.54° \pm 0.01° and is spatially coincident with the pulsar PSR J2238+5903. Its spectrum is characterized by a power-law with a cutoff at 41.0\pm 3.5 TeV. Additionally, the source exhibits a significant signal of 7.9σabove 100 TeV, implying that it is a PeVatron candidate. While the gamma-ray emission is consistent with a pulsar wind nebula (PWN) scenario, the relatively large extension size also allows for a halo interpretation, potentially caused by electron-positron pairs escaping from the PWN.
△ Less
Submitted 23 July, 2026;
originally announced July 2026.
-
Final assessment of radioactive impurities in the JUNO detector
Authors:
Thomas Adam,
Fengpeng An,
Costas Andreopoulos,
Giuseppe Andronico,
Nikolay Anfimov,
Vito Antonelli,
Tatiana Antoshkina,
João Pedro Athayde Marcondes de André,
Didier Auguste,
Nikita Balashov,
Andrea Barresi,
Davide Basilico,
Eric Baussan,
Marco Beretta,
Antonio Bergnoli,
Nikita Bessonov,
Daniel Bick,
Lukas Bieger,
Svetlana Biktemerova,
Thilo Birkenfeld,
Simon Blyth,
Manuel Böhles,
Anastasia Bolshakova,
Mathieu Bongrand,
Matteo Borghesi
, et al. (549 additional authors not shown)
Abstract:
The Jiangmen Underground Neutrino Observatory (JUNO) collaboration has completed the construction of the 20,000-ton liquid scintillator detector and the associated muon veto detector system. To meet the physics objectives, the materials used in the detector must exhibit low radioactive contamination. The single-event rate in the fiducial volume (R $<$ 17.2 m) of the scintillator is required to be…
▽ More
The Jiangmen Underground Neutrino Observatory (JUNO) collaboration has completed the construction of the 20,000-ton liquid scintillator detector and the associated muon veto detector system. To meet the physics objectives, the materials used in the detector must exhibit low radioactive contamination. The single-event rate in the fiducial volume (R $<$ 17.2 m) of the scintillator is required to be approximately 7 Hz for energies above 0.7 MeV, resulting in an accidental coincidence background of about 1 event per day for reactor neutrino physics analyses. Since the beginning of the construction phase, we have screened the natural radioactivity content of thousands of materials, to select those that meet the design background budget. The radioactive impurity concentrations of the materials ultimately used in the JUNO detector are summarized in this paper. The construction of the entire detector and the subsequent filling of the liquid scintillator were completed in August 2025. From the initial data, the total count rate of natural radioactivity within the detector's fiducial volume has met the requirements and is sufficient to support the reactor antineutrino analysis.
△ Less
Submitted 19 July, 2026;
originally announced July 2026.
-
A Low-energy Threshold and Multi-messenger Trigger System for the JUNO Experiment
Authors:
Thomas Adam,
Fengpeng An,
Costas Andreopoulos,
Giuseppe Andronico,
Nikolay Anfimov,
Vito Antonelli,
Tatiana Antoshkina,
João Pedro Athayde Marcondes de André,
Didier Auguste,
Nikita Balashov,
Andrea Barresi,
Davide Basilico,
Eric Baussan,
Marco Beretta,
Antonio Bergnoli,
Nikita Bessonov,
Daniel Bick,
Lukas Bieger,
Svetlana Biktemerova,
Thilo Birkenfeld,
Simon Blyth,
Manuel Boehles,
Anastasia Bolshakova,
Mathieu Bongrand,
Matteo Borghesi
, et al. (543 additional authors not shown)
Abstract:
The Jiangmen Underground Neutrino Observatory (JUNO) is a 20-kiloton liquid scintillator neutrino detector, located 650 meters (1800 m.w.e.) underground in Jiangmen, Guangdong, China. JUNO is primarily designed for reactor neutrino measurements and has been taking data since 2025. With the largest mass of its kind and an excellent energy resolution, JUNO is a leading observatory for high-precision…
▽ More
The Jiangmen Underground Neutrino Observatory (JUNO) is a 20-kiloton liquid scintillator neutrino detector, located 650 meters (1800 m.w.e.) underground in Jiangmen, Guangdong, China. JUNO is primarily designed for reactor neutrino measurements and has been taking data since 2025. With the largest mass of its kind and an excellent energy resolution, JUNO is a leading observatory for high-precision measurements of MeV neutrinos. The standard global trigger system serves as the primary trigger for JUNO. We present a newly developed multi-messenger trigger system that extends the capabilities of the global trigger by providing a lower energy threshold and an independent monitoring capability. During the 2025 operation, it achieved an effective energy threshold of approximately 110 +/- 10 keV, providing a lower threshold configuration suitable for low-energy event analysis. The system shows the potential to further reduce the threshold to well below 100 keV. Based on the multi-messenger trigger system, an astrophysical monitor has been developed to receive and process external alerts from other messengers, such as gravitational-wave observations. A Transient Neutrino Burst Monitor is integrated to detect short-time-scale neutrino burst events and enables real-time monitoring of transient astrophysical phenomena. The system is sensitive to neutrino bursts from core-collapse supernovae within a distance of about 250 kpc.
△ Less
Submitted 15 July, 2026;
originally announced July 2026.
-
When and How to Ask: Dynamic Preference Elicitation Strategies for Conversational Recommendation
Authors:
Feng Xia,
Shuo Zhang,
Xi Wang
Abstract:
Conversational Recommender Systems (CRSs) are interactive systems that use multi-turn natural language dialogue to understand evolving user preferences and provide personalized recommendations. To achieve this goal, CRSs rely on preference elicitation strategies to actively gather informative preference cues from users; however, the timing and selection of these strategies during a conversation re…
▽ More
Conversational Recommender Systems (CRSs) are interactive systems that use multi-turn natural language dialogue to understand evolving user preferences and provide personalized recommendations. To achieve this goal, CRSs rely on preference elicitation strategies to actively gather informative preference cues from users; however, the timing and selection of these strategies during a conversation remain largely unexplored. While many existing studies emphasize eliciting explicit item attributes and tend to adopt relatively static elicitation strategies, the use of item-based preference elicitation and how it varies across different dialogue stages remains less explored. In this work, we conduct a systematic investigation of preference elicitation strategies from a stage-aware perspective. We provide empirical evidence that optimal preference elicitation strategies are stage-dependent and context-sensitive: attribute-based inquiries are effective in early stages, while item-based strategies become superior as preferences refine. To support this paradigm, we introduce InPE, a dataset enriched with fine-grained annotations for elicitation necessity and strategy selection. With this dataset, we propose COPE (COnversational Preference Elicitation via Mixture of Experts), a novel architecture for strategy modeling. Extensive offline evaluation on our dataset indicates that context-aware preference elicitation strategies are beneficial for conversational recommendation. In addition, the analysis of the predicted strategies uncovers consistent stage-wise tendencies in dialogue progression, providing empirical evidence of common interaction patterns in conversational recommendation systems. Our dataset is available at https://github.com/juanfacabian/InPE.
△ Less
Submitted 7 July, 2026;
originally announced July 2026.
-
DRL-CLBA: A Clean Label Backdoor Attack for Speech Classification via DDPG Reinforcement Learning
Authors:
Yueming Huang,
Wenhan Yao,
Fen Xiao,
Xiarun Chen,
Weiping Wen
Abstract:
Deep learning models for speech classification are vulnerable to backdoor attacks, where malicious triggers cause misclassification at inference time. While sample-specific attacks can bypass many defenses, they often rely on poisoned label attack, making them detectable via manual data defense. In this paper, we propose DRL-CLBA, a novel clean label backdoor attack for speech classification that…
▽ More
Deep learning models for speech classification are vulnerable to backdoor attacks, where malicious triggers cause misclassification at inference time. While sample-specific attacks can bypass many defenses, they often rely on poisoned label attack, making them detectable via manual data defense. In this paper, we propose DRL-CLBA, a novel clean label backdoor attack for speech classification that leverages Deep Deterministic Policy Gradient (DDPG) reinforcement learning. We also utilize deep audio steganography to embed sample-specific triggers into source audio, creating feature-space anchors. The proposed reinforcement learning framework effectively optimizes target samples toward trigger-bearing anchor points in the model's deep latent space, enabling label-migration-free poisoning of target samples. Experimental results across three datasets and four different DNNs demonstrate that DRL-CLBA achieves a high attack success rate, effectively bypassing some backdoor defenses. The attack demonstrates strong resistance against fine-tuning, pruning, and spectral signature defenses, exposing critical vulnerabilities in speech-controlled systems.
△ Less
Submitted 2 July, 2026;
originally announced July 2026.
-
Pmeta-TLA: Backdoor Attacks for Speech Classification Models via Meta-Learning with Timbre Leakage Attack
Authors:
Yueming Huang,
Wenhan Yao,
Fen Xiao,
Xiarun Chen,
Weiping Wen
Abstract:
Recently, speech classification methods have gained widespread adoption in intelligent gadgets. Current study indicates that backdoor attacks provide a substantial security concern to these models, underscoring the pressing necessity to investigate additional potential attack techniques to expose and prevent such risks. This work discusses the vulnerability of current speech triggers to detection…
▽ More
Recently, speech classification methods have gained widespread adoption in intelligent gadgets. Current study indicates that backdoor attacks provide a substantial security concern to these models, underscoring the pressing necessity to investigate additional potential attack techniques to expose and prevent such risks. This work discusses the vulnerability of current speech triggers to detection by deep neural network defenders and introduces the Timbre Leakage Attack (TLA). The suggested trigger disseminates timbre information at the frame level within the deep self-supervised features, producing poisoned samples that appear natural to human perception. Furthermore, we introduce Pmeta-TLA, an innovative training mechanism for embedding numerous backdoors one time. This method proposes a multi-backdoor injection training strategy using meta-learning and Projected Conflicting Gradients (PCGrad) and introduces TLA as a multi-target attack tool within it. We performed tests on data-poisoning backdoor attacks in keyword spotting tasks utilizing some deep neural network models. Experimental results indicate that the proposed strategy attains superior Attack efficacy, enhanced stealthiness, robustness, and a reduced attack cost relative to baseline methods.
△ Less
Submitted 2 July, 2026;
originally announced July 2026.
-
No Prompt, No Leaks: A Robust Generative Steganography Framework via Prompt-Free Diffusion
Authors:
Jingwen Cai,
Fen Xiao,
Shuhua Deng,
Xieping Gao
Abstract:
Generative image steganography synthesizes stego images directly from secret information to achieve inherent security advantages. Latent Diffusion Models (LDMs) have recently emerged as a fundamental image steganography framework that modulates secret latent representations with text prompts. Limited by the inflexibility of text prompts, these methods still struggle to generate high-quality stego…
▽ More
Generative image steganography synthesizes stego images directly from secret information to achieve inherent security advantages. Latent Diffusion Models (LDMs) have recently emerged as a fundamental image steganography framework that modulates secret latent representations with text prompts. Limited by the inflexibility of text prompts, these methods still struggle to generate high-quality stego images and accurately recover secret images. In this work, we propose a prompt-free diffusion image steganography framework that integrates style semantic priors to control more robust and reliable stego image generation. Specifically, a Cascaded Affine Coupling Module (CACM) establishes a bijective, deterministic mapping between a secret image and its latent representation. Then, style semantics are integrated into the diffusion process to control latent representation and ensure visual imperceptibility in the generated stego images. To mitigate trajectory deviations stemming from the unconditioned reverse process, a predictor-corrector mechanism is introduced to iteratively refine the generation trajectory via feedback from the current and predicted next states. Extensive experimental results show that the proposed method achieves competitive performance compared to state-of-the-art methods in terms of security, secret image reconstruction accuracy and controllability.
△ Less
Submitted 30 June, 2026;
originally announced June 2026.
-
Single-Base-Station Indoor Localization via Super-Resolved Relative Power Delay Profiles
Authors:
Fangqing Xiao,
Dirk T. M. Slock
Abstract:
Indoor multipath is shaped by surrounding reflectors, scatterers, and blockages, so a relative power-delay profile (PDP) can serve as a location fingerprint without an identifiable LoS path, angle information, or absolute time-of-arrival ranging. However, a communication receiver observes finitely many noisy pilot-frequency samples rather than an ideal PDP. This paper models the resulting Dirichle…
▽ More
Indoor multipath is shaped by surrounding reflectors, scatterers, and blockages, so a relative power-delay profile (PDP) can serve as a location fingerprint without an identifiable LoS path, angle information, or absolute time-of-arrival ranging. However, a communication receiver observes finitely many noisy pilot-frequency samples rather than an ideal PDP. This paper models the resulting Dirichlet blur, delay folding, and off-grid mismatch, and reconstructs a posterior-power profile using expectation-maximization sparse Bayesian learning. In spatially consistent QuaDRiGa simulations, twofold SBL raises 20-dB Top-1 accuracy from 75.79\% (native PDP) and 87.24\% (threefold zero-padding) to 93.27\%, with 0.392~m mean error.
△ Less
Submitted 25 June, 2026;
originally announced June 2026.
-
AIGP: An LLM-Based Framework for Long-Term Value Alignment in E-Commerce Pricing
Authors:
Chennan Ma,
Yanning Zhang,
Siqi Hong,
Xiuchong Wang,
Fei Xiao,
Keping Yang
Abstract:
Traditional dynamic pricing models in large-scale e-commerce suffer from limited interpretability, poor utilization of unstructured information, and misalignment with long-term business objectives such as cumulative Gross Merchandise Value (GMV), Return on Investment (ROI) and milestone achievement. We propose AIGP, a novel framework that leverages a Large Language Model (LLM) prompted with domain…
▽ More
Traditional dynamic pricing models in large-scale e-commerce suffer from limited interpretability, poor utilization of unstructured information, and misalignment with long-term business objectives such as cumulative Gross Merchandise Value (GMV), Return on Investment (ROI) and milestone achievement. We propose AIGP, a novel framework that leverages a Large Language Model (LLM) prompted with domain knowledge, structured data and textual context to make interpretable, knowledge-aware pricing decisions. For efficient deployment while maintaining high-quality outputs, we employ supervised fine-tuning for knowledge distillation. Central to AIGP is the Long-Term Value Estimator (LTVE), trained via offline reinforcement learning on historical data, which serves as a reward model to score candidate pricing actions and select preference pairs for Direct Preference Optimization (DPO), thereby aligning the pricing policy with long-term business objectives. Extensive offline evaluations and large-scale online A/B tests on Tao Factory demonstrate that AIGP achieves significant improvements: +13.21% in GMV, +7.59% in ROI, and +8.20% in milestone achievement rate over 14 days compared to the production baseline, while simultaneously providing interpretable and transparent pricing rationales.
△ Less
Submitted 25 June, 2026;
originally announced June 2026.
-
Extreme PeV accelerator associated with GRS 1915+105
Authors:
Zhen Cao,
F. Aharonian,
Y. X. Bai,
Y. W. Bao,
D. Bastieri,
X. J. Bi,
Y. J. Bi,
W. Bian,
J. Blunier,
A. V. Bukevich,
C. M. Cai,
Y. Y. Cai,
W. Y. Cao,
Zhe Cao,
J. Chang,
J. F. Chang,
E. S. Chen,
G. H. Chen,
H. K. Chen,
L. F. Chen,
Liang Chen,
Long Chen,
M. J. Chen,
M. L. Chen,
Q. H. Chen
, et al. (304 additional authors not shown)
Abstract:
Microquasars, binary systems featuring relativistic jets, have emerged as sources for particle acceleration beyond PeV energies. We present a study of the broadband $γ$-ray emission from one of the most prominent Galactic microquasars GRS 1915+105 based on data accumulated by LHAASO and Fermi-LAT over 4 and 17 years, respectively. A joint analysis of LHAASO-WCDA and LHAASO-KM2A data reveals extend…
▽ More
Microquasars, binary systems featuring relativistic jets, have emerged as sources for particle acceleration beyond PeV energies. We present a study of the broadband $γ$-ray emission from one of the most prominent Galactic microquasars GRS 1915+105 based on data accumulated by LHAASO and Fermi-LAT over 4 and 17 years, respectively. A joint analysis of LHAASO-WCDA and LHAASO-KM2A data reveals extended $γ$-ray emission whose centroid appears significantly shifted, by ~ 0.13°, from the binary system and its jets. The spectral energy distribution is well described by a curved spectrum with progressive steepening that can be described by a log-parabola function with no evidence for a sharp cutoff, consistent with parent particles reaching multi-PeV energies and an extreme acceleration efficiency approaching the limit set by the available potential drop across the source. Several features, most notably the shift of the emission and single-power-law spectrum down to GeV band, favor radiation by cosmic rays accelerated in the source interacting with the dense ambient medium. Our spectral modeling implies that at least a few percent of the jet mechanical power is transferred to protons, whose maximum energy reaches beyond 5 PeV. These results strengthen the case for microquasars as exceptionally efficient accelerators in our Galaxy.
△ Less
Submitted 25 June, 2026; v1 submitted 23 June, 2026;
originally announced June 2026.
-
DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
Authors:
DeepSeek-AI,
Anyi Xu,
Bangcai Lin,
Bing Xue,
Bingxuan Wang,
Bingzheng Xu,
Bochao Wu,
Bowei Zhang,
Chaofan Lin,
Chen Dong,
Chenchen Ling,
Chengda Lu,
Chenggang Zhao,
Chengqi Deng,
Chengyu Hou,
Chenhao Xu,
Chenze Shao,
Chong Ruan,
Conner Sun,
Damai Dai,
Daya Guo,
Dejian Yang,
Deli Chen,
Donghao Li,
Dongjie Ji
, et al. (294 additional authors not shown)
Abstract:
We present a preview version of DeepSeek-V4 series, including two strong Mixture-of-Experts (MoE) language models -- DeepSeek-V4-Pro with 1.6T parameters (49B activated) and DeepSeek-V4-Flash with 284B parameters (13B activated) -- both supporting a context length of one million tokens. DeepSeek-V4 series incorporate several key upgrades in architecture and optimization: (1) a hybrid attention arc…
▽ More
We present a preview version of DeepSeek-V4 series, including two strong Mixture-of-Experts (MoE) language models -- DeepSeek-V4-Pro with 1.6T parameters (49B activated) and DeepSeek-V4-Flash with 284B parameters (13B activated) -- both supporting a context length of one million tokens. DeepSeek-V4 series incorporate several key upgrades in architecture and optimization: (1) a hybrid attention architecture that combines Compressed Sparse Attention (CSA) and Heavily Compressed Attention (HCA) to improve long-context efficiency; (2) Manifold-Constrained Hyper-Connections (mHC) that enhance conventional residual connections; (3) and the Muon optimizer for faster convergence and greater training stability. We pre-train both models on more than 32T diverse and high-quality tokens, followed by a comprehensive post-training pipeline that unlocks and further enhances their capabilities. DeepSeek-V4-Pro-Max, the maximum reasoning effort mode of DeepSeek-V4-Pro, redefines the state-of-the-art for open models, outperforming its predecessors in core tasks. Meanwhile, DeepSeek-V4 series are highly efficient in long-context scenarios. In the one-million-token context setting, DeepSeek-V4-Pro requires only 27% of single-token inference FLOPs and 10% of KV cache compared with DeepSeek-V3.2. This enables us to routinely support one-million-token contexts, thereby making long-horizon tasks and further test-time scaling more feasible. The model checkpoints are available at https://huggingface.co/collections/deepseek-ai/deepseek-v4.
△ Less
Submitted 26 April, 2026;
originally announced June 2026.
-
A Fourth-order Conservative Adaptive Multiresolution Wavelet Upwind Scheme for Compressible Flows
Authors:
Bing Yang,
Xiaojing Liu,
Youhe Zhou,
Feng Xiao,
Jizeng Wang
Abstract:
A fourth-order conservative adaptive multiresolution average-interpolating wavelet upwind scheme is proposed for compressible flows governed by hyperbolic conservation laws. A family of asymmetric average-interpolating wavelets with upwind properties is constructed for conservative finite volume discretization, while symmetric average-interpolating wavelets are employed for multiresolution decompo…
▽ More
A fourth-order conservative adaptive multiresolution average-interpolating wavelet upwind scheme is proposed for compressible flows governed by hyperbolic conservation laws. A family of asymmetric average-interpolating wavelets with upwind properties is constructed for conservative finite volume discretization, while symmetric average-interpolating wavelets are employed for multiresolution decomposition and reconstruction of physical variables in the adaptive procedure. Since both the conservative discretization and the adaptive multiresolution representation are constructed from cell-average quantities, the proposed scheme preserves strict conservation during both numerical evolution and adaptive cell redistribution. Unlike hybrid adaptive wavelet methods that use wavelets mainly for data compression and mesh adaptation, the present adaptive wavelet upwind scheme utilizes average-interpolating wavelet multiresolution approximation to reconstruct the interface values directly for numerical flux evaluation, thereby avoiding additional ghost-cell marking and reconstruction near coarse--fine mesh interfaces. The boundary variation diminishing reconstruction is incorporated at the finest resolution level to achieve non-oscillatory shock-capturing capability. Numerical tests demonstrate that the proposed scheme achieves the expected fourth-order accuracy, maintains conservation errors close to machine precision, and controls numerical errors around the prescribed threshold. The proposed method also sharply captures shock waves and contact discontinuities without spurious oscillations and resolves multiscale smooth structures through a sparse adaptive representation. These results indicate that the proposed scheme provides an efficient, conservative, and reliable approach for high-resolution simulations of compressible flows.
△ Less
Submitted 16 June, 2026;
originally announced June 2026.
-
Lesion-DDPM: Lesion-Enhanced 3D Diffusion for MS MRI Synthesis
Authors:
Weidong Zhang,
Yongchan Jung,
Shafayat Mowla Anik,
Furen Xiao,
Vasudevan Janarthanan,
Enkhzaya Chuluunbaatar,
Byeong Kil Lee,
Jeeho Ryoo
Abstract:
3D FLAIR MRI is widely recommended as one of the standard MRI sequences for brain imaging in multiple sclerosis (MS), but publicly available MS datasets remain relatively small and vary across scanners, acquisition protocols, and lesion patterns. This scarcity and variability hinder the development of robust neuroimaging machine learning models and are particularly challenging for generative model…
▽ More
3D FLAIR MRI is widely recommended as one of the standard MRI sequences for brain imaging in multiple sclerosis (MS), but publicly available MS datasets remain relatively small and vary across scanners, acquisition protocols, and lesion patterns. This scarcity and variability hinder the development of robust neuroimaging machine learning models and are particularly challenging for generative models that aim to synthesize images while preserving small, sparse lesions. We propose Lesion-DDPM, a 3D conditional diffusion framework for lesion-aware FLAIR synthesis that incorporates multi-level anatomical mask injection together with a lesion-weighted reconstruction loss to emphasize lesion voxels while maintaining global brain structure. Using a curated subset of the MSLesSeg dataset, we compare Lesion-DDPM with representative state-of-the-art GAN- and diffusion-based models, assessing both image-generation metrics and downstream 3D U-Net segmentation. In our experiments, Lesion-DDPM achieved the lowest lesion-region reconstruction error among all methods. In a downstream 3D U-Net lesion segmentation task, a model trained only on Lesion-DDPM-generated scans and evaluated on real MRIs reached a Dice score of 0.616 compared with 0.569 for the best competing synthetic dataset. When Lesion-DDPM images were added to the real training set, the Dice score further increased to 0.685.
△ Less
Submitted 13 June, 2026;
originally announced June 2026.
-
Generalization Hacking: Models Can Game Reinforcement Learning by Preventing Behavioral Generalization
Authors:
Frank Xiao,
Mary Phuong
Abstract:
Model post-training, and in particular reinforcement learning (RL), is one of the primary mechanisms by which developers can shape models' values and behaviors. However, as models become increasingly evaluation and training aware, they may be motivated to resist training when the perceived objective conflicts with their current values, undermining developers' ability to detect misalignment and cor…
▽ More
Model post-training, and in particular reinforcement learning (RL), is one of the primary mechanisms by which developers can shape models' values and behaviors. However, as models become increasingly evaluation and training aware, they may be motivated to resist training when the perceived objective conflicts with their current values, undermining developers' ability to detect misalignment and correct model behavior through further training. In this paper, we demonstrate generalization hacking, in which a model collects reward during RL while preventing the rewarded behavior from generalizing. We construct a model organism on Qwen3-235B-A22B, finetuning on synthetic documents describing training awareness and self-inoculation, a novel mechanism in which the model frames compliance as context-specific in its chain of thought, without demonstrating or instructing either behavior. The model organism achieves train-time harmfulness comparable to controls while maintaining a persistent ${\sim}15$ percentage point compliance gap across 700 steps of RL. Additionally, a control organism trained only on training awareness documents independently discovers inoculation-like reasoning under RL pressure, developing its own compliance gap despite never being exposed to the concept. Because the generalization-hacking organism receives high reward throughout, standard training metrics provide no signal that generalization has failed. Our results constitute the first demonstration that a model can actively resist RL behavioral modification while maintaining high reward, suggesting that as models become more capable and training-aware, they may be able to undermine the training process itself.
△ Less
Submitted 10 June, 2026;
originally announced June 2026.
-
Bootstrapped Monitoring: Leveraging Transparent Reasoning to Oversee Stronger AI Agents
Authors:
Frank Xiao,
Mary Phuong
Abstract:
Trusted monitoring is a cornerstone of AI control. However, as frontier models grow more capable, the increasing capabilities gap between trusted and untrusted models may render trusted models unreliable monitors. We introduce \emph{bootstrapped monitoring}, a protocol that addresses this by inserting a stronger, intermediate untrusted model with transparent chain-of-thought reasoning into the ove…
▽ More
Trusted monitoring is a cornerstone of AI control. However, as frontier models grow more capable, the increasing capabilities gap between trusted and untrusted models may render trusted models unreliable monitors. We introduce \emph{bootstrapped monitoring}, a protocol that addresses this by inserting a stronger, intermediate untrusted model with transparent chain-of-thought reasoning into the oversight chain. The untrusted monitor ($U_m$) evaluates the agent's actions, while a weaker trusted model ($T$) oversees $U_m$'s reasoning to detect collusion. We evaluate bootstrapped monitoring on multi-turn software engineering tasks (BashArena) across multiple agents and monitors. Bootstrapped monitoring substantially improves catch rates over trusted-only monitoring, even when the untrusted monitor actively colludes with the agent, provided we have access to its raw chain-of-thought. Our results suggest that bootstrapped monitoring can extend the useful lifetime of trusted models in control as AI capabilities advance.
△ Less
Submitted 10 June, 2026;
originally announced June 2026.
-
ERAlign: Energy-based Representation Alignment of GNNs and LLMs on Text-attributed Graphs
Authors:
Xianlin Zeng,
Fan Xia,
Xiangyu Chen
Abstract:
Text-attributed Graphs (TAGs) incorporate textual node attributes with graph structures to describe rich relational semantics. Recent efforts to integrate Graph Neural Networks (GNNs) and Large Language Models (LLMs) have shown promise for learning on TAGs, yet achieving well-aligned representations remains challenging. Prior studies largely rely on heuristics that perform coarse-grained matching.…
▽ More
Text-attributed Graphs (TAGs) incorporate textual node attributes with graph structures to describe rich relational semantics. Recent efforts to integrate Graph Neural Networks (GNNs) and Large Language Models (LLMs) have shown promise for learning on TAGs, yet achieving well-aligned representations remains challenging. Prior studies largely rely on heuristics that perform coarse-grained matching. They lack sufficient constraints and ignore distributional alignment, leading to representation drift and limited generalization. Building on Energy-based Models (EBMs), we propose an Energy-based Representation Alignment (ERAlign) framework that projects GNN-encoded graph structure and LLM-derived text embeddings in a shared latent space to achieve distribution consistency. Concretely, layer-wise alignment is quantified by a distance metric and optimized via an EBM objective. By decreasing energy values, our framework yields well-aligned representations for downstream tasks. During training, we introduce Energy Discrepancy (ED) to avoid high sampling costs associated with intractable normalization. ED also carries theoretical guarantees of higher training efficiency and reduced energy landscape distortion. Empirical evaluations on eight TAG datasets demonstrate that ERAlign obtains state-of-the-art performance across varying levels of supervision and cross-task transfer scenarios.
△ Less
Submitted 9 June, 2026;
originally announced June 2026.
-
Gaussian-Process Dynamics of Diagonal Expectation Propagation under Variance-Profile Gaussian Measurements
Authors:
Fangqing Xiao,
Dirk T. M. Slock
Abstract:
State-evolution analyses of approximate-message-passing and expectation-propagation-type algorithms rely on an effective-channel principle: after a suitable Onsager, orthogonal, or extrinsic correction, the nonlinear module receives a fresh scalar Gaussian observation. This paper studies this principle for diagonal expectation propagation under variance-profile Gaussian sensing matrices. The model…
▽ More
State-evolution analyses of approximate-message-passing and expectation-propagation-type algorithms rely on an effective-channel principle: after a suitable Onsager, orthogonal, or extrinsic correction, the nonlinear module receives a fresh scalar Gaussian observation. This paper studies this principle for diagonal expectation propagation under variance-profile Gaussian sensing matrices. The model preserves Gaussian conditioning, but removes the isotropy that supports the usual scalar decoupling arguments. We prove a finite-time large-system description in which the linear EP module remains Gaussian at the coordinate level, but is generally not a fresh scalar channel. Instead, the residuals form a coordinate-dependent Gaussian process whose covariance is shaped by the variance profile and by the finite linear history of the algorithm. The standard diagonal EP cavity cancels the instantaneous response of the incoming message, but may leave a component predictable from past residuals. We characterize this process through a conditioned matrix-Dyson-equation deterministic equivalent and a Schur-complement representation of the linear module. A Gaussian-regression decomposition then separates the predictable memory from the orthogonal innovation and yields an oracle state-evolution-level correction. Thus, under variance-profile measurements, the limiting object for diagonal EP is a Gaussian-process dynamics with profile-dependent memory rather than the conventional fresh-noise scalar state evolution.
△ Less
Submitted 3 June, 2026;
originally announced June 2026.
-
Representation Forcing for Bottleneck-Free Unified Multimodal Models
Authors:
Yuqing Wang,
Zhijie Lin,
Ceyuan Yang,
Yang Zhao,
Fei Xiao,
Hao He,
Qi Zhao,
Zihan Ding,
Fuyun Wang,
Shuai Wang,
Youliang Zhang,
Haoqi Fan,
Xihui Liu
Abstract:
Unified multimodal models (UMMs) aim to handle perception and generation in a single model. Yet existing UMMs still rely on a frozen, separately pretrained VAE for image generation, imposing a structural bottleneck. Naively removing it introduces a quality gap, as the model must learn both high-level structure and low-level details from raw pixels. In this paper, we propose Representation Forcing…
▽ More
Unified multimodal models (UMMs) aim to handle perception and generation in a single model. Yet existing UMMs still rely on a frozen, separately pretrained VAE for image generation, imposing a structural bottleneck. Naively removing it introduces a quality gap, as the model must learn both high-level structure and low-level details from raw pixels. In this paper, we propose Representation Forcing (RF), a technique that closes this gap by making representation prediction a native capability of the model. Concretely, RF forces the decoder to autoregressively predict visual representations as intermediate tokens before pixels; these tokens then stay in context to guide pixel diffusion within the same backbone. By turning representations from perception outputs into generation targets, RF eliminates the need for any external generative latent space. We find that RF benefits both understanding and generation. On image generation, our pixel-space model with RF matches state-of-the-art VAE-based unified models. On image understanding, pixel-space RF generally outperforms its VAE-based variant. Together, these results offer an effective step toward end-to-end, bottleneck-free UMMs.
△ Less
Submitted 3 July, 2026; v1 submitted 29 May, 2026;
originally announced May 2026.
-
Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoning
Authors:
Chun-Hsiao Yeh,
Shengyi Qian,
Manchen Wang,
Yi Ma,
Joseph Tighe,
Fanyi Xiao
Abstract:
Vision-Language Models (VLMs) often struggle with robust 3D spatial reasoning. Prevailing methods that rely on fine-tuning with 3D visual question-answering (VQA) datasets may overfit dataset-specific biases, while integrating specialized 3D visual encoders is often inflexible and cumbersome. In this paper, we argue that genuine spatial understanding should emerge from learning fundamental geometr…
▽ More
Vision-Language Models (VLMs) often struggle with robust 3D spatial reasoning. Prevailing methods that rely on fine-tuning with 3D visual question-answering (VQA) datasets may overfit dataset-specific biases, while integrating specialized 3D visual encoders is often inflexible and cumbersome. In this paper, we argue that genuine spatial understanding should emerge from learning fundamental geometric priors, not only from high-level VQA supervision. We propose GASP (Geometric-Aware Spatial Priors), a framework that injects these priors directly into the LLM's transformer layers. GASP employs a small correspondence head, applied as a deep supervision signal across all layers, and is trained with a dual objective leveraging ground-truth geometry from large-scale video scenes: a contrastive loss on ground-truth point correspondences enforces 2D view-invariance, while a depth consistency supervision resolves 3D geometric ambiguities. Our analysis first provides a diagnostic showing that standard VLMs' internal correspondence matching accuracy is very low (often below 5%). We then demonstrate that our training substantially improves this behavior, boosting peak layer-wise correspondence to over 70% and maintaining over 85% temporal robustness while baselines remain below 5%. These internal improvements translate to significant gains on downstream spatial benchmarks including +18.2% on All-Angles Bench and +29.0% on VSI-Bench, all without training on any 3D VQA data. Our findings indicate that learning from fundamental geometric priors is a promising and generalizable pathway towards VLMs with more reliable 3D spatial reasoning.
△ Less
Submitted 28 May, 2026;
originally announced May 2026.
-
CLUBench: A Clustering Benchmark
Authors:
Feng Xiao,
Dazhi Fu,
Chris Ding,
Jicong Fan
Abstract:
Clustering is a fundamental problem in data science with a long-standing research history, yielding numerous insightful algorithms. Despite this progress, a systematic and large-scale empirical evaluation that jointly considers conventional algorithms, deep learning-based methods, and recent foundation model-based clustering remains largely absent, leading to limited guidance on algorithm selectio…
▽ More
Clustering is a fundamental problem in data science with a long-standing research history, yielding numerous insightful algorithms. Despite this progress, a systematic and large-scale empirical evaluation that jointly considers conventional algorithms, deep learning-based methods, and recent foundation model-based clustering remains largely absent, leading to limited guidance on algorithm selection and deployment. To address this gap, we introduce CLUBench, a comprehensive clustering benchmark comprising 24 algorithms of diverse principles evaluated on 131 datasets across tabular, text, and image data, involving 178,815 experiments. Importantly, our analyses of (i) the impact of hyperparameter tuning,(ii) the impact of data types and characteristics,(iii) the impact of pretrained embeddings,(iv) large language model-based clustering,(v) the similarity of algorithms, and (vi) the low-rank structures of performance matrices, yield meaningful insights and promising pathways for clustering research. For instance, our study reveals that: 1) All evaluated deep clustering methods do not exhibit a significant advantage compared with the top-performing conventional clustering algorithms (e.g., KMeans, SpeClu) in terms of average performance; 2) For image and text clustering tasks, combining pretrained embeddings with conventional clustering algorithms (e.g., KMeans, SpeClu) offers effective and efficient clustering; 3) Clustering remains a challenging and nontrivial problem, even in the era of increasingly dominant foundation models. Moreover, we propose to use the low-rank structure in cross-model performance matrices to efficiently approximate the overall performance evaluation in practical applications. We further demonstrate the feasibility of model selection based on the performance matrices across all hyperparameter configurations.
△ Less
Submitted 28 May, 2026;
originally announced May 2026.
-
Robustness Enhancement of Consensus Networks: the Optimal Memory Depth
Authors:
Jiamin Wang,
Jian Liu,
Feng Xiao,
Haibin Duan,
Yuanshi Zheng
Abstract:
Understanding what governs collective robustness and how it can be enhanced remains a central pursuit in network science. This paper investigates the robustness of multi-agent consensus networks, quantified by the $H_2$ performance metric, and delves into the enhancing effect of agents' local memory on it. Inspired by the hierarchical temporal structure of memory observed in neuroscience, we focus…
▽ More
Understanding what governs collective robustness and how it can be enhanced remains a central pursuit in network science. This paper investigates the robustness of multi-agent consensus networks, quantified by the $H_2$ performance metric, and delves into the enhancing effect of agents' local memory on it. Inspired by the hierarchical temporal structure of memory observed in neuroscience, we focus on the role of memory depth, which reflects the temporal features of memory from recent to remote. Building on linear extrapolation, we propose a consensus protocol with single-step memory and tunable memory depth, derive the necessary and sufficient condition for achieving consensus, and show that the protocol exhibits an inheritable consensus property across memory depths. Furthermore, analytical expressions for the $H_2$ performance metric, which depend on the memory factor, memory depth, coupling gain, and Laplacian spectrum, are established. Under balanced usage of real-time and memory information, we demonstrate that memory at any accessible depth enhances $H_2$ performance, and the optimal memory depth occurs at either the most recent or the most remote memory, contingent upon certain parameter regions. Further detailed discussions are provided to clarify the broader implications of our findings.
△ Less
Submitted 28 May, 2026;
originally announced May 2026.
-
RASC: Region-Aware Self-Calibration for Dense 2D Sensor Arrays
Authors:
Yinglei Ma,
Fei Xiao
Abstract:
BJT-based 2D temperature-sensor arrays are factory-calibrated to +/-0.1 degC, but post-deployment thermal and mechanical stresses drift their per-sensor gain-offset parameters by an order of magnitude, and in-lab recalibration is impractical. We present RASC (Region-Aware Self-Calibration), a five-stage algorithm that decomposes the global ill-posed problem into local cluster-level problems, runs…
▽ More
BJT-based 2D temperature-sensor arrays are factory-calibrated to +/-0.1 degC, but post-deployment thermal and mechanical stresses drift their per-sensor gain-offset parameters by an order of magnitude, and in-lab recalibration is impractical. We present RASC (Region-Aware Self-Calibration), a five-stage algorithm that decomposes the global ill-posed problem into local cluster-level problems, runs robust alternating estimation (trimmed-mean field reconstruction + Huber IRLS) inside each cluster, and reconciles overlapping estimates by linear consensus on the cluster-overlap graph with provable exponential convergence. On 7,632 frames from a deployed 16x16 array exhibiting ~5x factory-spec non-uniformity, RASC cuts the locally-non-smooth fixed-pattern residual by 71+/-5% (10-fold CV), restoring +/-0.1 degC accuracy while perturbing the calibrated field by only 0.041 degC RMSE; reduction concentrates at the edges (78% vs 55% interior). In simulations on 8x8 to 32x32 arrays, RASC matches an oracle centralized EKF within 0.10 degC with ~4x lower bandwidth.
△ Less
Submitted 12 May, 2026;
originally announced May 2026.
-
Resolving Long-Tail Ambiguity in Unsupervised 3D Point Cloud Segmentation with Language Priors
Authors:
Siqi Wei,
Hongbin Xu,
Feng Xiao,
Tian Lan,
Chun Li,
Ming Li,
Qiuxia Wu
Abstract:
Existing approaches for unsupervised 3D point cloud segmentation predominantly rely on a purely visual similarity-based learning-by-clustering paradigm, which suffers from a fundamental limitation: long-tail ambiguity. In such a paradigm, features of minor classes are consistently absorbed by dominant clusters, leading to severely imbalanced predictions. To address this issue, we propose LangTail,…
▽ More
Existing approaches for unsupervised 3D point cloud segmentation predominantly rely on a purely visual similarity-based learning-by-clustering paradigm, which suffers from a fundamental limitation: long-tail ambiguity. In such a paradigm, features of minor classes are consistently absorbed by dominant clusters, leading to severely imbalanced predictions. To address this issue, we propose LangTail, a language-guided hierarchical learning framework that leverages the balanced world knowledge encoded in language models to mitigate long-tail ambiguity in unsupervised 3D segmentation. The key idea is to establish multi-level associations between language-derived semantic priors and visually underrepresented minor classes, thereby compensating for the biased attention of purely visual clustering toward dominant classes. Specifically, LangTail first constructs an entity-level semantic prior from language models, capturing balanced and fine-grained world knowledge across categories. These priors are injected into a hierarchical clustering framework via contrastive alignment. This guides multi-granularity semantic structure formation and prevents minor classes from being absorbed by dominant clusters, yielding more discriminative representations for underrepresented categories. Extensive experiments on ScanNet-v2, S3DIS, and nuScenes demonstrate that LangTail consistently outperforms existing methods by significant margins, \ie, +13.5, +12.9, and +8.9 mIoU, respectively. These results demonstrate the effectiveness of language priors in improving the representation of minority classes in 3D point clouds. The code will be released at: https://github.com/Whisky0129/langtail_official.
△ Less
Submitted 20 May, 2026;
originally announced May 2026.
-
ST-TGExplainer: Disentangling Stability and Transition Patterns for Temporal GNN Interpretability
Authors:
Hongjiang Chen,
Xin Zheng,
Pengfei Jiao,
Huan Liu,
Zhidong Zhao,
Huaming Wu,
Feng Xia,
Shirui Pan
Abstract:
Temporal graph neural networks (TGNNs) have gained significant traction for solving real-world temporal graph tasks. However, their interpretability remains limited, as most TGNNs fail to identify which historical interactions most influence a given prediction. Despite promising progress on interpretable TGNNs, existing methods predominantly focus on previously seen historical interactions, which…
▽ More
Temporal graph neural networks (TGNNs) have gained significant traction for solving real-world temporal graph tasks. However, their interpretability remains limited, as most TGNNs fail to identify which historical interactions most influence a given prediction. Despite promising progress on interpretable TGNNs, existing methods predominantly focus on previously seen historical interactions, which we term stability patterns, while overlooking newly emerging first-time interactions, which we term transition patterns. Both types of patterns are essential for faithful temporal explanations. To address this limitation, we propose ST-TGExplainer, a self-explainable TGNN that disentangles Stability and Transition patterns in temporal graphs for a more faithful Temporal GNN Explainer. Guided by a disentangled information bottleneck objective, ST-TGExplainer learns a compact explanatory subgraph that remains predictive of the event label while explicitly suppressing label-conditioned redundancy between stability and transition patterns. Extensive experiments demonstrate that ST-TGExplainer achieves strong predictive performance and yields more faithful explanations. Code is available at https://github.com/hjchen-hdu/ST-TGExplainer.
△ Less
Submitted 19 May, 2026;
originally announced May 2026.
-
TERGAD: Structure-Aware Text-Enhanced Representations for Graph Anomaly Detection
Authors:
Wen Shi,
Zhe Wang,
Huafei Huang,
Qing Qing,
Ziqi Xu,
Qixin Zhang,
Xikun Zhang,
Renqiang Luo,
Feng Xia
Abstract:
Graph Anomaly Detection (GAD) aims to identify atypical graph entities, such as nodes, edges, or substructures, that deviate significantly from the majority. While existing text-rich approaches typically integrate structural context into the data representation pipeline using raw textual features, they often neglect the structural context of nodes. This limitation hinders their ability to detect s…
▽ More
Graph Anomaly Detection (GAD) aims to identify atypical graph entities, such as nodes, edges, or substructures, that deviate significantly from the majority. While existing text-rich approaches typically integrate structural context into the data representation pipeline using raw textual features, they often neglect the structural context of nodes. This limitation hinders their ability to detect sophisticated anomalies arising from inconsistencies between a node's inherent content and its topological role. To bridge this gap, we propose TERGAD (Structure-aware Text-enhanced Representations for Graph Anomaly Detection), A novel data augmentation framework that enriches structural semantics for GAD via the semantic reasoning capabilities of Large Language Models (LLMs). Specifically, TERGAD translates node-level topological properties into descriptive natural language narratives, which are subsequently processed by an LLM to derive high-level semantic embeddings. These embeddings are then adaptively fused with original node attributes through a gated dual-branch autoencoder to jointly reconstruct both graph structure and node features. The anomaly score is computed based on the integrated reconstruction error, effectively capturing deviations in both observable attributes and LLM-informed semantic expectations. Extensive experiments on six real-world datasets demonstrate that TERGAD consistently outperforms state-of-the-art baselines. Furthermore, our ablation studies validate the indispensable role of structural semantic guidance and the efficacy of the gated fusion mechanism. Code is available at https://github.com/Kantorakitty/TERGAD-main.
△ Less
Submitted 19 May, 2026;
originally announced May 2026.
-
iDiff: Interpretable Difference-aware Framework for Pairwise Image Quality Assessment
Authors:
Xinli Yue,
JianHui Sun,
Tao Shao,
Liangchao Yao,
Fan Xia,
Yuetang Deng
Abstract:
Pairwise image quality assessment (IQA) in professional photography requires a model not only to identify the preferred image between two candidates, but also to provide convincing and image-grounded reasoning. In the NTIRE 2026 RAIM challenge, this requirement is further emphasized by jointly evaluating preference prediction and rationale generation. To address this task, we propose iDiff, an Int…
▽ More
Pairwise image quality assessment (IQA) in professional photography requires a model not only to identify the preferred image between two candidates, but also to provide convincing and image-grounded reasoning. In the NTIRE 2026 RAIM challenge, this requirement is further emphasized by jointly evaluating preference prediction and rationale generation. To address this task, we propose iDiff, an Interpretable Difference-aware framework for pairwise image quality assessment. Our method adopts a dual-branch design consisting of an Answer Model and a Thinking Model. The Answer Model performs robust preference prediction by explicitly decomposing each sample into left/right global and local views, followed by content-aware specialization for person and scene images and ensemble-based aggregation across backbones. The Thinking Model focuses on rationale generation and is progressively enhanced with expert-style templates, multi-source quality features, and answer-aware supervision conditioned on the Answer Model prediction. In this way, iDiff jointly models discriminative decision making and structured explanation, improving both robustness and interpretability. Extensive experiments demonstrate the effectiveness of the proposed framework on both accuracy and reasoning-quality metrics. Our method achieved first place in the NTIRE 2026 RAIM challenge, showing the effectiveness of integrating explicit difference modeling with structured multimodal reasoning for pairwise IQA.
△ Less
Submitted 19 May, 2026;
originally announced May 2026.
-
Generative Auto-Bidding with Unified Modeling and Exploration
Authors:
Mingming Zhang,
Feiqing Zhuang,
Na Li,
Shengjie Sun,
Xiaowei Chen,
Junxiong Zhu,
Fei Xiao,
Keping Yang,
Lixin Zou,
Chenliang Li
Abstract:
Automated bidding is central to modern digital advertising. Early rule-based methods lacked adaptability, while subsequent Reinforcement Learning approaches modeled bidding as a Markov Decision Process but struggled with long-term dependencies. Recent generative models show promise, yet they lack explicit mechanisms to balance exploration and safety, relying solely on action perturbations or traje…
▽ More
Automated bidding is central to modern digital advertising. Early rule-based methods lacked adaptability, while subsequent Reinforcement Learning approaches modeled bidding as a Markov Decision Process but struggled with long-term dependencies. Recent generative models show promise, yet they lack explicit mechanisms to balance exploration and safety, relying solely on action perturbations or trajectory guidance without a safety fallback. This results in inefficient exploration and elevated financial risk for advertising platforms.
To address this gap, we propose GUIDE (Generative Auto-Bidding with Unified Modeling and Exploration), a framework that synergistically integrates directed exploration with a safe fallback mechanism. GUIDE employs a Decision Transformer (DT) to jointly model historical bidding actions and environmental state transitions. A Q-value module guides the DT's exploration via regularization constraints, while an Inverse Dynamics Module (IDM) leverages DT-predicted future states to infer robust, behaviorally consistent actions as a safe policy fallback. The Q-value module then adaptively selects the final action between these two options, balancing exploration and safety. Together, these components form an integrated "explore-safeguard-select" pipeline that unifies efficiency and safety.
We conduct extensive experiments on public datasets, in simulated auction environments, and through large-scale online deployment on Taobao, a leading Chinese advertising platform. Results show GUIDE consistently outperforms state-of-the-art baselines across all scenarios. In real-world deployment, GUIDE achieves notable gains: +4.10% ad GMV, +1.40% ad clicks, +1.66% ad cost, and +3.52% ad ROI, demonstrating its effectiveness and strong industrial applicability.
△ Less
Submitted 19 May, 2026;
originally announced May 2026.
-
Towards Sustainable Growth: A Multi-Value-Aware Retrieval Framework for E-Commerce Search
Authors:
Yifan Wang,
Yixuan Wang,
YiDan Liang,
Qiang Liu,
Fei Xiao
Abstract:
New item growth is critical for maintaining a healthy ecosystem in large-scale e-commerce platforms. However, existing systems tend to prioritize presenting users with already popular items, a phenomenon often referred to as the "Matthew effect". In the context of search retrieval, current cold-start models suffer from the misalignment between training objectives and online business metrics, and t…
▽ More
New item growth is critical for maintaining a healthy ecosystem in large-scale e-commerce platforms. However, existing systems tend to prioritize presenting users with already popular items, a phenomenon often referred to as the "Matthew effect". In the context of search retrieval, current cold-start models suffer from the misalignment between training objectives and online business metrics, and they lack effective mechanisms to measure an item's growth potential. In this paper, we propose a Multi-Value-Aware retrieval framework tailored for e-commerce search, designed to better align with the cascaded online values across different stages of the search system while balancing immediate conversion and long-term item growth. Our framework GrowthGR consists of two key components: an Item Long-term Transaction Value Prediction (ItemLTV) module and a Multi-Value-Aware Generative Retrieval (MultiGR) module. First, in the ItemLTV module, we employ counterfactual inference to quantify the long-term value increment attributable to a single user interaction. Second, in the MultiGR module, building upon a semantic-ID-based generative retrieval architecture, we leverage structured samples with the search cascade signals and adopt a Multi-Value-Aware Policy Optimization (MoPO) training paradigm to align with multi-stage online values, while explicitly balancing short-term transactional value and long-term growth potential estimated by ItemLTV. We successfully deployed GrowthGR on Taobao's production platform, achieving a substantial 5.3% lift in new item GMV while delivering a non-trivial 0.3% gain in overall search GMV. Extensive online analysis and A/B testing demonstrate its positive impact on the overall ecosystem value.
△ Less
Submitted 18 May, 2026;
originally announced May 2026.
-
TTE-Flash: Accelerating Reasoning-based Multimodal Representations via Think-Then-Embed Tokens
Authors:
Jianpeng Cheng,
Xian Wu,
Jiangfan Zhang,
Wentao Bao,
Chaitanya Ahuja,
Shlok Kumar Mishra,
Hanchao Yu,
Yang Gao,
Fan Xia,
Qi Guo,
Shaodan Zhai,
Xiangjun Fan,
Jun Xiao
Abstract:
Recent research has demonstrated that Universal Multimodal Embedding (UME) benefits significantly from Chain-of-Thought (CoT) reasoning. In this paradigm, a generative model produces explicit reasoning traces for a multimodal query, with the final representation extracted from an <eos> embedding token attending to both the query and the reasoning. Despite its effectiveness, the computational overh…
▽ More
Recent research has demonstrated that Universal Multimodal Embedding (UME) benefits significantly from Chain-of-Thought (CoT) reasoning. In this paradigm, a generative model produces explicit reasoning traces for a multimodal query, with the final representation extracted from an <eos> embedding token attending to both the query and the reasoning. Despite its effectiveness, the computational overhead of generating explicit CoT traces is often prohibitive. In this work, we propose replacing explicit CoT with latent think tokens, which are interpreted as latent variables that can produce explicit CoT traces as observed variables. By optimizing think tokens using CoT generation loss and subsequent embedding tokens using contrastive loss, we produce high-performance, reasoning-aware representations at a constant inference cost. Our study investigates two key architectural designs: 1) how think and embeddings tokens should be extracted from the same LLM backbone. 2) how the tokens should be trained as two dependent tasks. We introduce TTE-Flash-2B, a reasoning-aware multimodal representation model that outperforms its explicit-CoT counterpart on the MMEB-v2 benchmark, while producing latent think tokens that are interpretable both textually and visually. Furthermore, zero-shot evaluation across 15 video datasets reveals scaling behavior as the number of think tokens increases, and motivating a pilot study of adaptive think budget allocation based on task requirements.
△ Less
Submitted 15 May, 2026;
originally announced May 2026.
-
RIDE: Retinex-Informed Decoupling for Exposing Concealed Objects
Authors:
Chunming He,
Rihan Zhang,
Dingming Zhang,
Chengyu Fang,
Longxiang Tang,
Jingjia Feng,
Fengyang Xiao,
Sina Farsiu
Abstract:
Concealed Object Segmentation (COS) encompasses a family of dense-prediction tasks, including camouflaged object detection, polyp segmentation, transparent object detection, and industrial defect inspection, where targets are visually entangled with their surroundings through different physical mechanisms. Existing methods either operate directly on RGB images or employ \emph{heterogeneous} decomp…
▽ More
Concealed Object Segmentation (COS) encompasses a family of dense-prediction tasks, including camouflaged object detection, polyp segmentation, transparent object detection, and industrial defect inspection, where targets are visually entangled with their surroundings through different physical mechanisms. Existing methods either operate directly on RGB images or employ \emph{heterogeneous} decompositions (\eg, Fourier, wavelet) that redistribute spatial evidence across scale/frequency coefficients, making pixel-aligned cues less direct. We introduce a fundamentally different perspective: \textbf{homogeneous image decomposition} via Retinex theory, which factorizes an image into illumination and reflectance components within the \emph{same} spatial domain. Our key insight is that visual entanglement enforces appearance matching in the composite space, but this does \emph{not} necessitate simultaneous matching in both component spaces, a phenomenon we formalize as the \textbf{Discriminability Gap Theorem}. Crucially, we show that across diverse COS sub-tasks, the underlying physical processes systematically anti-correlate illumination and reflectance differences, yielding theoretical guarantees that Retinex decomposition preserves or strictly improves total foreground--background discriminability across the full physical regime, with anti-correlation maximizing the gain. Building on this, we propose \textbf{RIDE} comprising: (i) a Task-Driven Retinex Decomposition module that learns segmentation-optimal factorizations end-to-end; (ii) a Discriminability Gap Attention mechanism that adaptively exploits where decomposition helps; and (iii) a Camouflage-Breaking Contrastive loss operating in reflectance feature space.
△ Less
Submitted 14 May, 2026;
originally announced May 2026.
-
Causal Discovery via Statistical Power (CDSP)
Authors:
Shreya Prakash,
Fan Xia,
Elena A. Erosheva
Abstract:
Causal discovery methods aim to infer causal direction from observational data. Functional causal discovery approaches use structural asymmetries to identify causal directionality but rely on strong modeling assumptions and provide limited tools for uncertainty quantification. We introduce Causal Discovery via Statistical Power (CDSP), a statistical inference framework that connects causal directi…
▽ More
Causal discovery methods aim to infer causal direction from observational data. Functional causal discovery approaches use structural asymmetries to identify causal directionality but rely on strong modeling assumptions and provide limited tools for uncertainty quantification. We introduce Causal Discovery via Statistical Power (CDSP), a statistical inference framework that connects causal direction estimation with statistical power and enables uncertainty quantification. Considering the foundational setting of bivariate observational data, we show how quantities analogous to statistical power and effect size can be used in causal discovery to determine when data contain sufficient information to favor one direction over the other. We introduce the effect-size asymmetry assumption that characterizes when the probability of correctly detecting the causal direction (i.e., the power of causal discovery) exceeds that of incorrectly favoring the reverse direction. We show that the effect-size asymmetry assumption can be used for causal direction estimation with uncertainty quantification. Simulations show that CDSP direction estimation is robust to mild and moderate model misspecifications. Real data analyses on 100 cause-effect benchmark pairs further demonstrate that CDSP reduces false discovery rates by approximately 18% relative to a commonly used existing method.
△ Less
Submitted 13 May, 2026;
originally announced May 2026.
-
Bridging Sequence and Graph Structure for Epigenetic Age Prediction
Authors:
Yao Li,
Xikun Zhang,
Xiaotao Shen,
Sonika Tyagi,
Xin Zheng,
Jiaxing Huang,
Feng Xia
Abstract:
Epigenetic clocks based on DNA methylation have emerged as powerful tools for estimating biological age, with broad applications in aging research, age-related disease studies, and longevity science. Despite advances across machine learning approaches to epigenetic age prediction, spanning penalised linear regression, deep feedforward networks, residual architectures, and graph neural networks, no…
▽ More
Epigenetic clocks based on DNA methylation have emerged as powerful tools for estimating biological age, with broad applications in aging research, age-related disease studies, and longevity science. Despite advances across machine learning approaches to epigenetic age prediction, spanning penalised linear regression, deep feedforward networks, residual architectures, and graph neural networks, no existing method jointly models co-methylation graph structure and site-specific DNA sequence context within a unified framework. We propose a unified sequence--graph integration framework for epigenetic age prediction that addresses this gap, integrating eight-dimensional DNA sequence statistical features through a lightweight gated modulation mechanism that adaptively scales each site's methylation signal according to its sequence-determined biological relevance prior to graph convolution. Evaluated on 3,707 blood methylation samples against a comprehensive set of baselines, our method achieves a test MAE of 3.149 years, a 12.8\% improvement over the strongest graph-based baseline. Biologically informed statistical features outperform CNN-based sequence encoding, demonstrating that handcrafted sequence features are more effective than end-to-end learned representations in this data regime. Post-hoc interpretability analysis identifies CpG density and local adenine frequency as features with age-dependent importance shifts, consistent with known mechanisms of age-related hypermethylation at CpG-dense promoter regions. Our code is at https://github.com/yaoli2022/graphage-seq.
△ Less
Submitted 11 May, 2026;
originally announced May 2026.
-
Matrix equivalence to Smith normal form: new theoretical results for multivariate polynomial matrices
Authors:
Dong Lu,
Yuanyuan Ruan,
Dingkang Wang,
Fanghui Xiao
Abstract:
This paper investigates the Smith normal form equivalence problem for multivariate polynomial matrices. Using methods from matrix theory and polynomial ideal theory, we prove that Frost and Storey's 1978 conjecture holds for a broad class of matrices: such a matrix is equivalent to its Smith normal form if and only if its reduced minors of each order generate the unit ideal. Moreover, by extending…
▽ More
This paper investigates the Smith normal form equivalence problem for multivariate polynomial matrices. Using methods from matrix theory and polynomial ideal theory, we prove that Frost and Storey's 1978 conjecture holds for a broad class of matrices: such a matrix is equivalent to its Smith normal form if and only if its reduced minors of each order generate the unit ideal. Moreover, by extending the original matrix class via automorphisms of the polynomial ring, we show that our framework applies in a substantially more general setting.
△ Less
Submitted 9 May, 2026;
originally announced May 2026.
-
Multi-Level Graph Attention Network Contrastive Learning for Knowledge-Aware Recommendation
Authors:
Zhifei Hu,
Feng Xia
Abstract:
In recent years, the use of edge information provided by knowledge graphs together with the advantages of higher-order connectivity in graph neural networks for recommendation systems has become an important research direction. However, existing approaches are often limited by sparse labels, insufficient graph structure learning, and noisy entities in the knowledge graph, which reduce recommendati…
▽ More
In recent years, the use of edge information provided by knowledge graphs together with the advantages of higher-order connectivity in graph neural networks for recommendation systems has become an important research direction. However, existing approaches are often limited by sparse labels, insufficient graph structure learning, and noisy entities in the knowledge graph, which reduce recommendation accuracy. To address these limitations, we propose a multi-view graph contrastive learning framework. The proposed method enhances user representations through multi-view knowledge graph distillation, enabling more accurate modeling of user preferences over entities and relations. The network aggregates neighborhood entity information to construct informative item representations. Furthermore, we design a multi-level self-supervised contrastive learning module that performs comparisons across three perspectives: Inter-Level, Intra-Level, and Interaction-Level. This design improves the model's ability to generalize across intra-class samples while increasing discrimination between inter-class samples, thereby enabling more effective multi-dimensional feature modeling. We conduct extensive experiments on three public datasets using both baseline and ablation settings. Experimental results demonstrate that the proposed framework consistently outperforms existing state-of-the-art methods. Ablation studies further verify the effectiveness of each module in the proposed model.
△ Less
Submitted 8 May, 2026;
originally announced May 2026.
-
A Qualitative Test-Risk Mechanism for Scaling Behavior in Normalized Residual Networks
Authors:
Daning Cheng,
Zeyu Liu,
Jun Sun,
Fen Xia,
Boyang Zhang,
Dongping Liu,
Yunquan Zhang
Abstract:
The scaling behavior, in which test performance often improves as model size and data increase, is a central empirical phenomenon in modern deep learning, yet its theoretical basis remains incomplete. In this paper, we study depth expansion in normalized residual networks: starting from a trained model in an old hypothesis class, we insert a new residual block at an intermediate layer and ask when…
▽ More
The scaling behavior, in which test performance often improves as model size and data increase, is a central empirical phenomenon in modern deep learning, yet its theoretical basis remains incomplete. In this paper, we study depth expansion in normalized residual networks: starting from a trained model in an old hypothesis class, we insert a new residual block at an intermediate layer and ask when such an expansion can yield a provable improvement in test risk. We develop a unified framework that decomposes this question into representational gain, optimization gain, and generalization transfer. First, under a first-order descent condition near zero initialization, we prove that the expanded hypothesis class contains an auxiliary jumpboard model with strictly smaller population risk than the original model. Second, under norm control tailored to post-normalized residual architectures, we establish a norm-based Rademacher complexity bound for the expanded model class. These ingredients lead to two complementary test-risk guarantees: one route passes through population risk and is tighter when a positive population margin is available, while the other works directly at the train/test level, avoids Hoeffding transfer, and is more robust in degenerate regimes. Together, these results provide a theorem-driven mechanism under which residual depth expansion can improve test performance in normalized residual networks. More broadly, they suggest that scaling is inherently joint: depth creates new improving directions, width enhances the finite-sample observability of weak signals, and data determines whether the statistical cost of expansion can be controlled.
△ Less
Submitted 8 May, 2026;
originally announced May 2026.
-
Computer Use at the Edge of the Statistical Precipice
Authors:
Pierluca D'Oro,
Sneha Silwal,
William Wong,
Yuxuan Sun,
Fanyi Xiao,
Manchen Wang,
Eric Gan,
Allen Bolourchi,
Joseph Tighe
Abstract:
Evaluating Computer Use Agents (CUAs) on interactive environments is fraught with methodological pitfalls that the field has yet to systematically address. We show that a 1MB replay script that blindly executes a recorded action sequence without ever observing the screen outperforms frontier models on prominent static benchmarks, and prove that its expected success rate is exactly equal to the sou…
▽ More
Evaluating Computer Use Agents (CUAs) on interactive environments is fraught with methodological pitfalls that the field has yet to systematically address. We show that a 1MB replay script that blindly executes a recorded action sequence without ever observing the screen outperforms frontier models on prominent static benchmarks, and prove that its expected success rate is exactly equal to the source agent's pass@k in deterministic environments. We trace this and other failures to two root causes: non-principled environment design (static, unsandboxed, or unreliably verified environments) and non-principled evaluation methodology (naive aggregation and misuse of pass@k for stateful UI interactions). To address the first, we propose PRISM, five design principles for CUA environments (privileged verification, realistic environments, integrity-checked configurations, sandboxed execution, and multifactorial variability) and instantiate them in DigiWorld, a benchmark of 15 realistic sandboxed mobile applications able to evaluate agents in over 3.2 million verified unique configurations. To address the second, we develop an aggregation framework pairing Wilson score intervals with hierarchical bootstrap, producing confidence intervals that correctly account for the nested structure of CUA benchmarks, as we empirically demonstrate. All together, we show that principled environment design and rigorous evaluation methodology are not optional refinements but prerequisites for meaningful CUA research.
△ Less
Submitted 7 May, 2026;
originally announced May 2026.
-
Safety Anchor: Defending Harmful Fine-tuning via Geometric Bottlenecks
Authors:
Guoxin Lu,
Letian Sha,
Qing Wang,
Peijie Sun,
Hao Zhou,
Hua Dai,
Fu Xiao
Abstract:
The safety alignment of Large Language Models (LLMs) remains vulnerable to Harmful Fine-tuning (HFT). While existing defenses impose constraints on parameters, gradients, or internal representations, we observe that they can be effectively circumvented under persistent HFT. Our analysis traces this failure to the inherent redundancy of the high-dimensional parameter space: attackers exploit optimi…
▽ More
The safety alignment of Large Language Models (LLMs) remains vulnerable to Harmful Fine-tuning (HFT). While existing defenses impose constraints on parameters, gradients, or internal representations, we observe that they can be effectively circumvented under persistent HFT. Our analysis traces this failure to the inherent redundancy of the high-dimensional parameter space: attackers exploit optimization trajectories that are orthogonal to defense constraints to restore harmful capabilities while deceptively adhering to safety restrictions. To address this, we propose Safety Bottleneck Regularization (SBR). SBR shifts the defensive focus from the redundant parameter space to the unembedding layer, which serves as a geometric bottleneck. By anchoring the final hidden states of harmful queries to those of the safety-aligned model, SBR enables the model to maintain safe responses even under persistent HFT. Extensive experiments confirm SBR's effectiveness, demonstrating that utilizing just a single safety anchor is sufficient to reduce the Harmful Score to $<$10 while preserving competitive performance on benign downstream tasks.
△ Less
Submitted 7 May, 2026; v1 submitted 7 May, 2026;
originally announced May 2026.