-
MTBBench: A Multimodal Sequential Clinical Decision-Making Benchmark in Oncology
Authors:
Kiril Vasilev,
Alexandre Misrahi,
Eeshaan Jain,
Phil F Cheng,
Petros Liakopoulos,
Olivier Michielin,
Michael Moor,
Charlotte Bunne
Abstract:
Multimodal Large Language Models (LLMs) hold promise for biomedical reasoning, but current benchmarks fail to capture the complexity of real-world clinical workflows. Existing evaluations primarily assess unimodal, decontextualized question-answering, overlooking multi-agent decision-making environments such as Molecular Tumor Boards (MTBs). MTBs bring together diverse experts in oncology, where d…
▽ More
Multimodal Large Language Models (LLMs) hold promise for biomedical reasoning, but current benchmarks fail to capture the complexity of real-world clinical workflows. Existing evaluations primarily assess unimodal, decontextualized question-answering, overlooking multi-agent decision-making environments such as Molecular Tumor Boards (MTBs). MTBs bring together diverse experts in oncology, where diagnostic and prognostic tasks require integrating heterogeneous data and evolving insights over time. Current benchmarks lack this longitudinal and multimodal complexity. We introduce MTBBench, an agentic benchmark simulating MTB-style decision-making through clinically challenging, multimodal, and longitudinal oncology questions. Ground truth annotations are validated by clinicians via a co-developed app, ensuring clinical relevance. We benchmark multiple open and closed-source LLMs and show that, even at scale, they lack reliability -- frequently hallucinating, struggling with reasoning from time-resolved data, and failing to reconcile conflicting evidence or different modalities. To address these limitations, MTBBench goes beyond benchmarking by providing an agentic framework with foundation model-based tools that enhance multi-modal and longitudinal reasoning, leading to task-level performance gains of up to 9.0% and 11.2%, respectively. Overall, MTBBench offers a challenging and realistic testbed for advancing multimodal LLM reasoning, reliability, and tool-use with a focus on MTB environments in precision oncology.
△ Less
Submitted 25 November, 2025;
originally announced November 2025.
-
AI-powered virtual tissues from spatial proteomics for clinical diagnostics and biomedical discovery
Authors:
Johann Wenckstern,
Eeshaan Jain,
Yexiang Cheng,
Benedikt von Querfurth,
Kiril Vasilev,
Matteo Pariset,
Phil F. Cheng,
Petros Liakopoulos,
Olivier Michielin,
Andreas Wicki,
Gabriele Gut,
Charlotte Bunne
Abstract:
Spatial proteomics technologies have transformed our understanding of complex tissue architecture in cancer but present unique challenges for computational analysis. Each study uses a different marker panel and protocol, and most methods are tailored to single cohorts, which limits knowledge transfer and robust biomarker discovery. Here we present Virtual Tissues (VirTues), a general-purpose found…
▽ More
Spatial proteomics technologies have transformed our understanding of complex tissue architecture in cancer but present unique challenges for computational analysis. Each study uses a different marker panel and protocol, and most methods are tailored to single cohorts, which limits knowledge transfer and robust biomarker discovery. Here we present Virtual Tissues (VirTues), a general-purpose foundation model for spatial proteomics that learns marker-aware, multi-scale representations of proteins, cells, niches and tissues directly from multiplex imaging data. From a single pretrained backbone, VirTues supports marker reconstruction, cell typing and niche annotation, spatial biomarker discovery, and patient stratification, including zero-shot annotation across heterogeneous panels and datasets. In triple-negative breast cancer, VirTues-derived biomarkers predict anti-PD-L1 chemo-immunotherapy response and stratify disease-free survival in an independent cohort, outperforming state-of-the-art biomarkers derived from the same datasets and current clinical stratification schemes.
△ Less
Submitted 9 December, 2025; v1 submitted 10 January, 2025;
originally announced January 2025.
-
Suppression of Dick Effect in the Ramsey-CPT atomic clock by Interleaving Lock
Authors:
X. L. Sun,
J. W. Zhang,
P. F. Cheng,
Y. N. Zuo,
L. J. Wang
Abstract:
For most passive atomic clocks, the Dick effect is one of the main limits to reach its frequency stability limitation due to quantum projection noise. In this paper, we demonstrate that the minimization of the Dick effect for the Ramsey-CPT atomic clock can be accomplished by interleaving lock. By optimizing the duty circle of laser pulses, averaging time during detection and optical intensity of…
▽ More
For most passive atomic clocks, the Dick effect is one of the main limits to reach its frequency stability limitation due to quantum projection noise. In this paper, we demonstrate that the minimization of the Dick effect for the Ramsey-CPT atomic clock can be accomplished by interleaving lock. By optimizing the duty circle of laser pulses, averaging time during detection and optical intensity of laser beam, the Dick effect induced Allan deviation can be reduced to the level of 10^-14.
△ Less
Submitted 5 July, 2017;
originally announced July 2017.