Skip to main content
arXiv is now an independent nonprofit! Learn more

Showing 1–15 of 15 results for author: Cheng, T S

.
  1. arXiv:2606.01727  [pdf

    physics.optics

    In-situ Silicon Doped hBN by High-Temperature Molecular Beam Epitaxy Enables Single Photon Emission

    Authors: Jiyun Kim, Nika Teran, Juliette Plo, Jonathan Bradford, Guillaume Cassabois, Amy F. M. Collins, Tin S. Cheng, Christopher J. Mellor, Shery L. Y. Chang, Sergei V. Novikov, Igor Aharonovich

    Abstract: Hexagonal boron nitride (hBN) has emerged as a leading host for optically active quantum defects. Yet introduction of specific impurity species other than carbon remains unexplored. Here, we demonstrate an in-situ silicon doping of hBN grown by high-temperature molecular beam epitaxy (HT-MBE). By systematically varying the growth temperature from 900 to 1390 °C under a constant silicon flux, we es… ▽ More

    Submitted 1 June, 2026; originally announced June 2026.

  2. arXiv:2602.16642  [pdf, ps, other

    cs.LG

    Optimizer choice matters for the emergence of Neural Collapse

    Authors: Jim Zhao, Tin Sum Cheng, Wojciech Masarczyk, Aurelien Lucchi

    Abstract: Neural Collapse (NC) refers to the emergence of highly symmetric geometric structures in the representations of deep neural networks during the terminal phase of training. Despite its prevalence, the theoretical understanding of NC remains limited. Existing analyses largely ignore the role of the optimizer, thereby suggesting that NC is universal across optimization methods. In this work, we chall… ▽ More

    Submitted 25 February, 2026; v1 submitted 18 February, 2026; originally announced February 2026.

    Comments: Published as a conference paper at ICLR 2026

  3. arXiv:2510.14217  [pdf, ps, other

    cs.LG physics.chem-ph

    Spectral Analysis of Molecular Features: When Richer Features Do Not Guarantee Better Generalization

    Authors: Asma Jamali, Tin Sum Cheng, Rodrigo A. Vargas-Hernández

    Abstract: The spectral properties of feature embeddings offer critical insights into model generalization and representation quality. While deep learning models are widely used for molecular property prediction, kernel methods remain competitive in low-data regimes, yet their spectral behavior is largely unexplored. We present the first comprehensive spectral analysis of kernel ridge regression across diver… ▽ More

    Submitted 12 June, 2026; v1 submitted 15 October, 2025; originally announced October 2025.

    Comments: 11 pages, 7 figures, 3 tables, SI: 13 pages, 9 figures, 4 Tables

  4. arXiv:2509.00924  [pdf, ps, other

    stat.ML cs.LG cs.NE math.NA math.PR

    Beyond Universal Approximation Theorems: Algorithmic Uniform Approximation by Neural Networks Trained with Noisy Data

    Authors: Anastasis Kratsios, Tin Sum Cheng, Daniel Roy

    Abstract: At its core, machine learning seeks to train models that reliably generalize beyond noisy observations; however, the theoretical vacuum in which state-of-the-art universal approximation theorems (UATs) operate isolates them from this goal, as they assume noiseless data and allow network parameters to be chosen freely, independent of algorithmic realism. This paper bridges that gap by introducing a… ▽ More

    Submitted 31 August, 2025; originally announced September 2025.

    MSC Class: 68T07; 68Q32; 68T05; 41A65 ACM Class: F.1.3; G.1.2; F.1.3

  5. arXiv:2506.14530  [pdf, ps, other

    stat.ML cs.AI cs.LG cs.NE math.ST

    Sharp Generalization Bounds for Foundation Models with Asymmetric Randomized Low-Rank Adapters

    Authors: Anastasis Kratsios, Tin Sum Cheng, Aurelien Lucchi, Haitz Sáez de Ocáriz Borde

    Abstract: Low-Rank Adaptation (LoRA) has emerged as a widely adopted parameter-efficient fine-tuning (PEFT) technique for foundation models. Recent work has highlighted an inherent asymmetry in the initialization of LoRA's low-rank factors, which has been present since its inception and was presumably derived experimentally. This paper focuses on providing a comprehensive theoretical characterization of asy… ▽ More

    Submitted 17 June, 2025; originally announced June 2025.

  6. arXiv:2506.01562  [pdf, ps, other

    cs.LG stat.ML

    Unpacking Softmax: How Temperature Drives Representation Collapse, Compression, and Generalization

    Authors: Wojciech Masarczyk, Mateusz Ostaszewski, Tin Sum Cheng, Tomasz Trzciński, Aurelien Lucchi, Razvan Pascanu

    Abstract: The softmax function is a fundamental building block of deep neural networks, commonly used to define output distributions in classification tasks or attention weights in transformer architectures. Despite its widespread use and proven effectiveness, its influence on learning dynamics and learned representations remains poorly understood, limiting our ability to optimize model behavior. In this pa… ▽ More

    Submitted 2 June, 2025; originally announced June 2025.

  7. arXiv:2505.21143  [pdf, ps, other

    cond-mat.mtrl-sci cond-mat.mes-hall

    Optically detected magnetic resonance of wafer-scale hexagonal boron nitride thin films

    Authors: Sam C. Scholten, Jakub Iwański, Kaijian Xing, Johannes Binder, Aleksandra K. Dąbrowska, Hark H. Tan, Tin S. Cheng, Jonathan Bradford, Christopher J. Mellor, Peter H. Beton, Sergei V. Novikov, Jan Mischke, Sergej Pasko, Emre Yengel, Alexander Henning, Simonas Krotkus, Andrzej Wysmołek, Jean-Philippe Tetienne

    Abstract: Hexagonal boron nitride (hBN) has recently been shown to host native defects exhibiting optically detected magnetic resonance (ODMR) with applications in nanoscale magnetic sensing and imaging. To advance these applications, deposition methods to create wafer-scale hBN films with controlled thicknesses are desirable, but a systematic study of the ODMR properties of the resultant films is lacking.… ▽ More

    Submitted 27 May, 2025; originally announced May 2025.

  8. arXiv:2410.17796  [pdf, other

    cs.LG

    A Comprehensive Analysis on the Learning Curve in Kernel Ridge Regression

    Authors: Tin Sum Cheng, Aurelien Lucchi, Anastasis Kratsios, David Belius

    Abstract: This paper conducts a comprehensive study of the learning curves of kernel ridge regression (KRR) under minimal assumptions. Our contributions are three-fold: 1) we analyze the role of key properties of the kernel, such as its spectral eigen-decay, the characteristics of the eigenfunctions, and the smoothness of the kernel; 2) we demonstrate the validity of the Gaussian Equivalent Property (GEP),… ▽ More

    Submitted 23 October, 2024; originally announced October 2024.

  9. arXiv:2402.01297  [pdf, other

    cs.LG stat.ML

    Characterizing Overfitting in Kernel Ridgeless Regression Through the Eigenspectrum

    Authors: Tin Sum Cheng, Aurelien Lucchi, Anastasis Kratsios, David Belius

    Abstract: We derive new bounds for the condition number of kernel matrices, which we then use to enhance existing non-asymptotic test error bounds for kernel ridgeless regression (KRR) in the over-parameterized regime for a fixed input dimension. For kernels with polynomial spectral decay, we recover the bound from previous work; for exponential decay, our bound is non-trivial and novel. Our contribution is… ▽ More

    Submitted 29 May, 2024; v1 submitted 2 February, 2024; originally announced February 2024.

  10. arXiv:2310.00987  [pdf, other

    cs.LG stat.ML

    A Theoretical Analysis of the Test Error of Finite-Rank Kernel Ridge Regression

    Authors: Tin Sum Cheng, Aurelien Lucchi, Ivan Dokmanić, Anastasis Kratsios, David Belius

    Abstract: Existing statistical learning guarantees for general kernel regressors often yield loose bounds when used with finite-rank kernels. Yet, finite-rank kernels naturally appear in several machine learning problems, e.g.\ when fine-tuning a pre-trained deep neural network's last layer to adapt it to a novel task when performing transfer learning. We address this gap for finite-rank kernel ridge regres… ▽ More

    Submitted 3 October, 2023; v1 submitted 2 October, 2023; originally announced October 2023.

  11. arXiv:2309.15197  [pdf, other

    cs.HC cs.CY cs.SI

    A Tale of Two Cultures: Comparing Interpersonal Information Disclosure Norms on Twitter

    Authors: Mainack Mondal, Anju Punuru, Tyng-Wen Scott Cheng, Kenneth Vargas, Chaz Gundry, Nathan S Driggs, Noah Schill, Nathaniel Carlson, Josh Bedwell, Jaden Q Lorenc, Isha Ghosh, Yao Li, Nancy Fulda, Xinru Page

    Abstract: We present an exploration of cultural norms surrounding online disclosure of information about one's interpersonal relationships (such as information about family members, colleagues, friends, or lovers) on Twitter. The literature identifies the cultural dimension of individualism versus collectivism as being a major determinant of offline communication differences in terms of emotion, topic, and… ▽ More

    Submitted 26 September, 2023; originally announced September 2023.

    Comments: This work will be presented at the 26th ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW 2023). This paper will also be published in The Proceedings of the ACM on Human Computer Interaction

  12. arXiv:2305.09952  [pdf

    cond-mat.mtrl-sci

    Cathodoluminescence spectroscopy of monolayer hexagonal boron nitride

    Authors: K. Shima, T. S. Cheng, C. J. Mellor, P. H. Beton, C. Elias, P. Valvin, B. Gil, G. Cassabois, S. V. Novikov, S. F. Chichibu

    Abstract: Cathodoluminescence (CL) spectroscopy is a powerful technique for studying emission properties of optoelectronic materials because CL is free from excitable bandgap limits and from ambiguous signals due to simple light scattering and resonant Raman scattering potentially involved in the photoluminescence (PL) spectra. However, direct CL measurements of atomically thin two-dimensional materials, su… ▽ More

    Submitted 17 May, 2023; originally announced May 2023.

    Comments: 7 pages, 3 figures

  13. arXiv:2107.07950  [pdf, other

    cond-mat.mes-hall cond-mat.mtrl-sci

    Band gap measurements of monolayer h-BN and insights into carbon-related point defects

    Authors: Ricardo Javier Peña Román, Fábio J R Costa Costa, Alberto Zobelli, Christine Elias, Pierre Valvin, Guillaume Cassabois, Bernard Gil, Alex Summerfield, Tin S Cheng, Christopher J Mellor, Peter H Beton, Sergei V Novikov, Luiz F Zagonel

    Abstract: Being a flexible wide band gap semiconductor, hexagonal boron nitride (h-BN) has great potential for technological applications like efficient deep ultraviolet light sources, building block for two-dimensional heterostructures and room temperature single photon emitters in the ultraviolet and visible spectral range. To enable such applications, it is mandatory to reach a better understanding of th… ▽ More

    Submitted 16 July, 2021; originally announced July 2021.

    Comments: 50 Pages, 8 Figures, 100+ references

    Journal ref: 2D Material 8 044001 (2021)

  14. arXiv:2003.00949  [pdf

    physics.app-ph cond-mat.mtrl-sci physics.optics

    Identifying Carbon as the Source of Visible Single Photon Emission from Hexagonal Boron Nitride

    Authors: Noah Mendelson, Dipankar Chugh, Jeffrey R. Reimers, Tin S. Cheng, Andreas Gottscholl, Hu Long, Christopher J. Mellor, Alex Zettl, Vladimir Dyakonov, Peter H. Beton, Sergei V. Novikov, Chennupati Jagadish, Hark Hoe Tan, Michael J. Ford, Milos Toth, Carlo Bradac, Igor Aharonovich

    Abstract: Single photon emitters (SPEs) in hexagonal boron nitride (hBN) have garnered significant attention over the last few years due to their superior optical properties. However, despite the vast range of experimental results and theoretical calculations, the defect structure responsible for the observed emission has remained elusive. Here, by controlling the incorporation of impurities into hBN and by… ▽ More

    Submitted 20 April, 2020; v1 submitted 2 March, 2020; originally announced March 2020.

  15. arXiv:cs/0703103   

    cs.DB

    Concept of a Value in Multilevel Security Databases

    Authors: Jia Tao, Shashi Gadia, Tsz Shing Cheng

    Abstract: This paper has been withdrawn.

    Submitted 29 June, 2009; v1 submitted 21 March, 2007; originally announced March 2007.

    Comments: This paper has been withdrawn