-
Tock: From Research to Securing 10 Million Computers
Authors:
Leon Schuermann,
Brad Campbell,
Branden Ghena,
Philip Levis,
Amit Levy,
Pat Pannuto
Abstract:
Tock began 10 years ago as a research operating system developed by academics to help other academics build urban sensing applications. By leveraging a new language (Rust) and new hardware protection mechanisms, Tock enabled Multiprogramming a 64 kB Computer Safely and Efficiently. Today, it is an open source project with a vibrant community of users and contributors. It is deployed on root of tru…
▽ More
Tock began 10 years ago as a research operating system developed by academics to help other academics build urban sensing applications. By leveraging a new language (Rust) and new hardware protection mechanisms, Tock enabled Multiprogramming a 64 kB Computer Safely and Efficiently. Today, it is an open source project with a vibrant community of users and contributors. It is deployed on root of trust hardware in data center servers and on millions of laptops; it is used to develop automotive and space products, wearable electronics, and hardware security tokens--all while remaining a platform for operating systems research. This paper focuses on the impact of Tock's technical design on its adoption, the challenges and unexpected benefits of using a type safe language (Rust)--particularly in security sensitive settings--and the experience of supporting a production open4source operating system from academia.
△ Less
Submitted 23 March, 2026;
originally announced March 2026.
-
UAV-Based Infrastructure Inspections: A Literature Review and Proposed Framework for AEC+FM
Authors:
Amir Farzin Nikkhah,
Dong Chen,
Bradford Campbell,
Somayeh Asadi,
Arsalan Heydarian
Abstract:
Unmanned Aerial Vehicles (UAVs) are transforming infrastructure inspections in the Architecture, Engineering, Construction, and Facility Management (AEC+FM) domain. By synthesizing insights from over 150 studies, this review paper highlights UAV-based methodologies for data acquisition, photogrammetric modeling, defect detection, and decision-making support. Key innovations include path optimizati…
▽ More
Unmanned Aerial Vehicles (UAVs) are transforming infrastructure inspections in the Architecture, Engineering, Construction, and Facility Management (AEC+FM) domain. By synthesizing insights from over 150 studies, this review paper highlights UAV-based methodologies for data acquisition, photogrammetric modeling, defect detection, and decision-making support. Key innovations include path optimization, thermal integration, and advanced machine learning (ML) models such as YOLO and Faster R-CNN for anomaly detection. UAVs have demonstrated value in structural health monitoring (SHM), disaster response, urban infrastructure management, energy efficiency evaluations, and cultural heritage preservation. Despite these advancements, challenges in real-time processing, multimodal data fusion, and generalizability remain. A proposed workflow framework, informed by literature and a case study, integrates RGB imagery, LiDAR, and thermal sensing with transformer-based architectures to improve accuracy and reliability in detecting structural defects, thermal anomalies, and geometric inconsistencies. The proposed framework ensures precise and actionable insights by fusing multimodal data and dynamically adapting path planning for complex environments, presented as a comprehensive step-by-step guide to address these challenges effectively. This paper concludes with future research directions emphasizing lightweight AI models, adaptive flight planning, synthetic datasets, and richer modality fusion to streamline modern infrastructure inspections.
△ Less
Submitted 20 August, 2026; v1 submitted 15 January, 2026;
originally announced January 2026.
-
Koopman-based Prediction of Connectivity for Flying Ad Hoc Networks
Authors:
Sivaram Krishnan,
Jinho Choi,
Jihong Park,
Gregory Sherman,
Benjamin Campbell
Abstract:
The application of machine learning (ML) to communication systems is expected to play a pivotal role in future artificial intelligence (AI)-based next-generation wireless networks. While most existing works focus on ML techniques for static wireless environments, they often face limitations when applied to highly dynamic environments, such as flying ad hoc networks (FANETs). This paper explores th…
▽ More
The application of machine learning (ML) to communication systems is expected to play a pivotal role in future artificial intelligence (AI)-based next-generation wireless networks. While most existing works focus on ML techniques for static wireless environments, they often face limitations when applied to highly dynamic environments, such as flying ad hoc networks (FANETs). This paper explores the use of data-driven Koopman approaches to address these challenges. Specifically, we investigate how these approaches can model UAV trajectory dynamics within FANETs, enabling more accurate predictions and improved network performance. By leveraging Koopman operator theory, we propose two possible approaches -- centralized and distributed -- to efficiently address the challenges posed by the constantly changing topology of FANETs. To demonstrate this, we consider a FANET performing surveillance with UAVs following pre-determined trajectories and predict signal-to-interference-plus-noise ratios (SINRs) to ensure reliable communication between UAVs. Our results show that these approaches can accurately predict connectivity and isolation events that lead to modelled communication outages. This capability could help UAVs schedule their transmissions based on these predictions.
△ Less
Submitted 3 November, 2025;
originally announced November 2025.
-
Is AI currently capable of identifying wild oysters? A comparison of human annotators against the AI model, ODYSSEE
Authors:
Brendan Campbell,
Alan Williams,
Kleio Baxevani,
Alyssa Campbell,
Rushabh Dhoke,
Rileigh E. Hudock,
Xiaomin Lin,
Vivek Mange,
Bernhard Neuberger,
Arjun Suresh,
Alhim Vera,
Arthur Trembanis,
Herbert G. Tanner,
Edward Hale
Abstract:
Oysters are ecologically and commercially important species that require frequent monitoring to track population demographics (e.g. abundance, growth, mortality). Current methods of monitoring oyster reefs often require destructive sampling methods and extensive manual effort. Therefore, they are suboptimal for small-scale or sensitive environments. A recent alternative, the ODYSSEE model, was dev…
▽ More
Oysters are ecologically and commercially important species that require frequent monitoring to track population demographics (e.g. abundance, growth, mortality). Current methods of monitoring oyster reefs often require destructive sampling methods and extensive manual effort. Therefore, they are suboptimal for small-scale or sensitive environments. A recent alternative, the ODYSSEE model, was developed to use deep learning techniques to identify live oysters using video or images taken in the field of oyster reefs to assess abundance. The validity of this model in identifying live oysters on a reef was compared to expert and non-expert annotators. In addition, we identified potential sources of prediction error. Although the model can make inferences significantly faster than expert and non-expert annotators (39.6 s, $2.34 \pm 0.61$ h, $4.50 \pm 1.46$ h, respectively), the model overpredicted the number of live oysters, achieving lower accuracy (63\%) in identifying live oysters compared to experts (74\%) and non-experts (75\%) alike. Image quality was an important factor in determining the accuracy of the model and the annotators. Better quality images improved human accuracy and worsened model accuracy. Although ODYSSEE was not sufficiently accurate, we anticipate that future training on higher-quality images, utilizing additional live imagery, and incorporating additional annotation training classes will greatly improve the model's predictive power based on the results of this analysis. Future research should address methods that improve the detection of living vs. dead oysters.
△ Less
Submitted 5 May, 2025;
originally announced May 2025.
-
Detecting Plant VOC Traces Using Indoor Air Quality Sensors
Authors:
Seyed Hamidreza Nabaei,
Ryan Lenfant,
Viswajith Govinda Rajan,
Dong Chen,
Michael P. Timko,
Bradford Campbell,
Arsalan Heydarian
Abstract:
In the era of growing interest in healthy buildings and smart homes, the importance of sustainable, health conscious indoor environments is paramount. Smart tools, especially VOC sensors, are crucial for monitoring indoor air quality, yet interpreting signals from various VOC sources remains challenging. A promising approach involves understanding how indoor plants respond to environmental conditi…
▽ More
In the era of growing interest in healthy buildings and smart homes, the importance of sustainable, health conscious indoor environments is paramount. Smart tools, especially VOC sensors, are crucial for monitoring indoor air quality, yet interpreting signals from various VOC sources remains challenging. A promising approach involves understanding how indoor plants respond to environmental conditions. Plants produce terpenes, a type of VOC, when exposed to abiotic and biotic stressors - including pathogens, predators, light, and temperature - offering a novel pathway for monitoring indoor air quality. While prior work often relies on specialized laboratory sensors, our research leverages readily available commercial sensors to detect and classify plant emitted VOCs that signify changes in indoor conditions. We quantified the sensitivity of these sensors by measuring 16 terpenes in controlled experiments, then identified and tested the most promising terpenes in realistic environments. We also examined physics based models to map VOC responses but found them lacking for real world complexity. Consequently, we trained machine learning models to classify terpenes using commercial sensors and identified optimal sensor placement. To validate this approach, we analyzed emissions from a living basil plant, successfully detecting terpene output. Our findings establish a foundation for overcoming challenges in plant VOC detection, paving the way for advanced plant based sensors to enhance indoor environmental quality in future smart buildings.
△ Less
Submitted 3 April, 2025;
originally announced April 2025.
-
Relaxed exception semantics for Arm-A (extended version)
Authors:
Ben Simner,
Alasdair Armstrong,
Thomas Bauereiss,
Brian Campbell,
Ohad Kammar,
Jean Pichon-Pharabod,
and Peter Sewell
Abstract:
To manage exceptions, software relies on a key architectural guarantee, precision: that exceptions appear to execute between instructions. However, this definition, dating back over 60 years, fundamentally assumes a sequential programmers model. Modern architectures such as Arm-A with programmer-observable relaxed behaviour make such a naive definition inadequate, and it is unclear exactly what gu…
▽ More
To manage exceptions, software relies on a key architectural guarantee, precision: that exceptions appear to execute between instructions. However, this definition, dating back over 60 years, fundamentally assumes a sequential programmers model. Modern architectures such as Arm-A with programmer-observable relaxed behaviour make such a naive definition inadequate, and it is unclear exactly what guarantees programmers have on exception entry and exit.
In this paper, we clarify the concepts needed to discuss exceptions in the relaxed-memory setting -- a key aspect of precisely specifying the architectural interface between hardware and software. We explore the basic relaxed behaviour across exception boundaries, and the semantics of external aborts, using Arm-A as a representative modern architecture. We identify an important problem, present yet unexplored for decades: pinning down what it means for exceptions to be precise in a relaxed setting. We describe key phenomena that any definition should account for. We develop an axiomatic model for Arm-A precise exceptions, tooling for axiomatic model execution, and a library of tests. Finally we explore the relaxed semantics of software-generated interrupts, as used in sophisticated programming patterns, and sketch how they too could be modelled.
△ Less
Submitted 19 December, 2024;
originally announced December 2024.
-
H-FedSN: Personalized Sparse Networks for Efficient and Accurate Hierarchical Federated Learning for IoT Applications
Authors:
Jiechao Gao,
Yuangang Li,
Yue Zhao,
Brad Campbell
Abstract:
The proliferation of Internet of Things (IoT) has increased interest in federated learning (FL) for privacy-preserving distributed data utilization. However, traditional two-tier FL architectures inadequately adapt to multi-tier IoT environments. While Hierarchical Federated Learning (HFL) improves practicality in multi-tier IoT environments by multi-layer aggregation, it still faces challenges in…
▽ More
The proliferation of Internet of Things (IoT) has increased interest in federated learning (FL) for privacy-preserving distributed data utilization. However, traditional two-tier FL architectures inadequately adapt to multi-tier IoT environments. While Hierarchical Federated Learning (HFL) improves practicality in multi-tier IoT environments by multi-layer aggregation, it still faces challenges in communication efficiency and accuracy due to high data transfer volumes, data heterogeneity, and imbalanced device distribution, struggling to meet the low-latency and high-accuracy model training requirements of practical IoT scenarios. To overcome these limitations, we propose H-FedSN, an innovative approach for practical IoT environments. H-FedSN introduces a binary mask mechanism with shared and personalized layers to reduce communication overhead by creating a sparse network while keeping original weights frozen. To address data heterogeneity and imbalanced device distribution, we integrate personalized layers for local data adaptation and apply Bayesian aggregation with cumulative Beta distribution updates at edge and cloud levels, effectively balancing contributions from diverse client groups. Evaluations on three real-world IoT datasets and MNIST under non-IID settings demonstrate that H-FedSN significantly reduces communication costs by 58 to 238 times compared to HierFAVG while achieving high accuracy, making it highly effective for practical IoT applications in hierarchical federated learning scenarios.
△ Less
Submitted 25 December, 2024; v1 submitted 9 December, 2024;
originally announced December 2024.
-
Predictive Covert Communication Against Multi-UAV Surveillance Using Graph Koopman Autoencoder
Authors:
Sivaram Krishnan,
Jihong Park,
Gregory Sherman,
Benjamin Campbell,
Jinho Choi
Abstract:
Low Probability of Detection (LPD) communication aims to obscure the presence of radio frequency (RF) signals to evade surveillance. In the context of mobile surveillance utilizing unmanned aerial vehicles (UAVs), achieving LPD communication presents significant challenges due to the UAVs' rapid and continuous movements, which are characterized by unknown nonlinear dynamics. Therefore, accurately…
▽ More
Low Probability of Detection (LPD) communication aims to obscure the presence of radio frequency (RF) signals to evade surveillance. In the context of mobile surveillance utilizing unmanned aerial vehicles (UAVs), achieving LPD communication presents significant challenges due to the UAVs' rapid and continuous movements, which are characterized by unknown nonlinear dynamics. Therefore, accurately predicting future locations of UAVs is essential for enabling real-time LPD communication. In this paper, we introduce a novel framework termed predictive covert communication, aimed at minimizing detectability in terrestrial ad-hoc networks under multi-UAV surveillance. Our data-driven method synergistically integrates graph neural networks (GNN) with Koopman theory to model the complex interactions within a multi-UAV network and facilitating long-term predictions by linearizing the dynamics, even with limited historical data. Extensive simulation results substantiate that the predicted trajectories using our method result in at least 63%-75% lower probability of detection when compared to well-known state-of-the-art baseline approaches, showing promise in enabling low-latency covert operations in practical scenarios.
△ Less
Submitted 25 September, 2024;
originally announced September 2024.
-
ODYSSEE: Oyster Detection Yielded by Sensor Systems on Edge Electronics
Authors:
Xiaomin Lin,
Vivek Mange,
Arjun Suresh,
Bernhard Neuberger,
Aadi Palnitkar,
Brendan Campbell,
Alan Williams,
Kleio Baxevani,
Jeremy Mallette,
Alhim Vera,
Markus Vincze,
Ioannis Rekleitis,
Herbert G. Tanner,
Yiannis Aloimonos
Abstract:
Oysters are a vital keystone species in coastal ecosystems, providing significant economic, environmental, and cultural benefits. As the importance of oysters grows, so does the relevance of autonomous systems for their detection and monitoring. However, current monitoring strategies often rely on destructive methods. While manual identification of oysters from video footage is non-destructive, it…
▽ More
Oysters are a vital keystone species in coastal ecosystems, providing significant economic, environmental, and cultural benefits. As the importance of oysters grows, so does the relevance of autonomous systems for their detection and monitoring. However, current monitoring strategies often rely on destructive methods. While manual identification of oysters from video footage is non-destructive, it is time-consuming, requires expert input, and is further complicated by the challenges of the underwater environment.
To address these challenges, we propose a novel pipeline using stable diffusion to augment a collected real dataset with realistic synthetic data. This method enhances the dataset used to train a YOLOv10-based vision model. The model is then deployed and tested on an edge platform in underwater robotics, achieving a state-of-the-art 0.657 mAP@50 for oyster detection on the Aqua2 platform.
△ Less
Submitted 4 March, 2025; v1 submitted 11 September, 2024;
originally announced September 2024.
-
Impact of Road Infrastructure and Traffic Scenarios on E-scooterists' Riding and Gaze Behavior
Authors:
Dong Chen,
Arman Hosseini,
Arik Smith,
Zeyang Zheng,
David Xiang,
Arsalan Heydarian,
Omid Shoghli,
Bradford Campbell
Abstract:
The growing adoption of e-scooters has raised significant safety concerns, particularly due to a surge in injuries and fatalities. This study explores the relationship between road infrastructure, traffic scenarios, and e-scooterists' riding and gaze behaviors to improve road safety and user experience. A naturalistic study was conducted using instrumented e-scooters, capturing gaze patterns, fixa…
▽ More
The growing adoption of e-scooters has raised significant safety concerns, particularly due to a surge in injuries and fatalities. This study explores the relationship between road infrastructure, traffic scenarios, and e-scooterists' riding and gaze behaviors to improve road safety and user experience. A naturalistic study was conducted using instrumented e-scooters, capturing gaze patterns, fixation metrics, and head movement data across various road layouts and traffic scenarios. Key findings reveal that bike lanes offer a stable environment with reduced horizontal head movement and focused attention on the road, while shared roads and sidewalks lead to more dispersed gaze and increased head movement, indicating higher uncertainty and complexity. Interactions with other road users, such as navigating intersections, passing buses, riding near cars, and descending on downhill paths, demand greater cognitive load. Intersections require heightened visual focus and spatial awareness, reflected in increased horizontal eye and head movements. Interactions with vehicles prioritize visual scanning over head movement to maintain stability and avoid collisions, while high-speed and downhill riding demand focused attention on obstacles and the road surface. The results provide insights into e-scooter riders' behavior and physiological response analysis, paving the way for safer riding experiences and improved understanding of their needs.
△ Less
Submitted 16 March, 2025; v1 submitted 5 May, 2024;
originally announced July 2024.
-
Performance Evaluation of Real-Time Object Detection for Electric Scooters
Authors:
Dong Chen,
Arman Hosseini,
Arik Smith,
Amir Farzin Nikkhah,
Arsalan Heydarian,
Omid Shoghli,
Bradford Campbell
Abstract:
Electric scooters (e-scooters) have rapidly emerged as a popular mode of transportation in urban areas, yet they pose significant safety challenges. In the United States, the rise of e-scooters has been marked by a concerning increase in related injuries and fatalities. Recently, while deep-learning object detection holds paramount significance in autonomous vehicles to avoid potential collisions,…
▽ More
Electric scooters (e-scooters) have rapidly emerged as a popular mode of transportation in urban areas, yet they pose significant safety challenges. In the United States, the rise of e-scooters has been marked by a concerning increase in related injuries and fatalities. Recently, while deep-learning object detection holds paramount significance in autonomous vehicles to avoid potential collisions, its application in the context of e-scooters remains relatively unexplored. This paper addresses this gap by assessing the effectiveness and efficiency of cutting-edge object detectors designed for e-scooters. To achieve this, the first comprehensive benchmark involving 22 state-of-the-art YOLO object detectors, including five versions (YOLOv3, YOLOv5, YOLOv6, YOLOv7, and YOLOv8), has been established for real-time traffic object detection using a self-collected dataset featuring e-scooters. The detection accuracy, measured in terms of mAP@0.5, ranges from 27.4% (YOLOv7-E6E) to 86.8% (YOLOv5s). All YOLO models, particularly YOLOv3-tiny, have displayed promising potential for real-time object detection in the context of e-scooters. Both the traffic scene dataset (https://zenodo.org/records/10578641) and software program codes (https://github.com/DongChen06/ScooterDet) for model benchmarking in this study are publicly available, which will not only improve e-scooter safety with advanced object detection but also lay the groundwork for tailored solutions, promising a safer and more sustainable urban micromobility landscape.
△ Less
Submitted 5 May, 2024;
originally announced May 2024.
-
Clinical translation of machine learning algorithms for seizure detection in scalp electroencephalography: systematic review
Authors:
Nina Moutonnet,
Steven White,
Benjamin P Campbell,
Saeid Sanei,
Toshihisa Tanaka,
Hong Ji,
Danilo Mandic,
Gregory Scott
Abstract:
Machine learning algorithms for seizure detection have shown considerable diagnostic potential, with recent reported accuracies reaching 100%. Yet, only few published algorithms have fully addressed the requirements for successful clinical translation. This is, for example, because the properties of training data may limit the generalisability of algorithms, algorithm performance may vary dependin…
▽ More
Machine learning algorithms for seizure detection have shown considerable diagnostic potential, with recent reported accuracies reaching 100%. Yet, only few published algorithms have fully addressed the requirements for successful clinical translation. This is, for example, because the properties of training data may limit the generalisability of algorithms, algorithm performance may vary depending on which electroencephalogram (EEG) acquisition hardware was used, or run-time processing costs may be prohibitive to real-time clinical use cases. To address these issues in a critical manner, we systematically review machine learning algorithms for seizure detection with a focus on clinical translatability, assessed by criteria including generalisability, run-time costs, explainability, and clinically-relevant performance metrics. For non-specialists, the domain-specific knowledge necessary to contextualise model development and evaluation is provided. It is our hope that such critical evaluation of machine learning algorithms with respect to their potential real-world effectiveness can help accelerate clinical translation and identify gaps in the current seizure detection literature.
△ Less
Submitted 13 August, 2024; v1 submitted 8 April, 2024;
originally announced April 2024.
-
Graph Koopman Autoencoder for Predictive Covert Communication Against UAV Surveillance
Authors:
Sivaram Krishnan,
Jihong Park,
Gregory Sherman,
Benjamin Campbell,
Jinho Choi
Abstract:
Low Probability of Detection (LPD) communication aims to obscure the very presence of radio frequency (RF) signals, going beyond just hiding the content of the communication. However, the use of Unmanned Aerial Vehicles (UAVs) introduces a challenge, as UAVs can detect RF signals from the ground by hovering over specific areas of interest. With the growing utilization of UAVs in modern surveillanc…
▽ More
Low Probability of Detection (LPD) communication aims to obscure the very presence of radio frequency (RF) signals, going beyond just hiding the content of the communication. However, the use of Unmanned Aerial Vehicles (UAVs) introduces a challenge, as UAVs can detect RF signals from the ground by hovering over specific areas of interest. With the growing utilization of UAVs in modern surveillance, there is a crucial need for a thorough understanding of their unknown nonlinear dynamic trajectories to effectively implement LPD communication. Unfortunately, this critical information is often not readily available, posing a significant hurdle in LPD communication. To address this issue, we consider a case-study for enabling terrestrial LPD communication in the presence of multiple UAVs that are engaged in surveillance. We introduce a novel framework that combines graph neural networks (GNN) with Koopman theory to predict the trajectories of multiple fixed-wing UAVs over an extended prediction horizon. Using the predicted UAV locations, we enable LPD communication in a terrestrial ad-hoc network by controlling nodes' transmit powers to keep the received power at UAVs' predicted locations minimized. Our extensive simulations validate the efficacy of the proposed framework in accurately predicting the trajectories of multiple UAVs, thereby effectively establishing LPD communication.
△ Less
Submitted 23 January, 2024;
originally announced February 2024.
-
Federated Graph Learning for Low Probability of Detection in Wireless Ad-Hoc Networks
Authors:
Sivaram Krishnan,
Jihong Park,
Subhash Sagar,
Gregory Sherman,
Benjamin Campbell,
Jinho Choi
Abstract:
Low probability of detection (LPD) has recently emerged as a means to enhance the privacy and security of wireless networks. Unlike existing wireless security techniques, LPD measures aim to conceal the entire existence of wireless communication instead of safeguarding the information transmitted from users. Motivated by LPD communication, in this paper, we study a privacy-preserving and distribut…
▽ More
Low probability of detection (LPD) has recently emerged as a means to enhance the privacy and security of wireless networks. Unlike existing wireless security techniques, LPD measures aim to conceal the entire existence of wireless communication instead of safeguarding the information transmitted from users. Motivated by LPD communication, in this paper, we study a privacy-preserving and distributed framework based on graph neural networks to minimise the detectability of a wireless ad-hoc network as a whole and predict an optimal communication region for each node in the wireless network, allowing them to communicate while remaining undetected from external actors. We also demonstrate the effectiveness of the proposed method in terms of two performance measures, i.e., mean absolute error and median absolute error.
△ Less
Submitted 1 June, 2023;
originally announced June 2023.
-
The Hitchiker's Guide to Successful Living Lab Operations
Authors:
Alan Wang,
Feng Yi Chang,
Siavash Yousefi,
Beatrice Li,
Brad Campbell,
Arsalan Heydarian
Abstract:
Living labs have been established across different countries to evaluate how the interaction between humans and buildings can be optimized to improve comfort, health, and energy savings. However, existing living labs can be too project-specific, not scalable, and inflexible for comparison against other labs. Furthermore, the lack of transparency in its software infrastructure inhibits opportunitie…
▽ More
Living labs have been established across different countries to evaluate how the interaction between humans and buildings can be optimized to improve comfort, health, and energy savings. However, existing living labs can be too project-specific, not scalable, and inflexible for comparison against other labs. Furthermore, the lack of transparency in its software infrastructure inhibits opportunities for critique and reuse, reducing the platform's overall potential. In the face of climate change and global energy shortage, we envision the future of living labs to be open source and scalable to support the integration of different IoTs, subjective measures, human-building interactions, security, and privacy contexts. In this work, we share our living lab software stack and present our experience developing a platform that supports qualitative and quantitative experiments from the ground up. We propose the first open-source interoperable living lab platform for multidisciplinary smart environment research.
△ Less
Submitted 20 November, 2022;
originally announced December 2022.
-
Graph Neural Networks in IoT: A Survey
Authors:
Guimin Dong,
Mingyue Tang,
Zhiyuan Wang,
Jiechao Gao,
Sikun Guo,
Lihua Cai,
Robert Gutierrez,
Bradford Campbell,
Laura E. Barnes,
Mehdi Boukhechba
Abstract:
The Internet of Things (IoT) boom has revolutionized almost every corner of people's daily lives: healthcare, home, transportation, manufacturing, supply chain, and so on. With the recent development of sensor and communication technologies, IoT devices including smart wearables, cameras, smartwatches, and autonomous vehicles can accurately measure and perceive their surrounding environment. Conti…
▽ More
The Internet of Things (IoT) boom has revolutionized almost every corner of people's daily lives: healthcare, home, transportation, manufacturing, supply chain, and so on. With the recent development of sensor and communication technologies, IoT devices including smart wearables, cameras, smartwatches, and autonomous vehicles can accurately measure and perceive their surrounding environment. Continuous sensing generates massive amounts of data and presents challenges for machine learning. Deep learning models (e.g., convolution neural networks and recurrent neural networks) have been extensively employed in solving IoT tasks by learning patterns from multi-modal sensory data. Graph Neural Networks (GNNs), an emerging and fast-growing family of neural network models, can capture complex interactions within sensor topology and have been demonstrated to achieve state-of-the-art results in numerous IoT learning tasks. In this survey, we present a comprehensive review of recent advances in the application of GNNs to the IoT field, including a deep dive analysis of GNN design in various IoT sensing environments, an overarching list of public data and source code from the collected publications, and future research directions. To keep track of newly published works, we collect representative papers and their open-source implementations and create a Github repository at https://github.com/GuiminDong/GNN4IoT.
△ Less
Submitted 31 March, 2022; v1 submitted 29 March, 2022;
originally announced March 2022.
-
Machine Learning Kreuzer--Skarke Calabi--Yau Threefolds
Authors:
Per Berglund,
Ben Campbell,
Vishnu Jejjala
Abstract:
Using a fully connected feedforward neural network we study topological invariants of a class of Calabi--Yau manifolds constructed as hypersurfaces in toric varieties associated with reflexive polytopes from the Kreuzer--Skarke database. In particular, we find the existence of a simple expression for the Euler number that can be learned in terms of limited data extracted from the polytope and its…
▽ More
Using a fully connected feedforward neural network we study topological invariants of a class of Calabi--Yau manifolds constructed as hypersurfaces in toric varieties associated with reflexive polytopes from the Kreuzer--Skarke database. In particular, we find the existence of a simple expression for the Euler number that can be learned in terms of limited data extracted from the polytope and its dual.
△ Less
Submitted 16 December, 2021;
originally announced December 2021.
-
Social Network Conceptualization and Operationalization of Hierarchy Within Therapeutic Communities
Authors:
Benjamin W. Campbell,
Keith Warren
Abstract:
In the United States, the Therapeutic Community (TC) treatment model for substance use disorder recovery relies heavily upon the assumption that peers serve as mentors, affirming behavior consistent with the norms of the treatment model and correcting behavior contrary to those norms. Despite being foundational to the TC model, little work has been done to clearly conceptualize and operationalize…
▽ More
In the United States, the Therapeutic Community (TC) treatment model for substance use disorder recovery relies heavily upon the assumption that peers serve as mentors, affirming behavior consistent with the norms of the treatment model and correcting behavior contrary to those norms. Despite being foundational to the TC model, little work has been done to clearly conceptualize and operationalize this hierarchy. In this manuscript, we fill that gap in the literature, presenting a novel conceptualization of hierarchy within the TC context, complete with a complementary measurement drawing from the field of social network analysis. With this new framework for understanding and studying hierarchy within TCs, we can ask and rigorously answer a new set of questions previously unexamined.
△ Less
Submitted 13 January, 2021;
originally announced January 2021.
-
Path Planning for Shepherding a Swarm in a Cluttered Environment using Differential Evolution
Authors:
Saber Elsayed,
Hemant Singh,
Essam Debie,
Anthony Perry,
Benjamin Campbell,
Robert Hunjet,
Hussein Abbass
Abstract:
Shepherding involves herding a swarm of agents (\emph{sheep}) by another a control agent (\emph{sheepdog}) towards a goal. Multiple approaches have been documented in the literature to model this behaviour. In this paper, we present a modification to a well-known shepherding approach, and show, via simulation, that this modification improves shepherding efficacy. We then argue that given complexit…
▽ More
Shepherding involves herding a swarm of agents (\emph{sheep}) by another a control agent (\emph{sheepdog}) towards a goal. Multiple approaches have been documented in the literature to model this behaviour. In this paper, we present a modification to a well-known shepherding approach, and show, via simulation, that this modification improves shepherding efficacy. We then argue that given complexity arising from obstacles laden environments, path planning approaches could further enhance this model. To validate this hypothesis, we present a 2-stage evolutionary-based path planning algorithm for shepherding a swarm of agents in 2D environments. In the first stage, the algorithm attempts to find the best path for the sheepdog to move from its initial location to a strategic driving location behind the sheep. In the second stage, it calculates and optimises a path for the sheep. It does so by using \emph{way points} on that path as the sequential sub-goals for the sheepdog to aim towards. The proposed algorithm is evaluated in obstacle laden environments via simulation with further improvements achieved.
△ Less
Submitted 28 August, 2020;
originally announced August 2020.
-
Is Rust Used Safely by Software Developers?
Authors:
Ana Nora Evans,
Bradford Campbell,
Mary Lou Soffa
Abstract:
Rust, an emerging programming language with explosive growth, provides a robust type system that enables programmers to write memory-safe and data-race free code. To allow access to a machine's hardware and to support low-level performance optimizations, a second language, Unsafe Rust, is embedded in Rust. It contains support for operations that are difficult to statically check, such as C-style p…
▽ More
Rust, an emerging programming language with explosive growth, provides a robust type system that enables programmers to write memory-safe and data-race free code. To allow access to a machine's hardware and to support low-level performance optimizations, a second language, Unsafe Rust, is embedded in Rust. It contains support for operations that are difficult to statically check, such as C-style pointers for access to arbitrary memory locations and mutable global variables. When a program uses these features, the compiler is unable to statically guarantee the safety properties Rust promotes. In this work, we perform a large-scale empirical study to explore how software developers are using Unsafe Rust in real-world Rust libraries and applications. Our results indicate that software engineers use the keyword unsafe in less than 30% of Rust libraries, but more than half cannot be entirely statically checked by the Rust compiler because of Unsafe Rust hidden somewhere in a library's call chain. We conclude that although the use of the keyword unsafe is limited, the propagation of unsafeness offers a challenge to the claim of Rust as a memory-safe language. Furthermore, we recommend changes to the Rust compiler and to the central Rust repository's interface to help Rust software developers be aware of when their Rust code is unsafe.
△ Less
Submitted 1 July, 2020;
originally announced July 2020.
-
Fast Intent Classification for Spoken Language Understanding
Authors:
Akshit Tyagi,
Varun Sharma,
Rahul Gupta,
Lynn Samson,
Nan Zhuang,
Zihang Wang,
Bill Campbell
Abstract:
Spoken Language Understanding (SLU) systems consist of several machine learning components operating together (e.g. intent classification, named entity recognition and resolution). Deep learning models have obtained state of the art results on several of these tasks, largely attributed to their better modeling capacity. However, an increase in modeling capacity comes with added costs of higher lat…
▽ More
Spoken Language Understanding (SLU) systems consist of several machine learning components operating together (e.g. intent classification, named entity recognition and resolution). Deep learning models have obtained state of the art results on several of these tasks, largely attributed to their better modeling capacity. However, an increase in modeling capacity comes with added costs of higher latency and energy usage, particularly when operating on low complexity devices. To address the latency and computational complexity issues, we explore a BranchyNet scheme on an intent classification scheme within SLU systems. The BranchyNet scheme when applied to a high complexity model, adds exit points at various stages in the model allowing early decision making for a set of queries to the SLU model. We conduct experiments on the Facebook Semantic Parsing dataset with two candidate model architectures for intent classification. Our experiments show that the BranchyNet scheme provides gains in terms of computational complexity without compromising model accuracy. We also conduct analytical studies regarding the improvements in the computational cost, distribution of utterances that egress from various exit points and the impact of adding more complexity to models with the BranchyNet scheme.
△ Less
Submitted 14 February, 2020; v1 submitted 3 December, 2019;
originally announced December 2019.
-
The Signpost Platform for City-Scale Sensing
Authors:
Joshua Adkins,
Branden Ghena,
Neal Jackson,
Pat Pannuto,
Samuel Rohrer,
Bradford Campbell,
Prabal Dutta
Abstract:
City-scale sensing holds the promise of enabling a deeper understanding of our urban environments. However, a city-scale deployment requires physical installation, power management, and communications---all challenging tasks standing between a good idea and a realized one. This indicates the need for a platform that enables easy deployment and experimentation for applications operating at city sca…
▽ More
City-scale sensing holds the promise of enabling a deeper understanding of our urban environments. However, a city-scale deployment requires physical installation, power management, and communications---all challenging tasks standing between a good idea and a realized one. This indicates the need for a platform that enables easy deployment and experimentation for applications operating at city scale. To address these challenges, we present Signpost, a modular, energy-harvesting platform for city-scale sensing. Signpost simplifies deployment by eliminating the need for connection to wired infrastructure and instead harvesting energy from an integrated solar panel. The platform furnishes the key resources necessary to support multiple, pluggable sensor modules while providing fair, safe, and reliable sharing in the face of dynamic energy constraints. We deploy Signpost with several sensor modules, showing the viability of an energy-harvesting, multi-tenant, sensing system, and evaluate its ability to support sensing applications. We believe Signpost reduces the difficulty inherent in city-scale deployments, enables new experimentation, and provides improved insights into urban health.
△ Less
Submitted 21 February, 2018;
originally announced February 2018.
-
NLP2Code: Code Snippet Content Assist via Natural Language Tasks
Authors:
Brock Angus Campbell,
Christoph Treude
Abstract:
Developers increasingly take to the Internet for code snippets to integrate into their programs. To save developers the time required to switch from their development environments to a web browser in the quest for a suitable code snippet, we introduce NLP2Code, a content assist for code snippets. Unlike related tools, NLP2Code integrates directly into the source code editor and provides developers…
▽ More
Developers increasingly take to the Internet for code snippets to integrate into their programs. To save developers the time required to switch from their development environments to a web browser in the quest for a suitable code snippet, we introduce NLP2Code, a content assist for code snippets. Unlike related tools, NLP2Code integrates directly into the source code editor and provides developers with a content assist feature to close the vocabulary gap between developers' needs and code snippet meta data. Our preliminary evaluation of NLP2Code shows that the majority of invocations lead to code snippets rated as helpful by users and that the tool is able to support a wide range of tasks.
△ Less
Submitted 2 August, 2017; v1 submitted 19 January, 2017;
originally announced January 2017.