title: An Improved Upper Bound on the Rate-Distortion Function of Images

abstract: Recent work has shown that Variational Autoencoders (VAEs) can be used to upper-bound the information rate-distortion (R-D) function of images, i.e., the fundamental limit of lossy image compression. In this paper, we report an improved upper bound on the R-D function of images implemented by (1) introducing a new VAE model architecture, (2) applying variable-rate compression techniques, and (3) proposing a novel \ourfunction{} to stabilize training. We demonstrate that at least 30\% BD-rate reduction w.r.t. the intra prediction mode in VVC codec is achievable, suggesting that there is still great potential for improving lossy image compression. Code is made publicly available at https://github.com/duanzhiihao/lossy-vae.


title: In Situ Soil Property Estimation for Autonomous Earthmoving Using Physics-Infused Neural Networks

abstract: A novel, learning-based method for in situ estimation of soil properties using a physics-infused neural network (PINN) is presented. The network is trained to produce estimates of soil cohesion, angle of internal friction, soil-tool friction, soil failure angle, and residual depth of cut which are then passed through an earthmoving model based on the fundamental equation of earthmoving (FEE) to produce an estimated force. The network ingests a short history of kinematic observations along with past control commands and predicts interaction forces accurately with average error of less than 2kN, 13% of the measured force. To validate the approach, an earthmoving simulation of a bladed vehicle is developed using Vortex Studio, enabling comparison of the estimated parameters to pseudo-ground-truth values which is challenging in real-world experiments. The proposed approach is shown to enable accurate estimation of interaction forces and produces meaningful parameter estimates even when the model and the environmental physics deviate substantially.


title: Emphysema Subtyping on Thoracic Computed Tomography Scans using Deep Neural Networks

abstract: Accurate identification of emphysema subtypes and severity is crucial for effective management of COPD and the study of disease heterogeneity. Manual analysis of emphysema subtypes and severity is laborious and subjective. To address this challenge, we present a deep learning-based approach for automating the Fleischner Society's visual score system for emphysema subtyping and severity analysis. We trained and evaluated our algorithm using 9650 subjects from the COPDGene study. Our algorithm achieved the predictive accuracy at 52\%, outperforming a previously published method's accuracy of 45\%. In addition, the agreement between the predicted scores of our method and the visual scores was good, where the previous method obtained only moderate agreement. Our approach employs a regression training strategy to generate categorical labels while simultaneously producing high-resolution localized activation maps for visualizing the network predictions. By leveraging these dense activation maps, our method possesses the capability to compute the percentage of emphysema involvement per lung in addition to categorical severity scores. Furthermore, the proposed method extends its predictive capabilities beyond centrilobular emphysema to include paraseptal emphysema subtypes.


title: EUSO-OffLine: A Comprehensive Simulation and Analysis Framework

abstract: The complexity of modern cosmic ray observatories and the rich data sets they capture often require a sophisticated software framework to support the simulation of physical processes, detector response, as well as reconstruction and analysis of real and simulated data. Here we present the EUSO-OffLine framework. The code base was originally developed by the Pierre Auger Collaboration, and portions of it have been adopted by other collaborations to suit their needs. We have extended this software to fulfill the requirements of UHECR detectors and VHE neutrino detectors developed for the JEM-EUSO. These path-finder instruments constitute a program to chart the path to a future space-based mission like POEMMA. For completeness, we describe the overall structure of the framework developed by the Pierre Auger collaboration and continue with a description of the JEM-EUSO simulation and reconstruction capabilities. The framework is written predominantly in modern C++ and incorporates third-party libraries chosen based on functionality and our best judgment regarding support and longevity. Modularity is a central notion in the framework design, a requirement for large collaborations in which many individuals contribute to a common code base and often want to compare different approaches to a given problem. For the same reason, the framework is designed to be highly configurable, which allows us to contend with a variety of JEM-EUSO missions and observation scenarios. We also discuss how we incorporate broad, industry-standard testing coverage which is necessary to ensure quality and maintainability of a relatively large code base, and the tools we employ to support a multitude of computing platforms and enable fast, reliable installation of external packages. Finally, we provide a few examples of simulation and reconstruction applications using EUSO-OffLine.


title: Anatomy-Driven Pathology Detection on Chest X-rays

abstract: Pathology detection and delineation enables the automatic interpretation of medical scans such as chest X-rays while providing a high level of explainability to support radiologists in making informed decisions. However, annotating pathology bounding boxes is a time-consuming task such that large public datasets for this purpose are scarce. Current approaches thus use weakly supervised object detection to learn the (rough) localization of pathologies from image-level annotations, which is however limited in performance due to the lack of bounding box supervision. We therefore propose anatomy-driven pathology detection (ADPD), which uses easy-to-annotate bounding boxes of anatomical regions as proxies for pathologies. We study two training approaches: supervised training using anatomy-level pathology labels and multiple instance learning (MIL) with image-level pathology labels. Our results show that our anatomy-level training approach outperforms weakly supervised methods and fully supervised detection with limited training samples, and our MIL approach is competitive with both baseline approaches, therefore demonstrating the potential of our approach.


title: A Social Network Approach to Analyzing Token Properties and Abnormal Events in Decentralized Exchanges

abstract: The properties of tokens within the Ethereum blockchain, such as their current prices, trade volumes, and potential future values, have been the subjects of numerous studies. Employing social networks and graphs, as powerful tools for modeling connections within groups or communities would provide valuable guidance for analyzing these properties. This study mainly focuses on creating and examining networks related to two major decentralized exchanges including Uniswap Version 2 (UniswapV2) and SushiSwap. We have discovered that the distribution of nodes' degrees follows a power law that makes them scale-free networks, in addition, the centrality of tokens in exchange graphs provides valuable insights into their price and significance in cryptocurrency markets. These measures of centrality can be used to detect anomalies in cryptocurrency markets and prices. Notably, these networks exhibit remarkably similar structures, hinting at exciting research opportunities for modeling such networks.


title: Unveiling Intractable Epileptogenic Brain Networks with Deep Learning Algorithms: A Novel and Comprehensive Framework for Scalable Seizure Prediction with Unimodal Neuroimaging Data in Pediatric Patients

abstract: Epilepsy is a prevalent neurological disorder affecting 50 million individuals worldwide and 1.2 million Americans. There exist millions of pediatric patients with intractable epilepsy, a condition in which seizures fail to come under control. The occurrence of seizures can result in physical injury, disorientation, unconsciousness, and additional symptoms that could impede children's ability to participate in everyday tasks. Predicting seizures can help parents and healthcare providers take precautions, prevent risky situations, and mentally prepare children to minimize anxiety and nervousness associated with the uncertainty of a seizure. This research proposes a novel and comprehensive framework to predict seizures in pediatric patients by evaluating machine learning algorithms on unimodal neuroimaging data consisting of electroencephalogram signals. The bandpass filtering and independent component analysis proved to be effective in reducing the noise and artifacts from the dataset. Various machine learning algorithms' performance is evaluated on important metrics such as accuracy, precision, specificity, sensitivity, F1 score and MCC. The results show that the deep learning algorithms are more successful in predicting seizures than logistic Regression, and k nearest neighbors. The recurrent neural network (RNN) gave the highest precision and F1 Score, long short-term memory (LSTM) outperformed RNN in accuracy and convolutional neural network (CNN) resulted in the highest Specificity. This research has significant implications for healthcare providers in proactively managing seizure occurrence in pediatric patients, potentially transforming clinical practices, and improving pediatric care.


title: Rapid Exchange Cooling with Trapped Ions

abstract: The trapped-ion quantum charge-coupled device (QCCD) architecture is a leading candidate for advanced quantum information processing. In current QCCD implementations, imperfect ion transport and anomalous heating can excite ion motion during a calculation. To counteract this, intermediate cooling is necessary to maintain high-fidelity gate performance. Cooling the computational ions sympathetically with ions of another species, a commonly employed strategy, creates a significant runtime bottleneck. Here, we demonstrate a different approach we call exchange cooling. Unlike sympathetic cooling, exchange cooling does not require trapping two different atomic species. The protocol introduces a bank of "coolant" ions which are repeatedly laser cooled. A computational ion can then be cooled by transporting a coolant ion into its proximity. We test this concept experimentally with two $^{40}\mathrm{Ca}^{+}$ ions, executing the necessary transport in 107 $\mathrm{\mu s}$, an order of magnitude faster than typical sympathetic cooling durations. We remove over 96%, and as many as 102(5) quanta, of axial motional energy from the computational ion. We verify that re-cooling the coolant ion does not decohere the computational ion. This approach validates the feasibility of a single-species QCCD processor, capable of fast quantum simulation and computation.


title: Maurer-Cartan equation for gentle algebras

abstract: Let $A= \Bbbk Q/I$ be a finite-dimensional gentle algebra. In this article, under some hypothesis on the quiver $Q$, we give conditions for nilpotency of the $L_\infty$-structure on the shifted Bardzell's complex $B(A)[1]$. For nilpotent cases, we describe Maurer-Cartan elements.


title: Representation Learning for Sequential Volumetric Design Tasks

abstract: Volumetric design, also called massing design, is the first and critical step in professional building design which is sequential in nature. As the volumetric design process is complex, the underlying sequential design process encodes valuable information for designers. Many efforts have been made to automatically generate reasonable volumetric designs, but the quality of the generated design solutions varies, and evaluating a design solution requires either a prohibitively comprehensive set of metrics or expensive human expertise. While previous approaches focused on learning only the final design instead of sequential design tasks, we propose to encode the design knowledge from a collection of expert or high-performing design sequences and extract useful representations using transformer-based models. Later we propose to utilize the learned representations for crucial downstream applications such as design preference evaluation and procedural design generation. We develop the preference model by estimating the density of the learned representations whereas we train an autoregressive transformer model for sequential design generation. We demonstrate our ideas by leveraging a novel dataset of thousands of sequential volumetric designs. Our preference model can compare two arbitrarily given design sequences and is almost 90% accurate in evaluation against random design sequences. Our autoregressive model is also capable of autocompleting a volumetric design sequence from a partial design sequence.


title: Multivariate Mat\'ern Models -- A Spectral Approach

abstract: The classical Mat\'ern model has been a staple in spatial statistics. Novel data-rich applications in environmental and physical sciences, however, call for new, flexible vector-valued spatial and space-time models. Therefore, the extension of the classical Mat\'ern model has been a problem of active theoretical and methodological interest. In this paper, we offer a new perspective to extending the Mat\'ern covariance model to the vector-valued setting. We adopt a spectral, stochastic integral approach, which allows us to address challenging issues on the validity of the covariance structure and at the same time to obtain new, flexible, and interpretable models. In particular, our multivariate extensions of the Mat\'ern model allow for asymmetric covariance structures. Moreover, the spectral approach provides an essentially complete flexibility in modeling the local structure of the process. We establish closed-form representations of the cross-covariances when available, compare them with existing models, simulate Gaussian instances of these new processes, and demonstrate estimation of the model's parameters through maximum likelihood. An application of the new class of multivariate Mat\'ern models to environmental data indicate their success in capturing inherent covariance-asymmetry phenomena.


title: A Structurally Informed Data Assimilation Approach for Nonlinear Partial Differential Equations

abstract: Ensemble transform Kalman filtering (ETKF) data assimilation is often used to combine available observations with numerical simulations to obtain statistically accurate and reliable state representations in dynamical systems. However, it is well known that the commonly used Gaussian distribution assumption introduces biases for state variables that admit discontinuous profiles, which are prevalent in nonlinear partial differential equations. This investigation designs a new structurally informed non-Gaussian prior that exploits statistical information from the simulated state variables. In particular, we construct a new weighting matrix based on the second moment of the gradient information of the state variable to replace the prior covariance matrix used for model/data compromise in the ETKF data assimilation framework. We further adapt our weighting matrix to include information in discontinuity regions via a clustering technique. Our numerical experiments demonstrate that this new approach yields more accurate estimates than those obtained using ETKF on shallow water equations, even when ETKF is enhanced with inflation and localization techniques.


title: The Detection of Higher-Order Millimeter Hydrogen Recombination Lines in the Large Magellanic Cloud

abstract: We report the first extragalactic detection of the higher-order millimeter hydrogen recombination lines ($\Delta n>2$). The $\gamma$-, $\epsilon$-, and $\eta$-transitions have been detected toward the millimeter continuum source N105-1A in the star-forming region N105 in the Large Magellanic Cloud (LMC) with the Atacama Large Millimeter/submillimeter Array (ALMA). We use the H40$\alpha$ line, the brightest of the detected recombination lines (H40$\alpha$, H36$\beta$, H50$\beta$, H41$\gamma$, H57$\gamma$, H49$\epsilon$, H53$\eta$, and H54$\eta$), and/or the 3 mm free-free continuum emission to determine the physical parameters of N105-1A (the electron temperature, emission measure, electron density, and size) and study ionized gas kinematics. We compare the physical properties of N105-1A to a large sample of Galactic compact and ultracompact (UC) H II regions and conclude that N105-1A is similar to the most luminous ($L>10^5$ $L_{\odot}$) UC H II regions in the Galaxy. N105-1A is ionized by an O5.5 V star, it is deeply embedded in its natal molecular clump, and likely associated with a (proto)cluster. We incorporate high-resolution molecular line data including CS, SO, SO$_2$, and CH$_3$OH ($\sim$0.12 pc), and HCO$^{+}$ and CO ($\sim$0.087 pc) to explore the molecular environment of N105-1A. Based on the CO data, we find evidence for a cloud-cloud collision that likely triggered star formation in the region. We find no clear outflow signatures, but the presence of filaments and streamers indicates on-going accretion onto the clump hosting the UC H II region. Sulfur chemistry in N105-1A is consistent with the accretion shock model predictions.


title: The singular support of an $\ell$-adic sheaf

abstract: We define the singular support of an $\ell$-adic sheaf on a smooth variety over any field. To do this, we combine Beilinson's construction of the singular support for torsion \'etale sheaves with Hansen and Scholze's theory of universal local acyclicity for $\ell$-adic sheaves.


title: Distances between realizations of order types

abstract: Any $n$-tuple of points in the plane can be moved to any other $n$-tuple by a continuous motion with at most $\binom{n}{3}$ intermediate changes of the order type. Even for tuples with the same order type, the cubic bound is sharp: there exist pairs of $n$-tuples of the same order type requiring $c\binom{n}{3}$ intermediate changes.


title: Approximating High-Dimensional Minimal Surfaces with Physics-Informed Neural Networks

abstract: In this paper, we compute numerical approximations of the minimal surfaces, an essential type of Partial Differential Equation (PDE), in higher dimensions. Classical methods cannot handle it in this case because of the Curse of Dimensionality, where the computational cost of these methods increases exponentially fast in response to higher problem dimensions, far beyond the computing capacity of any modern supercomputers. Only in the past few years have machine learning researchers been able to mitigate this problem. The solution method chosen here is a model known as a Physics-Informed Neural Network (PINN) which trains a deep neural network (DNN) to solve the minimal surface PDE. It can be scaled up into higher dimensions and trained relatively quickly even on a laptop with no GPU. Due to the inability to view the high-dimension output, our data is presented as snippets of a higher-dimension shape with enough fixed axes so that it is viewable with 3-D graphs. Not only will the functionality of this method be tested, but we will also explore potential limitations in the method's performance.


title: Artificial General Intelligence for Radiation Oncology

abstract: The emergence of artificial general intelligence (AGI) is transforming radiation oncology. As prominent vanguards of AGI, large language models (LLMs) such as GPT-4 and PaLM 2 can process extensive texts and large vision models (LVMs) such as the Segment Anything Model (SAM) can process extensive imaging data to enhance the efficiency and precision of radiation therapy. This paper explores full-spectrum applications of AGI across radiation oncology including initial consultation, simulation, treatment planning, treatment delivery, treatment verification, and patient follow-up. The fusion of vision data with LLMs also creates powerful multimodal models that elucidate nuanced clinical patterns. Together, AGI promises to catalyze a shift towards data-driven, personalized radiation therapy. However, these models should complement human expertise and care. This paper provides an overview of how AGI can transform radiation oncology to elevate the standard of patient care in radiation oncology, with the key insight being AGI's ability to exploit multimodal clinical data at scale.


title: Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning

abstract: We present CM3Leon (pronounced "Chameleon"), a retrieval-augmented, token-based, decoder-only multi-modal language model capable of generating and infilling both text and images. CM3Leon uses the CM3 multi-modal architecture but additionally shows the extreme benefits of scaling up and tuning on more diverse instruction-style data. It is the first multi-modal model trained with a recipe adapted from text-only language models, including a large-scale retrieval-augmented pre-training stage and a second multi-task supervised fine-tuning (SFT) stage. It is also a general-purpose model that can do both text-to-image and image-to-text generation, allowing us to introduce self-contained contrastive decoding methods that produce high-quality outputs. Extensive experiments demonstrate that this recipe is highly effective for multi-modal models. CM3Leon achieves state-of-the-art performance in text-to-image generation with 5x less training compute than comparable methods (zero-shot MS-COCO FID of 4.88). After SFT, CM3Leon can also demonstrate unprecedented levels of controllability in tasks ranging from language-guided image editing to image-controlled generation and segmentation.


title: BWSNet: Automatic Perceptual Assessment of Audio Signals

abstract: This paper introduces BWSNet, a model that can be trained from raw human judgements obtained through a Best-Worst scaling (BWS) experiment. It maps sound samples into an embedded space that represents the perception of a studied attribute. To this end, we propose a set of cost functions and constraints, interpreting trial-wise ordinal relations as distance comparisons in a metric learning task. We tested our proposal on data from two BWS studies investigating the perception of speech social attitudes and timbral qualities. For both datasets, our results show that the structure of the latent space is faithful to human judgements.


title: Quantum Voting and Violation of Gibbard-Satterthwaite's Impossibility Theorem

abstract: In the realm of algorithmic economics, voting systems are evaluated and compared by examining the properties or axioms they satisfy. While this pursuit has yielded valuable insights, it has also led to seminal impossibility results such as Arrow's and Gibbard-Satterthwaite's Impossibility Theorems, which pose challenges in designing ideal voting systems. Enter the domain of quantum computing: recent advancements have introduced the concept of quantum voting systems, which have many potential applications including in security and blockchain. Building on recent works that bypass Arrow's Impossibility Theorem using quantum voting systems, our research extends Quantum Condorcet Voting (QCV) to counter the Gibbard-Satterthwaite Impossibility Theorem in a quantum setting. To show this, we introduce a quantum-specific notion of truthfulness, extend ideas like incentive compatibility and the purpose of onto to the quantum domain, and introduce new tools to map social welfare functions to social choice functions in this domain.


title: How do Developers Improve Code Readability? An Empirical Study of Pull Requests

abstract: Readability models and tools have been proposed to measure the effort to read code. However, these models are not completely able to capture the quality improvements in code as perceived by developers. To investigate possible features for new readability models and production-ready tools, we aim to better understand the types of readability improvements performed by developers when actually improving code readability, and identify discrepancies between suggestions of automatic static tools and the actual improvements performed by developers. We collected 370 code readability improvements from 284 Merged Pull Requests (PRs) under 109 GitHub repositories and produce a catalog with 26 different types of code readability improvements, where in most of the scenarios, the developers improved the code readability to be more intuitive, modular, and less verbose. Surprisingly, SonarQube only detected 26 out of the 370 code readability improvements. This suggests that some of the catalog produced has not yet been addressed by SonarQube rules, highlighting the potential for improvement in Automatic static analysis tools (ASAT) code readability rules as they are perceived by developers.


title: How to measure the free energy and partition function from atom-atom correlations

abstract: We propose an experimental approach for determining thermodynamic properties of ultracold atomic gases with short-range interactions. As a test case, we focus on the one-dimensional (1D) Bose gas described by the integrable Lieb-Liniger model. The proposed approach relies on deducing the Helmholtz or Landau free energy directly from measurements of local atom-atom correlations by utilising the inversion of a finite-temperature version of the Hellmann-Feynman theorem. We demonstrate this approach theoretically by deriving approximate analytic expressions for the free energies in specific asymptotic regimes of the 1D Bose gas and find excellent agreement with the exact results based on the thermodynamic Bethe ansatz available for this integrable model.


title: Self-Supervised Pretraining Improves Performance and Inference Efficiency in Multiple Lung Ultrasound Interpretation Tasks

abstract: In this study, we investigated whether self-supervised pretraining could produce a neural network feature extractor applicable to multiple classification tasks in B-mode lung ultrasound analysis. When fine-tuning on three lung ultrasound tasks, pretrained models resulted in an improvement of the average across-task area under the receiver operating curve (AUC) by 0.032 and 0.061 on local and external test sets respectively. Compact nonlinear classifiers trained on features outputted by a single pretrained model did not improve performance across all tasks; however, they did reduce inference time by 49% compared to serial execution of separate fine-tuned models. When training using 1% of the available labels, pretrained models consistently outperformed fully supervised models, with a maximum observed test AUC increase of 0.396 for the task of view classification. Overall, the results indicate that self-supervised pretraining is useful for producing initial weights for lung ultrasound classifiers.


title: A unified approach to self-improving property via K-functionals

abstract: In this paper we obtain new quantitative estimates that improve the classical inequalities: Poincar\'e-Ponce, Gaussian Sobolev, and John-Nirenberg. Our method is based on the K-functionals and allows one to derive self-improving type inequalities. We show the optimality of the method by obtaining new Bourgain-Brezis-Mironescu and Maz'ya-Shaposhnikova limiting formulas. In particular, we derive these formulas for fractional powers of infinitesimal generators of operator semigroups on Banach spaces.


title: The SLED (Shelf Life Expiration Date) Tracking System: Using Machine Learning Algorithms to Combat Food Waste and Food Borne Illnesses

abstract: The issue of food waste is a major problem contributing to the emission of greenhouse gases into the environment in addition to causing illness in humans. This research aimed to develop a correlation between the amount of time until a food spoiled and dates on food labels in conjunction with sensory observations. Sensory observations are more accurate as they are immediate observations that are specific to the food. This experiment observed bananas, bread, milk, eggs, and leafy greens over a period of time using characteristics specific to the food to quantify food spoilage. It was shown that the actual time until spoilage for all foods was longer than that of the best by date and that sensory observations proved to be a more accurate factor in determining spoilage. From this data, a machine learning algorithm was trained to predict if food was spoiled or not, in addition to the number of days until spoilage. This was presented to the consumer as an app, where the user can track foods and are reminded to check on them to prevent wastage. In addition, the experimental procedures were incorporated into a test kit for the consumer to take instructed observations to assess the spoilage of their food, which are then entered into the app to improve the algorithm. This paper discusses the individual effects of sensorial observations on each food and examines the shifting of consumer habits through an app and test kit to combat environmental consequences of food waste.


title: Testing Meson Portal Dark Sector Solutions to the MiniBooNE Anomaly at CCM

abstract: A solution to the MiniBooNE excess invoking rare three-body decays of the charged pions and kaons to new states in the MeV mass scale was recently proposed as a dark-sector explanation. This class of solution illuminates the fact that, while the charged pions were focused in the target-mode run, their decay products were isotropically suppressed in the beam-dump-mode run in which no excess was observed. This suggests a new physics solution correlated to the mesonic sector. We investigate an extended set of phenomenological models that can explain the MiniBooNE excess as a dark sector solution, utilizing long-lived particles that might be produced in the three-body decays of the charged mesons and the two-body anomalous decays of the neutral mesons. Over a broad set of interactions with the long-lived particles, we show that these scenarios can be compatible with constraints from LSND, KARMEN, and MicroBooNE, and evaluate the sensitivity of the ongoing and future data taken by the Coherent CAPTAIN Mills experiment (CCM) to a potential discovery in this parameter space.


title: Comparative Evaluation of Metaheuristic Algorithms for Hyperparameter Selection in Short-Term Weather Forecasting

abstract: Weather forecasting plays a vital role in numerous sectors, but accurately capturing the complex dynamics of weather systems remains a challenge for traditional statistical models. Apart from Auto Regressive time forecasting models like ARIMA, deep learning techniques (Vanilla ANNs, LSTM and GRU networks), have shown promise in improving forecasting accuracy by capturing temporal dependencies. This paper explores the application of metaheuristic algorithms, namely Genetic Algorithm (GA), Differential Evolution (DE), and Particle Swarm Optimization (PSO), to automate the search for optimal hyperparameters in these model architectures. Metaheuristic algorithms excel in global optimization, offering robustness, versatility, and scalability in handling non-linear problems. We present a comparative analysis of different model architectures integrated with metaheuristic optimization, evaluating their performance in weather forecasting based on metrics such as Mean Squared Error (MSE) and Mean Absolute Percentage Error (MAPE). The results demonstrate the potential of metaheuristic algorithms in enhancing weather forecasting accuracy \& helps in determining the optimal set of hyper-parameters for each model. The paper underscores the importance of harnessing advanced optimization techniques to select the most suitable metaheuristic algorithm for the given weather forecasting task.


title: Compatibility graphs in scheduling on batch processing machines

abstract: We consider the problem of minimizing the makespan on batch processing identical machines, subject to compatibility constraints, where two jobs are compatible if they can be processed simultaneously in a same batch. These constraints are modeled by an undirected graph $G$, in which compatible jobs are represented by adjacent vertices. We show that several subproblems are polynomial. We propose some exact polynomial algorithms to solve these subproblems. To solve the general case, we propose a mixed-integer linear programming (MILP) formulation alongside with heuristic approaches. Furthermore, computational experiments are carried out to measure the performance of the proposed methods.


title: Geometric Mechanics of the Vertical Slice Model

abstract: The goals of the present work are to: (i) investigate the dynamics of oceanic frontogenesis by taking advantage of the geometric mechanics underlying the class of Vertical Slice Models (VSMs) of ocean dynamics; and (ii) illustrate the versatility and utility of deterministic and stochastic variational approaches by deriving several variants of wave-current interaction models which describe the effects of internal waves propagating within a vertical planar slice embedded in a 3D region of constant horizontal gradient of buoyancy in the direction transverse to the vertical plane.


title: Detection of Unknown-Unknowns in Human-in-Plant Human-in-Loop Systems Using Physics Guided Process Models

abstract: Unknown-unknowns are operational scenarios in systems that are not accounted for in the design and test phase. In such scenarios, the operational behavior of the Human-in-loop (HIL) Human-in-Plant (HIP) systems is not guaranteed to meet requirements such as safety and efficacy. We propose a novel framework for analyzing the operational output characteristics of safety-critical HIL-HIP systems that can discover unknown-unknown scenarios and evaluate potential safety hazards. We propose dynamics-induced hybrid recurrent neural networks (DiH-RNN) to mine a physics-guided surrogate model (PGSM) that checks for deviation of the cyber-physical system (CPS) from safety-certified operational characteristics. The PGSM enables early detection of unknown-unknowns based on the physical laws governing the system. We demonstrate the detection of operational changes in an Artificial Pancreas(AP) due to unknown insulin cartridge errors.


title: Screening of Pneumonia and Urinary Tract Infection at Triage using TriNet

abstract: Due to the steady rise in population demographics and longevity, emergency department visits are increasing across North America. As more patients visit the emergency department, traditional clinical workflows become overloaded and inefficient, leading to prolonged wait-times and reduced healthcare quality. One of such workflows is the triage medical directive, impeded by limited human workload, inaccurate diagnoses and invasive over-testing. To address this issue, we propose TriNet: a machine learning model for medical directives that automates first-line screening at triage for conditions requiring downstream testing for diagnosis confirmation. To verify screening potential, TriNet was trained on hospital triage data and achieved high positive predictive values in detecting pneumonia (0.86) and urinary tract infection (0.93). These models outperform current clinical benchmarks, indicating that machine-learning medical directives can offer cost-free, non-invasive screening with high specificity for common conditions, reducing the risk of over-testing while increasing emergency department efficiency.


title: A pragma based C++ framework for hybrid quantum/classical computation

abstract: Quantum computers promise exponential speed ups over classical computers for various tasks. This emerging technology is expected to have its first huge impact in High Performance Computing (HPC), as it can solve problems beyond the reach of HPC. To that end, HPC will require quantum accelerators, which will enable applications to run on both classical and quantum devices, via hybrid quantum-classical nodes. Hybrid quantum-HPC applications should be scalable, executable on Quantum Error Corrected (QEC) devices, and could use quantum-classical primitives. However, the lack of scalability, poor performances, and inability to insert classical schemes within quantum applications has prevented current quantum frameworks from being adopted by the HPC community. This paper specifies the requirements of a hybrid quantum-classical framework compatible with HPC environments, and introduces a novel hardware-agnostic framework called Q-Pragma. This framework extends the classical programming language C++ heavily used in HPC via the addition of pragma directives to manage quantum computations.


title: Distributed Variational Inference for Online Supervised Learning

abstract: Developing efficient solutions for inference problems in intelligent sensor networks is crucial for the next generation of location, tracking, and mapping services. This paper develops a scalable distributed probabilistic inference algorithm that applies to continuous variables, intractable posteriors and large-scale real-time data in sensor networks. In a centralized setting, variational inference is a fundamental technique for performing approximate Bayesian estimation, in which an intractable posterior density is approximated with a parametric density. Our key contribution lies in the derivation of a separable lower bound on the centralized estimation objective, which enables distributed variational inference with one-hop communication in a sensor network. Our distributed evidence lower bound (DELBO) consists of a weighted sum of observation likelihood and divergence to prior densities, and its gap to the measurement evidence is due to consensus and modeling errors. To solve binary classification and regression problems while handling streaming data, we design an online distributed algorithm that maximizes DELBO, and specialize it to Gaussian variational densities with non-linear likelihoods. The resulting distributed Gaussian variational inference (DGVI) efficiently inverts a $1$-rank correction to the covariance matrix. Finally, we derive a diagonalized version for online distributed inference in high-dimensional models, and apply it to multi-robot probabilistic mapping using indoor LiDAR data.


title: Big Tiles in Hyperbolic Groups

abstract: We prove that if $\Gamma $ is a word hyperbolic group and $K$ is a finite subset of $\Gamma $, then $\Gamma $ admits a tile containing $K$.


title: The Iberian Exception: An overview of its effects over its first 100 days

abstract: This paper offers an independent assessment of certain key economic effects of the Iberian Exception (IE). Their stated aim was to reduce the major component of electricity prices for most Iberian consumers, a component which was indexed to Iberian wholesale power market spot prices power market prices that were rising alarmingly due to extremely tight international markets for natural gas. The Spanish Government estimates that, during its first 100 days, the IE provided substantial benefits for consumers affected by the IE, which included over 10 million small consumers as well as many large ones, but the authors of this study question that estimate. The authors of this paper argue that the estimated effect of the IE on retail prices depends critically on the assumptions about what would have occurred in the absence of the IE, i.e., in a counterfactual scenario. Although counterfactuals are always difficult to construct, the government s counterfactual ignores demand elasticity, and this inflates their estimate of immediate consumer benefits. Using hourly data on the wholesale electricity market for the first 100 days of the IE, this paper s analysis of alternative counterfactuals that reflect the effects of demand elasticity shows substantially lower benefits of the IE for consumers than the Spanish government estimates. Indeed, this paper s analysis suggests that affected consumers would have paid somewhat less for electricity in the first 100 days of the IE had it not been introduced. The authors identify several other potential short and longterm effects of the IE that deserve further study. These include increased margins for fossil fired generators, reduced margins for some decarbonized inframarginal plant, heightened investor perceptions of regulatory risk, weakened incentives for efficient consumption, and higher carbon emissions and gas prices.


title: Directionality-Aware Mixture Model Parallel Sampling for Efficient Linear Parameter Varying Dynamical System Learning

abstract: The Linear Parameter Varying Dynamical System (LPV-DS) is an effective approach that learns stable, time-invariant motion policies using statistical modeling and semi-definite optimization to encode complex motions for reactive robot control. Despite its strengths, the LPV-DS learning approach faces challenges in achieving a high model accuracy without compromising the computational efficiency. To address this, we introduce the Directionality-Aware Mixture Model (DAMM), a novel statistical model that applies the Riemannian metric on the n-sphere $\mathbb{S}^n$ to efficiently blend non-Euclidean directional data with $\mathbb{R}^m$ Euclidean states. Additionally, we develop a hybrid Markov chain Monte Carlo technique that combines Gibbs Sampling with Split/Merge Proposal, allowing for parallel computation to drastically speed up inference. Our extensive empirical tests demonstrate that LPV-DS integrated with DAMM achieves higher reproduction accuracy, better model efficiency, and near real-time/online learning compared to standard estimation methods on various datasets. Lastly, we demonstrate its suitability for incrementally learning multi-behavior policies in real-world robot experiments.


title: T-SaS: Toward Shift-aware Dynamic Adaptation for Streaming Data

abstract: In many real-world scenarios, distribution shifts exist in the streaming data across time steps. Many complex sequential data can be effectively divided into distinct regimes that exhibit persistent dynamics. Discovering the shifted behaviors and the evolving patterns underlying the streaming data are important to understand the dynamic system. Existing methods typically train one robust model to work for the evolving data of distinct distributions or sequentially adapt the model utilizing explicitly given regime boundaries. However, there are two challenges: (1) shifts in data streams could happen drastically and abruptly without precursors. Boundaries of distribution shifts are usually unavailable, and (2) training a shared model for all domains could fail to capture varying patterns. This paper aims to solve the problem of sequential data modeling in the presence of sudden distribution shifts that occur without any precursors. Specifically, we design a Bayesian framework, dubbed as T-SaS, with a discrete distribution-modeling variable to capture abrupt shifts of data. Then, we design a model that enable adaptation with dynamic network selection conditioned on that discrete variable. The proposed method learns specific model parameters for each distribution by learning which neurons should be activated in the full network. A dynamic masking strategy is adopted here to support inter-distribution transfer through the overlapping of a set of sparse networks. Extensive experiments show that our proposed method is superior in both accurately detecting shift boundaries to get segments of varying distributions and effectively adapting to downstream forecast or classification tasks.


title: A projective resolution for the Fomin-Kirillov algebra $\operatorname{FK}(4)$

abstract: In this article we show that, given a quadratic algebra satisfying some assumptions, which we call having a resolving datum, one can construct a projective resolution of the trivial module which is obtained as iterated cones of Koszul complexes, and this projective resolution is minimal under some further assumptions. We observe that many examples of quadratic algebras studied so far have a resolving datum, and that the (minimal) projective resolutions constructed for all of them in the literature are an example of our construction. The second main result of the article is that the Fomin-Kirillov algebra $\operatorname{FK}(4)$ of index $4$ has a resolving datum.


title: Music Source Separation with Band-Split RoPE Transformer

abstract: Music source separation (MSS) aims to separate a music recording into multiple musically distinct stems, such as vocals, bass, drums, and more. Recently, deep learning approaches such as convolutional neural networks (CNNs) and recurrent neural networks (RNNs) have been used, but the improvement is still limited. In this paper, we propose a novel frequency-domain approach based on a Band-Split RoPE Transformer (called BS-RoFormer). BS-RoFormer relies on a band-split module to project the input complex spectrogram into subband-level representations, and then arranges a stack of hierarchical Transformers to model the inner-band as well as inter-band sequences for multi-band mask estimation. To facilitate training the model for MSS, we propose to use the Rotary Position Embedding (RoPE). The BS-RoFormer system trained on MUSDB18HQ and 500 extra songs ranked the first place in the MSS track of Sound Demixing Challenge (SDX23). Benchmarking a smaller version of BS-RoFormer on MUSDB18HQ, we achieve state-of-the-art result without extra training data, with 9.80 dB of average SDR.


title: Project-Fair and Truthful Mechanisms for Budget Aggregation

abstract: We study the budget aggregation problem in which a set of strategic voters must split a finite divisible resource (such as money or time) among a set of competing projects. Our goal is twofold: We seek truthful mechanisms that provide fairness guarantees to the projects. For the first objective, we focus on the class of moving phantom mechanisms [Freeman et al., 2021], which are -- to this day -- essentially the only known truthful mechanisms in this setting. For project fairness, we consider the mean division as a fair baseline, and bound the maximum difference between the funding received by any project and this baseline. We propose a novel and simple moving phantom mechanism that provides optimal project fairness guarantees. As a corollary of our results, we show that our new mechanism minimizes the $\ell_1$ distance to the mean (a measure suggested by Caragiannis et al. [2022]) for three projects and gives the first non-trivial bounds on this quantity for more than three projects.


title: Utilizing Generative Adversarial Networks for Stable Structure Generation in Angry Birds

abstract: This paper investigates the suitability of using Generative Adversarial Networks (GANs) to generate stable structures for the physics-based puzzle game Angry Birds. While previous applications of GANs for level generation have been mostly limited to tile-based representations, this paper explores their suitability for creating stable structures made from multiple smaller blocks. This includes a detailed encoding/decoding process for converting between Angry Birds level descriptions and a suitable grid-based representation, as well as utilizing state-of-the-art GAN architectures and training methods to produce new structure designs. Our results show that GANs can be successfully applied to generate a varied range of complex and stable Angry Birds structures.


title: Generative Algorithms for Fusion of Physics-Based Wildfire Spread Models with Satellite Data for Initializing Wildfire Forecasts

abstract: Increases in wildfire activity and the resulting impacts have prompted the development of high-resolution wildfire behavior models for forecasting fire spread. Recent progress in using satellites to detect fire locations further provides the opportunity to use measurements to improve fire spread forecasts from numerical models through data assimilation. This work develops a method for inferring the history of a wildfire from satellite measurements, providing the necessary information to initialize coupled atmosphere-wildfire models from a measured wildfire state in a physics-informed approach. The fire arrival time, which is the time the fire reaches a given spatial location, acts as a succinct representation of the history of a wildfire. In this work, a conditional Wasserstein Generative Adversarial Network (cWGAN), trained with WRF-SFIRE simulations, is used to infer the fire arrival time from satellite active fire data. The cWGAN is used to produce samples of likely fire arrival times from the conditional distribution of arrival times given satellite active fire detections. Samples produced by the cWGAN are further used to assess the uncertainty of predictions. The cWGAN is tested on four California wildfires occurring between 2020 and 2022, and predictions for fire extent are compared against high resolution airborne infrared measurements. Further, the predicted ignition times are compared with reported ignition times. An average Sorensen's coefficient of 0.81 for the fire perimeters and an average ignition time error of 32 minutes suggest that the method is highly accurate.


title: Generative AI-aided Joint Training-free Secure Semantic Communications via Multi-modal Prompts

abstract: Semantic communication (SemCom) holds promise for reducing network resource consumption while achieving the communications goal. However, the computational overheads in jointly training semantic encoders and decoders-and the subsequent deployment in network devices-are overlooked. Recent advances in Generative artificial intelligence (GAI) offer a potential solution. The robust learning abilities of GAI models indicate that semantic decoders can reconstruct source messages using a limited amount of semantic information, e.g., prompts, without joint training with the semantic encoder. A notable challenge, however, is the instability introduced by GAI's diverse generation ability. This instability, evident in outputs like text-generated images, limits the direct application of GAI in scenarios demanding accurate message recovery, such as face image transmission. To solve the above problems, this paper proposes a GAI-aided SemCom system with multi-model prompts for accurate content decoding. Moreover, in response to security concerns, we introduce the application of covert communications aided by a friendly jammer. The system jointly optimizes the diffusion step, jamming, and transmitting power with the aid of the generative diffusion models, enabling successful and secure transmission of the source messages.


title: Compressing Vision Transformers for Low-Resource Visual Learning

abstract: Vision transformer (ViT) and its variants have swept through visual learning leaderboards and offer state-of-the-art accuracy in tasks such as image classification, object detection, and semantic segmentation by attending to different parts of the visual input and capturing long-range spatial dependencies. However, these models are large and computation-heavy. For instance, the recently proposed ViT-B model has 86M parameters making it impractical for deployment on resource-constrained devices. As a result, their deployment on mobile and edge scenarios is limited. In our work, we aim to take a step toward bringing vision transformers to the edge by utilizing popular model compression techniques such as distillation, pruning, and quantization. Our chosen application environment is an unmanned aerial vehicle (UAV) that is battery-powered and memory-constrained, carrying a single-board computer on the scale of an NVIDIA Jetson Nano with 4GB of RAM. On the other hand, the UAV requires high accuracy close to that of state-of-the-art ViTs to ensure safe object avoidance in autonomous navigation, or correct localization of humans in search-and-rescue. Inference latency should also be minimized given the application requirements. Hence, our target is to enable rapid inference of a vision transformer on an NVIDIA Jetson Nano (4GB) with minimal accuracy loss. This allows us to deploy ViTs on resource-constrained devices, opening up new possibilities in surveillance, environmental monitoring, etc. Our implementation is made available at https://github.com/chensy7/efficient-vit.


title: Time-Varying Feedback Optimization for Quadratic Programs with Heterogeneous Gradient Step Sizes

abstract: Online feedback-based optimization has become a promising framework for real-time optimization and control of complex engineering systems. This tutorial paper surveys the recent advances in the field as well as provides novel convergence results for primal-dual online algorithms with heterogeneous step sizes for different elements of the gradient. The analysis is performed for quadratic programs and the approach is illustrated on applications for adaptive step-size and model-free online algorithms, in the context of optimal control of modern power systems.


title: Collisional flavor swap with neutrino self-interactions

abstract: Neutrinos play pivotal roles in determining fluid dynamics, nucleosynthesis, and their observables in core-collapse supernova (CCSN) and binary neutron star merger (BNSM). In this paper, we present a novel phenomenon, collisional flavor swap, in which neutrino-matter interactions trigger the complete interchange of neutrino spectra between two different flavors, aided by neutrino self-interactions. We find that a necessary condition to trigger the collisional swap is occurrences of resonance-like collisional flavor instability. In cases where neutrino self-interactions substantially dominate over the collision rate, the collisional swap occurs in the entire neutrino energy spectrum, while intriguing energy dependent features can emerge after the completion of flavor swap. Since flavor swaps correspond to the most extreme case in flavor conversions, they have a great potential to affect CCSN and BNSM phenomena.


title: Soficity of free extensions of effective subshifts

abstract: Let $G$ be a group and $H\leqslant G$ a subgroup. The free extension of an $H$-subshift $X$ to $G$ is the $G$-subshift $\widetilde{X}$ whose configurations are those for which the restriction to every coset of $H$ is a configuration from $X$. We study the case of $G = H \times K$ for infinite and finitely generated groups $H$ and $K$: on the one hand we show that if $K$ is nonamenable and $H$ has decidable word problem, then the free extension to $G$ of any $H$-subshift which is effectively closed is a sofic $G$-subshift. On the other hand we prove that if both $H$ and $K$ are amenable, there are always $H$-subshifts which are effectively closed by patterns whose free extension to $G$ is non-sofic. We also present a few applications in the form of a new simulation theorem and a new class of groups which admit strongly aperiodic SFTs.


title: Observational Causality Testing

abstract: In prior work we have introduced an asymptotic threshold of sufficient randomness for causal inference from observational data. In this paper we extend that prior work in three main ways. First, we show how to empirically estimate a lower bound for the randomness from measures of concordance transported from studies of monozygotic twins. Second, we generalize our methodology for application on a finite population and we introduce methods to implement finite population corrections. Third, we generalize our methodology in another direction by incorporating measured covariate data into the analysis. The first extension represents a proof of concept that observational causality testing is possible. The second and third extensions help to make observational causality testing more practical. As a theoretical and indirect consequence of the third extension we formulate and introduce a novel criterion for covariate selection. We demonstrate our proposed methodology for observational causality testing with numerous example applications.


title: Coherent response of inhomogeneously broadened and spatially localized emitter ensembles in waveguide QED

abstract: Spectrally and spatially varying ensembles of emitters embedded into waveguides are ever-present in both well-established and emerging technologies. If control of collective excitations can be attained, a plethora of coherent quantum dynamics and applications may be realized on-chip in the scalable paradigm of waveguide quantum electrodynamics (WQED).Here, we investigate inhomogeneously broadened ensembles embedded with subwavelength spatial extent into waveguides employed as single effective and coherent emitters. We develop a method permitting the approximate analysis and simulation of such mesoscopic systems featuring many emitters, and show how collective resonances are observable within the waveguide transmission spectrum once their linewidth exceeds the inhomogeneous line. In particular, this allows for near-unity and tailorable non-Lorentzian extinction of waveguide photons overcoming large inhomogeneous broadening present in current state-of-the-art. As a particular illustration possible in such existing experiments, we consider the classic emulation of the cavity QED (CQED) paradigm here using ensembles of rare-earth ions as coherent mirrors and qubits and demonstrate the possibility of strong coupling given existing restrictions on inhomogeneous broadening and ensemble spatial extent. This work introduces coherent ensemble dynamics in the solid-state to WQED and extends the realm to spectrally tailorable emitters.


title: Superclustering by finding statistically significant separable groups of optimal gaussian clusters

abstract: The paper presents the algorithm for clustering a dataset by grouping the optimal, from the point of view of the BIC criterion, number of Gaussian clusters into the optimal, from the point of view of their statistical separability, superclusters. The algorithm consists of three stages: representation of the dataset as a mixture of Gaussian distributions - clusters, which number is determined based on the minimum of the BIC criterion; using the Mahalanobis distance, to estimate the distances between the clusters and cluster sizes; combining the resulting clusters into superclusters using the DBSCAN method by finding its hyperparameter (maximum distance) providing maximum value of introduced matrix quality criterion at maximum number of superclusters. The matrix quality criterion corresponds to the proportion of statistically significant separated superclusters among all found superclusters. The algorithm has only one hyperparameter - statistical significance level, and automatically detects optimal number and shape of superclusters based of statistical hypothesis testing approach. The algorithm demonstrates a good results on test datasets in noise and noiseless situations. An essential advantage of the algorithm is its ability to predict correct supercluster for new data based on already trained clusterer and perform soft (fuzzy) clustering. The disadvantages of the algorithm are: its low speed and stochastic nature of the final clustering. It requires a sufficiently large dataset for clustering, which is typical for many statistical methods.


title: On Zariski multiplicity conjecture for quasihomogeneous surfaces with non-isolated singularities

abstract: In this work, we consider an $\mathcal{A}$-finite map germ $f$ from $(\mathbb{C}^2,0)$ to $(\mathbb{C}^3,0)$ of corank $1$. If $f$ is quasihomogeneous then we present a characterization of the fold components of the double point curve $D(f)$. We also present the number of fold and identification components of $D(f)$ in terms of the weights and degrees of $f$. As an application of this result, we consider Zariski multiplicity question for germs of surfaces $(X_1,0)$ and $(X_2,0)$, in $(\mathbb{C}^3,0)$ with $1$-dimensional singular set $(\Sigma(X_i),0)$. We suppose that each $X_i$ is quasihomogeneous, i.e., $X_i$ is given by $F_i=0$ where $F_i$ is a quasihomogeneous holomorphic function. We also suppose that the Euler obstruction of $(X_i,0)$ is equal to $1$ and that $(X_i,0)$ is $\delta_1$-minimal, i.e., the $\delta$-invariant of a generic transversal slice of $(X_i,0)$ is equal to the multiplicity of $(\Sigma(X_i),0)$. With this setting, if $(X_1,0)$ and $(X_2,0)$ are topologically equivalent, then we show that the multiplicity of $(X_1,0)$ is equal to the multiplicity of $(X_2,0)$.


title: ALMA sub-/millimeter sources among $Spitzer$ SMUVS galaxies at $z>2$ in the COSMOS field

abstract: Sub-millimeter observations reveal the star-formation activity obscured by dust in the young Universe. It still remains unclear how galaxies detected at sub-millimeter wavelengths are related to ultraviolet/optical-selected galaxies in terms of their observed quantities, physical properties, and evolutionary stages. Deep near- and mid-infrared observational data are crucial to characterize the stellar properties of galaxies detected with sub-millimeter emission. In this study, we make use of a galaxy catalog from the $Spitzer$ Matching Survey of the UltraVISTA ultra-deep Stripes. By cross-matching with a sub-millimeter source catalog constructed with the archival data of the Atacama Large Millimeter/submillimeter Array (ALMA), we search for galaxies at $z>$ 2 with a sub-millimeter detection in our galaxy catalog. We find that the ALMA-detected galaxies at $z>$ 2 are systematically massive and have redder $K_s$-[4.5] colors than the non-detected galaxies. The redder colors are consistent with the larger dust reddening values of the ALMA-detected galaxies obtained from SED fitting. We also find that the ALMA-detected galaxies tend to have brighter 4.5 $\mu$m magnitudes. This may suggest that they tend to have smaller mass-to-light ratios, and thus, to be younger than star-forming galaxies fainter at sub-millimeter wavelengths with similar stellar masses. We identify starburst galaxies with high specific star-formation rates among both ALMA-detected and non-detected SMUVS sources. Irrespective of their brightness at sub-millimeter wavelengths, these populations have similar dust reddening values, which may suggest a variety of dust SED shapes among the starburst galaxies at $z>2$.


title: Adaptive Consensus: A network pruning approach for decentralized optimization

abstract: We consider network-based decentralized optimization problems, where each node in the network possesses a local function and the objective is to collectively attain a consensus solution that minimizes the sum of all the local functions. A major challenge in decentralized optimization is the reliance on communication which remains a considerable bottleneck in many applications. To address this challenge, we propose an adaptive randomized communication-efficient algorithmic framework that reduces the volume of communication by periodically tracking the disagreement error and judiciously selecting the most influential and effective edges at each node for communication. Within this framework, we present two algorithms: Adaptive Consensus (AC) to solve the consensus problem and Adaptive Consensus based Gradient Tracking (AC-GT) to solve smooth strongly convex decentralized optimization problems. We establish strong theoretical convergence guarantees for the proposed algorithms and quantify their performance in terms of various algorithmic parameters under standard assumptions. Finally, numerical experiments showcase the effectiveness of the framework in significantly reducing the information exchange required to achieve a consensus solution.


title: Scissors Modes of a Bose-Einstein Condensate in a Synthetic Magnetic Field

abstract: We study the scissors modes of a harmonically trapped Bose-Einstein condensate under the influence of a synthetic magnetic field, which induces rigid rotational components in the velocity field. Our investigation reveals that the scissors mode, excited in the plane perpendicular to the synthetic magnetic field, becomes coupled to the quadrupole modes of the condensate, giving rise to typical beating effects. Moreover, the two scissors modes excited in the vertical planes are also coupled together by the synthetic magnetic field, resulting in intriguing gyroscope dynamics. Our analytical results, derived from a spinor hydrodynamic theory, are further validated through numerical simulations of the three-dimensional Gross-Pitaevskii equation. These predictions for the condensates subject to a synthetic magnetic field are experimentally accessible with current cold-atom setups and hold promise for potential applications in quantum sensing.


title: Self-consistent dust and non-LTE line radiative transfer with SKIRT

abstract: We introduce Monte Carlo-based non-LTE line radiative transfer calculations in the 3D dust radiative transfer code SKIRT, which was originally set up as a dust radiative transfer code. By doing so, we develop a generic and powerful 3D radiative transfer code that can self-consistently generate spectra with molecular and atomic lines against the underlying continuum. We test the accuracy of the non-LTE line radiative transfer module in the extended SKIRT code using standard benchmarks. We find excellent agreement between the SKIRT results, the published benchmark results, and results obtained using the ray-tracing non-LTE line radiative transfer code MAGRITTE, which validates our implementation. We apply the extended SKIRT code on a 3D hydrodynamic simulation of a dusty AGN torus model and generate multi-wavelength images with CO rotational-line spectra against the underlying dust continuum. We find that the low-J CO emission traces the geometrically thick molecular torus, whereas the higher-J CO lines originate from the gas with high kinetic temperature located in the innermost regions of the torus. Comparing the calculations with and without dust radiative transfer, we find that higher-J CO lines are slightly attenuated by the surrounding cold dust when seen edge-on. This shows that atomic and molecular lines can experience attenuation, an effect that is particularly important for transitions at mid- and near-infrared wavelengths. Therefore, our self-consistent dust and non-LTE line radiative transfer calculations can help interpret the observational data from Herschel, ALMA, and JWST.


title: Multi-Agent Search for a Moving and Camouflaging Target

abstract: In multi-agent search planning for a randomly moving and camouflaging target, we examine heterogeneous searchers that differ in terms of their endurance level, travel speed, and detection ability. This leads to a convex mixed-integer nonlinear program, which we reformulate using three linearization techniques. We develop preprocessing steps, outer approximations via lazy constraints, and bundle-based cutting plane methods to address large-scale instances. Further specializations emerge when the target moves according to a Markov chain. We carry out an extensive numerical study to show the computational efficiency of our methods and to derive insights regarding which approach should be favored for which type of problem instance.


title: Three new $q$-Abel transformations and their applications

abstract: In the present paper, we establish three special $q$-Abel transformation formulae of $q$-series via the use of Abel's lemma on summation by parts. As direct applications, we set up the corresponding $q$-contiguous relations for three kinds of truncated $q$-series. Several new transformations are consequently established.


title: A Bayesian Nonparametric Method to Adjust for Unmeasured Confounding with Negative Controls

abstract: Unmeasured confounding bias is among the largest threats to the validity of observational studies. Although sensitivity analyses and various study designs have been proposed to address this issue, they do not leverage the growing availability of auxiliary data accessible through open data platforms. Using negative controls has been introduced in the causal inference literature as a promising approach to account for unmeasured confounding bias. In this paper, we develop a Bayesian nonparametric method to estimate a causal exposure-response function (CERF). This estimation method effectively utilizes auxiliary information from negative control variables to adjust for unmeasured confounding completely. We model the CERF as a mixture of linear models. This strategy offers the dual advantage of capturing the potential nonlinear shape of CERFs while maintaining computational efficiency. Additionally, it leverages closed-form results that hold under the linear model assumption. We assess the performance of our method through simulation studies. The results demonstrate the method's ability to accurately recover the true shape of the CERF in the presence of unmeasured confounding. To showcase the practical utility of our approach, we apply it to adjust for a potential unmeasured confounder when evaluating the relationship between long-term exposure to ambient $PM_{2.5}$ and cardiovascular hospitalization rates among the elderly in the continental U.S. We implement our estimation procedure in open-source software to ensure transparency and reproducibility and make our code publicly available.


title: Deep Reinforcement Learning from Hierarchical Preference Design

abstract: Reward design is a fundamental, yet challenging aspect of reinforcement learning (RL). Researchers typically utilize feedback signals from the environment to handcraft a reward function, but this process is not always effective due to the varying scale and intricate dependencies of the feedback signals. This paper shows by exploiting certain structures, one can ease the reward design process. Specifically, we propose a hierarchical reward modeling framework -- HERON for scenarios: (I) The feedback signals naturally present hierarchy; (II) The reward is sparse, but with less important surrogate feedback to help policy learning. Both scenarios allow us to design a hierarchical decision tree induced by the importance ranking of the feedback signals to compare RL trajectories. With such preference data, we can then train a reward model for policy learning. We apply HERON to several RL applications, and we find that our framework can not only train high performing agents on a variety of difficult tasks, but also provide additional benefits such as improved sample efficiency and robustness. Our code is available at \url{https://github.com/abukharin3/HERON}.


title: Vortex Creep Heating vs. Dark Matter Heating in Neutron Stars

abstract: Dark matter particles captured in neutron stars deposit their energy as heat. This DM heating effect can be observed only if it dominates over other internal heating effects in NSs. In this work, as an example of such an internal heating source, we consider the frictional heating caused by the creep motion of neutron superfluid vortex lines in the NS crust. The luminosity of this heating effect is controlled by the strength of the interaction between the vortex lines and nuclei in the crust, which can be estimated from the many-body calculation of a high-density nuclear system as well as through the temperature observation of old NSs. We show that both the temperature observation and theoretical calculation suggest that the vortex creep heating dominates over the DM heating. The vortex-nuclei interaction must be smaller than the estimated values by several orders of magnitude to overturn this.


title: Prediction of Giant Tunneling Magnetoresistance in RuO$_{2}$/TiO$_{2}$/RuO$_{2}$ (110) Antiferromagnetic Tunnel Junctions

abstract: Using first-principles quantum-transport calculations, we investigate spin-dependent electronic and transport properties of antiferromagnetic tunnel junctions (AFMTJs) that consist of (110)-oriented antiferromagnetic (AFM) metal RuO$_{2}$ electrodes and an insulating TiO$_{2}$ tunneling barrier. We predict the emergence of a giant tunneling magnetoresistance (TMR) effect in a wide energy window, a series of barrier layer thicknesses, and different interface terminations, indicating the robustness of this effect. We show that the predicted TMR cannot be explained in terms of the global transport spin-polarization of RuO$_{2}$ (110) but is well understood based on matching the momentum-dependent spin-polarized conduction channels of the two RuO$_{2}$ (110) electrodes. We predict oscillations of TMR with increasing barrier thickness, indicating a non-negligible contribution from the perfectly epitaxial interfaces. Our work helps the understanding of the physics of TMR in AFMTJs and aids in realizing efficient AFM spintronic devices.


title: Efficient Maximum $k$-Defective Clique Computation with Improved Time Complexity

abstract: $k$-defective cliques relax cliques by allowing up-to $k$ missing edges from being a complete graph. This relaxation enables us to find larger near-cliques and has applications in link prediction, cluster detection, social network analysis and transportation science. The problem of finding the largest $k$-defective clique has been recently studied with several algorithms being proposed in the literature. However, the currently fastest algorithm KDBB does not improve its time complexity from being the trivial $O(2^n)$, and also, KDBB's practical performance is still not satisfactory. In this paper, we advance the state of the art for exact maximum $k$-defective clique computation, in terms of both time complexity and practical performance. Moreover, we separate the techniques required for achieving the time complexity from others purely used for practical performance consideration; this design choice may facilitate the research community to further improve the practical efficiency while not sacrificing the worst case time complexity. In specific, we first develop a general framework kDC that beats the trivial time complexity of $O(2^n)$ and achieves a better time complexity than all existing algorithms. The time complexity of kDC is solely achieved by non-fully-adjacent-first branching rule, excess-removal reduction rule and high-degree reduction rule. Then, to make kDC practically efficient, we further propose a new upper bound, two reduction rules, and an algorithm for efficiently computing a large initial solution. Extensive empirical studies on three benchmark graph collections with $290$ graphs in total demonstrate that kDC outperforms the currently fastest algorithm KDBB by several orders of magnitude.


title: Multiclass Alignment of Confidence and Certainty for Network Calibration

abstract: Deep neural networks (DNNs) have made great strides in pushing the state-of-the-art in several challenging domains. Recent studies reveal that they are prone to making overconfident predictions. This greatly reduces the overall trust in model predictions, especially in safety-critical applications. Early work in improving model calibration employs post-processing techniques which rely on limited parameters and require a hold-out set. Some recent train-time calibration methods, which involve all model parameters, can outperform the postprocessing methods. To this end, we propose a new train-time calibration method, which features a simple, plug-and-play auxiliary loss known as multi-class alignment of predictive mean confidence and predictive certainty (MACC). It is based on the observation that a model miscalibration is directly related to its predictive certainty, so a higher gap between the mean confidence and certainty amounts to a poor calibration both for in-distribution and out-of-distribution predictions. Armed with this insight, our proposed loss explicitly encourages a confident (or underconfident) model to also provide a low (or high) spread in the presoftmax distribution. Extensive experiments on ten challenging datasets, covering in-domain, out-domain, non-visual recognition and medical image classification scenarios, show that our method achieves state-of-the-art calibration performance for both in-domain and out-domain predictions. Our code and models will be publicly released.


title: Malicious Package Detection in NPM and PyPI using a Single Model of Malicious Behavior Sequence

abstract: Open-source software (OSS) supply chain enlarges the attack surface, which makes package registries attractive targets for attacks. Recently, package registries NPM and PyPI have been flooded with malicious packages. The effectiveness of existing malicious NPM and PyPI package detection approaches is hindered by two challenges. The first challenge is how to leverage the knowledge of malicious packages from different ecosystems in a unified way such that multi-lingual malicious package detection can be feasible. The second challenge is how to model malicious behavior in a sequential way such that maliciousness can be precisely captured. To address the two challenges, we propose and implement Cerebro to detect malicious packages in NPM and PyPI. We curate a feature set based on a high-level abstraction of malicious behavior to enable multi-lingual knowledge fusing. We organize extracted features into a behavior sequence to model sequential malicious behavior. We fine-tune the BERT model to understand the semantics of malicious behavior. Extensive evaluation has demonstrated the effectiveness of Cerebro over the state-of-the-art as well as the practically acceptable efficiency. Cerebro has successfully detected 306 and 196 new malicious packages in PyPI and NPM, and received 385 thank letters from the official PyPI and NPM teams.


title: Review of photoacoustic imaging plus X

abstract: Photoacoustic imaging (PAI) is a novel modality in biomedical imaging technology that combines the rich optical contrast with the deep penetration of ultrasound. To date, PAI technology has found applications in various biomedical fields. In this review, we present an overview of the emerging research frontiers on PAI plus other advanced technologies, named as PAI plus X, which includes but not limited to PAI plus treatment, PAI plus new circuits design, PAI plus accurate positioning system, PAI plus fast scanning systems, PAI plus novel ultrasound sensors, PAI plus advanced laser sources, PAI plus deep learning, and PAI plus other imaging modalities. We will discuss each technology's current state, technical advantages, and prospects for application, reported mostly in recent three years. Lastly, we discuss and summarize the challenges and potential future work in PAI plus X area.


title: Improved CPS and CBS Extrapolation of PNO-CCSD(T) Energies: The MOBH35 and ISOL24 Data Sets

abstract: Computation of heats of reaction of large molecules is now feasible using domain-based PNO-CCSD(T) theory. However, to obtain agreement within 1~kcal/mol of experiment, it is necessary to eliminate basis set incompleteness error, which comprises of both the AO basis set error and the PNO truncation error. Our investigation into the convergence to the canonical limit of PNO-CCSD(T) energies with PNO truncation threshold $T$ shows that errors follow the model $E(T) = E + A T^{1/2}$. Therefore, PNO truncation errors can be eliminated using a simple two-point CPS extrapolation to the canonical limit, so that subsequent CBS extrapolation is not limited by residual PNO truncation error. Using the ISOL24 and MOBH35 data sets, we find that PNO truncation errors are larger for molecules with significant static correlation, and that it is necessary to use very tight thresholds of $T=10^{-8}$ to ensure errors do not exceed 1~kcal/mol. We present a lower-cost extrapolation scheme that uses information from small basis sets to estimate PNO truncation errors for larger basis sets. In this way the canonical limit of CCSD(T) calculations on large molecules with large basis sets can be reliably estimated in a practical way. Using this approach, we report complete basis set limit CCSD(T) reaction energies for the full ISOL24 and MOBH35 data sets.


title: Epi-Curriculum: Episodic Curriculum Learning for Low-Resource Domain Adaptation in Neural Machine Translation

abstract: Neural Machine Translation (NMT) models have become successful, but their performance remains poor when translating on new domains with a limited number of data. In this paper, we present a novel approach Epi-Curriculum to address low-resource domain adaptation (DA), which contains a new episodic training framework along with denoised curriculum learning. Our episodic training framework enhances the model's robustness to domain shift by episodically exposing the encoder/decoder to an inexperienced decoder/encoder. The denoised curriculum learning filters the noised data and further improves the model's adaptability by gradually guiding the learning process from easy to more difficult tasks. Experiments on English-German and English-Romanian translation show that: (i) Epi-Curriculum improves both model's robustness and adaptability in seen and unseen domains; (ii) Our episodic training framework enhances the encoder and decoder's robustness to domain shift.


title: TFBEST: Dual-Aspect Transformer with Learnable Positional Encoding for Failure Prediction

abstract: Hard Disk Drive (HDD) failures in datacenters are costly - from catastrophic data loss to a question of goodwill, stakeholders want to avoid it like the plague. An important tool in proactively monitoring against HDD failure is timely estimation of the Remaining Useful Life (RUL). To this end, the Self-Monitoring, Analysis and Reporting Technology employed within HDDs (S.M.A.R.T.) provide critical logs for long-term maintenance of the security and dependability of these essential data storage devices. Data-driven predictive models in the past have used these S.M.A.R.T. logs and CNN/RNN based architectures heavily. However, they have suffered significantly in providing a confidence interval around the predicted RUL values as well as in processing very long sequences of logs. In addition, some of these approaches, such as those based on LSTMs, are inherently slow to train and have tedious feature engineering overheads. To overcome these challenges, in this work we propose a novel transformer architecture - a Temporal-fusion Bi-encoder Self-attention Transformer (TFBEST) for predicting failures in hard-drives. It is an encoder-decoder based deep learning technique that enhances the context gained from understanding health statistics sequences and predicts a sequence of the number of days remaining before a disk potentially fails. In this paper, we also provide a novel confidence margin statistic that can help manufacturers replace a hard-drive within a time frame. Experiments on Seagate HDD data show that our method significantly outperforms the state-of-the-art RUL prediction methods during testing over the exhaustive 10-year data from Backblaze (2013-present). Although validated on HDD failure prediction, the TFBEST architecture is well-suited for other prognostics applications and may be adapted for allied regression problems.


title: Two-pointed Prym-Brill-Noether Loci and coupled Prym-Petri theorem

abstract: We establish two-pointed Prym-Brill-Noether loci with special vanishing at two points, and determine their K-theory classes when the dimensions are as expected. The classes are derived by the applications of a formula for the K-theory of certain vexillary degeneracy loci in type D. In particular, we show a two-pointed version of Prym-Petri theorem on the expected dimension in the general case, with a coupled Prym-Petri map. Our approach is inspired by the work on pointed cases by Tarasca, and we generalize unpointed cases by De Concini-Pragacz and Welters.


title: Control of spectral extreme events in ultrafast fibre lasers by a genetic algorithm

abstract: Extreme wave events or rogue waves (RWs) are both statistically rare and of exceptionally large amplitude. They are observed in many complex systems ranging from oceanic and optical environments to financial models and Bose-Einstein condensates. As they appear from nowhere and disappear without a trace, their emergence is unpredictable and non-repetitive, which make them particularly challenging to control. Here, we extend the use of genetic algorithms (GAs), which have been exclusively designed for searching and optimising stationary or repetitive processes in nonlinear optical systems, to the active control of extreme events in a fibre laser cavity. Feeding real-time spectral measurements into a GA controlling the electronics to optimise the cavity parameters, we are able to trigger wave events in the cavity that have the typical statistics of RWs in the frequency domain. This accurate control enables the generation of the optical RWs with a spectral peak intensity 32.8 times higher than the significant intensity threshold. A rationale is proposed and confirmed by numerical simulations of the laser model for the related frequency up- and down-shifting of the optical spectrum that are experimentally observed.


title: The Scarf complex and betti numbers of powers of extremal ideals

abstract: This paper is concerned with finding bounds on betti numbers and describing combinatorially and topologically (minimal) free resolutions of powers of ideals generated by a fixed number $q$ of square-free monomials. Among such ideals, we focus on a specific ideal $\mathcal{E}_q$, which we call {\it extremal}, and which has the property that for each $r\ge 1$ the betti numbers of ${\mathcal{E}_q}^r$ are an upper bound for the betti numbers of $I^r$ for any ideal $I$ generated by $q$ square-free monomials (in any number of variables). We study the Scarf complex of the ideals ${\mathcal{E}_q}^r$ and use this simplicial complex to extract information on minimal free resolutions. In particular, we show that ${\mathcal{E}_q}^r$ has a minimal free resolution supported on its Scarf complex when $q\leq 4$ or when $r\leq 2$, and we describe explicitly this complex. For any $q$ and $r$, we also show that $\beta_1({\mathcal{E}_q}^r)$ is the smallest possible, or in other words equal to the number of edges in the Scarf complex. These results lead to effective bounds on the betti numbers of $I^r$, with $I$ as above. For example, we obtain that pd$(I^r)\leq 5$ for all ideals $I$ generated by $4$ square-free monomials and any $r\geq 1$.


title: Mean Field Game-based Waveform Precoding Design for Mobile Crowd Integrated Sensing, Communication, and Computation Systems

abstract: Data collection and processing timely is crucial for mobile crowd integrated sensing, communication, and computation~(ISCC) systems with various applications such as smart home and connected cars, which requires numerous integrated sensing and communication~(ISAC) devices to sense the targets and offload the data to the base station~(BS) for further processing. However, as the number of ISAC devices growing, there exists intensive interactions among ISAC devices in the processes of data collection and processing since they share the common network resources. In this paper, we consider the environment sensing problem in the large-scale mobile crowd ISCC systems and propose an efficient waveform precoding design algorithm based on the mean field game~(MFG). Specifically, to handle the complex interactions among large-scale ISAC devices, we first utilize the MFG method to transform the influence from other ISAC devices into the mean field term and derive the Fokker-Planck-Kolmogorov equation, which models the evolution of the system state. Then, we derive the cost function based on the mean field term and reformulate the waveform precoding design problem. Next, we utilize the G-prox primal-dual hybrid gradient algorithm to solve the reformulated problem and analyze the computational complexity of the proposed algorithm. Finally, simulation results demonstrate that the proposed algorithm can solve the interactions among large-scale ISAC devices effectively in the ISCC process. In addition, compared with other baselines, the proposed waveform precoding design algorithm has advantages in improving communication performance and reducing cost function.


title: Benchmarking Inverse Optimization Algorithms for Materials Design

abstract: Machine learning-based inverse materials discovery has attracted enormous attention recently due to its flexibility in dealing with black box models. Yet, many metaheuristic algorithms are not as widely applied to materials discovery applications as machine learning methods. There are ongoing challenges in applying different optimization algorithms to discover crystals with single- or multi-elemental compositions and how these algorithms differ in mining the ideal materials. We comprehensively compare 11 different optimization algorithms for the design of single- and multi-elemental crystals with targeted properties. By maximizing the bulk modulus and minimizing the Fermi energy through perturbing the parameterized elemental composition representations, we estimated the unique counts of elemental compositions, mean density scan of the objectives space, mean objectives and frequency distributed over the materials' representations and objectives. We found that nature-inspired algorithms contain more uncertainties in the defined elemental composition design tasks, which correspond to their dependency on multiple hyperparameters. Runge Kutta optimization (RUN) exhibits higher mean objectives whereas Bayesian optimization (BO) displayed low mean objectives compared with other methods. Combined with materials count and density scan, we propose that BO strives to approximate a more accurate surrogate of the design space by sampling more elemental compositions and hence have lower mean objectives, yet RUN will repeatedly sample the targeted elemental compositions with higher objective values. Our work shed light on the automated digital design of crystals with single- and multi-elemental compositions and is expected to elicit future studies on materials optimization such as composite and alloy design based on specific desired properties.


title: Extension of all-optical reconstruction method for isolated attosecond pulses using high-harmonic generation streaking spectra

abstract: An all-optical method for directly reconstructing the spectral phase of isolated attosecond pulse (IAP) has been proposed recently [New J. Phys. 25, 083003 (2023)]. This method is based on the high-harmonic generation (HHG) streaking spectra generated by an IAP and a time-delayed intense infrared (IR) laser, which can be accurately simulated by an extended quantitative rescattering model. Here we extend the retrieval algorithm in this method to successfully retrieve the spectral phase of an shaped IAP, which has a spectral minimum, a phase jump about $\pi$, and a "split" temporal profile. We then reconstruct the carrier-envelope phase of IR laser from HHG streaking spectra. And we finally discuss the retrieval of the phase of high harmonics by the intense IR laser alone using the Fourier transform of HHG streaking spectra.


title: Joint Beamforming and Power Allocation for RIS Aided Full-Duplex Integrated Sensing and Uplink Communication System

abstract: Integrated sensing and communication (ISAC) capability is envisioned as one key feature for future cellular networks. Classical half-duplex (HD) radar sensing is conducted in a "first-emit-then-listen" manner. One challenge to realize HD ISAC lies in the discrepancy of the two systems' time scheduling for transmitting and receiving. This difficulty can be overcome by full-duplex (FD) transceivers. Besides, ISAC generally has to comprise its communication rate due to realizing sensing functionality. This loss can be compensated by the emerging reconfigurable intelligent surface (RIS) technology. This paper considers the joint design of beamforming, power allocation and signal processing in a FD uplink communication system aided by RIS, which is a highly nonconvex problem. To resolve this challenge, via leveraging the cutting-the-edge majorization-minimization (MM) and penalty-dual-decomposition (PDD) methods, we develop an iterative solution that optimizes all variables via using convex optimization techniques. Besides, by wisely exploiting alternative direction method of multipliers (ADMM) and optimality analysis, we further develop a low complexity solution that updates all variables analytically and runs highly efficiently. Numerical results are provided to verify the effectiveness and efficiency of our proposed algorithms and demonstrate the significant performance boosting by employing RIS in the FD ISAC system.


title: Controllability Backbone in Networks

abstract: This paper studies the controllability backbone problem in dynamical networks defined over graphs. The main idea of the controllability backbone is to identify a small subset of edges in a given network such that any subnetwork containing those edges/links has at least the same network controllability as the original network while assuming the same set of input/leader vertices. We consider the strong structural controllability (SSC) in our work, which is useful but computationally challenging. Thus, we utilize two lower bounds on the network's SSC based on the zero forcing notion and graph distances. We provide algorithms to compute controllability backbones while preserving these lower bounds. We thoroughly analyze the proposed algorithms and compute the number of edges in the controllability backbones. Finally, we compare and numerically evaluate our methods on random graphs.


title: Convolutional Neural Network-based RoCoF-Constrained Unit Commitment

abstract: The fast growth of inverter-based resources such as wind plants and solar farms will largely replace and reduce conventional synchronous generators in the future renewable energy-dominated power grid. Such transition will make the system operation and control much more complicated; and one key challenge is the low inertia issue that has been widely recognized. However, locational post-contingency rate of change of frequency (RoCoF) requirements to accommodate significant inertia reduction has not been fully investigated in the literature. This paper presents a convolutional neural network (CNN) based RoCoF-constrained unit commitment (CNN-RCUC) model to guarantee RoCoF stability following the worst generator outage event while ensuring operational efficiency. A generic CNN based predictor is first trained to track the highest locational RoCoF based on a high-fidelity simulation dataset. The RoCoF predictor is then formulated as MILP constraints into the unit commitment model. Case studies are carried out on the IEEE 24-bus system, and simulation results obtained with PSS/E indicate that the proposed method can ensure locational post-contingency RoCoF stability without conservativeness.


title: Contrastive Learning as Kernel Approximation

abstract: In standard supervised machine learning, it is necessary to provide a label for every input in the data. While raw data in many application domains is easily obtainable on the Internet, manual labelling of this data is prohibitively expensive. To circumvent this issue, contrastive learning methods produce low-dimensional vector representations (also called features) of high-dimensional inputs on large unlabelled datasets. This is done by training with a contrastive loss function, which enforces that similar inputs have high inner product and dissimilar inputs have low inner product in the feature space. Rather than annotating each input individually, it suffices to define a means of sampling pairs of similar and dissimilar inputs. Contrastive features can then be fed as inputs to supervised learning systems on much smaller labelled datasets to obtain high accuracy on end tasks of interest. The goal of this thesis is to provide an overview of the current theoretical understanding of contrastive learning, specifically as it pertains to the minimizers of contrastive loss functions and their relationship to prior methods for learning features from unlabelled data. We highlight popular contrastive loss functions whose minimizers implicitly approximate a positive semidefinite (PSD) kernel. The latter is a well-studied object in functional analysis and learning theory that formalizes a notion of similarity between elements of a space. PSD kernels provide an implicit definition of features through the theory of reproducing kernel Hilbert spaces.


title: On Averaging of a Class of "Non-Singularly Perturbed" Control Systems

abstract: We study a control system resembling a singularly perturbed system whose variables are decomposed into groups that change their values with rates of different orders of magnitude. We establish that the slow trajectories of this system are dense in the set of solutions of a certain differential inclusion and discuss an implication of this result for optimal control.


title: Passive Eavesdropping Can Significantly Slow Down RIS-Assisted Secret Key Generation

abstract: Reconfigurable Intelligent Surface (RIS) assisted physical layer key generation has shown great potential to secure wireless communications by smartly controlling signals such as phase and amplitude. However, previous studies mainly focus on RIS adjustment under ideal conditions, while the correlation between the eavesdropping channel and the legitimate channel, a more practical setting in the real world, is still largely under-explored for the key generation. To fill this gap, this paper aims to maximize the RIS-assisted physical-layer secret key generation by optimizing the RIS units switching under the eavesdropping channel. Firstly, we theoretically show that passive eavesdropping significantly reduces RIS-assisted secret key generation. Keeping this in mind, we then introduce a mathematical formulation to maximize the key generation rate and provide a step-by-step analysis. Extensive experiments show the effectiveness of our method in benefiting the secret key capacity under the eavesdropping channel. We also observe that the key randomness, and unmatched key rate, two metrics that measure the secret key quality, are also significantly improved, potentially paving the way to RIS-assisted key generation in real-world scenarios.