title: Leveraging Local Temporal Information for Multimodal Scene Classification

abstract: Robust video scene classification models should capture the spatial (pixel-wise) and temporal (frame-wise) characteristics of a video effectively. Transformer models with self-attention which are designed to get contextualized representations for individual tokens given a sequence of tokens, are becoming increasingly popular in many computer vision tasks. However, the use of Transformer based models for video understanding is still relatively unexplored. Moreover, these models fail to exploit the strong temporal relationships between the neighboring video frames to get potent frame-level representations. In this paper, we propose a novel self-attention block that leverages both local and global temporal relationships between the video frames to obtain better contextualized representations for the individual frames. This enables the model to understand the video at various granularities. We illustrate the performance of our models on the large scale YoutTube-8M data set on the task of video categorization and further analyze the results to showcase improvement.


title: Planetary Nebulae: Sources of Enlightenment

abstract: In this review/tutorial we explore planetary nebulae as a stage in the evolution of low-to-intermediate-mass stars, as major contributors to the mass and chemical enrichment of the interstellar medium, and as astrophysical laboratories. We discuss many observed properties of planetary nebulae, placing particular emphasis on element abundance determinations and comparisons with theoretical predictions. Dust and molecules associated with planetary nebulae are considered as well. We then examine distances, binarity, and planetary nebula morphology and evolution. We end with mention of some of the advances that will be enabled by future observing capabilities.


title: Study of light scalar mesons through $D_s^+ \to \pi^0 \pi^0 e^+ \nu_e$ and $K_S^0 K_S^0 e^+ \nu_e$ decays

abstract: Using 6.32~fb$^{-1}$ of $e^+e^-$ collision data recorded by the BESIII detector at center-of-mass energies between $4.178$ to $4.226$ GeV, we present the first measurement of the decay $D_s^+\to f_0(980)e^+\nu_e,\,f_0(980)\to \pi^0\pi^0$. The product branching fraction of $D_s^+\to f_0(980)e^+\nu_e,\,f_0(980)\to \pi^0\pi^0$ is measured to be $(7.9\pm1.4_{\rm stat} \pm0.3_{\rm syst})\times 10^{-4}$, with a statistical significance of $7.8\sigma$. Furthermore, the upper limits on the product branching fractions of $D_s^+\to f_0(500)e^+\nu_e$ with $f_0(500)\to \pi^0\pi^0$ and the branching fraction of $D_s^+\to K_{S}^{0}K_{S}^{0}e^+\nu_e$ are set to be $7.3\times 10^{-4}$ and $3.8\times 10^{-4}$ at 90\% confidence level, respectively. Our results provide valuable inputs to the understanding of the structures of light scalar mesons.


title: Software Engineering Meets Systems Engineering: Conceptual Modeling Applied to Engineering Operations

abstract: Models are fundamentally crucial to many scientific fields, including software engineering, systems engineering, enterprise modeling, and business modeling. This paper focuses on diagrammatic conceptual modeling, as opposed to mathematical or computational models, wherein a conceptual model is a translation of reality processes into an abstract mechanism that has similar structure and parallel events of the external processes. Although various modeling approaches exist, including UML (Unified Modeling Language) in software engineering and its dialect, SysML (System Modeling Language), in systems engineering, several difficulties arise in such models, including the problem of model multiplicity that is related to the lack an integrated view of structure and behavior. This paper generalizes conceptual modeling to be applied in organizations at large. According to authorities, the so-called organization theory portrays organizations as machine-like systems. As a machine, an organization coordinates its parts to transform inputs into outputs. Therefore, we synthesize the notion of an organization as a machine and apply a new modeling methodology called thinging machine (TM) to real engineering operations. The results show the viability of the TM methodology serving as a foundation for high-level modelling of systems.


title: Controllable Data Augmentation Through Deep Relighting

abstract: At the heart of the success of deep learning is the quality of the data. Through data augmentation, one can train models with better generalization capabilities and thus achieve greater results in their field of interest. In this work, we explore how to augment a varied set of image datasets through relighting so as to improve the ability of existing models to be invariant to illumination changes, namely for learned descriptors. We develop a tool, based on an encoder-decoder network, that is able to quickly generate multiple variations of the illumination of various input scenes whilst also allowing the user to define parameters such as the angle of incidence and intensity. We demonstrate that by training models on datasets that have been augmented with our pipeline, it is possible to achieve higher performance on localization benchmarks.


title: Planes in $\mathbb{Z^4}$ and Eisenstein series

abstract: We study the number of two-dimensional sublattices of $\mathbb{Z^4}$ of a fixed covolume and construct the associated Dirichlet series. The latter is shown to be related to Eisenstein series on both $GL_4$ and its metaplectic double cover.


title: Efficient Learning and Decoding of the Continuous-Time Hidden Markov Model for Disease Progression Modeling

abstract: The Continuous-Time Hidden Markov Model (CT-HMM) is an attractive approach to modeling disease progression due to its ability to describe noisy observations arriving irregularly in time. However, the lack of an efficient parameter learning algorithm for CT-HMM restricts its use to very small models or requires unrealistic constraints on the state transitions. In this paper, we present the first complete characterization of efficient EM-based learning methods for CT-HMM models, as well as the first solution to decoding the optimal state transition sequence and the corresponding state dwelling time. We show that EM-based learning consists of two challenges: the estimation of posterior state probabilities and the computation of end-state conditioned statistics. We solve the first challenge by reformulating the estimation problem as an equivalent discrete time-inhomogeneous hidden Markov model. The second challenge is addressed by adapting three distinct approaches from the continuous time Markov chain (CTMC) literature to the CT-HMM domain. Additionally, we further improve the efficiency of the most efficient method by a factor of the number of states. Then, for decoding, we incorporate a state-of-the-art method from the (CTMC) literature, and extend the end-state conditioned optimal state sequence decoding to the CT-HMM case with the computation of the expected state dwelling time. We demonstrate the use of CT-HMMs with more than 100 states to visualize and predict disease progression using a glaucoma dataset and an Alzheimer's disease dataset, and to decode and visualize the most probable state transition trajectory for individuals on the glaucoma dataset, which helps to identify progressing phenotypes in a comprehensive way. Finally, we apply the CT-HMM modeling and decoding strategy to investigate the progression of language acquisition and development.


title: Exploring the Role of Machine Learning in Scientific Workflows: Opportunities and Challenges

abstract: In this survey, we discuss the challenges of executing scientific workflows as well as existing Machine Learning (ML) techniques to alleviate those challenges. We provide the context and motivation for applying ML to each step of the execution of these workflows. Furthermore, we provide recommendations on how to extend ML techniques to unresolved challenges in the execution of scientific workflows. Moreover, we discuss the possibility of using ML techniques for in-situ operations. We explore the challenges of in-situ workflows and provide suggestions for improving the performance of their execution using ML techniques.


title: Towards Hyperparameter-free Policy Selection for Offline Reinforcement Learning

abstract: How to select between policies and value functions produced by different training algorithms in offline reinforcement learning (RL) -- which is crucial for hyperpa-rameter tuning -- is an important open question. Existing approaches based on off-policy evaluation (OPE) often require additional function approximation and hence hyperparameters, creating a chicken-and-egg situation. In this paper, we design hyperparameter-free algorithms for policy selection based on BVFT [XJ21], a recent theoretical advance in value-function selection, and demonstrate their effectiveness in discrete-action benchmarks such as Atari. To address performance degradation due to poor critics in continuous-action domains, we further combine BVFT with OPE to get the best of both worlds, and obtain a hyperparameter-tuning method for Q-function based OPE with theoretical guarantees as a side product.


title: SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event Data

abstract: We study the problem of inferring heterogeneous treatment effects from time-to-event data. While both the related problems of (i) estimating treatment effects for binary or continuous outcomes and (ii) predicting survival outcomes have been well studied in the recent machine learning literature, their combination -- albeit of high practical relevance -- has received considerably less attention. With the ultimate goal of reliably estimating the effects of treatments on instantaneous risk and survival probabilities, we focus on the problem of learning (discrete-time) treatment-specific conditional hazard functions. We find that unique challenges arise in this context due to a variety of covariate shift issues that go beyond a mere combination of well-studied confounding and censoring biases. We theoretically analyse their effects by adapting recent generalization bounds from domain adaptation and treatment effect estimation to our setting and discuss implications for model design. We use the resulting insights to propose a novel deep learning method for treatment-specific hazard estimation based on balancing representations. We investigate performance across a range of experimental settings and empirically confirm that our method outperforms baselines by addressing covariate shifts from various sources.


title: CARMS: Categorical-Antithetic-REINFORCE Multi-Sample Gradient Estimator

abstract: Accurately backpropagating the gradient through categorical variables is a challenging task that arises in various domains, such as training discrete latent variable models. To this end, we propose CARMS, an unbiased estimator for categorical random variables based on multiple mutually negatively correlated (jointly antithetic) samples. CARMS combines REINFORCE with copula based sampling to avoid duplicate samples and reduce its variance, while keeping the estimator unbiased using importance sampling. It generalizes both the ARMS antithetic estimator for binary variables, which is CARMS for two categories, as well as LOORF/VarGrad, the leave-one-out REINFORCE estimator, which is CARMS with independent samples. We evaluate CARMS on several benchmark datasets on a generative modeling task, as well as a structured output prediction task, and find it to outperform competing methods including a strong self-control baseline. The code is publicly available.


title: Connected greedy colourings of perfect graphs and other classes: the good, the bad and the ugly

abstract: The Grundy number of a graph is the maximum number of colours used by the "First-Fit" greedy colouring algorithm over all vertex orderings. Given a vertex ordering $\sigma= v_1,\dots,v_n$, the "First-Fit" greedy colouring algorithm colours the vertices in the order of $\sigma$ by assigning to each vertex the smallest colour unused in its neighbourhood. By restricting this procedure to vertex orderings that are connected, we obtain {\em connected greedy colourings}. For some graphs, all connected greedy colourings use exactly $\chi(G)$ colours; they are called {\em good graphs}. On the opposite, some graphs do not admit any connected greedy colouring using only $\chi(G)$ colours; they are called {\em ugly graphs}. We show that no perfect graph is ugly. We also give simple proofs of this fact for subclasses of perfect graphs (block graphs, comparability graphs), and show that no $K_4$-minor free graph is ugly. Moreover, our proofs are constructive, and imply the existence of polynomial-time algorithms to compute good connected orderings for these graph classes.


title: Ultrafast signatures of spin and orbital order in antiferromagnetic $\alpha$-Sr$_2$CrO$_4$

abstract: We used femtosecond optical spectroscopy to study ultrafast spin and orbital ordering dynamics in the antiferromagnetic Mott insulator $\alpha$-Sr$_2$CrO$_4$. This chromate system possesses multiple spin and orbital ordered phases, and therefore could enable us to study the unique interplay between these collective phases through their non-equilibrium response to photoexcitation. Here, by varying the pump photon energy, we selectively drove inter-site spin hopping between neighboring Cr $t_{2g}$ orbitals and charge transfer-type transitions between oxygen 2$p$ and Cr $e_{g}$ orbitals. The resulting transient reflectivity dynamics revealed temperature-dependent anomalies across the N${\textrm{\'e}}$el temperature for spin ordering as well as the transition temperatures linked to different types of orbital order. Our results reveal distinct relaxation timescales for spin and orbital orders in $\alpha$-Sr$_2$CrO$_4$ and provide experimental evidence for the phase transition at $T_\textrm{O}$, possibly related to antiferro-type orbital ordering.


title: From superintegrability to tridiagonal representation of $\beta$-ensembles

abstract: The wonderful formulas by I.Dumitriu and A.Edelman rewrite $\beta$-ensemble, with eigenvalue integrals containing Vandermonde factors in the power $2\beta$, through integrals over tridiagonal matrices, where $\beta$-dependent are the powers of individual matrix elements, not their differences. These potentially useful formulas are usually deduced from rather complicated and non-transparent combinatorics and are not as widely known as they deserve. We explain that the superintegrability property, i.e. a simple expression of the Gaussian averages of arbitrary Jack polynomials through the same Jack polynomials, is immediately consistent with this tridiagonal representation, which may serve as a clue to its simple and transparent interpretation. For a formal non-perturbative proof, we use the Virasoro constraints, which themselves acquire an interesting structure in the tridiagonal realization. We also attract attention to the surprising spontaneous breakdown of discrete invariance by the tridiagonal measure, which may signal a new interesting anomaly at the elementary level of the basic eigenvalue matrix model.


title: Deep machine learning potentials for multicomponent metallic melts: development, predictability and compositional transferability

abstract: The use of machine learning interatomic potentials (MLIPs) in simulations of materials is a state-of-the-art approach, which allows achieving nearly \textit{ab initio} accuracy with orders of magnitude less computational cost. Multicomponent disordered systems have a highly complicated potential energy surface due to both topological and compositional disorder. That arises issues in MLIPs developing, such as optimal design strategy of potentials and their predictability and transferability. Here we address MLIPs for multicomponent metallic melts taking the ternary Al-Cu-Ni ones as a convenient example. We use many-body deep machine learning potentials as implemented in the DeePMD-kit to build MLIP that allows describing both atomic structure and dynamics of the system in the whole composition range. Doing that we consider different sets of neural networks hyperparameters and learning schemes to create an optimal MLIP, which allows archiving good accuracy in comparison with both \textit{ab initio} and experimental data. We find that developed MLIP demonstrates good compositional transferability, which extends far beyond compositional fluctuations in the training configurations. The results obtained open up prospects for simulating structural and dynamical properties of multicomponent metallic alloys with MLIPs.


title: TOD: GPU-accelerated Outlier Detection via Tensor Operations

abstract: Outlier detection (OD) is a key learning task for finding rare and deviant data samples, with many time-critical applications such as fraud detection and intrusion detection. In this work, we propose TOD, the first tensor-based system for efficient and scalable outlier detection on distributed multi-GPU machines. A key idea behind TOD is decomposing complex OD applications into a small collection of basic tensor algebra operators. This decomposition enables TOD to accelerate OD computations by leveraging recent advances in deep learning infrastructure in both hardware and software. Moreover, to deploy memory-intensive OD applications on modern GPUs with limited on-device memory, we introduce two key techniques. First, provable quantization speeds up OD computations and reduces its memory footprint by automatically performing specific floating-point operations in lower precision while provably guaranteeing no accuracy loss. Second, to exploit the aggregated compute resources and memory capacity of multiple GPUs, we introduce automatic batching, which decomposes OD computations into small batches for both sequential execution on a single GPU and parallel execution on multiple GPUs. TOD supports a diverse set of OD algorithms. Extensive evaluation on 11 real and 3 synthetic OD datasets shows that TOD is on average 10.9x faster than the leading CPU-based OD system PyOD (with a maximum speedup of 38.9x), and can handle much larger datasets than existing GPU-based OD systems. In addition, TOD allows easy integration of new OD operators, enabling fast prototyping of emerging and yet-to-discovered OD algorithms.


title: Exact sampling and fast mixing of Activated Random Walk

abstract: Activated Random Walk (ARW) is an interacting particle system on the $d$-dimensional lattice $\mathbb{Z}^d$. On a finite subset $V \subset \mathbb{Z}^d$ it defines a Markov chain on $\{0,1\}^V$. We prove that when $V$ is a Euclidean ball intersected with $\mathbb{Z}^d$, the mixing time of the ARW Markov chain is at most $1+o(1)$ times the volume of the ball. The proof uses an exact sampling algorithm for the stationary distribution, a coupling with internal DLA, and an upper bound on the time when internal DLA fills the entire ball. We conjecture cutoff at time $\zeta$ times the volume of the ball, where $\zeta<1$ is the limiting density of the stationary state.


title: Finite-density QCD, $\mathcal{PT}$ symmetry, and dual algorithms

abstract: Finite-density QCD and many other field theories with sign problems have a $\mathcal{PT}$-type symmetry. After a brief introduction to $\mathcal{PT}$-symmetric field theories, a real dual representation for $\mathcal{PT}$-symmetric scalar field theories with complex actions is derived. We show that $\mathcal{PT}$-symmetric field theories can exhibit exotic behavior, including sinusoidally modulated propagators, disorder lines, and spatially inhomogeneous pattern-forming phases. We discuss the interplay of duality, $\mathcal{PT}$-symmetry and pattern formation using a $\phi^4$ model and $Z(N)$ spin model with sign problems as examples. These behaviors may occur in finite-density QCD and related models.


title: MisConv: Convolutional Neural Networks for Missing Data

abstract: Processing of missing data by modern neural networks, such as CNNs, remains a fundamental, yet unsolved challenge, which naturally arises in many practical applications, like image inpainting or autonomous vehicles and robots. While imputation-based techniques are still one of the most popular solutions, they frequently introduce unreliable information to the data and do not take into account the uncertainty of estimation, which may be destructive for a machine learning model. In this paper, we present MisConv, a general mechanism, for adapting various CNN architectures to process incomplete images. By modeling the distribution of missing values by the Mixture of Factor Analyzers, we cover the spectrum of possible replacements and find an analytical formula for the expected value of convolution operator applied to the incomplete image. The whole framework is realized by matrix operations, which makes MisConv extremely efficient in practice. Experiments performed on various image processing tasks demonstrate that MisConv achieves superior or comparable performance to the state-of-the-art methods.


title: Cluster-and-Conquer: A Framework For Time-Series Forecasting

abstract: We propose a three-stage framework for forecasting high-dimensional time-series data. Our method first estimates parameters for each univariate time series. Next, we use these parameters to cluster the time series. These clusters can be viewed as multivariate time series, for which we then compute parameters. The forecasted values of a single time series can depend on the history of other time series in the same cluster, accounting for intra-cluster similarity while minimizing potential noise in predictions by ignoring inter-cluster effects. Our framework -- which we refer to as "cluster-and-conquer" -- is highly general, allowing for any time-series forecasting and clustering method to be used in each step. It is computationally efficient and embarrassingly parallel. We motivate our framework with a theoretical analysis in an idealized mixed linear regression setting, where we provide guarantees on the quality of the estimates. We accompany these guarantees with experimental results that demonstrate the advantages of our framework: when instantiated with simple linear autoregressive models, we are able to achieve state-of-the-art results on several benchmark datasets, sometimes outperforming deep-learning-based approaches.


title: Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classification

abstract: The interdependence between nodes in graphs is key to improve class predictions on nodes and utilized in approaches like Label Propagation (LP) or in Graph Neural Networks (GNN). Nonetheless, uncertainty estimation for non-independent node-level predictions is under-explored. In this work, we explore uncertainty quantification for node classification in three ways: (1) We derive three axioms explicitly characterizing the expected predictive uncertainty behavior in homophilic attributed graphs. (2) We propose a new model Graph Posterior Network (GPN) which explicitly performs Bayesian posterior updates for predictions on interdependent nodes. GPN provably obeys the proposed axioms. (3) We extensively evaluate GPN and a strong set of baselines on semi-supervised node classification including detection of anomalous features, and detection of left-out classes. GPN outperforms existing approaches for uncertainty estimation in the experiments.


title: Deep Integrated Pipeline of Segmentation Guided Classification of Breast Cancer from Ultrasound Images

abstract: Breast cancer has become a symbol of tremendous concern in the modern world, as it is one of the major causes of cancer mortality worldwide. In this regard, breast ultrasonography images are frequently utilized by doctors to diagnose breast cancer at an early stage. However, the complex artifacts and heavily noised breast ultrasonography images make diagnosis a great challenge. Furthermore, the ever-increasing number of patients being screened for breast cancer necessitates the use of automated end-to-end technology for highly accurate diagnosis at a low cost and in a short time. In this concern, to develop an end-to-end integrated pipeline for breast ultrasonography image classification, we conducted an exhaustive analysis of image preprocessing methods such as K Means++ and SLIC, as well as four transfer learning models such as VGG16, VGG19, DenseNet121, and ResNet50. With a Dice-coefficient score of 63.4 in the segmentation stage and accuracy and an F1-Score (Benign) of 73.72 percent and 78.92 percent in the classification stage, the combination of SLIC, UNET, and VGG16 outperformed all other integrated combinations. Finally, we have proposed an end to end integrated automated pipelining framework which includes preprocessing with SLIC to capture super-pixel features from the complex artifact of ultrasonography images, complementing semantic segmentation with modified U-Net, leading to breast tumor classification using a transfer learning approach with a pre-trained VGG16 and a densely connected neural network. The proposed automated pipeline can be effectively implemented to assist medical practitioners in making more accurate and timely diagnoses of breast cancer.


title: Measuring and Modeling Neighborhoods

abstract: Granular geographic data present new opportunities to understand how neighborhoods are formed, and how they influence politics. At the same time, the inherent subjectivity of neighborhoods creates methodological challenges in measuring and modeling them. We develop an open-source survey instrument that allows respondents to draw their neighborhoods on a map. We also propose a statistical model to analyze how the characteristics of respondents and local areas determine subjective neighborhoods. We conduct two surveys: collecting subjective neighborhoods from voters in Miami, New York City, and Phoenix, and asking New York City residents to draw a community of interest for inclusion in their city council district. Our analysis shows that, holding other factors constant, White respondents include census blocks with more White residents in their neighborhoods. Similarly, Democrats and Republicans are more likely to include co-partisan areas. Furthermore, our model provides more accurate out-of-sample predictions than standard neighborhood measures.


title: Pion Fragmentation Functions at High Energy Colliders

abstract: We revisit the description of pion production in proton-proton collisions in the light of the very precise data taken at the Large Hadron Collider (LHC) over the past decade. First attempts to include LHC results in next-to-leading order global QCD analyses of parton-to-pion fragmentation functions insinuated some conflict between data sets at different center-of-mass system energies. We show that the data can be well described within their uncertainties by a consistent set of pion fragmentation functions once the theoretical scale dependence is taken into account in the global QCD analysis.


title: Infrared imaging of samples in ultra high pressure diamond anvil cells

abstract: We describe an experimental platform that generates infrared images of micrometer-sized samples in the high pressure region of a diamond anvil cell. Using a 2.3 micron laser as a source of radiation, the system will be particularly useful in identifying hydride superconductors which exhibit an anomalous temperature dependence of reflectivity in the 2.3 micron region. Our system shows an intensity stability within one percent when the sample temperature is swept from 100 K to 300 K. The spatial stability is of the order of a few micrometers in the same temperature range.


title: What does not get observed can be used to make age curves stronger: estimating player age curves using regression and imputation

abstract: The impact of player age on performance has received attention across sport. Most research has focused on the performance of players at each age, ignoring the reality that age likewise influences which players receive opportunities to perform. Our manuscript makes two contributions. First, we highlight how selection bias is linked to both (i) which players receive opportunity to perform in sport, and (ii) at which ages we observe these players perform. This approach is used to generate underlying distributions of how players move in and out of sport organizations. Second, motivated by methods for missing data, we propose novel estimation methods of age curves by using both observed and unobserved (imputed) data. We use simulations to compare several comparative approaches for estimating aging curves. Imputation-based methods, as well as models that account for individual player skill, tend to generate lower RMSE and age curve shapes that better match the truth. We implement our approach using data from the National Hockey League.


title: Pattern Formation in Random Networks Using Graphons

abstract: We study Turing bifurcations on one-dimensional random ring networks where the probability of a connection between two nodes depends on the distance between the two nodes. Our approach uses the theory of graphons to approximate the graph Laplacian in the limit as the number of nodes tends to infinity by a nonlocal operator -- the graphon Laplacian. For the ring networks considered here, we employ center manifold theory to characterize Turing bifurcations in the continuum limit in a manner similar to the classical partial differential equation case and classify these bifurcations as sub/super/trans-critical. We derive estimates that relate the eigenvalues and eigenvectors of the finite graph Laplacian to those of the graphon Laplacian. We are then able to show that, for a sufficiently large realization of the network, with high probability the bifurcations that occur in the finite graph are well approximated by those in the graphon limit. The number of nodes required depends on the spectral gap between the critical eigenvalue and the remaining ones, with the smaller this gap the more nodes that are required to guarantee that the graphon and graph bifurcations are similar. We demonstrate that if this condition is not satisfied then the bifurcations that occur in the finite network can differ significantly from those in the graphon limit.


title: Reliable and Trustworthy Machine Learning for Health Using Dataset Shift Detection

abstract: Unpredictable ML model behavior on unseen data, especially in the health domain, raises serious concerns about its safety as repercussions for mistakes can be fatal. In this paper, we explore the feasibility of using state-of-the-art out-of-distribution detectors for reliable and trustworthy diagnostic predictions. We select publicly available deep learning models relating to various health conditions (e.g., skin cancer, lung sound, and Parkinson's disease) using various input data types (e.g., image, audio, and motion data). We demonstrate that these models show unreasonable predictions on out-of-distribution datasets. We show that Mahalanobis distance- and Gram matrices-based out-of-distribution detection methods are able to detect out-of-distribution data with high accuracy for the health models that operate on different modalities. We then translate the out-of-distribution score into a human interpretable CONFIDENCE SCORE to investigate its effect on the users' interaction with health ML applications. Our user study shows that the \textsc{confidence score} helped the participants only trust the results with a high score to make a medical decision and disregard results with a low score. Through this work, we demonstrate that dataset shift is a critical piece of information for high-stake ML applications, such as medical diagnosis and healthcare, to provide reliable and trustworthy predictions to the users.


title: The Difficulty of Passive Learning in Deep Reinforcement Learning

abstract: Learning to act from observational data without active environmental interaction is a well-known challenge in Reinforcement Learning (RL). Recent approaches involve constraints on the learned policy or conservative updates, preventing strong deviations from the state-action distribution of the dataset. Although these methods are evaluated using non-linear function approximation, theoretical justifications are mostly limited to the tabular or linear cases. Given the impressive results of deep reinforcement learning, we argue for a need to more clearly understand the challenges in this setting. In the vein of Held & Hein's classic 1963 experiment, we propose the "tandem learning" experimental paradigm which facilitates our empirical analysis of the difficulties in offline reinforcement learning. We identify function approximation in conjunction with fixed data distributions as the strongest factors, thereby extending but also challenging hypotheses stated in past work. Our results provide relevant insights for offline deep reinforcement learning, while also shedding new light on phenomena observed in the online case of learning control.


title: Characterization of a high bandwidth readout chain for the CMS Phase-2 pixel upgrade

abstract: The CMS collaboration is building a new inner tracking pixel detector for the High-Luminosity LHC. Each pixel readout chip will be controlled with a single serial input stream at 160 Mbps and will send out data via four current mode logic (CML) 1.28 Gbps outputs. The readout chips will be grouped in modules and connected with up to 1.6 meters long low-mass electrical links to Low-Power Gigabit Transceivers (lpGBT) and Versatile Link PLUS Transceiver (VTRx+) modules that send the data optically to off-detector electronics at 10 Gbps. The characterization of these components and system tests of the readout chain are presented.


title: Intelligent Meta-Imagers: From Compressed to Learned Sensing

abstract: Computational meta-imagers synergize metamaterial hardware with advanced signal processing approaches such as compressed sensing. Recent advances in artificial intelligence (AI) are gradually reshaping the landscape of meta-imaging. Most recent works use AI for data analysis, but some also use it to program the physical meta-hardware. The role of "intelligence" in the measurement process and its implications for critical metrics like latency are often not immediately clear. Here, we comprehensively review the evolution of computational meta-imaging from the earliest frequency-diverse compressive systems to modern programmable intelligent meta-imagers. We introduce a clear taxonomy in terms of the flow of task-relevant information that has direct links to information theory: compressive meta-imagers indiscriminately acquire all scene information in a task-agnostic measurement process that aims at a near-isometric embedding; intelligent meta-imagers highlight task-relevant information in a task-aware measurement process that is purposefully non-isometric. The measurement process of intelligent meta-imagers is thus simultaneously an analog wave processor that implements a first task-specific inference step "over-the-air". We provide explicit design tutorials for the integration of programmable meta-atoms as trainable physical weights into an intelligent end-to-end sensing pipeline. This merging of the physical world of metamaterial engineering and the digital world of AI enables the remarkable latency gains of intelligent meta-imagers. We further outline emerging opportunities for cognitive meta-imagers with reverberation-enhanced resolution and we point out how the meta-imaging community can reap recent advances in the vibrant field of metamaterial wave processors to reach the holy grail of low-energy ultra-fast all-analog intelligent meta-sensors.

categories: physics.app-ph cs.IT cs.SY eess.SP eess.SY math.IT physics.optics


title: First Measurement of Energy-Dependent Inclusive Muon Neutrino Charged-Current Cross Sections on Argon with the MicroBooNE Detector

abstract: We report a measurement of the energy-dependent total charged-current cross section $\sigma\left(E_\nu\right)$ for inclusive muon neutrinos scattering on argon, as well as measurements of flux-averaged differential cross sections as a function of muon energy and hadronic energy transfer ($\nu$). Data corresponding to 5.3$\times$10$^{19}$ protons on target of exposure were collected using the MicroBooNE liquid argon time projection chamber located in the Fermilab Booster Neutrino Beam with a mean neutrino energy of approximately 0.8 GeV. The mapping between the true neutrino energy $E_\nu$ and reconstructed neutrino energy $E^{rec}_\nu$ and between the energy transfer $\nu$ and reconstructed hadronic energy $E^{rec}_{had}$ are validated by comparing the data and Monte Carlo (MC) predictions. In particular, the modeling of the missing hadronic energy and its associated uncertainties are verified by a new method that compares the $E^{rec}_{had}$ distributions between data and an MC prediction after constraining the reconstructed muon kinematic distributions, energy and polar angle, to those of data. The success of this validation gives confidence that the missing energy in the MicroBooNE detector is well-modeled and underpins first-time measurements of both the total cross section $\sigma\left(E_\nu\right)$ and the differential cross section $d\sigma/d\nu$ on argon.


title: Symmetry results for Serrin-type problems in doubly connected domains

abstract: In this work, we employ the technique developed in arXiv:2109.11255 to prove rotational symmetry for a class of Serrin-type problems for the standard laplacian. We also discuss in some length how our strategy compares with the classical moving plane method.


title: A Two-stage Stochastic Model Considering Randomness of Demand in Variable Speed Limit and Boundary Flow Control

abstract: The combination of boundary flow control and variable speed limit (VSL) is a widely used strategy for highway corridors to maintain safety and throughput when the capacity downstream is dropped. However, most proposed models assume fixed and known demand, which is not always true in reality. Following a recently proposed boundary flow and VSL control model that is based on the Lax-Hopf solution to the Lighthill-Whitham-Richards (LWR) model, this paper proposes a two-stage stochastic model to tackle the uncertainties in demand. Our model assumes the demand follows a discrete distribution and the speed limit can be chosen from a pre-defined set with reasonable values. The first stage tries to find the optimal inflow control, which is the here-and-now decision, by considering the speed limit control downstream, and the second stage is to determine the optimal speed limit after observing the real demand. Those controls are coordinated by using a rolling horizon scheme. The case study shows the proposed model outperforms three deterministic models, which use the minimum, mean value and maximum of the demand as model input, under various scenarios. With ensuring the maximum of throughput, the proposed model is demonstrated to be able to reduce the fluctuation of entry flow without a significant increase in blocked vehicles.


title: Anomalous transport of a classical wave-particle entity in a tilted potential

abstract: A classical wave-particle entity in the form of a millimetric walking droplet can emerge on the free surface of a vertically vibrating liquid bath. Such wave-particle entities have been shown to exhibit hydrodynamic analogs of quantum systems. Using an idealized theoretical model of this wave-particle entity in a tilted potential, we explore its transport behavior. The integro-differential equation of motion governing the dynamics of the wave-particle entity transforms to a Lorenz-like system of ordinary differential equations (ODEs) that drives the particle's velocity. Several anomalous transport regimes such as absolute negative mobility (ANM), differential negative mobility (DNM) and lock-in regions corresponding to force-independent mobility, are observed. These observations motivate experiments in the hydrodynamic walking-droplet system for the experimental realizations of anomalous transport phenomena.


title: Entanglement-Enhanced Matter-Wave Interferometry in a High-Finesse Cavity

abstract: Entanglement is a fundamental resource that allows quantum sensors to surpass the standard quantum limit set by the quantum collapse of independent atoms. Collective cavity-QED systems have succeeded in generating large amounts of directly observed entanglement involving the internal degrees of freedom of laser-cooled atomic ensembles. Here we demonstrate cavity-QED entanglement of external degrees of freedom to realize a matter-wave interferometer of 700 atoms in which each individual atom falls freely under gravity and simultaneously traverses two paths through space while also entangled with the other atoms. We demonstrate both quantum non-demolition measurements and cavity-mediated spin interactions for generating squeezed momentum states with directly observed metrological gain $3.4^{+1.1}_{-0.9}$ dB and $2.5^{+0.6}_{-0.6}$ dB below the standard quantum limit respectively. An entangled state is for the first time successfully injected into a Mach-Zehnder light-pulse interferometer with $1.7^{+0.5}_{-0.5}$ dB of directly observed metrological enhancement. Reducing the fundamental quantum source of imprecision provides a new resource that can be exploited to directly enhance measurement precision, bandwidth, and accuracy or operate at reduced size. These results also open a new path for combining particle delocalization and entanglement for inertial sensors, searches for new physics, particles, and fields, future advanced gravitational wave detectors, and accessing beyond mean-field quantum many-body physics.


title: New CC0\pi\ GENIE Model Tune for MicroBooNE

abstract: A novel tune has been made for the MicroBooNE experiment. The fit uses 4 new parameters within the GENIE v3.0.6 Monte Carlo program. Charged current pionless data from the T2K experiment was used. New uncertainties were obtained. These results will be used in future MicroBooNE analyses.


title: Evolving Heterotic Gauge Backgrounds: Genetic Algorithms versus Reinforcement Learning

abstract: The immensity of the string landscape and the difficulty of identifying solutions that match the observed features of particle physics have raised serious questions about the predictive power of string theory. Modern methods of optimisation and search can, however, significantly improve the prospects of constructing the standard model in string theory. In this paper we scrutinise a corner of the heterotic string landscape consisting of compactifications on Calabi-Yau three-folds with monad bundles and show that genetic algorithms can be successfully used to generate anomaly-free supersymmetric SO(10) GUTs with three families of fermions that have the right ingredients to accommodate the standard model. We compare this method with reinforcement learning and find that the two methods have similar efficacy but somewhat complementary characteristics.


title: Improving Local Effectiveness for Global robust training

abstract: Despite its popularity, deep neural networks are easily fooled. To alleviate this deficiency, researchers are actively developing new training strategies, which encourage models that are robust to small input perturbations. Several successful robust training methods have been proposed. However, many of them rely on strong adversaries, which can be prohibitively expensive to generate when the input dimension is high and the model structure is complicated. We adopt a new perspective on robustness and propose a novel training algorithm that allows a more effective use of adversaries. Our method improves the model robustness at each local ball centered around an adversary and then, by combining these local balls through a global term, achieves overall robustness. We demonstrate that, by maximizing the use of adversaries via focusing on local balls, we achieve high robust accuracy with weak adversaries. Specifically, our method reaches a similar robust accuracy level to the state of the art approaches trained on strong adversaries on MNIST, CIFAR-10 and CIFAR-100. As a result, the overall training time is reduced. Furthermore, when trained with strong adversaries, our method matches with the current state of the art on MNIST and outperforms them on CIFAR-10 and CIFAR-100.


title: Surrogate Regret Bounds for Polyhedral Losses

abstract: Surrogate risk minimization is an ubiquitous paradigm in supervised machine learning, wherein a target problem is solved by minimizing a surrogate loss on a dataset. Surrogate regret bounds, also called excess risk bounds, are a common tool to prove generalization rates for surrogate risk minimization. While surrogate regret bounds have been developed for certain classes of loss functions, such as proper losses, general results are relatively sparse. We provide two general results. The first gives a linear surrogate regret bound for any polyhedral (piecewise-linear and convex) surrogate, meaning that surrogate generalization rates translate directly to target rates. The second shows that for sufficiently non-polyhedral surrogates, the regret bound is a square root, meaning fast surrogate generalization rates translate to slow rates for the target. Together, these results suggest polyhedral surrogates are optimal in many cases.


title: MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge

abstract: Recently, a new trend of exploring sparsity for accelerating neural network training has emerged, embracing the paradigm of training on the edge. This paper proposes a novel Memory-Economic Sparse Training (MEST) framework targeting for accurate and fast execution on edge devices. The proposed MEST framework consists of enhancements by Elastic Mutation (EM) and Soft Memory Bound (&S) that ensure superior accuracy at high sparsity ratios. Different from the existing works for sparse training, this current work reveals the importance of sparsity schemes on the performance of sparse training in terms of accuracy as well as training speed on real edge devices. On top of that, the paper proposes to employ data efficiency for further acceleration of sparse training. Our results suggest that unforgettable examples can be identified in-situ even during the dynamic exploration of sparsity masks in the sparse training process, and therefore can be removed for further training speedup on edge devices. Comparing with state-of-the-art (SOTA) works on accuracy, our MEST increases Top-1 accuracy significantly on ImageNet when using the same unstructured sparsity scheme. Systematical evaluation on accuracy, training speed, and memory footprint are conducted, where the proposed MEST framework consistently outperforms representative SOTA works. A reviewer strongly against our work based on his false assumptions and misunderstandings. On top of the previous submission, we employ data efficiency for further acceleration of sparse training. And we explore the impact of model sparsity, sparsity schemes, and sparse training algorithms on the number of removable training examples. Our codes are publicly available at: https://github.com/boone891214/MEST.


title: Noninvasive ultrasound for Lithium-ion batteries state estimation

abstract: Lithium-ion battery degradation estimation using fast and noninvasive techniques is a crucial issue in the circular economy framework of this technology. Currently, most of the approaches used to establish the battery-state (i.e., State of Charge (SoC), State of Health (SoH)) require time-consuming processes. In the present preliminary study, an ultrasound array was used to assess the influence of the SoC and SoH on the variations in the time of flight (TOF) and the speed of sound (SOS) of the ultrasound wave inside the batteries. Nine aged 18650 Lithium-ion batteries were imaged at 100% and 0% SoC using a Vantage-256 system (Verasonics, Inc.) equipped with a 64-element ultrasound array and a center frequency of 5 MHz (Imasonic SAS). It was found that second-life batteries have a complex ultrasound response due to the presence of many degradation pathways and, thus, making it harder to analyze the ultrasound measurements. Although further analysis must be done to elucidate a clear correlation between changes in the ultrasound wave properties and the battery state estimation, this approach seems very promising for future nondestructive evaluation of second-life batteries.


title: r-local sensing: Improved algorithm and applications

abstract: The unlabeled sensing problem is to solve a noisy linear system of equations under unknown permutation of the measurements. We study a particular case of the problem where the permutations are restricted to be r-local, i.e. the permutation matrix is block diagonal with r x r blocks. Assuming a Gaussian measurement matrix, we argue that the r-local permutation model is more challenging compared to a recent sparse permutation model. We propose a proximal alternating minimization algorithm for the general unlabeled sensing problem that provably converges to a first order stationary point. Applied to the r-local model, we show that the resulting algorithm is efficient. We validate the algorithm on synthetic and real datasets. We also formulate the 1-d unassigned distance geometry problem as an unlabeled sensing problem with a structured measurement matrix.


title: Detection of a dense SiO jet in the evolved protostellar phase

abstract: Jets and outflows trace the accretion history of protostars. High-velocity molecular jets have been observed from several protostars in the early Class\,0 phase of star formation, detected with the high-density tracer SiO. Until now, no clear jet has been detected with SiO emission from isolated evolved Class\,I protostellar systems. We report a prominent dense SiO jet from a Class\,I source G205S3 (HOPS\,315: T$_{bol}$ $\sim$ 180 K, spectral index $\sim$ 0.417), with a moderately high mass-loss rate ($\sim$ 0.59 $\times$ 10$^{-6}$ M$_\odot$ yr$^{-1}$) estimated from CO emission. Together, these features suggest that G205S3 is still in a high accretion phase, similar to that expected of Class\,0 objects. We compare G205S3 to a representative Class\,0 system G206W2 (HOPS\,399) and literature Class\,0/I sources to explore the possible explanations behind the SiO emission seen at the later phase. We estimate a high inclination angle ($\sim$ 40$^\circ$) for G205S3 from CO emission, which may expose the infrared emission from the central core and mislead the spectral classification. However, the compact 1.3\,mm continuum, C$^{18}$O emission, location in the bolometric luminosity to sub-millimeter fluxes diagram, outflow force ($\sim$ 3.26 $\times$ 10$^{-5}$ M$_\odot$km s$^{-1}$/yr) are also analogous to that of Class\,I systems. We thus consider G205S3 to be at the very early phase of Class\,I, and in the late phase of ``high-accretion". The episodic ejection could be due to the presence of an unknown binary, a planetary companion, or dense clumps, where the required mass for such high accretion could be supplied by a massive circumbinary disk.


title: Fast estimation of ion-pairing for screening electrolytes: A cluster can approximate a bulk liquid

abstract: The propensity for ion-pairing can often dictate the thermodynamic and kinetic properties of electrolyte solutions. Fast and accurate estimates of ion-pairing can thus be extremely valuable for supplementing design and screening efforts for novel electrolytes. Here, we introduce an efficient cluster model to estimate the local ion-pair potential-of-mean-force (PMF) between ionic solutes in electrolytes. The model incorporates an ion-pair and a few layers of explicit solvent in a gas-phase cluster and leverages an enhanced sampling approach to achieve high efficiency and accuracy. We employ harmonic restraints to prevent solvent escape from the cluster and restrict sampling of large inter ion distances. We develop a Cluster Ion-Pair Sampling (CLIPS) tool that implements our cluster model and demonstrate its potential utility for screening simple and poly-electrolyte systems.


title: Revisiting the Performance of iALS on Item Recommendation Benchmarks

abstract: Matrix factorization learned by implicit alternating least squares (iALS) is a popular baseline in recommender system research publications. iALS is known to be one of the most computationally efficient and scalable collaborative filtering methods. However, recent studies suggest that its prediction quality is not competitive with the current state of the art, in particular autoencoders and other item-based collaborative filtering methods. In this work, we revisit the iALS algorithm and present a bag of tricks that we found useful when applying iALS. We revisit four well-studied benchmarks where iALS was reported to perform poorly and show that with proper tuning, iALS is highly competitive and outperforms any method on at least half of the comparisons. We hope that these high quality results together with iALS's known scalability spark new interest in applying and further improving this decade old technique.


title: Robustness of Graph Neural Networks at Scale

abstract: Graph Neural Networks (GNNs) are increasingly important given their popularity and the diversity of applications. Yet, existing studies of their vulnerability to adversarial attacks rely on relatively small graphs. We address this gap and study how to attack and defend GNNs at scale. We propose two sparsity-aware first-order optimization attacks that maintain an efficient representation despite optimizing over a number of parameters which is quadratic in the number of nodes. We show that common surrogate losses are not well-suited for global attacks on GNNs. Our alternatives can double the attack strength. Moreover, to improve GNNs' reliability we design a robust aggregation function, Soft Median, resulting in an effective defense at all scales. We evaluate our attacks and defense with standard GNNs on graphs more than 100 times larger compared to previous work. We even scale one order of magnitude further by extending our techniques to a scalable GNN.


title: Fast cooling and internal heating in hyperon stars

abstract: Neutron star models with maximum mass close to $2 \ M_{\odot}$ reach high central densities, which may activate nucleonic and hyperon direct Urca neutrino emission. To alleviate the tension between fast theoretical cooling rates and thermal luminosity observations of moderately magnetized, isolated thermally-emitting stars (with $L_{\gamma} \gtrsim 10^{31}$ erg s$^{-1}$ at $t \gtrsim 10^{5.3}$ yr), some internal heating source is required. The power supplied by the internal heater is estimated for both a phenomenological source in the inner crust and Joule heating due to magnetic field decay, assuming different superfluidity models and compositions of the outer stellar envelope. It is found that a thermal power of $W(t) \approx 10^{34}$ erg s$^{-1}$ allows neutron star models to match observations of moderately magnetized, isolated stars with ages $t \gtrsim 10^{5.3}$ yr. The requisite $W(t)$ can be supplied by Joule heating due to crust-confined initial magnetic configurations with (i) mixed poloidal-toroidal fields, with surface strength $B_{\textrm{dip}} = 10^{13}$ G at the pole of the dipolar poloidal component and $\sim 90$ per cent of the magnetic energy stored in the toroidal component; and (ii) poloidal-only configurations with $B_{\textrm{dip}} = 10^{14}$ G.


title: Finding the Best Partitioning Policy for Efficient Verification of Autonomous Systems at Runtime

abstract: The autonomous systems need to decide how to react to the changes at runtime efficiently. The ability to rigorously analyze the environment and the system together is theoretically possible by the model-driven approaches; however, the model size and timing limitations are two significant obstacles against such an autonomous decision-making process. To tackle this issue, the incremental approximation technique can be used to partition the model and only verify a partition if it is affected by the change. This paper proposes a policy-based analysis approach that finds the best partitioning policy among a set of available policies based on two proposed metrics, namely Balancing and Variation. The metrics quantitatively evaluate the generated components from the incremental approximation scheme according to their size and frequency. We investigate the validity of the approach both theoretically and experimentally via a case study on energy harvesting systems. The results confirm the effectiveness of the proposed approach.


title: A remark on inverse problems for nonlinear magnetic Schr\"odinger equations on complex manifolds

abstract: We show that the knowledge of the Dirichlet--to--Neumann map for a nonlinear magnetic Schr\"odinger operator on the boundary of a compact complex manifold, equipped with a K\"ahler metric and admitting sufficiently many global holomorphic functions, determines the nonlinear magnetic and electric potentials uniquely.


title: A Cost-Effective, Scalable, and Portable IoT Data Infrastructure for Indoor Environment Sensing

abstract: The vast number of facility management systems, home automation systems, and the ever-increasing number of Internet of Things (IoT) devices are in constant need of environmental monitoring. Indoor environment data can be utilized to improve indoor facilities and better occupants' working and living experience, however, such data are scarce because many existing facility monitoring technologies are expensive and proprietary for certain building systems, such as building automation systems, energy management systems, and maintenance systems. In this work, the authors designed and prototyped a cost-effective, distributed, scalable, and portable indoor environmental data collection system, Building Data Lite (BDL). BDL is based on Raspberry Pi computers and multiple changeable arrays of sensors, such as sensors of temperature, humidity, light, motion, sound, vibration, and multiple types of gases. The system includes a distributed sensing network and a centralized server. The server provides a web-based graphical user interface that enables users to access the collected data over the Internet. To evaluate the BDL system's functionality, cost-effectiveness, scalability, and portability, the research team conducted a case study in an affordable housing community where the system prototype is deployed to 12 households. The case study results indicate that the system is functioning as designed, costs about \$3500 to sense 48 building zones (about \$73 per zone) and provides 12 types of indoor environment data, is easy to scale up, and is fully portable.


title: Fragment-Based Test Generation For Web Apps

abstract: Automated model-based test generation presents a viable alternative to the costly manual test creation currently employed for regression testing of web apps. However, existing model inference techniques rely on threshold-based whole-page comparison to establish state equivalence, which cannot reliably identify near-duplicate web pages in modern web apps. Consequently, existing techniques produce inadequate models for dynamic web apps, and fragile test oracles, rendering the generated regression test suites ineffective. We propose a model-based test generation technique, FRAGGEN, that eliminates the need for thresholds, by employing a novel state abstraction based on page fragmentation to establish state equivalence. FRAGGEN also uses fine-grained page fragment analysis to diversify state exploration and generate reliable test oracles. Our evaluation shows that FRAGGEN outperforms existing whole-page techniques by detecting more near-duplicates, inferring better web app models and generating test suites that are better suited for regression testing. On a dataset of 86,165 state-pairs, FRAGGEN detected 123% more near-duplicates on average compared to whole-page techniques. The crawl models inferred by FRAGGEN have 62% more precision and 70% more recall on average. FRAGGEN also generates reliable regression test suites with test actions that have nearly 100% success rate on the same version of the web app even if the execution environment is varied. The test oracles generated by FRAGGEN can detect 98.7% of the visible changes in web pages while being highly robust, making them suitable for regression testing.


title: iALS++: Speeding up Matrix Factorization with Subspace Optimization

abstract: iALS is a popular algorithm for learning matrix factorization models from implicit feedback with alternating least squares. This algorithm was invented over a decade ago but still shows competitive quality compared to recent approaches like VAE, EASE, SLIM, or NCF. Due to a computational trick that avoids negative sampling, iALS is very efficient especially for large item catalogues. However, iALS does not scale well with large embedding dimensions, d, due to its cubic runtime dependency on d. Coordinate descent variations, iCD, have been proposed to lower the complexity to quadratic in d. In this work, we show that iCD approaches are not well suited for modern processors and can be an order of magnitude slower than a careful iALS implementation for small to mid scale embedding sizes (d ~ 100) and only perform better than iALS on large embeddings d ~ 1000. We propose a new solver iALS++ that combines the advantages of iALS in terms of vector processing with a low computational complexity as in iCD. iALS++ is an order of magnitude faster than iCD both for small and large embedding dimensions. It can solve benchmark problems like Movielens 20M or Million Song Dataset even for 1000 dimensional embedding vectors in a few minutes.


title: The Computational Complexity of Finding Arithmetic Expressions With and Without Parentheses

abstract: We show NP-completeness for various problems about the existence of arithmetic expression trees. When given a set of operations, inputs, and a target value does there exist an expression tree with those inputs and operations that evaluates to the target? We consider the variations where the structure of the tree is also given and the variation where no parentheses are allowed in the expression.


title: Open Markets and Hybrid Jacobi Processes

abstract: We propose a unified approach to several problems in Stochastic Portfolio Theory (SPT), which is a framework for equity markets with a large number $d$ of stocks. Our approach combines open markets, where trading is confined to the top $N$ capitalized stocks as well as the market portfolio consisting of all $d$ assets, with a parametric family of models which we call hybrid Jacobi processes. We provide a detailed analysis of ergodicity, particle collisions, and boundary attainment, and use these results to study the associated financial markets. Their properties include (1) stability of the capital distribution curve and (2) unleveraged and explicit growth optimal strategies. The sub-class of rank Jacobi models are additionally shown to (3) serve as the worst-case model for a robust asymptotic growth problem under model ambiguity and (4) exhibit stability in the large-$d$ limit. Our definition of an open market is a relaxation of existing definitions which is essential to make the analysis tractable.


title: Bounding the Distance to Unsafe Sets with Convex Optimization

abstract: This work proposes an algorithm to bound the minimum distance between points on trajectories of a dynamical system and points on an unsafe set. Prior work on certifying safety of trajectories includes barrier and density methods, which do not provide a margin of proximity to the unsafe set in terms of distance. The distance estimation problem is relaxed to a Monge-Kantorovich type optimal transport problem based on existing occupation-measure methods of peak estimation. Specialized programs may be developed for polyhedral norm distances (e.g. L1 and Linfinity) and for scenarios where a shape is traveling along trajectories (e.g. rigid body motion). The distance estimation problem will be correlatively sparse when the distance objective is separable.


title: Conflict-Averse Gradient Descent for Multi-task Learning

abstract: The goal of multi-task learning is to enable more efficient learning than single task learning by sharing model structures for a diverse set of tasks. A standard multi-task learning objective is to minimize the average loss across all tasks. While straightforward, using this objective often results in much worse final performance for each task than learning them independently. A major challenge in optimizing a multi-task model is the conflicting gradients, where gradients of different task objectives are not well aligned so that following the average gradient direction can be detrimental to specific tasks' performance. Previous work has proposed several heuristics to manipulate the task gradients for mitigating this problem. But most of them lack convergence guarantee and/or could converge to any Pareto-stationary point. In this paper, we introduce Conflict-Averse Gradient descent (CAGrad) which minimizes the average loss function, while leveraging the worst local improvement of individual tasks to regularize the algorithm trajectory. CAGrad balances the objectives automatically and still provably converges to a minimum over the average loss. It includes the regular gradient descent (GD) and the multiple gradient descent algorithm (MGDA) in the multi-objective optimization (MOO) literature as special cases. On a series of challenging multi-task supervised learning and reinforcement learning tasks, CAGrad achieves improved performance over prior state-of-the-art multi-objective gradient manipulation methods.


title: Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

abstract: Data Shapley has recently been proposed as a principled framework to quantify the contribution of individual datum in machine learning. It can effectively identify helpful or harmful data points for a learning algorithm. In this paper, we propose Beta Shapley, which is a substantial generalization of Data Shapley. Beta Shapley arises naturally by relaxing the efficiency axiom of the Shapley value, which is not critical for machine learning settings. Beta Shapley unifies several popular data valuation methods and includes data Shapley as a special case. Moreover, we prove that Beta Shapley has several desirable statistical properties and propose efficient algorithms to estimate it. We demonstrate that Beta Shapley outperforms state-of-the-art data valuation methods on several downstream ML tasks such as: 1) detecting mislabeled training data; 2) learning with subsamples; and 3) identifying points whose addition or removal have the largest positive or negative impact on the model.


title: First-principles calculations of phonon transport across a vacuum gap

abstract: Phonon transport across a vacuum gap separating intrinsic silicon crystals is predicted via the atomistic Green's function method combined with first-principles calculations of all interatomic force constants. The overlap of electron wave functions in the vacuum gap generates weak covalent interaction between the silicon surfaces, thus creating a pathway for phonons. Phonon transport, dominated by acoustic modes, exceeds near-field radiation for vacuum gaps smaller than ~ 1 nm. The first-principles-based approach proposed in this work is critical to accurately quantify the contribution of phonon transport to heat transfer in the extreme near field.


title: A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challenges

abstract: Machine learning models often encounter samples that are diverged from the training distribution. Failure to recognize an out-of-distribution (OOD) sample, and consequently assign that sample to an in-class label significantly compromises the reliability of a model. The problem has gained significant attention due to its importance for safety deploying models in open-world settings. Detecting OOD samples is challenging due to the intractability of modeling all possible unknown distributions. To date, several research domains tackle the problem of detecting unfamiliar samples, including anomaly detection, novelty detection, one-class learning, open set recognition, and out-of-distribution detection. Despite having similar and shared concepts, out-of-distribution, open-set, and anomaly detection have been investigated independently. Accordingly, these research avenues have not cross-pollinated, creating research barriers. While some surveys intend to provide an overview of these approaches, they seem to only focus on a specific domain without examining the relationship between different domains. This survey aims to provide a cross-domain and comprehensive review of numerous eminent works in respective areas while identifying their commonalities. Researchers can benefit from the overview of research advances in different fields and develop future methodology synergistically. Furthermore, to the best of our knowledge, while there are surveys in anomaly detection or one-class learning, there is no comprehensive or up-to-date survey on out-of-distribution detection, which our survey covers extensively. Finally, having a unified cross-domain perspective, we discuss and shed light on future lines of research, intending to bring these fields closer together.


title: Typical large graphs with given edge and triangle densities

abstract: The analysis of large simple graphs with extreme values of the densities of edges and triangles has been extended to the statistical structure of typical graphs of fixed intermediate densities, by the use of large deviations of Erdoes-Renyi graphs. We prove that the typical graph exhibits sharp singularities as the constraining densities vary between different curves of extreme values, and we determine the precise nature of the singularities. The extension to graphs with fixed densities of edges and k-cycles for odd k>3 is straightforward and we note the simple changes in the proof.


title: NeuroBack: Improving CDCL SAT Solving using Graph Neural Networks

abstract: Propositional satisfiability (SAT) is an NP-complete problem that impacts many research fields, such as planning, verification, and security. Mainstream modern SAT solvers are based on the Conflict-Driven Clause Learning (CDCL) algorithm. Recent work aimed to enhance CDCL SAT solvers using Graph Neural Networks (GNNs). However, so far this approach either has not made solving more effective, or required substantial GPU resources for frequent online model inferences. Aiming to make GNN improvements practical, this paper proposes an approach called NeuroBack, which builds on two insights: (1) predicting phases (i.e., values) of variables appearing in the majority (or even all) of the satisfying assignments are essential for CDCL SAT solving, and (2) it is sufficient to query the neural model only once for the predictions before the SAT solving starts. Once trained, the offline model inference allows NeuroBack to execute exclusively on the CPU, removing its reliance on GPU resources. To train NeuroBack, a new dataset called DataBack containing 120,286 data samples is created. NeuroBack is implemented as an enhancement to a state-of-the-art SAT solver called Kissat. As a result, it allowed Kissat to solve up to 5.2% and 7.4% more problems on two recent SAT competition problem sets, SATCOMP-2022 and SATCOMP-2023, respectively. NeuroBack therefore shows how machine learning can be harnessed to improve SAT solving in an effective and practical manner.


title: Search for an Excess of Electron Neutrino Interactions in MicroBooNE Using Multiple Final State Topologies

abstract: We present a measurement of electron neutrino interactions from the Fermilab Booster Neutrino Beam using the MicroBooNE liquid argon time projection chamber to address the nature of the excess of low energy interactions observed by the MiniBooNE collaboration. Three independent electron neutrino searches are performed across multiple single electron final states, including an exclusive search for two-body scattering events with a single proton, a semi-inclusive search for pion-less events, and a fully inclusive search for events containing all hadronic final states. With differing signal topologies, statistics, backgrounds, reconstruction algorithms, and analysis approaches, the results are found to be consistent with the nominal electron neutrino rate expectations from the Booster Neutrino Beam and no excess of electron neutrino events is observed.


title: Polynomial-Spline Neural Networks with Exact Integrals

abstract: Using neural networks to solve variational problems, and other scientific machine learning tasks, has been limited by a lack of consistency and an inability to exactly integrate expressions involving neural network architectures. We address these limitations by formulating a novel neural network architecture that combines a polynomial mixture-of-experts model with free knot B1-spline basis functions. Effectively, our architecture performs piecewise polynomial approximation on each cell of a trainable partition of unity. Our architecture exhibits both $h$- and $p$- refinement for regression problems at the convergence rates expected from approximation theory, allowing for consistency in solving variational problems. Moreover, this architecture, its moments, and its partial derivatives can all be integrated exactly, obviating a reliance on sampling or quadrature and enabling error-free computation of variational forms. We demonstrate the success of our network on a range of regression and variational problems that illustrate the consistency and exact integrability of our network architecture.


title: How to transfer algorithmic reasoning knowledge to learn new algorithms?

abstract: Learning to execute algorithms is a fundamental problem that has been widely studied. Prior work~\cite{veli19neural} has shown that to enable systematic generalisation on graph algorithms it is critical to have access to the intermediate steps of the program/algorithm. In many reasoning tasks, where algorithmic-style reasoning is important, we only have access to the input and output examples. Thus, inspired by the success of pre-training on similar tasks or data in Natural Language Processing (NLP) and Computer Vision, we set out to study how we can transfer algorithmic reasoning knowledge. Specifically, we investigate how we can use algorithms for which we have access to the execution trace to learn to solve similar tasks for which we do not. We investigate two major classes of graph algorithms, parallel algorithms such as breadth-first search and Bellman-Ford and sequential greedy algorithms such as Prim and Dijkstra. Due to the fundamental differences between algorithmic reasoning knowledge and feature extractors such as used in Computer Vision or NLP, we hypothesise that standard transfer techniques will not be sufficient to achieve systematic generalisation. To investigate this empirically we create a dataset including 9 algorithms and 3 different graph types. We validate this empirically and show how instead multi-task learning can be used to achieve the transfer of algorithmic reasoning knowledge.


title: Meta-learning with an Adaptive Task Scheduler

abstract: To benefit the learning of a new task, meta-learning has been proposed to transfer a well-generalized meta-model learned from various meta-training tasks. Existing meta-learning algorithms randomly sample meta-training tasks with a uniform probability, under the assumption that tasks are of equal importance. However, it is likely that tasks are detrimental with noise or imbalanced given a limited number of meta-training tasks. To prevent the meta-model from being corrupted by such detrimental tasks or dominated by tasks in the majority, in this paper, we propose an adaptive task scheduler (ATS) for the meta-training process. In ATS, for the first time, we design a neural scheduler to decide which meta-training tasks to use next by predicting the probability being sampled for each candidate task, and train the scheduler to optimize the generalization capacity of the meta-model to unseen tasks. We identify two meta-model-related factors as the input of the neural scheduler, which characterize the difficulty of a candidate task to the meta-model. Theoretically, we show that a scheduler taking the two factors into account improves the meta-training loss and also the optimization landscape. Under the setting of meta-learning with noise and limited budgets, ATS improves the performance on both miniImageNet and a real-world drug discovery benchmark by up to 13% and 18%, respectively, compared to state-of-the-art task schedulers.


title: The Remarkable Spin-down and Ultra-fast Outflows of the Highly-Pulsed Supersoft Source of Nova Hercules 2021

abstract: Nova Her 2021 (V1674 Her), which erupted on 2021 June 12, reached naked-eye brightness and has been detected from radio to $\gamma$-rays. An extremely fast optical decline of 2 magnitudes in 1.2 days and strong Ne lines imply a high-mass white dwarf. The optical pre-outburst detection of a 501.42s oscillation suggests a magnetic white dwarf. This is the first time that an oscillation of this magnitude has been detected in a classical nova prior to outburst. We report X-ray outburst observations from {\it Swift} and {\it Chandra} which uniquely show: (1) a very strong modulation of super-soft X-rays at a different period from reported optical periods; (2) strong pulse profile variations and the possible presence of period variations of the order of 0.1-0.3s; and (3) rich grating spectra that vary with modulation phase and show P Cygni-type emission lines with two dominant blue-shifted absorption components at $\sim 3000$ and 9000 km s$^{-1}$ indicating expansion velocities up to 11000 km s$^{-1}$. X-ray oscillations most likely arise from inhomogeneous photospheric emission related to the magnetic field. Period differences between reported pre- and post-outburst optical observations, if not due to other period drift mechanisms, suggest a large ejected mass for such a fast nova, in the range $2\times 10^{-5}$-$2\times 10^{-4} M_\odot$. A difference between the period found in the {\it Chandra} data and a reported contemporaneous post-outburst optical period, as well as the presence of period drifts, could be due to weakly non-rigid photospheric rotation.


title: Relativistic time-dependent configuration-interaction singles

abstract: In this work, a derivation and implementation of the relativistic time-dependent configuration interaction singles (RTDCIS) method is presented. Various observables for krypton and xenon atoms obtained by RTDCIS are compared with experimental data and alternative relativistic calculations. This includes energies of occupied orbitals in the Dirac-Fock ground state, Rydberg state energies, Fano resonances and photoionization cross sections. Diagrammatic many-body perturbation theory, based on the relativistic random phase approximation, is used as a benchmark with excellent agreement between RTDCIS reported at the Tamm-Dancoff level. Results from RTDCIS are computed in the length gauge, here the negative energy states can be omitted with acceptable loss of accuracy. A complex absorbing potential, that is used to remove photoelectrons far from the ion, is implemented as a scalar potential and validated for RTDCIS. The RTDCIS methodology presented here opens for future studies of strong-field processes, such as attosecond transient absorption and high-order harmonic generation, with electron and hole spin dynamics and other relativistic effects described by first principle via the Dirac equation.


title: Argo Scholar: Interactive Visual Exploration of Literature in Browsers

abstract: Discovering and making sense of relevant research literature is fundamental to becoming knowledgeable in any scientific discipline. Visualization can aid this process; however, existing tools' adoption and impact have often been constrained, such as by their reliance on small curated paper datasets that quickly become outdated or a lack of support for personalized exploration. We introduce Argo Scholar, an open-source, web-based visualization tool for interactive exploration of literature and easy sharing of exploration results. Argo Scholar queries and visualizes Semantic Scholar's live data of almost 200 million papers, enabling users to generate personalized literature exploration results in real-time through flexible, incremental exploration, a common and effective method for researchers to discover relevant work. Our tool allows users to easily share their literature exploration results as a URL or web-embedded IFrame application. Argo Scholar is open-sourced and available at https://poloclub.github.io/argo-scholar/.


title: On $\Sigma$-skew reflexive-nilpotents-property for rings

abstract: In this paper, we study the reflexive-nilpotents-property (briefly, RNP) for Ore extensions of injective type, and more generally, skew PBW extensions. With this aim, we introduce the notions of $\Sigma$-skew CN rings and $\Sigma$-skew reflexive (RNP) rings, for $\Sigma$ a finite family of ring endomorphisms of a ring $R$. Under certain conditions of compatibility, we study the transfer of the $\Sigma$-skew RNP property from a ring of coefficients to an Ore extension or skew PBW extension over this ring. We also consider this property for localizations of these noncommutative rings. Our results extend those corresponding presented by Bhattacharjee \cite{Bhattacharjee2020}.


title: The diagonal of the operahedra

abstract: The primary goal of this article is to set up a general theory of coherent cellular approximations of the diagonal for families of polytopes by developing the method introduced by N. Masuda, A. Tonks, H. Thomas and B. Vallette. We apply this theory to the study of the operahedra, a family of polytopes ranging from the associahedra to the permutahedra, and which encodes homotopy operads. After defining Loday realizations of the operahedra, we make a coherent choice of cellular approximations of the diagonal, which leads to a compatible topological cellular operad structure on them. This gives a model for topological and algebraic homotopy operads and an explicit functorial formula for their tensor product.


title: Visualization of sphere and horosphere packings related to Coxeter tilings generated by simply truncated orthoschemes with parallel faces

abstract: In this paper, we describe and visualize the densest ball and horoball packing configurations belonging to the simply truncated $3$-dimensional hyperbolic Coxeter orthoschemes with parallel faces. These beautiful packing arrangements describe and show the very interesting structure of the mentioned orthoschemes and the corresponding Coxeter groups. We use for the visualization the Beltrami-Cayley-Klein ball model of $3$-dimensional hyperbolic space $\boldsymbol{H}^3$ and the pictures were made by the Python software.


title: How will electric vehicles affect traffic congestion and energy consumption: an integrated modelling approach

abstract: This paper explores the impact of electric vehicles (EVs) on traffic congestion and energy consumption by proposing an integrated bi-level framework comprising of: a) a dynamic micro-scale traffic simulation suitable for modelling current and hypothetical traffic and charging demand scenarios and b) a queue model for capturing the impact of fast charging station use, informed by traffic flows, travel distances, availability of charging infrastructure and estimated vehicle battery state of charge. To the best of our knowledge, this paper represents the first integrated analysis of potential traffic congestion and energy infrastructure impacts linked to EV uptake, based on real traffic flows and the placement and design of existing fast-charging infrastructure. Results showcase that the integrated queue-energy-transport modelling framework can predict correctly the limitations of the EV infrastructure as well as the traffic congestion evolution. The modelling approach identifies concrete pain points to be addressed in both traffic and energy management and planning. The code for this project can be found at : https://github.com/Future-Mobility-Lab/EV-charging-impact


title: Search for an anomalous excess of charged-current $\nu_e$ interactions without pions in the final state with the MicroBooNE experiment

abstract: This article presents a measurement of $\nu_e$ interactions without pions in the final state using the MicroBooNE experiment and an investigation into the excess of low-energy electromagnetic events observed by the MiniBooNE collaboration. The measurement is performed in exclusive channels with (1$e$N$p$0$\pi$) and without (1$e$0$p$0$\pi$) visible final-state protons using 6.86$\times 10^{20}$ protons on target of data collected from the Booster Neutrino Beam at Fermilab. Events are reconstructed with the Pandora pattern recognition toolkit and selected using additional topological information from the MicroBooNE liquid argon time projection chamber. Using a goodness-of-fit test the data are found to be consistent with the predicted number of events with nominal flux and interaction models with a $p$-value of 0.098 in the two channels combined. A model based on the low-energy excess observed in MiniBooNE is introduced to quantify the strength of a possible $\nu_e$ excess. The analysis suggests that if an excess is present, it is not consistent with a simple scaling of the $\nu_e$ contribution to the flux. Combined, the 1$e$N$p$0$\pi$ and 1$e$0$p$0$\pi$ channels do not give a conclusive indication about the tested model, but separately they both disfavor the low-energy excess model at $>$90% CL. The observation in the most sensitive 1$e$N$p$0$\pi$ channel is below the prediction and consistent with no excess. In the less sensitive 1$e$0$p$0$\pi$ channel the observation at low energy is above the prediction, while overall there is agreement over the full energy spectrum.


title: Towards Model Reduction for Power System Transients with Physics-Informed PDE

abstract: This manuscript reports the first step towards building a robust and efficient model reduction methodology to capture transient dynamics in a transmission level electric power system. Such dynamics is normally modeled on seconds-to-tens-of-seconds time scales by the so-called swing equations, which are ordinary differential equations defined on a spatially discrete model of the power grid. Following Seymlyen (1974) and Thorpe, Seyler, and Phadke (1999), we suggest to map the swing equations onto a linear, inhomogeneous Partial Differential Equation (PDE) of parabolic type in two space and one time dimensions with time-independent coefficients and properly defined boundary conditions. We illustrate our method on the synchronous transmission grid of continental Europe. We show that, when properly coarse-grained, i.e., with the PDE coefficients and source terms extracted from a spatial convolution procedure of the respective discrete coefficients in the swing equations, the resulting PDE reproduces faithfully and efficiently the original swing dynamics. We finally discuss future extensions of this work, where the presented PDE-based modeling will initialize a physics-informed machine learning approach for real-time modeling, $n-1$ feasibility assessment and transient stability analysis of power systems.


title: Simultaneous Statistical Inference for Second Order Parameters of Time Series under Weak Conditions

abstract: Strict stationarity is a common assumption used in the time series literature in order to derive asymptotic distributional results for second-order statistics, like sample autocovariances and sample autocorrelations. Focusing on weak stationarity, this paper derives the asymptotic distribution of the maximum of sample autocovariances and sample autocorrelations under weak conditions by using Gaussian approximation techniques. The asymptotic theory for parameter estimation obtained by fitting a (linear) autoregressive model to a general weakly stationary time series is revisited and a Gaussian approximation theorem for the maximum of the estimators of the autoregressive coefficients is derived. To perform statistical inference for the second order parameters considered, a bootstrap algorithm, the so-called second-order wild bootstrap, is applied. Consistency of this bootstrap procedure is proven. In contrast to existing bootstrap alternatives, validity of the second-order wild bootstrap does not require the imposition of strict stationary conditions or structural process assumptions, like linearity. The good finite sample performance of the second-order wild bootstrap is demonstrated by means of simulations.


title: Drawing Robust Scratch Tickets: Subnetworks with Inborn Robustness Are Found within Randomly Initialized Networks

abstract: Deep Neural Networks (DNNs) are known to be vulnerable to adversarial attacks, i.e., an imperceptible perturbation to the input can mislead DNNs trained on clean images into making erroneous predictions. To tackle this, adversarial training is currently the most effective defense method, by augmenting the training set with adversarial samples generated on the fly. Interestingly, we discover for the first time that there exist subnetworks with inborn robustness, matching or surpassing the robust accuracy of the adversarially trained networks with comparable model sizes, within randomly initialized networks without any model training, indicating that adversarial training on model weights is not indispensable towards adversarial robustness. We name such subnetworks Robust Scratch Tickets (RSTs), which are also by nature efficient. Distinct from the popular lottery ticket hypothesis, neither the original dense networks nor the identified RSTs need to be trained. To validate and understand this fascinating finding, we further conduct extensive experiments to study the existence and properties of RSTs under different models, datasets, sparsity patterns, and attacks, drawing insights regarding the relationship between DNNs' robustness and their initialization/overparameterization. Furthermore, we identify the poor adversarial transferability between RSTs of different sparsity ratios drawn from the same randomly initialized dense network, and propose a Random RST Switch (R2S) technique, which randomly switches between different RSTs, as a novel defense method built on top of RSTs. We believe our findings about RSTs have opened up a new perspective to study model robustness and extend the lottery ticket hypothesis.


title: Comment on "Synchronization dynamics in non-normal networks: the trade-off for optimality"

abstract: A recent paper by R. Muolo, T. Carletti, J. P. Gleeson, and M. Asllani [Entropy 23, 36 (2021)] presents a mainly numerical study on the role of non-normality in the synchronization of coupled periodic oscillators, deriving apparent contradictions with the existing literature. Here, we show that their conclusions are artifactual due to a misinterpretation of the master stability function formalism and confirm that the existing literature is correct. We also point to a broader existing literature in which research considered in this paper was correctly addressed numerically, analytically, and experimentally.


title: Leading and higher twist transverse momentum dependent parton distribution functions in the spectator model

abstract: Transverse momentum dependent parton distribution functions, also abbreviated as TMDs, offer a three-dimensional picture of hadrons by taking the intrinsic transverse momentum of the parton into consideration. Hence, they are very important for us to understand the structure of hadrons. In this article, we calculate and summarize all TMDs of quark through the spectator model, from twist-2 to twist-4. Especially, we give complete results of TMDs at twist-4. We adopt a general analytical framework to calculate TMDs, with both scalar and axial-vector spectators being considered. All TMDs are calculated analytically in the light-cone coordinate, and single gluon rescattering is considered to generate T-odd TMDs. T-even TMDs are also calculated to this level, maybe for the first time. Different from the traditional point of view, the twist-4 TMDs can contribute to some physical observables like azimuthal asymmetries. An approximate formula of the Sivers asymmetry, including twist-4 TMDs, is given.


title: From classical to quantum regime of topological surface states via defect engineering

abstract: Since the notion of topological insulator (TI) was envisioned in late 2000s, topology has become a new paradigm in condensed matter physics. Realization of topology as a generic property of materials has led to numerous predictions of topological effects. Although most of the classical topological effects, directly resulting from the presence of the spin-momentum-locked topological surface states (TSS), were experimentally confirmed soon after the theoretical prediction of TIs, many topological quantum effects remained elusive for a long while. It turns out that native defects, particularly interfacial defects, have been the main culprit behind this impasse. Even after quantum regime is achieved for the bulk states, TSS still tends to remain in the classical regime due to high density of interfacial defects, which frequently donate mobile carriers due to the very nature of the topologically-protected surface states. However, with several defect engineering schemes that suppress these effects, a series of topological quantum effects have emerged including quantum anomalous Hall effect, quantum Hall effect, quantized Faraday/Kerr rotations, topological quantum phase transitions, axion insulating state, zeroth-Landau level state, etc. Here, we review how these defect engineering schemes have allowed topological surface states to pull out of the murky classical regime and reveal their elusive quantum signatures, over the past decade.


title: Efficient solvers for Armijo's backtracking problem

abstract: Backtracking is an inexact line search procedure that selects the first value in a sequence $x_0, x_0\beta, x_0\beta^2...$ that satisfies $g(x)\leq 0$ on $\mathbb{R}_+$ with $g(x)\leq 0$ iff $x\leq x^*$. This procedure is widely used in descent direction optimization algorithms with Armijo-type conditions. It both returns an estimate in $(\beta x^*,x^*]$ and enjoys an upper-bound $\lceil \log_{\beta} \epsilon/x_0 \rceil$ on the number of function evaluations to terminate, with $\epsilon$ a lower bound on $x^*$. The basic bracketing mechanism employed in several root-searching methods is adapted here for the purpose of performing inexact line searches, leading to a new class of inexact line search procedures. The traditional bisection algorithm for root-searching is transposed into a very simple method that completes the same inexact line search in at most $\lceil \log_2 \log_{\beta} \epsilon/x_0 \rceil$ function evaluations. A recent bracketing algorithm for root-searching which presents both minmax function evaluation cost (as the bisection algorithm) and superlinear convergence is also transposed, asymptotically requiring $\sim \log \log \log \epsilon/x_0 $ function evaluations for sufficiently smooth functions. Other bracketing algorithms for root-searching can be adapted in the same way. Numerical experiments suggest time savings of 50\% to 80\% in each call to the inexact search procedure.


title: Pair Fluctuation Effects on Quasiparticle Transport in Fermi Systems

abstract: The leading corrections to Fermi liquid theory for non-equilibrium quasiparticle transport near a Cooper instability arise from the virtual emission and absorption of incipient Cooper pairs. We formulate the corrections to the Landau-Boltzmann transport equation starting from Keldysh's field theory for non-equilibrium, strongly interacting Fermions. The theory is applicable to quasiparticle transport in conventional and unconventional superconductors, dense nuclear matter and the low temperature phases of liquid $^3$He. Validation of the theory is provided by our analysis, and quantitative agreement between theory and experiment, of the excess attenuation of zero sound in liquid $^3$He near the superfluid transition. We propose an additional experimental test of the theory based on the effects of a Zeeman field on the spectrum of pairing fluctuations for the Cooper instability in spin-triplet superfluids.


title: Fault-Tolerant Federated Reinforcement Learning with Theoretical Guarantee

abstract: The growing literature of Federated Learning (FL) has recently inspired Federated Reinforcement Learning (FRL) to encourage multiple agents to federatively build a better decision-making policy without sharing raw trajectories. Despite its promising applications, existing works on FRL fail to I) provide theoretical analysis on its convergence, and II) account for random system failures and adversarial attacks. Towards this end, we propose the first FRL framework the convergence of which is guaranteed and tolerant to less than half of the participating agents being random system failures or adversarial attackers. We prove that the sample efficiency of the proposed framework is guaranteed to improve with the number of agents and is able to account for such potential failures or attacks. All theoretical results are empirically verified on various RL benchmark tasks.


title: (Quasi-)conformal methods in two-dimensional free boundary problems

abstract: In this paper we study the local behavior of solutions to some free boundary problems. We relate the theory of quasi-conformal maps to the regularity of the solutions to nonlinear thin-obstacle problems; we prove that the contact set is locally a finite union of intervals and we apply this result to the solutions of one-phase Bernoulli problems with geometric constraint. We also introduce a new conformal hodograph transform, which allows to obtain the precise expansion at branch points of both the solutions to the one-phase problem with geometric constraint and a class of symmetric solutions to the two-phase problem, as well as to construct examples of free boundaries with cusp-like singularities.