title: Scattering Expansion for Localization in One Dimension

abstract: We present a perturbative approach to disordered systems in one spatial dimension that accesses the full range of phase disorder and clarifies the connection between localization and phase information. We consider a long chain of identically disordered scatterers and expand in the reflection strength of any individual scatterer. As an example application, we show analytically that in a discrete-time quantum walk, the localization length can depend non-monotonically on the strength of phase disorder (whereas expanding in weak disorder yields monotonic decrease). More generally, we obtain to all orders in the expansion a particular non-separable form for the joint probability distribution of the transmission coefficient logarithm and reflection phase. Furthermore, we show that for weak local reflection strength, a version of the scaling theory of localization holds: the joint distribution is determined by just three parameters.


title: Geometry in Scattering Amplitudes

abstract: We formulate the field-space geometry for an effective field theory of scalars and gauge bosons. Geometric invariants such as the field-space curvature enter in both scattering amplitudes and the renormalization group equations, with the scalar and gauge results unified in a single expression.


title: Learnable Polyphase Sampling for Shift Invariant and Equivariant Convolutional Networks

abstract: We propose learnable polyphase sampling (LPS), a pair of learnable down/upsampling layers that enable truly shift-invariant and equivariant convolutional networks. LPS can be trained end-to-end from data and generalizes existing handcrafted downsampling layers. It is widely applicable as it can be integrated into any convolutional network by replacing down/upsampling layers. We evaluate LPS on image classification and semantic segmentation. Experiments show that LPS is on-par with or outperforms existing methods in both performance and shift consistency. For the first time, we achieve true shift-equivariance on semantic segmentation (PASCAL VOC), i.e., 100% shift consistency, outperforming baselines by an absolute 3.3%.


title: Partial Tidal Disruption of Main-Sequence Stars by Intermediate-Mass Black Holes

abstract: We study close encounters of a $1\,M_{\odot}$ middle-age main-sequence star (modeled using MESA) with massive black holes through hydrodynamic simulations, and explore in particular the dependence of the outcomes on the black hole mass. We consider here black holes in the intermediate-mass range, $M_{\rm BH}= 100-10^4\,M_{\odot}$. Possible outcomes vary from a small tidal perturbation for weak encounters all the way to partial or full disruption for stronger encounters. We find that stronger encounters lead to increased mass loss at the first pericenter passage, in many cases ejecting the partially disrupted star on an unbound orbit. For encounters that initially produce a bound system, with only partial stripping of the star, the fraction of mass stripped from the star increases with each subsequent pericenter passage and a stellar remnant of finite mass is ultimately ejected in all cases. The critical penetration depth that separates bound and unbound remnants has a dependence on the black hole mass when $M_{\rm BH} \lesssim 10^3\,M_{\odot}$. We also find that the number of successive close passages before ejection decreases as we go from the stellar-mass black hole to the intermediate-mass black hole regime. For instance, after an initial encounter right at the classical tidal disruption limit, a $1\,M_{\odot}$ star undergoes 16 (5) pericenter passages before ejection from a $10\,M_{\odot}$ ($100\,M_{\odot}$) black hole. Observations of periodic flares from these repeated close passages could in principle indicate signatures of a partial tidal disruption event.


title: Hierarchical Decentralized Deep Reinforcement Learning Architecture for a Simulated Four-Legged Agent

abstract: Legged locomotion is widespread in nature and has inspired the design of current robots. The controller of these legged robots is often realized as one centralized instance. However, in nature, control of movement happens in a hierarchical and decentralized fashion. Introducing these biological design principles into robotic control systems has motivated this work. We tackle the question whether decentralized and hierarchical control is beneficial for legged robots and present a novel decentral, hierarchical architecture to control a simulated legged agent. Three different tasks varying in complexity are designed to benchmark five architectures (centralized, decentralized, hierarchical and two different combinations of hierarchical decentralized architectures). The results demonstrate that decentralizing the different levels of the hierarchical architectures facilitates learning of the agent, ensures more energy efficient movements as well as robustness towards new unseen environments. Furthermore, this comparison sheds light on the importance of modularity in hierarchical architectures to solve complex goal-directed tasks. We provide an open-source code implementation of our architecture (https://github.com/wzaielamri/hddrl).


title: Misaligned orientations of 4f optical neural network for image classification accuracy on various datasets

abstract: In recent years, the optical 4f system has drawn much attention in building high-speed and ultra-low-power optical neural networks (ONNs). Most optical systems suffer from the misalignment of the optical devices during installment. The performance of ONN based on the optical 4f system (4f-ONN) is considered sensitive to the misalignment in the optical path introduced. In order to comprehensively investigate the influence caused by the misalignment, we proposed a method for estimating the performance of a 4f-ONN in response to various misalignment in the context of the image classification task.The misalignment in numerical simulation is estimated by manipulating the optical intensity distributions in the fourth focus plane in the 4f system. Followed by a series of physical experiments to validate the simulation results. Using our method to test the impact of misalignment of 4f system on the classification accuracy of two popular image classification datasets, MNIST and Quickdraw16. On both datasets, we found that the performances of 4f-ONN generally degraded dramatically as the positioning error increased. Different positioning error tolerance in the misalignment orientations was observed over the two datasets. Classification performance could be preserved by positioning errors up to 200 microns in a specific direction.


title: A MIP-Based Approach for Multi-Robot Geometric Task-and-Motion Planning

abstract: We address multi-robot geometric task-and-motion planning (MR-GTAMP) problems in synchronous, monotone setups. The goal of the MR-GTAMP problem is to move objects with multiple robots to goal regions in the presence of other movable objects. To perform the tasks successfully and effectively, the robots have to adopt intelligent collaboration strategies, i.e., decide which robot should move which objects to which positions, and perform collaborative actions, such as handovers. To endow robots with these collaboration capabilities, we propose to first collect occlusion and reachability information for each robot as well as information about whether two robots can perform a handover action by calling motion-planning algorithms. We then propose a method that uses the collected information to build a graph structure which captures the precedence of the manipulations of different objects and supports the implementation of a mixed-integer program to guide the search for highly effective collaborative task-and-motion plans. The search process for collaborative task-and-motion plans is based on a Monte-Carlo Tree Search (MCTS) exploration strategy to achieve exploration-exploitation balance. We evaluate our framework in two challenging GTAMP domains and show that it can generate high-quality task-and-motion plans with respect to the planning time, the resulting plan length and the number of objects moved compared to two state-of-the-art baselines.


title: Failure Analysis of Big Cloud Service Providers Prior to and During Covid-19 Period

abstract: Cloud services are important for societal function such as healthcare, commerce, entertainment and education. Cloud can provide a variety of features such as increased collaboration and inexpensive computing. Failures are unavoidable in cloud services due to the large size and complexity, resulting in decreased reliability and efficiency. For example, due to bugs, many high-severity failures have been occurring in cloud infrastructure of popular providers, causing outages of several hours and the unrecoverable loss of user data. There are prior studies about cloud failure analyses are limited and use sources such as news articles. However, a detailed cloud failure focused study is required that provides analyses for cloud failure data gathered directly from the vendors. Furthermore, the Covid-19 cloud failures should be studied as cloud services played a major role throughout the Covid-19 period, as individuals relied on cloud services for activities such as working from home. A program can be made for this task. As a result, we will be able to better understand and mitigate cloud failures to reduce the effect of cloud failures.


title: Knowledge acquisition via interactive Distributed Cognitive skill Modules

abstract: The human's cognitive capacity for problem solving is always limited to his/her educational background, skills, experiences, etc. Hence, it is often insufficient to bring solution to extraordinary problems especially when there is a time restriction. Nowadays this sort of personal cognitive limitations are overcome at some extend by the computational utilities (e.g. program packages, internet, etc.) where each one provides a specific background skill to the individual to solve a particular problem. Nevertheless these models are all based on already available conventional tools or knowledge and unable to solve spontaneous unique problems, except human's procedural cognitive skills. But unfortunately such low-level skills can not be modelled and stored in a conventional way like classical models and knowledge. This work aims to introduce an early stage of a modular approach to procedural skill acquisition and storage via distributed cognitive skill modules which provide unique opportunity to extend the limits of its exploitation.


title: Inductive Logical Query Answering in Knowledge Graphs

abstract: Formulating and answering logical queries is a standard communication interface for knowledge graphs (KGs). Alleviating the notorious incompleteness of real-world KGs, neural methods achieved impressive results in link prediction and complex query answering tasks by learning representations of entities, relations, and queries. Still, most existing query answering methods rely on transductive entity embeddings and cannot generalize to KGs containing new entities without retraining the entity embeddings. In this work, we study the inductive query answering task where inference is performed on a graph containing new entities with queries over both seen and unseen entities. To this end, we devise two mechanisms leveraging inductive node and relational structure representations powered by graph neural networks (GNNs). Experimentally, we show that inductive models are able to perform logical reasoning at inference time over unseen nodes generalizing to graphs up to 500% larger than training ones. Exploring the efficiency--effectiveness trade-off, we find the inductive relational structure representation method generally achieves higher performance, while the inductive node representation method is able to answer complex queries in the inference-only regime without any training on queries and scales to graphs of millions of nodes. Code is available at https://github.com/DeepGraphLearning/InductiveQE.


title: Trajectory Prediction for Vehicle Conflict Identification at Intersections Using Sequence-to-Sequence Recurrent Neural Networks

abstract: Surrogate safety measures in the form of conflict indicators are indispensable components of the proactive traffic safety toolbox. Conflict indicators can be classified into past-trajectory-based conflicts and predicted-trajectory-based conflicts. While the calculation of the former class of conflicts is deterministic and unambiguous, the latter category is computed using predicted vehicle trajectories and is thus more stochastic. Consequently, the accuracy of prediction-based conflicts is contingent on the accuracy of the utilized trajectory prediction algorithm. Trajectory prediction can be a challenging task, particularly at intersections where vehicle maneuvers are diverse. Furthermore, due to limitations relating to the road user trajectory extraction pipelines, accurate geometric representation of vehicles during conflict analysis is a challenging task. Misrepresented geometries distort the real distances between vehicles under observation. In this research, a prediction-based conflict identification methodology was proposed. A sequence-to-sequence Recurrent Neural Network was developed to sequentially predict future vehicle trajectories for up to 3 seconds ahead. Furthermore, the proposed network was trained using the CitySim Dataset to forecast both future vehicle positions and headings to facilitate the prediction of future bounding boxes, thus maintaining accurate vehicle geometric representations. It was experimentally determined that the proposed method outperformed frequently used trajectory prediction models for conflict analysis at intersections. A comparison between Time-to-Collision (TTC) conflict identification using vehicle bounding boxes versus the commonly used vehicle center points for geometric representation was conducted. Compared to the bounding box method, the center point approach often failed to identify TTC conflicts or underestimated their severity.


title: SKYSURF-4: Panchromatic HST All-Sky Surface-Brightness Measurement Methods and Results

abstract: The diffuse, unresolved sky provides most of the photons that the Hubble Space Telescope (HST) receives, yet remains poorly understood. HST Archival Legacy program SKYSURF aims to measure the 0.2-1.6 $\mu$m sky surface brightness (sky-SB) from over 140,000 HST images. We describe a sky-SB measurement algorithm designed for SKYSURF that is able to recover the input sky-SB from simulated images to within 1% uncertainty. We present our sky-SB measurements estimated using this algorithm on the entire SKYSURF database. Comparing our sky-SB spectral energy distribution (SED) to measurements from the literature shows general agreements. Our SKYSURF SED also reveals a possible dependence on Sun angle, indicating either non-isotropic scattering of solar photons off interplanetary dust or an additional component to Zodiacal Light. Finally, we update Diffuse Light limits in the near-IR based on the methods from Carleton et al. (2022), with values of 0.009 MJy sr$^{-1}$ (22 nW m$^{-2}$ sr$^{-1}$) at 1.25 $\mu$m, 0.015 MJy sr$^{-1}$ (32 nW m$^{-2}$ sr$^{-1}$) at 1.4 $\mu$m, and 0.013 MJy sr$^{-1}$ (25 nW m$^{-2}$ sr$^{-1}$) at 1.6 $\mu$m. These estimates provide the most stringent all-sky constraints to date in this wavelength range. SKYSURF sky-SB measurements are made public on the official SKYSURF website and will be used to constrain Diffuse Light in future papers.


title: Autoencoder based Anomaly Detection and Explained Fault Localization in Industrial Cooling Systems

abstract: Anomaly detection in large industrial cooling systems is very challenging due to the high data dimensionality, inconsistent sensor recordings, and lack of labels. The state of the art for automated anomaly detection in these systems typically relies on expert knowledge and thresholds. However, data is viewed isolated and complex, multivariate relationships are neglected. In this work, we present an autoencoder based end-to-end workflow for anomaly detection suitable for multivariate time series data in large industrial cooling systems, including explained fault localization and root cause analysis based on expert knowledge. We identify system failures using a threshold on the total reconstruction error (autoencoder reconstruction error including all sensor signals). For fault localization, we compute the individual reconstruction error (autoencoder reconstruction error for each sensor signal) allowing us to identify the signals that contribute most to the total reconstruction error. Expert knowledge is provided via look-up table enabling root-cause analysis and assignment to the affected subsystem. We demonstrated our findings in a cooling system unit including 34 sensors over a 8-months time period using 4-fold cross validation approaches and automatically created labels based on thresholds provided by domain experts. Using 4-fold cross validation, we reached a F1-score of 0.56, whereas the autoencoder results showed a higher consistency score (CS of 0.92) compared to the automatically created labels (CS of 0.62) -- indicating that the anomaly is recognized in a very stable manner. The main anomaly was found by the autoencoder and automatically created labels and was also recorded in the log files. Further, the explained fault localization highlighted the most affected component for the main anomaly in a very consistent manner.


title: A geospatial bounded confidence model including mega-influencers with an application to Covid-19 vaccine hesitancy

abstract: We introduce a geospatial bounded confidence model with mega-influencers, inspired by Hegselmann and Krause. The inclusion of geography gives rise to large-scale geospatial patterns evolving out of random initial data; that is, spatial clusters of like-minded agents emerge regardless of initialization. Mega-influencers and stochasticity amplify this effect, and soften local consensus. As an application, we consider national views on Covid-19 vaccines. For a certain set of parameters, our model yields results comparable to real survey results on vaccine hesitancy from late 2020.


title: On the Relationship Between Variational Inference and Auto-Associative Memory

abstract: In this article, we propose a variational inference formulation of auto-associative memories, allowing us to combine perceptual inference and memory retrieval into the same mathematical framework. In this formulation, the prior probability distribution onto latent representations is made memory dependent, thus pulling the inference process towards previously stored representations. We then study how different neural network approaches to variational inference can be applied in this framework. We compare methods relying on amortized inference such as Variational Auto Encoders and methods relying on iterative inference such as Predictive Coding and suggest combining both approaches to design new auto-associative memory models. We evaluate the obtained algorithms on the CIFAR10 and CLEVR image datasets and compare them with other associative memory models such as Hopfield Networks, End-to-End Memory Networks and Neural Turing Machines.


title: Smoothing complex-valued signals on Graphs with Monte-Carlo

abstract: We introduce new smoothing estimators for complex signals on graphs, based on a recently studied Determinantal Point Process (DPP). These estimators are built from subsets of edges and nodes drawn according to this DPP, making up trees and unicycles, i.e., connected components containing exactly one cycle. We provide a Julia implementation of these estimators and study their performance when applied to a ranking problem.


title: AR Training App for Energy Optimal Programming of Cobots

abstract: Worldwide most factories aim for low-cost and fast production ignoring resources and energy consumption. But, high revenues have been accompanied by environmental degradation. The United Nations reacted to the ecological problem and proposed the Sustainable Development Goals, and one of them is Sustainable Production (Goal 12). In addition, the participation of lightweight robots, such as collaborative robots, in modern industrial production is increasing. The energy consumption of a single collaborative robot is not significant, however, the consumption of more and more cobots worldwide is representative. Consequently, our research focuses on strategies to reduce the energy consumption of lightweight robots aiming for sustainable production. Firstly, the energy consumption of the lightweight robot UR10e is assessed by a set of experiments. We analyzed the results of the experiments to describe the relationship between the energy consumption and the evaluation parameters, thus paving the way to optimization strategies. Next, we propose four strategies to reduce energy consumption: 1) optimal standby position, 2) optimal robot instruction, 3) optimal motion time, and 4) reduction of dissipative energy. The results show that cobots potentially reduce from 3\% up to 37\% of their energy consumption, depending on the optimization technique. To disseminate the results of our research, we developed an AR game in which the users learn how to energy-efficiently program cobots.


title: Prediction of drug effectiveness in rheumatoid arthritis patients based on machine learning algorithms

abstract: Rheumatoid arthritis (RA) is an autoimmune condition caused when patients' immune system mistakenly targets their own tissue. Machine learning (ML) has the potential to identify patterns in patient electronic health records (EHR) to forecast the best clinical treatment to improve patient outcomes. This study introduced a Drug Response Prediction (DRP) framework with two main goals: 1) design a data processing pipeline to extract information from tabular clinical data, and then preprocess it for functional use, and 2) predict RA patient's responses to drugs and evaluate classification models' performance. We propose a novel two-stage ML framework based on European Alliance of Associations for Rheumatology (EULAR) criteria cutoffs to model drug effectiveness. Our model Stacked-Ensemble DRP was developed and cross-validated using data from 425 RA patients. The evaluation used a subset of 124 patients (30%) from the same data source. In the evaluation of the test set, two-stage DRP leads to improved classification accuracy over other end-to-end classification models for binary classification. Our proposed method provides a complete pipeline to predict disease activity scores and identify the group that does not respond well to anti-TNF treatments, thus showing promise in supporting clinical decisions based on EHR information.


title: An integral transform for quantum amplitudes

abstract: The central impediment to reducing multidimensional integrals of transition amplitudes to analytic form, or at least to a fewer number of integral dimensions, is the presence of magnitudes of coordinate vector differences (square roots of polynomials) $|{\bf x}_{1}-{\bf x}_{2}|^{2}=\sqrt{x_{1}^{2}-2x_{1}x_{2}\cos\theta+x_{2}^{2}}$ in disjoint products of functions. Fourier transforms circumvent this by introducing a three-dimensional momentum integral for each of those products, followed in many cases by another set of integral transforms to move all of the resulting denominators into a single quadratic form in one denominator whose square my be completed. Gaussian transforms introduce a one-dimensional integral for each such product while squaring the square roots of coordinate vector differences and moving them into an exponential. Addition theorems may also be used for this purpose, and sometimes direct integration is even possible. Each method has its strengths and weaknesses. An alternative integral transform to Fourier transforms and Gaussian transforms is derived herein and utilized. A number of consequent integrals of Macdonald functions, hypergeometric functions, and Meijer G-functions with complicated arguments is given.


title: Constraints on Evolutionary Timescales for M Dwarf Planets from Dynamical Stability Arguments

abstract: The diversity of dynamical conditions among exoplanets is now well established. Yet, the relevance of orbital dynamical timescales to biological evolutionary timescales is poorly understood. Given that even minor orbital changes may place significant pressure on any organisms living on a planet, dynamical sculpting has important implications for the putative evolution of life. In this manuscript, we employ a Monte Carlo framework to investigate how a range of exoplanetary dynamical sculpting timescales affects timescales for biological evolution. We proceed with minimal assumptions for how dynamical sculpting proceeds and the emergence and persistence of life. We focus our investigation on M dwarf stars, the most common exoplanetary hosts in the Milky Way. We assign dynamical statuses, dependent on stellar age, to a suite of planetary systems, varying the rate of dynamical disruption within limits that are consistent with present-day planet demographics. We then simulate the observed yield of planets according to the completeness of NASA's Kepler and TESS missions, and investigate the properties of these samples. With this simplified approach, we find that systems hosting multiple transiting planets ought to have, on average, shorter dynamically-uninterrupted intervals than single-transiting systems. However, depending upon the rate of dynamical sculpting, planets orbiting older stars will exhibit the opposite trend. Even modest constraints on stellar age would help identify "older" stars for which this holds. The degree of these effects varies, dependent upon both the intrinsic dynamical demographics of exoplanets and whether we consider planets detected by NASA's Kepler or TESS missions.


title: Integer characteristic polynomial factorization and Hilbert space fragmentation

abstract: Models with Hilbert space fragmentation are characterized by (exponentially) many dynamically disconnected subspaces, not associated with conventional symmetries but captured by nontrivial Krylov subspaces. These subspaces usually exhibit a whole range of thermalization properties, from chaotic to integrable, to quantum many-body scars. However, so far, they have not been properly defined, nor can they be easily found, given a Hamiltonian. In this work, we consider Hamiltonians that have integer representations, a common feature of many (most) celebrated models in condensed matter. We show the equivalence of the integer characteristic polynomial factorization and the existence of Krylov subspaces generated from integer vectors. Considering the pair-hopping model, we illustrate how the factorization property can be used as a method to unveil Hilbert space fragmentation. We discuss the generalization over other rings of integers, for example those based on the cyclotomic field which are relevant when working in a given ($\ne 0, \pi$) momentum sector.


title: A stabilizing kernel for complex Langevin simulations of real-time gauge theories

abstract: The complex Langevin (CL) method is a promising approach to overcome the sign problem, which emerges in real-time formulations of quantum field theories. Over the past decade, stabilization techniques for CL have been developed with important applications in finite density QCD. However, they are insufficient for SU($N_c$) gauge theories on a Schwinger-Keldysh time contour that is required for a real-time formulation. In these proceedings we revise the discretization of the real-time CL equations and introduce a novel anisotropic kernel that enables CL simulations on discretized time contours. Applying it to SU(2) Yang-Mills theory in 3+1 dimensions, we obtain unprecedentedly stable results that may allow us to calculate real-time observables from first principles.


title: More Ingredients for an Altarelli Cocktail at MiniBooNE

abstract: The MiniBooNE excess persists as a significant puzzle in particle physics. Given that the MiniBooNE detector cannot discriminate between electron-like signals and backgrounds due to photons, the goal of this work is to study photon backgrounds in MiniBooNE in depth. We first consider a novel single-photon background arising from multi-nucleon scattering with coherently enhanced initial or final state radiation. This class of processes, which we dub "2p2h$\gamma$" (two-particle--two-hole + photon) can explain ${\sim}40$ of the ${\sim}560$ excess events observed by MiniBooNE in neutrino mode. Second, we consider the background from neutral-current single-$\pi^0$ production, where two photons from $\pi^0\to\gamma\gamma$ decay are mis-identified as an electron-like shower. We construct a phenomenological likelihood that reproduces MiniBooNE's $\pi^0\to\gamma\gamma$ background faithfully. Even with data-driven background estimation techniques, we find there is a residual dependence on the Monte Carlo generator used. Our results motivate a reduction in the significance of the MiniBooNE excess by $0.4\sigma$.


title: Fuzzy Aquarius: evolution of a Milky-way like system in the Fuzzy Dark Matter scenario

abstract: We present the first high-resolution zoom-in simulation of a Milky-way-like halo extracted from the Aquarius Project in the Fuzzy Dark Matter (FDM) framework. We use the N-body code AX-GADGET, based on a particle oriented solution of the Schr\"{o}dinger-Poisson equations, able to detail the complexity of structure formation while keeping track of the quantum effects in FDM. The halo shows a cored density profile, with a core size of several kpc for a FDM mass of $m_{\chi}=2.5h \times 10^{-22}\ {\rm eV}/c^2$. A flattening is observed also in the velocity profile, representing a distinct feature of FDM dynamics. We provide a quantitative analysis of the impact of fuzziness on satellites in terms of abundance, mass, distance and velocity distribution functions and their evolution with redshift. Very interestingly, we show that all collapsed structures, despite showing a flat density profile at $z=0$, do not reach the solitonic ground-state at the time of formation: on the contrary, they asymptotically converge to it on a timescale that depends on their mass and formation history. This implies that current limits on FDM mass - obtained by applying simple scaling relations to observed galaxies - should be taken with extreme care, since single objects can significantly deviate from the expected asymptotic behavior during their evolution.


title: Quasi-periodic eruptions from mildly eccentric unstable mass transfer in galactic nuclei

abstract: We propose that the recently observed quasi-periodic eruptions (QPEs) in galactic nuclei are produced by unstable mass transfer due to Roche lobe overflow of a low-mass main-sequence star in a mildly eccentric (e ~ 0.5) orbit. We argue that the QPE emission is powered by circularization shocks, but not directly by black hole accretion. Our model predicts the presence of a time-steady accretion disk that is bolometrically brighter than the time-averaged QPE luminosity, but primarily emits in the extreme-UV. This is consistent with the quiescent soft X-ray emission detected in between the eruptions in eROSITA QPE1, QPE2, and GSN 069. Such accretion disks have an unusual $\nu L_\nu \propto \nu^{12/7}$ optical spectrum. The lifetime of the bright QPE phase, 100-1000 yrs, is set by mass-loss triggered by ram-pressure interaction between the star and the accretion disk fed by the star itself. We show that the stellar orbits needed to explain QPEs can be efficiently created by the Hills breakup of tight stellar binaries provided that (i) the stellar binary orbit is tidally hardened before the breakup due to diffusive growth of the f-mode amplitude, and (ii) the captured star's orbit decays by gravitational wave emission without significant orbital angular momentum diffusion (which is the case for black holes less than about a million Msun). We conclude by discussing the implications of our model for hyper-velocity stars, extreme mass ratio inspirals, repeating partial TDEs, and related stellar phenomena in galactic nuclei.


title: Photochemistry and Heating/Cooling of the Multiphase Interstellar Medium with UV Radiative Transfer for Magnetohydrodynamic Simulations

abstract: We present an efficient heating/cooling method coupled with chemistry and ultraviolet (UV) radiative transfer, which can be applied to numerical simulations of the interstellar medium (ISM). We follow the time-dependent evolution of hydrogen species (H$_2$, H, H$^+$), assume carbon/oxygen species (C, C$^+$, CO, O, and O$^+$) are in formation-destruction balance given the non-steady hydrogen abundances, and include essential heating/cooling processes needed to capture thermodynamics of all ISM phases. UV radiation from discrete point sources and the diffuse background is followed through adaptive ray tracing and a six-ray approximation, respectively, allowing for H$_2$ self-shielding; cosmic ray (CR) heating and ionization are also included. To validate our methods and demonstrate their application for a range of density, metallicity, and radiation field, we conduct a series of tests, including the equilibrium curves of thermal pressure vs. density, the chemical and thermal structure in photo-dissociation regions, H I-to-H$_2$ transitions, and the expansion of H II regions and radiative supernova remnants. Careful treatment of photochemistry and CR ionization is essential for many aspects of ISM physics, including identifying the thermal pressure at which cold and warm neutral phases co-exist. We caution that many current heating and cooling treatments used in galaxy formation simulations do not reproduce the correct thermal pressure and ionization fraction in the neutral ISM. Our new model is implemented in the MHD code Athena and incorporated in the TIGRESS simulation framework, for use in studying the star-forming ISM in a wide range of environments.


title: Strong correlations in ABC-stacked trilayer graphene: Moir\'{e} is important

abstract: Recent experiments on multilayer graphene materials have discovered a plethora of correlated phases, including ferromagnetism and superconductivity, in the absence of a moir\'{e} potential. These findings pose an intriguing question of whether an underlying moir\'{e} potential plays a key role in determining the phases realizable in tunable two-dimensional quantum materials, or whether it merely acts as a weak periodic potential that perturbs an underlying correlated many body state. In this work, employing a Hartree-Fock mean field analysis, we examine this question theoretically by quantitatively studying the effects of an hexagonal Boron Nitride (h-BN) substrate on ABC-stacked trilayer graphene (ABC-TLG). For the topologically trivial regime, we find that the moir\'{e} potential leads to a strong suppression of the ferromagnetism of the underlying metal. Further, band insulators appear solely at full filling of the moir\'{e} unit cell, with a moir\'{e} potential stronger than is conventionally assumed. Thus the observed correlated insulating phases in ABC-TLG aligned with h-BN cannot be understood through band folding of the ferromagnetic metal found without the moir\'{e} potential. For the topologically non-trivial regime, we discover the appearance of prominent incompressible states when fractional hole fillings (of the moir\'{e} unit cell) coincide with the occurrence of fractional-metallic states in the moir\'{e}-less setting, as well as a slight weakening of the ferromagnetic nature of the phases; however this once again requires a moir\'{e} potential stronger than is conventionally assumed. Our findings highlight the importance of interactions in renormalizing the electronic bandstructure, and emphasizes the key role played by the moir\'{e} potential in determining the strong correlation physics.


title: Magnetic-field-induced cavity protection for intersubband polaritons

abstract: We analyse the effect of a strong perpendicular magnetic field on an intersubband transition in a disordered doped quantum well strongly coupled to an optical cavity. The magnetic field changes the lineshape of the intersubband optical transition due to the interface roughness of the quantum well from a Lorentzian to a Gaussian one. In this regime, a novel form of magnetic-field-induced cavity protection sets in, which strongly reduces the polariton linewidth to the cavity contribution only. Implications of our results for fundamental studies of nonlinear polariton dynamics and for technological applications to polariton lasers are finally highlighted.


title: Predicting Good Quantum Circuit Compilation Options

abstract: Any potential application of quantum computing, once encoded as a quantum circuit, needs to be compiled in order to be executed on a quantum computer. Deciding which qubit technology, which device, which compiler, and which corresponding settings are best for the considered problem -- according to a measure of goodness -- requires expert knowledge and is overwhelming for end-users from different domains trying to use quantum computing to their advantage. In this work, we treat the problem as a statistical classification task and explore the utilization of supervised machine learning techniques to optimize the compilation of quantum circuits. Based on that, we propose a framework that, given a quantum circuit, predicts the best combination of these options and, therefore, automatically makes these decisions for end-users. Experimental evaluations show that, considering a prototypical setting with 3000 quantum circuits, the proposed framework yields promising results: for more than three quarters of all unseen test circuits, the best combination of compilation options is determined. Moreover, for more than 95% of the circuits, a combination of compilation options within the top-three is determined -- while the median compilation time is reduced by more than one order of magnitude. Furthermore, the resulting methodology not only provides end-users with a prediction of the best compilation options, but also provides means to extract explicit knowledge from the machine learning technique. This knowledge helps in two ways: it lays the foundation for further applications of machine learning in this domain and, also, allows one to quickly verify whether a machine learning algorithm is reasonably trained. The corresponding framework and the pre-trained classifier are publicly available on GitHub (https://github.com/cda-tum/MQTPredictor) as part of the Munich Quantum Toolkit (MQT).


title: On thermal false vacuum decay around black holes

abstract: In flat space and at finite temperature, there are two regimes of false vacuum decay in quantum field theory. At low temperature, the decay proceeds through thermally-assisted tunneling described by periodic Euclidean solutions -- bounces -- with non-trivial time dependence. On the other hand, at high temperature the bounces are time-independent and describe thermal jumps of the field over the potential barrier. We argue that only solutions of the second type are relevant for false vacuum decay catalyzed by a black hole in equilibrium with thermal bath. The argument applies to a wide class of spherical black holes, including $d$-dimensional AdS/dS-Schwarzschild black holes and Reissner-Nordstr\"om black holes sufficiently far from criticality. It does not rely on the thin-wall approximation and applies to multi-field scalar theories.


title: High-energy neutrino emission from magnetised jets of rapidly rotating protomagnetars

abstract: Relativistic jets originating from protomagnetar central engines can lead to long duration gamma-ray bursts (GRBs) and are considered potential sources of ultrahigh-energy cosmic rays and secondary neutrinos. We explore the propagation of such jets through a broad range of progenitors, from stars which have shed their envelopes to supergiants which have not. We use a semi-analytical spindown model for the strongly magnetised and rapidly rotating PNS to investigate the role of central engine properties such as the surface dipole field strength, initial rotation period, and jet opening angle on the interactions and dynamical evolution of the jet-cocoon system. With this model, we determine the properties of the relativistic jet, the mildly-relativistic cocoon, and the collimation shock in terms of system parameters such as the time-dependent jet luminosity, injection angle and density profile of the stellar medium. We also analyse the criteria for a successful jet breakout, the maximum energy that can be deposited into the cocoon by the relativistic jet, and structural stability of the magnetised outflow relative to local instabilities. Lastly, we compute the high-energy neutrino emission as these magnetised outflows burrow through their progenitors. Precursor neutrinos from successful GRB jets are unlikely to be detected by IceCube, which is consistent with the results of previous works. On the other hand, we find high-energy neutrinos may be produced for extended progenitors like blue and red supergiants, and we estimate the detectability of neutrinos with next-generation detectors such as IceCube-Gen2.


title: On the cosmic evolution of AGN obscuration and the X-ray luminosity function: XMM-Newton and Chandra spectral analysis of the 31.3 deg$^2$ Stripe 82X

abstract: We present X-ray spectral analysis of XMM and Chandra observations in the 31.3 deg$^2$ Stripe-82X (S82X) field. Of the 6181 X-ray sources in this field, we analyze a sample of 2937 active galactic nuclei (AGN) with solid redshifts and sufficient counts determined by simulations. Our results show a population with median values of spectral index $\Gamma=1.94_{-0.39}^{+0.31}$, column density log$\,N_{\mathrm{H}}/\mathrm{cm}^{-2}=20.7_{-0.5}^{+1.2}$ and intrinsic, de-absorbed, 2-10 keV luminosity log$\,L_{\mathrm{X}}/\mathrm{erg\,s}^{-1}=44.0_{-1.0}^{+0.7}$, in the redshift range 0-4. We derive the intrinsic fraction of AGN that are obscured ($22\leq\mathrm{log}\,N_{\mathrm{H}}/\mathrm{cm}^{-2}<24$), finding a significant increase in the obscured AGN fraction with redshift and a decline with increasing luminosity. The average obscured AGN fraction is $57\pm4\%$ for log$\,L_{\mathrm{X}}/\mathrm{erg\,s}^{-1}>43$. This work constrains the AGN obscuration and spectral shape of the still uncertain high-luminosity and high-redshift regimes (log$\,L_{\mathrm{X}}/\mathrm{erg\,s}^{-1}>45.5$, $z>3$), where the obscured AGN fraction rises to $64\pm12\%$. We report a luminosity and density evolution of the X-ray luminosity function, with obscured AGN dominating at all luminosities at $z>2$ and unobscured sources prevailing at log$\,L_{\mathrm{X}}/\mathrm{erg\,s}^{-1}>45$ at lower redshifts. Our results agree with evolutionary models in which the bulk of AGN activity is triggered by gas-rich environments and in a downsizing scenario. Also, the black hole accretion density (BHAD) is found to evolve similarly to the star formation rate density, confirming the co-evolution between AGN and host-galaxy, but suggesting different time scales in their growing history. The derived BHAD evolution shows that Compton-thick AGN contribute to the accretion history of AGN as much as all other AGN populations combined.


title: Neural Attentive Circuits

abstract: Recent work has seen the development of general purpose neural architectures that can be trained to perform tasks across diverse data modalities. General purpose models typically make few assumptions about the underlying data-structure and are known to perform well in the large-data regime. At the same time, there has been growing interest in modular neural architectures that represent the data using sparsely interacting modules. These models can be more robust out-of-distribution, computationally efficient, and capable of sample-efficient adaptation to new data. However, they tend to make domain-specific assumptions about the data, and present challenges in how module behavior (i.e., parameterization) and connectivity (i.e., their layout) can be jointly learned. In this work, we introduce a general purpose, yet modular neural architecture called Neural Attentive Circuits (NACs) that jointly learns the parameterization and a sparse connectivity of neural modules without using domain knowledge. NACs are best understood as the combination of two systems that are jointly trained end-to-end: one that determines the module configuration and the other that executes it on an input. We demonstrate qualitatively that NACs learn diverse and meaningful module configurations on the NLVR2 dataset without additional supervision. Quantitatively, we show that by incorporating modularity in this way, NACs improve upon a strong non-modular baseline in terms of low-shot adaptation on CIFAR and CUBs dataset by about 10%, and OOD robustness on Tiny ImageNet-R by about 2.5%. Further, we find that NACs can achieve an 8x speedup at inference time while losing less than 3% performance. Finally, we find NACs to yield competitive results on diverse data modalities spanning point-cloud classification, symbolic processing and text-classification from ASCII bytes, thereby confirming its general purpose nature.


title: Terahertz Dynamics in the Glycerol-Water System

abstract: The model glass-former glycerol and its aqueous mixtures were investigated with terahertz-time domain spectroscopy (THz-TDS) in the frequency range of 0.3--3.0\,THz at temperatures from 80--305\,K. It was shown that the infrared absorption coefficient measured with THz-TDS can be theoretically related to the reduced Raman intensity ($\propto \alpha/\omega^2$) and the reduced density of states ($\propto \alpha/\omega^3$) and the agreement with experimental results confirms this. The data were further used to investigate the behaviour of model glasses in the harmonic (below the glass transition temperature $T_{\text{g}}$), anharmonic (above $T_{\text{g}}$), and liquid regime. The onset temperature of the molecular mobility as measured by the infrared active dipoles, $T_{\text{g}}$, was found to correlate with the onset of anharmonic effects, leading to an apparent shift of the boson peak and obscuring it at elevated temperatures. The influence of clustered and unclustered water on the dynamics, the boson peak, and the vibrational dynamics was also investigated. A change in structural dynamics was observed at a water concentration of approximately 5\,wt.\%, corresponding to a transition from isolated water molecules distributed homogeneously throughout the sample to the presence of small water clusters and an increased number of water-water hydrogen bonds which lower the barriers on the potential energy surface.


title: Rapid Method for Computing the Mechanical Resonances of Irregular Objects

abstract: A solid object's geometry, density, and elastic moduli completely determine its spectrum of normal modes. Solving the inverse problem - determining a material's elastic moduli given a set of resonance frequencies and sample geometry - relies on the ability to compute resonance spectra accurately and efficiently. Established methods for calculating these spectra are either fast but limited to simple geometries, or are applicable to arbitrarily shaped samples at the cost of being prohibitively slow. Here, we describe a method to rapidly compute the normal modes of irregularly shaped objects using entirely open-source software. Our method's accuracy compares favorably with existing methods for simple geometries and shows a significant improvement in speed over existing methods for irregular geometries.


title: Empirical Network Structure of Malicious Programs

abstract: A modern binary executable is a composition of various networks. Control flow graphs are commonly used to represent an executable program in labeled datasets used for classification tasks. Control flow and term representations are widely adopted, but provide only a partial view of program semantics. This study is an empirical analysis of the networks composing malicious binaries in order to provide a complete representation of the structural properties of a program. This is accomplished by the measurement of structural properties of program networks in a malicious binary executable dataset. We demonstrate the presence of Scale-Free properties of network structure for program data dependency and control flow graphs, and show that data dependency graphs also have Small-World structural properties. We show that program data dependency graphs have a degree correlation that is structurally disassortative, and that control flow graphs have a neutral degree assortativity, indicating the use of random graphs to model the structural properties of program control flow graphs would show increased accuracy. By providing an increase in feature resolution within labeled datasets of executable programs we provide a quantitative basis to interpret the results of classifiers trained on CFG graph features. An increase in feature resolution allows for the structural properties of program classes to be analyzed for patterns as well as their component parts. By capturing a complete picture of program graphs we can enable theoretical solutions for the mapping a program's operational semantics to its structure.


title: Circuit Theory for Chemical Reaction Networks

abstract: We lay the foundation of a circuit theory for chemical reaction networks. Chemical reactions are grouped into chemical modules solely characterized by their current-concentration characteristic, as electrical devices by their current-voltage (I-V) curve in electronic circuit theory. This, combined with the chemical analog of Kirchhoff's current and voltage laws, provides a powerful tool to predict reaction currents and dissipation across complex chemical networks. The theory can serve to build accurate reduced models of complex networks as well as to design networks performing desired tasks.


title: Meta Transferring for Deblurring

abstract: Most previous deblurring methods were built with a generic model trained on blurred images and their sharp counterparts. However, these approaches might have sub-optimal deblurring results due to the domain gap between the training and test sets. This paper proposes a reblur-deblur meta-transferring scheme to realize test-time adaptation without using ground truth for dynamic scene deblurring. Since the ground truth is usually unavailable at inference time in a real-world scenario, we leverage the blurred input video to find and use relatively sharp patches as the pseudo ground truth. Furthermore, we propose a reblurring model to extract the homogenous blur from the blurred input and transfer it to the pseudo-sharps to obtain the corresponding pseudo-blurred patches for meta-learning and test-time adaptation with only a few gradient updates. Extensive experimental results show that our reblur-deblur meta-learning scheme can improve state-of-the-art deblurring models on the DVD, REDS, and RealBlur benchmark datasets.


title: Polar Dust Emission in Quasar IR SEDs and Its Correlation with Narrow Line Regions

abstract: Polar dust has been found to play an important role in the mid-infrared emission of nearby Seyfert nuclei. If and how often polar dust exists among the quasar population is unknown due to the lack of spatially-resolved observations. In this Letter, we report correlations between the prominence of AGN forbidden line emission (commonly associated with the narrow line region) and the dust mid-IR energy output among the archetypal Palomar-Green quasar sample and other bright type-1 AGNs drawn from the SDSS, Spitzer and WISE archives. The AGN mid-IR color differences traced by WISE W2 ($\sim4.6 \mu m$)$-$W3 ($\sim12 \mu m$) and W2 ($\sim4.6 \mu m$)$-$W4 ($\sim22 \mu m$), and near-IR to mid-IR SEDs constrained with 2MASS, WISE and Spitzer data have clear trends with the relative strength of the forbidden line regions traced by the optical \OIII and mid-IR \OIV emission lines. These observations indicate that, where the lines are strong, a large fraction of the AGN emission at $\lambda\gtrsim5 \mu$m comes from dust in the forbidden line regions. We find that the widely quoted universal AGN template is a result of averaging quasar SEDs with different levels of polar dust emission above the torus output and that the typical intrinsic IR SED of compact torus dust emission alone falls with increasing wavelength past 5 $\mu$m (in $\nu F_\nu$). In addition, the association of polar dust with the forbidden lines suggests an alternative to the receding torus hypothesis for the decrease in infrared output with increasing AGN luminosity.


title: BICEP / Keck XVII: Line of Sight Distortion Analysis: Estimates of Gravitational Lensing, Anisotropic Cosmic Birefringence, Patchy Reionization, and Systematic Errors

abstract: We present estimates of line-of-sight distortion fields derived from the 95 GHz and 150 GHz data taken by BICEP2, BICEP3, and Keck Array up to the 2018 observing season, leading to cosmological constraints and a study of instrumental and astrophysical systematics. Cosmological constraints are derived from three of the distortion fields concerning gravitational lensing from large-scale structure, polarization rotation from magnetic fields or an axion-like field, and the screening effect of patchy reionization. We measure an amplitude of the lensing power spectrum $A_L^{\phi\phi}=0.95 \pm 0.20$. We constrain polarization rotation, expressed as the coupling constant of a Chern-Simons electromagnetic term $g_{a\gamma} \leq 2.6 \times 10^{-2}/H_I$, where $H_I$ is the inflationary Hubble parameter, and an amplitude of primordial magnetic fields smoothed over 1 Mpc $B_{1\text{Mpc}} \leq 6.6 \;\text{nG}$ at 95 GHz. We constrain the root mean square of optical-depth fluctuations in a simple "crinkly surface" model of patchy reionization, finding $A^\tau<0.19$ ($2\sigma$) for the coherence scale of $L_c=100$. We show that all of the distortion fields of the 95 GHz and 150 GHz polarization maps are consistent with simulations including lensed-$\Lambda$CDM, dust, and noise, with no evidence for instrumental systematics. In some cases, the EB and TB quadratic estimators presented here are more sensitive than our previous map-based null tests at identifying and rejecting spurious B-modes that might arise from instrumental effects. Finally, we verify that the standard deprojection filtering in the BICEP/Keck data processing is effective at removing temperature to polarization leakage.


title: Qubit-reuse compilation with mid-circuit measurement and reset

abstract: A number of commercially available quantum computers, such as those based on trapped-ion or superconducting qubits, can now perform mid-circuit measurements and resets. In addition to being crucial for quantum error correction, this capability can help reduce the number of qubits needed to execute many types of quantum algorithms by measuring qubits as early as possible, resetting them, and reusing them elsewhere in the circuit. In this work, we introduce the idea of qubit-reuse compilation, which takes as input a quantum circuit and produces as output a compiled circuit that requires fewer qubits to execute due to qubit reuse. We present two algorithms for performing qubit-reuse compilation: an exact constraint programming optimization model and a greedy heuristic. We introduce the concept of dual circuits, obtained by exchanging state preparations with measurements and vice versa and reversing time, and show that optimal qubit-reuse compilation requires the same number of qubits to execute a circuit as its dual. We illustrate the performance of these algorithms on a variety of relevant near-term quantum circuits, such as one-dimensional and two-dimensional time-evolution circuits, and numerically benchmark their performance on the quantum adiabatic optimization algorithm (QAOA) applied to the MaxCut problem on random three-regular graphs. To demonstrate the practical benefit of these techniques, we experimentally realize an 80-qubit QAOA MaxCut circuit on the 20-qubit Quantinuum H1-1 trapped ion quantum processor using qubit-reuse compilation algorithms.


title: Axial segregation of granular mixtures in laterally shaken multi-trapezium channels

abstract: We investigate axial segregation of binary mixtures in a laterally shaken horizontal channel formed by ratchet-like sidewalls that appear as concatenated trapeziums when not offset axially. Grain mixtures shaken in such a channel are observed to segregate in two stages: they first separate rapidly into two vertically arranged layers and, then, these layers move axially in opposite directions, segregating the two species. Here, we conduct experiments to study the influence on the segregation process of various parameters: the size ratio of grains, the shaking frequency and the channel's geometry. We find that (a) segregation quality depends upon shaking frequency and it is possible to find a unique optimal frequency for segregation, (b) the optimal frequency lowers with increase in size ratio, (c) segregation is generally poorer when the sidewalls are more inclined to each other, and (d) segregation is improved when the sidewalls are axially offset from each other. We then carry out discrete element simulations of the segregation process in order to relate the experimental observations to the interfacial pressure gradient mechanism of Bhateja et al. [Bhateja, A., I. Sharma and J. K. Singh 2017. Segregation physics of a macroscale granular ratchet, Phys. Rev. Fluids 2, 052301]. We demonstrate that the segregation quality correlates well with the scaled interfacial pressure gradient, which is the ratio of the interfacial pressure gradient between the layers, formed in the first stage of the segregation process, to the axial body force provided by the tapered sidewalls.


title: Region2Vec: Community Detection on Spatial Networks Using Graph Embedding with Node Attributes and Spatial Interactions

abstract: Community Detection algorithms are used to detect densely connected components in complex networks and reveal underlying relationships among components. As a special type of networks, spatial networks are usually generated by the connections among geographic regions. Identifying the spatial network communities can help reveal the spatial interaction patterns, understand the hidden regional structures and support regional development decision-making. Given the recent development of Graph Convolutional Networks (GCN) and its powerful performance in identifying multi-scale spatial interactions, we proposed an unsupervised GCN-based community detection method "region2vec" on spatial networks. Our method first generates node embeddings for regions that share common attributes and have intense spatial interactions, and then applies clustering algorithms to detect communities based on their embedding similarity and spatial adjacency. Experimental results show that while existing methods trade off either attribute similarities or spatial interactions for one another, "region2vec" maintains a great balance between both and performs the best when one wants to maximize both attribute similarities and spatial interactions within communities.


title: Measuring Network Resilience via Geospatial Knowledge Graph: a Case Study of the US Multi-Commodity Flow Network

abstract: Quantifying the resilience in the food system is important for food security issues. In this work, we present a geospatial knowledge graph (GeoKG)-based method for measuring the resilience of a multi-commodity flow network. Specifically, we develop a CFS-GeoKG ontology to describe geospatial semantics of a multi-commodity flow network comprehensively, and design resilience metrics that measure the node-level and network-level dependence of single-sourcing, distant, or non-adjacent suppliers/customers in food supply chains. We conduct a case study of the US state-level agricultural multi-commodity flow network with hierarchical commodity types. The results indicate that, by leveraging GeoKG, our method supports measuring both node-level and network-level resilience across space and over time and also helps discover concentration patterns of agricultural resources in the spatial network at different geographic scales.


title: The MASSIVE Survey. XVIII. Deep Wide-Field $K$-band Photometry and Local Scaling Relations for Massive Early-Type Galaxies

abstract: We present wide-field, deep $K$-band photometry of 98 luminous early-type galaxies (ETGs) from the MASSIVE survey based on observations taken with the WIRCam instrument on the Canada-France-Hawaii Telescope. Using these images, we extract accurate total $K$-band luminosities ($L_K$) and half-light radii ($R_e$) for this sample of galaxies. We use these new values to explore the size-luminosity and Faber-Jackson relations for massive ETGs. Within this volume-limited sample, we find clear evidence for curvature in both relations, indicating that the most luminous galaxies tend to have larger sizes and smaller velocity dispersions than expected from a simple power-law fit to less luminous galaxies. Our measured relations are qualitatively consistent with the most massive elliptical galaxies forming largely through dissipationless mergers. When the sample is separated into fast and slow rotators, we find the slow rotators to exhibit similar changes in slope with increasing $L_K$, suggesting that low-mass and high-mass slow rotators have different formation histories. The curvatures in the $R_e-L_K$ and $\sigma-L_K$ relations cancel, leading to a relation between dynamical mass and luminosity that is well described by a single power-law: $R_e\sigma^2 \propto {L_K}^b$ with $b \approx 1.2$. This is consistent with the tilt of the fundamental plane observed in lower mass elliptical galaxies.


title: On-chip quantum information processing with distinguishable photons

abstract: Multi-photon interference is at the heart of photonic quantum technologies. Arrays of integrated cavities can support bright sources of single-photons with high purity and small footprint, but the inevitable spectral distinguishability between photons generated from non-identical cavities is an obstacle to scaling. In principle, this problem can be alleviated by measuring photons with high timing resolution, which erases spectral information through the time-energy uncertainty relation. Here, we experimentally demonstrate that detection can be implemented with a temporal resolution sufficient to interfere photons detuned on the scales necessary for cavity-based integrated photon sources. By increasing the effective timing resolution of the system from 200ps to 20ps, we observe a 20% increase in the visibility of quantum interference between independent photons from integrated micro-ring resonator sources that are detuned by 6.8GHz. We go on to show how time-resolved detection of non-ideal photons can be used to improve the fidelity of an entangling operation and to mitigate the reduction of computational complexity in boson sampling experiments. These results pave the way for photonic quantum information processing with many photon sources without the need for active alignment.


title: Flux eruption events drive angular momentum transport in magnetically arrested accretion flows

abstract: We evolve two high-resolution general relativistic magnetohydrodynamic (GRMHD) simulations of advection-dominated accretion flows around non-spinning black holes (BHs), each over a duration $\sim 3\times 10^5\,GM_{\rm BH}/c^3$. One model captures the evolution of a weakly magnetized (SANE) disk and the other a magnetically arrested disk (MAD). Magnetic flux eruptions in the MAD model push out gas from the disk and launch strong winds with outflow efficiencies at times reaching $10\%$ of the incoming accretion power. Despite the substantial power in these winds, average mass outflow rates remain small out to a radius $\sim100\,GM_{\rm BH}/c^2$, only reaching $\sim 60-80\%$ of the horizon accretion rate. The average outward angular momentum transport is primarily radial in both modes of accretion, but with a clear distinction: magnetic flux eruption-driven disk winds cause a strong vertical flow of angular momentum in the MAD model, while for the SANE model, the magnetorotational instability (MRI) moves angular momentum mostly equatorially through the disk. Further, we find that the MAD state is highly transitory and non-axisymmetric, with the accretion mode often changing to a SANE-like state following an eruption before reattaining magnetic flux saturation with time. The Reynolds stress changes direction during such transitions, with the MAD (SANE) state showing an inward (outward) stress, possibly pointing to intermittent MRI-driven accretion in MADs. Pinning down the nature of flux eruptions using next-generation telescopes will be crucial in understanding the flow of mass, magnetic flux and angular momentum in sub-Eddington accreting BHs like M87$^*$ and Sagittarius A$^*$.


title: Differentiable Hybrid Traffic Simulation

abstract: We introduce a novel differentiable hybrid traffic simulator, which simulates traffic using a hybrid model of both macroscopic and microscopic models and can be directly integrated into a neural network for traffic control and flow optimization. This is the first differentiable traffic simulator for macroscopic and hybrid models that can compute gradients for traffic states across time steps and inhomogeneous lanes. To compute the gradient flow between two types of traffic models in a hybrid framework, we present a novel intermediate conversion component that bridges the lanes in a differentiable manner as well. We also show that we can use analytical gradients to accelerate the overall process and enhance scalability. Thanks to these gradients, our simulator can provide more efficient and scalable solutions for complex learning and control problems posed in traffic engineering than other existing algorithms. Refer to https://sites.google.com/umd.edu/diff-hybrid-traffic-sim for our project.


title: Injecting Domain Knowledge from Empirical Interatomic Potentials to Neural Networks for Predicting Material Properties

abstract: For decades, atomistic modeling has played a crucial role in predicting the behavior of materials in numerous fields ranging from nanotechnology to drug discovery. The most accurate methods in this domain are rooted in first-principles quantum mechanical calculations such as density functional theory (DFT). Because these methods have remained computationally prohibitive, practitioners have traditionally focused on defining physically motivated closed-form expressions known as empirical interatomic potentials (EIPs) that approximately model the interactions between atoms in materials. In recent years, neural network (NN)-based potentials trained on quantum mechanical (DFT-labeled) data have emerged as a more accurate alternative to conventional EIPs. However, the generalizability of these models relies heavily on the amount of labeled training data, which is often still insufficient to generate models suitable for general-purpose applications. In this paper, we propose two generic strategies that take advantage of unlabeled training instances to inject domain knowledge from conventional EIPs to NNs in order to increase their generalizability. The first strategy, based on weakly supervised learning, trains an auxiliary classifier on EIPs and selects the best-performing EIP to generate energies to supplement the ground-truth DFT energies in training the NN. The second strategy, based on transfer learning, first pretrains the NN on a large set of easily obtainable EIP energies, and then fine-tunes it on ground-truth DFT energies. Experimental results on three benchmark datasets demonstrate that the first strategy improves baseline NN performance by 5% to 51% while the second improves baseline performance by up to 55%. Combining them further boosts performance.


title: Probing Fermi sea topology by Andreev state transport

abstract: We show that the topology of the Fermi sea of a two-dimensional electron gas (2DEG) is reflected in the ballistic Landauer transport along a long and narrow Josephson $\pi$-junction that proximitizes the 2DEG. The low-energy Andreev states bound to the junction are shown to exhibit a dispersion that is sensitive to the Euler characteristic of the Fermi sea ($\chi_F$). We highlight two important relations: one connects the electron/hole nature of Andreev states to the convex/concave nature of Fermi surface critical points, and one relates these critical points to $\chi_F$. We then argue that the transport of Andreev states leads to a quantized conductance that probes $\chi_F$. An experiment is proposed to measure this effect, from which we predict an $I$-$V$ characteristic that not only captures the topology of Fermi sea in metals, but also resembles the rectification effect in diodes. Finally, we evaluate the feasibility of measuring this quantized response in graphene, InAs and HgTe 2DEGs.


title: Well-posedness of the shooting algorithm for control-affine problems with a scalar state constraint

abstract: We deal with a control-affine problem with scalar control subject to bounds, a scalar state constraint and endpoint constraints of equality type. For the numerical solution of this problem, we propose a shooting algorithm and provide a sufficient condition for its local convergence. We exhibit an example that illustrates the theory.


title: Multi-trainer Interactive Reinforcement Learning System

abstract: Interactive reinforcement learning can effectively facilitate the agent training via human feedback. However, such methods often require the human teacher to know what is the correct action that the agent should take. In other words, if the human teacher is not always reliable, then it will not be consistently able to guide the agent through its training. In this paper, we propose a more effective interactive reinforcement learning system by introducing multiple trainers, namely Multi-Trainer Interactive Reinforcement Learning (MTIRL), which could aggregate the binary feedback from multiple non-perfect trainers into a more reliable reward for an agent training in a reward-sparse environment. In particular, our trainer feedback aggregation experiments show that our aggregation method has the best accuracy when compared with the majority voting, the weighted voting, and the Bayesian method. Finally, we conduct a grid-world experiment to show that the policy trained by the MTIRL with the review model is closer to the optimal policy than that without a review model.


title: Prospects for $\gamma^\star \gamma^\star \to \pi \pi$ via lattice QCD

abstract: The $\gamma^\star \gamma^\star \to \pi \pi$ scattering amplitude plays a key role in a wide range of phenomena, including understanding the inner structure of scalar resonances as well as constraining the hadronic contributions to the anomalous magnetic moment of the muon. In this work, we explain how the infinite-volume Minkowski amplitude can be constrained from finite-volume Euclidean correlation functions. The relationship between the finite-volume Euclidean correlation functions and the desired amplitude holds up to energies where $3\pi$ states can go on shell, and is exact up to exponentially small corrections that scale like $\mathcal{O}(e^{-m_\pi L})$, where $L$ is the spatial extent of the cubic volume and $m_\pi$ is the pion mass. In order to implement this formalism and remove all power-law finite volume errors, it is necessary to first obtain $\pi \pi \to \pi\pi$, $\pi \gamma^\star \to \pi$, $\gamma^\star \to\pi\pi$, and $\pi\pi\gamma^\star \to\pi\pi$ amplitudes; all of which can be determined via lattice quantum chromodynamic calculations.


title: Protein-to-genome alignment with miniprot

abstract: Motivation: Protein-to-genome alignment is critical to annotating genes in non-model organisms. While there are a few tools for this purpose, all of them were developed over ten years ago and did not incorporate the latest advances in alignment algorithms. They are inefficient and could not keep up with the rapid production of new genomes and quickly growing protein databases. Results: Here we describe miniprot, a new aligner for mapping protein sequences to a complete genome. Miniprot integrates recent techniques such as k-mer sketch and SIMD-based dynamic programming. It is tens of times faster than existing tools while achieving comparable accuracy on real data. Availability and implementation: https://github.com/lh3/miniprot


title: Flexible Spatio-Temporal Hawkes Process Models for Earthquake Occurrences

abstract: Hawkes process is one of the most commonly used models for investigating the self-exciting nature of earthquake occurrences. However, seismicity patterns have complicated characteristics due to heterogeneous geology and stresses, for which existing methods with Hawkes process cannot fully capture. This study introduces novel nonparametric Hawkes process models that are flexible in three distinct ways. First, we incorporate the spatial inhomogeneity of the self-excitation earthquake productivity. Second, we consider the anisotropy in aftershock occurrences. Third, we reflect the space-time interactions between aftershocks with a non-separable spatio-temporal triggering structure. For model estimation, we extend the model-independent stochastic declustering (MISD) algorithm and suggest substituting its histogram-based estimators with kernel methods. We demonstrate the utility of the proposed methods by applying them to the seismicity data in regions with active seismic activities.


title: Semi-supervised Body Parsing and Pose Estimation for Enhancing Infant General Movement Assessment

abstract: General movement assessment (GMA) of infant movement videos (IMVs) is an effective method for early detection of cerebral palsy (CP) in infants. We demonstrate in this paper that end-to-end trainable neural networks for image sequence recognition can be applied to achieve good results in GMA, and more importantly, augmenting raw video with infant body parsing and pose estimation information can significantly improve performance. To solve the problem of efficiently utilizing partially labeled IMVs for body parsing, we propose a semi-supervised model, termed SiamParseNet (SPN), which consists of two branches, one for intra-frame body parts segmentation and another for inter-frame label propagation. During training, the two branches are jointly trained by alternating between using input pairs of only labeled frames and input of both labeled and unlabeled frames. We also investigate training data augmentation by proposing a factorized video generative adversarial network (FVGAN) to synthesize novel labeled frames for training. When testing, we employ a multi-source inference mechanism, where the final result for a test frame is either obtained via the segmentation branch or via propagation from a nearby key frame. We conduct extensive experiments for body parsing using SPN on two infant movement video datasets, where SPN coupled with FVGAN achieves state-of-the-art performance. We further demonstrate that SPN can be easily adapted to the infant pose estimation task with superior performance. Last but not least, we explore the clinical application of our method for GMA. We collected a new clinical IMV dataset with GMA annotations, and our experiments show that SPN models for body parsing and pose estimation trained on the first two datasets generalize well to the new clinical dataset and their results can significantly boost the CRNN-based GMA prediction performance.


title: Concordances of sums of alternating torus knots and their mirrors to $L$-space knots

abstract: Continuing the work of Zemke, Livingston and Allen, we consider when linear combinations of torus knots are concordant to $L$-space knots. We begin by proving Allen's conjecture for alternating torus knots. That is, we prove that a linear combination of alternating torus knots is concordant to an $L$-space knot if and only if the connected sum is a single torus knot. Then we establish a necessary condition for when a linear combination of torus knots is concordant to an $L$-space knot.


title: Twisted K\"ahler-Einstein metrics on flag varieties

abstract: In this paper, we describe invariant twisted K\"ahler-Einstein (tKE) metrics on flag varieties. We also explore some applications of the ideas involved in the proof of our main result to the existence of invariant twisted constant scalar curvature K\"{a}hler metrics. Also, we provide a precise description for the greatest Ricci lower bound of an arbitrary K\"{a}hler class on a flag variety. By means of this description, we establish some inequalities related to optimal volume upper bounds for K\"{a}hler metrics just using tools from Lie theory. Further, we describe the set of tKE metrics for several examples, including full flag varieties, the projectivization of the tangent bundle of $\mathbb{P}^{n+1}$, and families of flag varieties with Picard number $2$.


title: Pishgu: Universal Path Prediction Network Architecture for Real-time Cyber-physical Edge Systems

abstract: Path prediction is an essential task for many real-world Cyber-Physical Systems (CPS) applications, from autonomous driving and traffic monitoring/management to pedestrian/worker safety. These real-world CPS applications need a robust, lightweight path prediction that can provide a universal network architecture for multiple subjects (e.g., pedestrians and vehicles) from different perspectives. However, most existing algorithms are tailor-made for a unique subject with a specific camera perspective and scenario. This article presents Pishgu, a universal lightweight network architecture, as a robust and holistic solution for path prediction. Pishgu's architecture can adapt to multiple path prediction domains with different subjects (vehicles, pedestrians), perspectives (bird's-eye, high-angle), and scenes (sidewalk, highway). Our proposed architecture captures the inter-dependencies within the subjects in each frame by taking advantage of Graph Isomorphism Networks and the attention module. We separately train and evaluate the efficacy of our architecture on three different CPS domains across multiple perspectives (vehicle bird's-eye view, pedestrian bird's-eye view, and human high-angle view). Pishgu outperforms state-of-the-art solutions in the vehicle bird's-eye view domain by 42% and 61% and pedestrian high-angle view domain by 23% and 22% in terms of ADE and FDE, respectively. Additionally, we analyze the domain-specific details for various datasets to understand their effect on path prediction and model interpretation. Finally, we report the latency and throughput for all three domains on multiple embedded platforms showcasing the robustness and adaptability of Pishgu for real-world integration into CPS applications.


title: Intermittency analysis of charged particles generated in Xe-Xe~collisions at $\sqrt{s_{\rm{NN}}}$ = 5.44 TeV using the AMPT model

abstract: The multiplicity fluctuations are sensitive to QCD phase transition and to the presence of critical point in QCD phase diagram. At critical point a system undergoing phase transition is characterized by large fluctuations in the observables which is an important tool to understand the dynamics of particle production in heavy-ion interactions and phase changes. Multiplicity fluctuations of produced particles is an important observable to characterize the evolving system. Using scaling exponent obtained from the normalized factorial moments of the number of charged hadrons in the two dimensional ($\eta,\phi$) phase space, one can learn about the dynamics of system created in these collisions. Events generated using Xe-Xe collisions at $\sqrt{s_{\rm{NN}}} = 5.44 $ TeV with string-melting (SM) version of the AMPT model are analyzed and the scaling exponent $(\nu)$ for various $p_T$ intervals is determined. It is observed that the calculated value of $\nu$ is larger than the universal value 1.304, as is obtained from Ginzburg-Landau theory for second order phase transition. Here we will also present the results of the dependence of the scaling exponent on the transverse momentum bin width.


title: Word Clouds in the Wild

abstract: Word clouds are frequently used to analyze and communicate text data in many domains. In order to help guide research on improving the legibility of word clouds, we have conducted a survey of their usage in Digital Humanities academia and journalism. Using a modified grounded theory approach, we sought to identify the most common purposes for which word clouds were employed and the most common visual encodings they contained. Our findings indicate that font size, color, and word placement dominate as the primary data-encoding channels, as we hypothesized. Perhaps more surprisingly, we found that asking viewers to perform analytical tasks with word clouds was relatively common, especially in DH sources. This suggests that research into the interactions of these visual encoding channels (particularly in regards to legibility) is warranted.


title: Learning Skills from Demonstrations: A Trend from Motion Primitives to Experience Abstraction

abstract: The uses of robots are changing from static environments in factories to encompass novel concepts such as Human-Robot Collaboration in unstructured settings. Pre-programming all the functionalities for robots becomes impractical, and hence, robots need to learn how to react to new events autonomously, just like humans. However, humans, unlike machines, are naturally skilled in responding to unexpected circumstances based on either experiences or observations. Hence, embedding such anthropoid behaviours into robots entails the development of neuro-cognitive models that emulate motor skills under a robot learning paradigm. Effective encoding of these skills is bound to the proper choice of tools and techniques. This paper studies different motion and behaviour learning methods ranging from Movement Primitives (MP) to Experience Abstraction (EA), applied to different robotic tasks. These methods are scrutinized and then experimentally benchmarked by reconstructing a standard pick-n-place task. Apart from providing a standard guideline for the selection of strategies and algorithms, this paper aims to draw a perspectives on their possible extensions and improvements


title: Motion Inspired Unsupervised Perception and Prediction in Autonomous Driving

abstract: Learning-based perception and prediction modules in modern autonomous driving systems typically rely on expensive human annotation and are designed to perceive only a handful of predefined object categories. This closed-set paradigm is insufficient for the safety-critical autonomous driving task, where the autonomous vehicle needs to process arbitrarily many types of traffic participants and their motion behaviors in a highly dynamic world. To address this difficulty, this paper pioneers a novel and challenging direction, i.e., training perception and prediction models to understand open-set moving objects, with no human supervision. Our proposed framework uses self-learned flow to trigger an automated meta labeling pipeline to achieve automatic supervision. 3D detection experiments on the Waymo Open Dataset show that our method significantly outperforms classical unsupervised approaches and is even competitive to the counterpart with supervised scene flow. We further show that our approach generates highly promising results in open-set 3D detection and trajectory prediction, confirming its potential in closing the safety gap of fully supervised systems.


title: The PhotoDissociation Region Toolbox: Software and Models for Astrophysical Analysis

abstract: The PhotoDissociation Region Toolbox provides comprehensive, easy-to-use, public software tools and models that enable an understanding of the interaction of the light of young, luminous, massive stars with the gas and dust in the Milky Way and in other galaxies. It consists of an open-source Python toolkit and photodissociation region models for analysis of infrared and millimeter/submillimeter line and continuum observations obtained by ground-based and sub-orbital telescopes, and astrophysics space missions. Photodissociation regions (PDRs) include all of the neutral gas in the ISM where far-ultraviolet photons dominate the chemistry and/or heating. In regions of massive star formation, PDRs are created at the boundaries between the H II regions and neutral molecular cloud, as photons with energies 6 eV $ < h \nu < $ 13.6 eV photodissociate molecules and photoionize metals. The gas is heated by photo-electrons from small grains and large molecules and cools mostly through far-infrared fine-structure lines like [O I] and [C II]. The models are created from state-of-the art PDR codes that includes molecular freeze-out; recent collision, chemical, and photo rates; new chemical pathways, such as for oxygen chemistry; and allow for both clumpy and uniform media. The models predict the emergent intensities of many spectral lines and FIR continuum. The tools find the best-fit models to the observations and provide insights into the physical conditions and chemical makeup of the gas and dust. The PDR Toolbox enables novel analysis of data from telescopes such as ISO, Spitzer, Herschel, STO, SOFIA, SWAS, APEX, ALMA, and JWST.


title: On the simultanenous identification of the nonlinearity coefficient and the sound speed in the Westervelt equation

abstract: This paper considers the Westervelt equation, one of the most widely used models in nonlinear acoustics, and seeks to recover two spatially-dependent parameters of physical importance from time-trace boundary measurements. Specifically, these are the nonlinearity parameter $\kappa(x)$ often referred to as $B/A$ in the acoustics literature and the wave speed $c_0(x)$. The determination of the spatial change in these quantities can be used as a means of imaging. We consider identifiability from one or two boundary measurements as relevant in these applications. For a reformulation of the problem in terms of the squared slowness $\mathfrak{s}=1/c_0^2$ and the combined coefficient $\eta=\frac{B/A+2}{\varrho_0 c_0^4}$ we devise a frozen Newton method and prove its convergence. The effectiveness (and limitations) of this iterative scheme are demonstrated by numerical examples.


title: LESS: Label-Efficient Semantic Segmentation for LiDAR Point Clouds

abstract: Semantic segmentation of LiDAR point clouds is an important task in autonomous driving. However, training deep models via conventional supervised methods requires large datasets which are costly to label. It is critical to have label-efficient segmentation approaches to scale up the model to new operational domains or to improve performance on rare cases. While most prior works focus on indoor scenes, we are one of the first to propose a label-efficient semantic segmentation pipeline for outdoor scenes with LiDAR point clouds. Our method co-designs an efficient labeling process with semi/weakly supervised learning and is applicable to nearly any 3D semantic segmentation backbones. Specifically, we leverage geometry patterns in outdoor scenes to have a heuristic pre-segmentation to reduce the manual labeling and jointly design the learning targets with the labeling process. In the learning step, we leverage prototype learning to get more descriptive point embeddings and use multi-scan distillation to exploit richer semantics from temporally aggregated point clouds to boost the performance of single-scan models. Evaluated on the SemanticKITTI and the nuScenes datasets, we show that our proposed method outperforms existing label-efficient methods. With extremely limited human annotations (e.g., 0.1% point labels), our proposed method is even highly competitive compared to the fully supervised counterpart with 100% labels.


title: Just Round: Quantized Observation Spaces Enable Memory Efficient Learning of Dynamic Locomotion

abstract: Deep reinforcement learning (DRL) is one of the most powerful tools for synthesizing complex robotic behaviors. But training DRL models is incredibly compute and memory intensive, requiring large training datasets and replay buffers to achieve performant results. This poses a challenge for the next generation of field robots that will need to learn on the edge to adapt to their environment. In this paper, we begin to address this issue through observation space quantization. We evaluate our approach using four simulated robot locomotion tasks and two state-of-the-art DRL algorithms, the on-policy Proximal Policy Optimization (PPO) and off-policy Soft Actor-Critic (SAC) and find that observation space quantization reduces overall memory costs by as much as 4.2x without impacting learning performance.


title: Optimizing Vision Transformers for Medical Image Segmentation

abstract: For medical image semantic segmentation (MISS), Vision Transformers have emerged as strong alternatives to convolutional neural networks thanks to their inherent ability to capture long-range correlations. However, existing research uses off-the-shelf vision Transformer blocks based on linear projections and feature processing which lack spatial and local context to refine organ boundaries. Furthermore, Transformers do not generalize well on small medical imaging datasets and rely on large-scale pre-training due to limited inductive biases. To address these problems, we demonstrate the design of a compact and accurate Transformer network for MISS, CS-Unet, which introduces convolutions in a multi-stage design for hierarchically enhancing spatial and local modeling ability of Transformers. This is mainly achieved by our well-designed Convolutional Swin Transformer (CST) block which merges convolutions with Multi-Head Self-Attention and Feed-Forward Networks for providing inherent localized spatial context and inductive biases. Experiments demonstrate CS-Unet without pre-training outperforms other counterparts by large margins on multi-organ and cardiac datasets with fewer parameters and achieves state-of-the-art performance. Our code is available at Github.


title: Global city densities: re-examining urban scaling theory

abstract: Understanding scaling relations of social and environmental attributes of urban systems is necessary for effectively managing cities. Urban scaling theory (UST) has assumed that population density scales positively with city size. We present a new global analysis using a publicly available database of 933 cities from 38 countries. Our results showed that (18/38) 47% of countries analyzed supported increasing density scaling (pop ~ area) with exponents ~5/6 as UST predicts. In contrast, 17 of 38 countries (~45%) exhibited density scalings statistically indistinguishable from constant population densities across cities of varying sizes. These results were generally consistent in years spanning four decades from 1975 to 2015. Importantly, density varies by an order of magnitude between regions and countries and decreases in more developed economies. Our results (i) point to how economic and regional differences may affect the scaling of density with city size and (ii) show how understanding country- and region-specific strategies could inform effective management of urban systems for biodiversity, public health, conservation and resiliency from local to global scales.


title: Whole-body tumor segmentation of 18F -FDG PET/CT using a cascaded and ensembled convolutional neural networks

abstract: Background: A crucial initial processing step for quantitative PET/CT analysis is the segmentation of tumor lesions enabling accurate feature ex-traction, tumor characterization, oncologic staging, and image-based therapy response assessment. Manual lesion segmentation is however associated with enormous effort and cost and is thus infeasible in clinical routine. Goal: The goal of this study was to report the performance of a deep neural network designed to automatically segment regions suspected of cancer in whole-body 18F-FDG PET/CT images in the context of the AutoPET challenge. Method: A cascaded approach was developed where a stacked ensemble of 3D UNET CNN processed the PET/CT images at a fixed 6mm resolution. A refiner network composed of residual layers enhanced the 6mm segmentation mask to the original resolution. Results: 930 cases were used to train the model. 50% were histologically proven cancer patients and 50% were healthy controls. We obtained a dice=0.68 on 84 stratified test cases. Manual and automatic Metabolic Tumor Volume (MTV) were highly correlated (R2 = 0.969,Slope = 0.947). Inference time was 89.7 seconds on average. Conclusion: The proposed algorithm accurately segmented regions suspicious for cancer in whole-body 18F -FDG PET/CT images.


title: Zonotope Domains for Lagrangian Neural Network Verification

abstract: Neural network verification aims to provide provable bounds for the output of a neural network for a given input range. Notable prior works in this domain have either generated bounds using abstract domains, which preserve some dependency between intermediate neurons in the network; or framed verification as an optimization problem and solved a relaxation using Lagrangian methods. A key drawback of the latter technique is that each neuron is treated independently, thereby ignoring important neuron interactions. We provide an approach that merges these two threads and uses zonotopes within a Lagrangian decomposition. Crucially, we can decompose the problem of verifying a deep neural network into the verification of many 2-layer neural networks. While each of these problems is provably hard, we provide efficient relaxation methods that are amenable to efficient dual ascent procedures. Our technique yields bounds that improve upon both linear programming and Lagrangian-based verification techniques in both time and bound tightness.


title: Paraconsistent models of Zermelo-Fraenkel set theory

abstract: In this paper, we build Fidel-structures valued models following the methodology developed for Heyting-valued models; recall that Fidel structures are not algebras in the universal algebra sense. Taking models that verify Leibniz law, we are able to prove that all set-theoretic axioms of ZF are valid over these models. The proof is strongly based on the existence of paraconsistent models of Leibniz law. In this setting, the difficulty of having algebraic paraconsistent models of law for formulas with negation using the standard interpretation map is discussed, showing that the existence of models of Leibniz law is essential to getting models for ZF.


title: Localized Nitrogen-Vacancy centers generated by low-repetition rate fs-laser pulses

abstract: Among hundreds of impurities and defects in diamond, the nitrogen-vacancy (NV) center is one of the most interesting to be used as a platform for quantum technologies and nanosensing. Traditionally, synthetic diamond is irradiated with high-energy electrons or nitrogen ions to generate these color-centers. For precise positioning of the NV centers, fs-laser irradiation has been proposed as an alternative approach to produce spatially localized NV centers in diamond. However, most of the studies reported so far used high-repetition rate fs-laser systems. Here, we studied the influence of the irradiation conditions on the generation of NV$^-$. Specifically, we varied pulse fluence, laser focusing, and the number of pulses upon irradiation with 150 fs pulses at 775 nm from a Ti:sapphire laser amplifier operating at 1 kHz repetition rate. Optically Detected Magnetic Resonance (ODMR) was used to investigate the produced NV centers, revealing a sizeable zero-field splitting in the spectra and indicating the conditions in which the lattice strain produced in the ablation process may be deleterious for quantum information applications.


title: Modeling the Saturation of the Bell Instability using Hybrid Simulations

abstract: The nonresonant streaming instability (Bell instability) plays a pivotal role in the acceleration and confinement of cosmic rays (CRs); yet, the exact mechanism responsible for its saturation and the magnitude of the final amplified magnetic field have not been assessed from first-principles. Using a survey of hybrid simulations (with kinetic ions and fluid electrons), we study the evolution of the Bell instability as a function of the parameters of the CR population. We find that, at saturation, the magnetic pressure in the amplified field is comparable with the initial CR anisotropic pressure, rather than with the CR energy flux as previously argued. These results provide a predictive prescription for the total magnetic field amplification expected in the many astrophysical environments where the Bell instability is important.


title: Eliciting Compatible Demonstrations for Multi-Human Imitation Learning

abstract: Imitation learning from human-provided demonstrations is a strong approach for learning policies for robot manipulation. While the ideal dataset for imitation learning is homogenous and low-variance -- reflecting a single, optimal method for performing a task -- natural human behavior has a great deal of heterogeneity, with several optimal ways to demonstrate a task. This multimodality is inconsequential to human users, with task variations manifesting as subconscious choices; for example, reaching down, then across to grasp an object, versus reaching across, then down. Yet, this mismatch presents a problem for interactive imitation learning, where sequences of users improve on a policy by iteratively collecting new, possibly conflicting demonstrations. To combat this problem of demonstrator incompatibility, this work designs an approach for 1) measuring the compatibility of a new demonstration given a base policy, and 2) actively eliciting more compatible demonstrations from new users. Across two simulation tasks requiring long-horizon, dexterous manipulation and a real-world "food plating" task with a Franka Emika Panda arm, we show that we can both identify incompatible demonstrations via post-hoc filtering, and apply our compatibility measure to actively elicit compatible demonstrations from new users, leading to improved task success rates across simulated and real environments.