title: Empirical Time Complexity of Generic Dijkstra Algorithm

abstract: Generic Dijkstra is a novel algorithm for finding the optimal shortest path in both wavelength-division multiplexed networks (WDM) and elastic optical networks (EON), claimed to outperform known algorithms considerably. Because of its novelty, it has not been independently implemented and verified. Its time complexity also remains unknown. In this paper, we perform run-time analysis and show that Generic Dijkstra running time grows quadratically with the number of graph vertices and logarithmically with the number of edge units. We also discover that the running time of the Generic Dijkstra algorithm in the function of network utilization is not monotonic, as peak running time is at approximately 0.25 network utilization. Additionally, we provide an independent open source implementation of Generic Dijkstra in the Python language. We confirm the correctness of the algorithm and its superior performance. In comparison to the Filtered Graphs algorithm, Generic Dijkstra is approximately 2.3 times faster in networks with 25 to 500 nodes, and in 90% of calls its computation takes less time.


title: Strong band-filling-dependence of the scattering lifetime in gated MoS2 nanolayers induced by the opening of intervalley scattering channels

abstract: Gated molybdenum disulphide (MoS2) exhibits a rich phase diagram upon increasing electron doping, including a superconducting phase, a polaronic reconstruction of the bandstructure, and structural transitions away from the 2H polytype. The average time between two charge-carrier scattering events - the scattering lifetime - is a key parameter to describe charge transport and obtain physical insight in the behavior of such a complex system. In this work, we combine the solution of the Boltzmann transport equation (based on ab-initio density functional theory calculations of the electronic bandstructure) with the experimental results concerning the charge-carrier mobility, in order to determine the scattering lifetime in gated MoS2 nanolayers as a function of electron doping and temperature. From these dependencies, we assess the major sources of charge-carrier scattering upon increasing band filling, and discover two narrow ranges of electron doping where the scattering lifetime is strongly suppressed. We indentify the opening of additional intervalley scattering channels connecting the simultaneously-filled K/K' and Q/Q' valleys in the Brillouin zone as the source of these reductions, which are triggered by the two Lifshitz transitions induced by the filling of the high-energy Q/Q' valleys upon increasing electron doping.


title: The second homology group of the commutative case of Kontsevich's symplectic derivation Lie algebra

abstract: The symplectic derivation Lie algebras defined by Kontsevich are related to various geometric objects including moduli spaces of graphs and of Riemann surfaces, graph homologies, Hamiltonian vector fields, etc. Each of them and its Chevalley-Eilenberg chain complex have a $\mathbb{Z}_{\geq 0}$-grading called weight. We consider one of them $\mathfrak{c}_g$, called the "commutative case", and its positive weight part $\mathfrak{c}_g^{+} \subset \mathfrak{c}_g$. The symplectic invariant homology of $\mathfrak{c}_g^{+}$ is closely related to the commutative graph homology, hence there are some computational results from the viewpoint of graph homology theory. However, the entire homology group $H_\bullet (\mathfrak{c}_g^{+})$ is not known well. We determined $H_2 (\mathfrak{c}_g^{+})$ by using classical representation theory of $\mathrm{Sp}(2g; \mathbb{Q})$ and the decomposition by weight.


title: Calabi-Yau metrics with cone singularities along intersecting complex lines: the unstable case

abstract: We produce local Calabi-Yau metrics on $\mathbf C^2$ with conical singularities along three or more complex lines through the origin whose cone angles strictly violate the Troyanov condition. The tangent cone at the origin is a flat polyhedral K\"ahler cone with conical singularities along two intersecting lines: one with cone angle corresponding to the line with smallest cone angle, while the other forms as the collision of the remaining lines into a single conical line. Using a branched covering argument, we can construct Calabi-Yau metrics with cone singularities along cuspidal curves with cone angle in the unstable range.


title: Long-term variations of quasi-trapped and trapped electrons in the inner radiation belt observed by DEMETER and SAMPEX

abstract: Electrons in the Earth's radiation belts can be categorized into three populations: precipitating, quasi-trapped and trapped. We use data from the DEMETER and SAMPEX missions and from ground-based neutron monitors (NM) and sunspot observations to investigate the long-term variation of quasi-trapped and trapped sub-MeV electrons on different L shells in the inner belt. DEMETER and SAMPEX measurements span over 17 years and show that at $L \leq 1.14$ the electron flux is anti-correlated with sunspot number, but proportional to the cosmic ray intensity represented by NM count rates, which suggests that electrons at the inner edge of the inner belt are produced by Cosmic Ray Albedo Neutron Decay (CRAND). The solar cycle variation of cosmic rays increased the electron flux at $L \leq 1.14$ by a factor of two from solar maximum at 2001 to solar minimum at 2009. At $L \ge 1.2$, both quasi-trapped and trapped electrons are enhanced during geomagnetic storms and decay to a background level during extended quiet times. At $L>2$, quasi-trapped electrons resemble trapped electrons, with correlation coefficients as high as 0.97, indicating that pitch angle scattering is the dominant process in this region.


title: Treewidth versus clique number. I. Graph classes with a forbidden structure

abstract: Treewidth is an important graph invariant, relevant for both structural and algorithmic reasons. A necessary condition for a graph class to have bounded treewidth is the absence of large cliques. We study graph classes closed under taking induced subgraphs in which this condition is also sufficient, which we call $(tw,\omega)$-bounded. Such graph classes are known to have useful algorithmic applications related to variants of the clique and $k$-coloring problems. We consider six well-known graph containment relations: the minor, topological minor, subgraph, induced minor, induced topological minor, and induced subgraph relations. For each of them, we give a complete characterization of the graphs $H$ for which the class of graphs excluding $H$ is $(tw,\omega)$-bounded. Our results yield an infinite family of $\chi$-bounded induced-minor-closed graph classes and imply that the class of $1$-perfectly orientable graphs is $(tw,\omega)$-bounded, leading to linear-time algorithms for $k$-coloring $1$-perfectly orientable graphs for every fixed~$k$. This answers a question of Bre\v sar, Hartinger, Kos, and Milani{\v c} from 2018 and one of Beisegel, Chudnovsky, Gurvich, Milani{\v c}, and Servatius from 2019, respectively. We also reveal some further algorithmic implications of $(tw,\omega)$-boundedness related to list $k$-coloring and clique problems. In addition, we propose a question about the complexity of the maximum weight independent set problem in $(tw,\omega)$-bounded graph classes and prove that the problem is polynomial-time solvable in every class of graphs excluding a fixed star as an induced minor.


title: Variance reduction for Random Coordinate Descent-Langevin Monte Carlo

abstract: Sampling from a log-concave distribution function is one core problem that has wide applications in Bayesian statistics and machine learning. While most gradient free methods have slow convergence rate, the Langevin Monte Carlo (LMC) that provides fast convergence requires the computation of gradients. In practice one uses finite-differencing approximations as surrogates, and the method is expensive in high-dimensions. A natural strategy to reduce computational cost in each iteration is to utilize random gradient approximations, such as random coordinate descent (RCD) or simultaneous perturbation stochastic approximation (SPSA). We show by a counter-example that blindly applying RCD does not achieve the goal in the most general setting. The high variance induced by the randomness means a larger number of iterations are needed, and this balances out the saving in each iteration. We then introduce a new variance reduction approach, termed Randomized Coordinates Averaging Descent (RCAD), and incorporate it with both overdamped and underdamped LMC. The methods are termed RCAD-O-LMC and RCAD-U-LMC respectively. The methods still sit in the random gradient approximation framework, and thus the computational cost in each iteration is low. However, by employing RCAD, the variance is reduced, so the methods converge within the same number of iterations as the classical overdamped and underdamped LMC. This leads to a computational saving overall.


title: Robust Spammer Detection by Nash Reinforcement Learning

abstract: Online reviews provide product evaluations for customers to make decisions. Unfortunately, the evaluations can be manipulated using fake reviews ("spams") by professional spammers, who have learned increasingly insidious and powerful spamming strategies by adapting to the deployed detectors. Spamming strategies are hard to capture, as they can be varying quickly along time, different across spammers and target products, and more critically, remained unknown in most cases. Furthermore, most existing detectors focus on detection accuracy, which is not well-aligned with the goal of maintaining the trustworthiness of product evaluations. To address the challenges, we formulate a minimax game where the spammers and spam detectors compete with each other on their practical goals that are not solely based on detection accuracy. Nash equilibria of the game lead to stable detectors that are agnostic to any mixed detection strategies. However, the game has no closed-form solution and is not differentiable to admit the typical gradient-based algorithms. We turn the game into two dependent Markov Decision Processes (MDPs) to allow efficient stochastic optimization based on multi-armed bandit and policy gradient. We experiment on three large review datasets using various state-of-the-art spamming and detection strategies and show that the optimization algorithm can reliably find an equilibrial detector that can robustly and effectively prevent spammers with any mixed spamming strategies from attaining their practical goal. Our code is available at https://github.com/YingtongDou/Nash-Detect.


title: Optimizing Smart Grid Aggregators and Measuring Degree of Privacy in a Distributed Trust Based Anonymous Aggregation System

abstract: A smart grid is an advanced method for supplying electricity to the consumers alleviating the limitations of the existing system. It causes frequent meter reading transmission from the end-user to the supplier. This frequent data transmission poses privacy risks. Several works have been proposed to solve this problem but cannot ensure privacy at the optimal level. This work is based on a distributed trust-based data aggregation system leveraging a secret sharing mechanism. In this work, we show that {\em three aggregators} are enough for ensuring consumer's privacy in a distributed trust-based system. We leverage the idea of anonymity in our research and show that neither an active attacker nor a passive attacker can breach consumer's privacy. We show proof of our concept mathematically and in a cryptographic game based mechanism. We name our new proposed system \emph{"Distributed Trust Based Anonymous System (DTBAS)"}.


title: Affective Movement Generation using Laban Effort and Shape and Hidden Markov Models

abstract: Body movements are an important communication medium through which affective states can be discerned. Movements that convey affect can also give machines life-like attributes and help to create a more engaging human-machine interaction. This paper presents an approach for automatic affective movement generation that makes use of two movement abstractions: 1) Laban movement analysis (LMA), and 2) hidden Markov modeling. The LMA provides a systematic tool for an abstract representation of the kinematic and expressive characteristics of movements. Given a desired motion path on which a target emotion is to be overlaid, the proposed approach searches a labeled dataset in the LMA Effort and Shape space for similar movements to the desired motion path that convey the target emotion. An HMM abstraction of the identified movements is obtained and used with the desired motion path to generate a novel movement that is a modulated version of the desired motion path that conveys the target emotion. The extent of modulation can be varied, trading-off between kinematic and affective constraints in the generated movement. The proposed approach is tested using a full-body movement dataset. The efficacy of the proposed approach in generating movements with recognizable target emotions is assessed using a validated automatic recognition model and a user study. The target emotions were correctly recognized from the generated movements at a rate of 72% using the recognition model. Furthermore, participants in the user study were able to correctly perceive the target emotions from a sample of generated movements, although some cases of confusion were also observed.


title: Fully Unsupervised Diversity Denoising with Convolutional Variational Autoencoders

abstract: Deep Learning based methods have emerged as the indisputable leaders for virtually all image restoration tasks. Especially in the domain of microscopy images, various content-aware image restoration (CARE) approaches are now used to improve the interpretability of acquired data. Naturally, there are limitations to what can be restored in corrupted images, and like for all inverse problems, many potential solutions exist, and one of them must be chosen. Here, we propose DivNoising, a denoising approach based on fully convolutional variational autoencoders (VAEs), overcoming the problem of having to choose a single solution by predicting a whole distribution of denoised images. First we introduce a principled way of formulating the unsupervised denoising problem within the VAE framework by explicitly incorporating imaging noise models into the decoder. Our approach is fully unsupervised, only requiring noisy images and a suitable description of the imaging noise distribution. We show that such a noise model can either be measured, bootstrapped from noisy data, or co-learned during training. If desired, consensus predictions can be inferred from a set of DivNoising predictions, leading to competitive results with other unsupervised methods and, on occasion, even with the supervised state-of-the-art. DivNoising samples from the posterior enable a plethora of useful applications. We are (i) showing denoising results for 13 datasets, (ii) discussing how optical character recognition (OCR) applications can benefit from diverse predictions, and are (iii) demonstrating how instance cell segmentation improves when using diverse DivNoising predictions.


title: Origin of the Curie-von Schweidler law and the fractional capacitor from time-varying capacitance

abstract: Most dielectrics of practical purpose exhibit memory and are described by the century-old Curie-von Schweidler law. Interestingly, the Curie-von Schweidler law is the motivation behind an unconventional circuit component called fractional capacitor which due to its power-law property is extensively used in the modeling of complex dielectric media. Unfortunately, the empirical nature of the Curie-von Schweidler law plagues the applications of the fractional capacitor. Here, we derive the Curie-von Schweidler law from a series combination of a resistor and a capacitor with a linear time-varying capacitance. This may possibly be its first derivation from physical principles. However, this required a modification of the classical charge--voltage relation of a capacitor to account for the time-varying capacitance. The limitation of the classical charge-voltage relation and its subsequent modification are justified using appropriate circuit modeling. Consequently, the parameters of the Curie-von Schweidler law and the fractional capacitor gain physical interpretation. The Debye response of dielectrics emerges naturally from the limiting case of the power-law response at short timescales. The obtained results are validated by matching them with the published experimental reports.


title: Analyzing Power Grid, ICT, and Market Without Domain Knowledge Using Distributed Artificial Intelligence

abstract: Modern cyber-physical systems (CPS), such as our energy infrastructure, are becoming increasingly complex: An ever-higher share of Artificial Intelligence (AI)-based technologies use the Information and Communication Technology (ICT) facet of energy systems for operation optimization, cost efficiency, and to reach CO2 goals worldwide. At the same time, markets with increased flexibility and ever shorter trade horizons enable the multi-stakeholder situation that is emerging in this setting. These systems still form critical infrastructures that need to perform with highest reliability. However, today's CPS are becoming too complex to be analyzed in the traditional monolithic approach, where each domain, e.g., power grid and ICT as well as the energy market, are considered as separate entities while ignoring dependencies and side-effects. To achieve an overall analysis, we introduce the concept for an application of distributed artificial intelligence as a self-adaptive analysis tool that is able to analyze the dependencies between domains in CPS by attacking them. It eschews pre-configured domain knowledge, instead exploring the CPS domains for emergent risk situations and exploitable loopholes in codices, with a focus on rational market actors that exploit the system while still following the market rules.


title: Convergence of moments of twisted COE matrices

abstract: We investigate eigenvalue moments of matrices from Circular Orthogonal Ensemble multiplicatively perturbed by a permutation matrix. More precisely we investigate variance of the sum of the eigenvalues raised to power $k$, for arbitrary but fixed $k$ and in the limit of large matrix size. We find that when the permutation defining the perturbed ensemble has only long cycles, the answer is universal and approaches the corresponding moment of the Circular Unitary Ensemble with a particularly fast rate: the error is of order $1/N^3$ and the terms of orders $1/N$ and $1/N^2$ disappear due to cancellations. We prove this rate of convergence using Weingarten calculus and classifying the contributing Weingarten functions first in terms of a graph model and then algebraically.


title: Black to Negative: Embedded optionalities in commodities markets

abstract: We address the modelling of commodities that are supposed to have positive price but, on account of a possible failure in the physical delivery mechanism, may turn out not to. This is done by explicitly incorporating a `delivery liability' option into the contract. As such it is a simple generalisation of the established Black model.


title: S-semantics -- an example

abstract: The s-semantics makes it possible to explicitly deal with variables in program answers. So it seems suitable for programs using nonground data structures, like open lists. However it is difficult to find published examples of using the s-semantics to reason about particular programs. Here we apply s-semantics to prove correctness and completeness of Fr\"uhwirth's $n$ queens program. This is compared with a proof, published elsewhere, based on the standard semantics and Herbrand interpretations.


title: Risk Attitudes and Human Mobility during the COVID-19 Pandemic

abstract: Behavioral responses to pandemics are less shaped by actual mortality or hospitalization risks than they are by risk attitudes. We explore human mobility patterns as a measure of behavioral responses during the COVID-19 pandemic. Our results indicate that risk-taking attitude is a critical factor in predicting reduction in human mobility and increase social confinement around the globe. We find that the sharp decline in movement after the WHO (World Health Organization) declared COVID-19 to be a pandemic can be attributed to risk attitudes. Our results suggest that regions with risk-averse attitudes are more likely to adjust their behavioral activity in response to the declaration of a pandemic even before most official government lockdowns. Further understanding of the basis of responses to epidemics, e.g., precautionary behavior, will help improve the containment of the spread of the virus.


title: Fast Privacy-Preserving Punch Cards

abstract: Loyalty programs in the form of punch cards that can be redeemed for benefits have long been a ubiquitous element of the consumer landscape. However, their increasingly popular digital equivalents, while providing more convenience and better bookkeeping, pose a considerable privacy risk. This paper introduces a privacy-preserving punch card protocol that allows firms to digitize their loyalty programs without forcing customers to submit to corporate surveillance. We also present a number of extensions that allow our scheme to provide other privacy-preserving customer loyalty features. Compared to the best prior work, we achieve a $14\times$ reduction in the computation and a $11\times$ reduction in the communication required to perform a "hole punch," a $55\times$ reduction in the communication required to redeem a punch card, and a $128\times$ reduction in the computation time required to redeem a card. Much of our performance improvement can be attributed to removing the reliance on pairings or range proofs present in prior work, which has only addressed this problem in the context of more general loyalty systems. By tailoring our scheme to punch cards and related loyalty systems, we demonstrate that we can reduce communication and computation costs by orders of magnitude.


title: Least-Squares Affine Reflection Using Eigen Decomposition

abstract: This note summarizes the steps to computing the best-fitting affine reflection that aligns two sets of corresponding points.


title: Ergodic Specifications for Flexible Swarm Control: From User Commands to Persistent Adaptation

abstract: This paper presents a formulation for swarm control and high-level task planning that is dynamically responsive to user commands and adaptable to environmental changes. We design an end-to-end pipeline from a tactile tablet interface for user commands to onboard control of robotic agents based on decentralized ergodic coverage. Our approach demonstrates reliable and dynamic control of a swarm collective through the use of ergodic specifications for planning and executing agent trajectories as well as responding to user and external inputs. We validate our approach in a virtual reality simulation environment and in real-world experiments at the DARPA OFFSET Urban Swarm Challenge FX3 field tests with a robotic swarm where user-based control of the swarm and mission-based tasks require a dynamic and flexible response to changing conditions and objectives in real-time.


title: Towards Integrating Fairness Transparently in Industrial Applications

abstract: Numerous Machine Learning (ML) bias-related failures in recent years have led to scrutiny of how companies incorporate aspects of transparency and accountability in their ML lifecycles. Companies have a responsibility to monitor ML processes for bias and mitigate any bias detected, ensure business product integrity, preserve customer loyalty, and protect brand image. Challenges specific to industry ML projects can be broadly categorized into principled documentation, human oversight, and need for mechanisms that enable information reuse and improve cost efficiency. We highlight specific roadblocks and propose conceptual solutions on a per-category basis for ML practitioners and organizational subject matter experts. Our systematic approach tackles these challenges by integrating mechanized and human-in-the-loop components in bias detection, mitigation, and documentation of projects at various stages of the ML lifecycle. To motivate the implementation of our system -- SIFT (System to Integrate Fairness Transparently) -- we present its structural primitives with an example real-world use case on how it can be used to identify potential biases and determine appropriate mitigation strategies in a participatory manner.


title: Finite-size corrections for the static structure factor of a liquid slab with open boundaries

abstract: The presence of a confining boundary can modify the local structure of a liquid markedly. In addition, small samples of finite size are known to exhibit systematic deviations of thermodynamic quantities relative to their bulk values. Here, we consider the static structure factor of a liquid sample in slab geometry with open boundaries at the surfaces, which can be thought of as virtually cutting out the sample from a macroscopically large, homogeneous fluid. This situation is a relevant limit for the interpretation of grazing-incidence diffraction experiments at liquid interfaces and films. We derive an exact, closed expression for the slab structure factor, with the bulk structure factor as the only input. This shows that such free boundary conditions cause significant differences between the two structure factors, in particular at small wavenumbers. An asymptotic analysis of this result yields the scaling exponent and an accurate, useful approximation of these finite-size corrections. Furthermore, the open boundaries permit the interpretation of the slab as an open system, supporting particle exchange with a reservoir. We relate the slab structure factor to the particle number fluctuations and discuss conditions under which the subvolume of the slab represents a grand canonical ensemble with chemical potential $\mu$ and temperature $T$. Thus, the open slab serves as a test-bed for the small-system thermodynamics in a $\mu T$ reservoir. We provide a microscopically justified and exact result for the size dependence of the isothermal compressibility. Our findings are corroborated by simulation data for Lennard-Jones liquids at two representative temperatures.


title: Hydrodynamic Properties of the Sun's Giant Cellular Flows

abstract: Measurements of the large cellular flows on the Sun were made by local correlation tracking of supergranules seen in full-disk Doppler images obtained by the HMI instrument on the NASA SDO satellite. The hourly measurements were averaged over 34 days to produce daily maps of the latitudinal and longitudinal velocities. While flows at all latitudes are largely in the form of vortices with left-handed helicity in the north and right-handed helicity in the south, there are key distinctions between the low latitude and high latitudes cells. The low latitude cells have roughly circular shapes, lifetimes of about one month, rotate nearly rigidly, do not drift in latitude, and do not exhibit any correlation between longitudinal and latitudinal flow. The high latitude cells have long extensions that spiral inward toward the poles. They have lifetimes of several months, rotate differentially with latitude, drift poleward at speeds approaching 2 m s$^{-1}$, and have a strong correlation between prograde and equatorward flows. Spherical harmonic spectral analyses confirm that the flows are dominated by the curl component with RMS velocities of about 12 m s$^{-1}$ at wavenumber $\ell$ = 10. Fourier transforms in time indicate two notable components - an $m = \pm\ell$ feature representing the low latitude component and an $m = \pm1$ feature representing the high latitude component. The dispersion relation for the low latitude component is well represented by that derived for Rossby waves. The high latitude component has a constant temporal frequency for all $\ell$ indicating features advected by differential rotation at rates representative of the base of the convection zone high latitudes. The poleward motions of these features further suggest that the high latitude meridional flow at the base of the convection zone is poleward - not equatorward.


title: Long short-term memory networks for proton dose calculation in highly heterogeneous tissues

abstract: A novel dose calculation approach was designed based on the application of LSTM network that processes the 3D patient/phantom geometry as a sequence of 2D computed tomography input slices yielding a corresponding sequence of 2D slices that forms the respective 3D dose distribution. LSTM networks can propagate information effectively in one direction, resulting in a model that can properly imitate the mechanisms of proton interaction in matter. The study is centered on predicting dose on a single pencil beam level, avoiding the averaging effects in treatment plans comprised of thousands pencil beams. Moreover, such approach allows straightforward integration into today's treatment planning systems' inverse planning optimization process. The ground truth training data was prepared with Monte Carlo simulations for both phantom and patient studies by simulating different pencil beams impinging from random gantry angles through the patient geometry. For model training, 10'000 Monte Carlo simulations were prepared for the phantom study, and 4'000 simulations were prepared for the patient study. The trained LSTM model was able to achieve a 99.29 % gamma-index pass rate ([0.5 %, 1 mm]) accuracy on the set-aside test set for the phantom study, and a 99.33 % gamma-index pass rate ([0.5 %, 2 mm]) for the set-aside test set for the patient study. These results were achieved for each pencil beam in 6-23 ms. The average Monte Carlo simulation run-time using Topas was 1160 s. The generalization of the model was verified by testing for 5 previously unseen lung cancer patients. LSTM networks are well suited for proton therapy dose calculation tasks. However, further work needs to be performed to generalize the proposed approach to clinical applications, primarily to be implemented for various energies, patient sites, and CT resolutions/scanners.


title: Photonic bound states in the continuum in Si structures with the self-assembled Ge nanoislands

abstract: Germanium self-assembled nanoislands and quantum dots are very prospective for CMOS-compatible optoelectronic integrated circuits but their luminescence intensity is still insufficient for many practical applications. Here, we demonstrate experimentally that photoluminescence of Ge nanoislands in silicon photonic crystal slab with hexagonal lattice can be dramatically enhanced due to the involvement in the emission process of the bounds states in the continuum. We experimentally demonstrate more than two orders of magnitude peak photoluminescence enhancement and more than one order of magnitude integrated PL enhancement in a photonic crystal slab compared with the non-structured sample area. We theoretically study this effect by the Fourier modal method in the scattering matrix form and demonstrate the appearance of quasi-normal guided modes in our photonic crystal slab. We also describe their symmetry in terms of group theory. Our work paves the way towards a new class of optoelectronic components compatible with silicon technology.


title: Singularly Perturbed Boundary-Focus Bifurcations

abstract: We consider smooth systems limiting as $\epsilon \to 0$ to piecewise-smooth (PWS) systems with a boundary-focus (BF) bifurcation. After deriving a suitable local normal form, we study the dynamics for the smooth system with $0 < \epsilon \ll 1$ using a combination of geometric singular perturbation theory and blow-up. We show that the type of BF bifurcation in the PWS system determines the bifurcation structure for the smooth system within an $\epsilon-$dependent domain which shrinks to zero as $\epsilon \to 0$, identifying a supercritical Andronov-Hopf bifurcation in one case, and a supercritical Bogdanov-Takens bifurcation in two other cases. We also show that PWS cycles associated with BF bifurcations persist as relaxation cycles in the smooth system, and prove existence of a family of stable limit cycles which connects the relaxation cycles to regular cycles within the $\epsilon-$dependent domain described above. Our results are applied to models for Gause predator-prey interaction and mechanical oscillation subject to friction.


title: Data-driven Thermal Model Inference with ARMAX, in Smart Environments, based on Normalized Mutual Information

abstract: Understanding the models that characterize the thermal dynamics in a smart building is important for the comfort of its occupants and for its energy optimization. A significant amount of research has attempted to utilize thermodynamics (physical) models for smart building control, but these approaches remain challenging due to the stochastic nature of the intermittent environmental disturbances. This paper presents a novel data-driven approach for indoor thermal model inference, which combines an Autoregressive Moving Average with eXogenous inputs model (ARMAX) with a Normalized Mutual Information scheme (NMI). Based on this information-theoretic method, NMI, causal dependencies between the indoor temperature and exogenous inputs are explicitly obtained as a guideline for the ARMAX model to find the dominating inputs. For validation, we use three datasets based on building energy systems-against which we compare our method to an autoregressive model with exogenous inputs (ARX), a regularized ARMAX model, and state-space models.


title: Classification of finite Morse index solutions of higher-order Gelfand-Liouville equation

abstract: We classify finite Morse index solutions of the following Gelfand-Liouville equation \begin{equation*} (-\Delta)^{s} u= e^u \ \ \text{in} \ \ \mathbb{R}^n, \end{equation*} for $1<s<2$ and $s=2$ via a novel monotonicity formula and technical blow-down analysis. We show that the above equation does not admit any finite Morse index solution with $(-\Delta)^{s/2} u$ vanishes at infinity provided $n>2s$ and \begin{equation*} \label{1.condition} \frac{ \Gamma(\frac{n+2s}{4})^2 }{ \Gamma(\frac{n-2s}{4})^2} < \frac{\Gamma(\frac{n}{2}) \Gamma(1+s)}{ \Gamma(\frac{n-2s}{2})}, \end{equation*} where $\Gamma$ is the classical Gamma function. The cases of $s=1$ and $s=2$ are settled by Dancer and Farina \cite{df,d} and Dupaigne et al. \cite{dggw}, respectively, using Moser iteration arguments established by Crandall and Rabinowitz \cite{CR}. The case of $0<s<1$ is established by Hyder-Yang in \cite{hy} applying arguments provided in \cite{ddw,fw}.


title: Robustified Multivariate Regression and Classification Using Distributionally Robust Optimization under the Wasserstein Metric

abstract: We develop Distributionally Robust Optimization (DRO) formulations for Multivariate Linear Regression (MLR) and Multiclass Logistic Regression (MLG) when both the covariates and responses/labels may be contaminated by outliers. The DRO framework uses a probabilistic ambiguity set defined as a ball of distributions that are close to the empirical distribution of the training set in the sense of the Wasserstein metric. We relax the DRO formulation into a regularized learning problem whose regularizer is a norm of the coefficient matrix. We establish out-of-sample performance guarantees for the solutions to our model, offering insights on the role of the regularizer in controlling the prediction error. Experimental results show that our approach improves the predictive error by 7% -- 37% for MLR, and a metric of robustness by 100% for MLG.


title: Autonomous Driving with Deep Learning: A Survey of State-of-Art Technologies

abstract: Since DARPA Grand Challenges (rural) in 2004/05 and Urban Challenges in 2007, autonomous driving has been the most active field of AI applications. Almost at the same time, deep learning has made breakthrough by several pioneers, three of them (also called fathers of deep learning), Hinton, Bengio and LeCun, won ACM Turin Award in 2019. This is a survey of autonomous driving technologies with deep learning methods. We investigate the major fields of self-driving systems, such as perception, mapping and localization, prediction, planning and control, simulation, V2X and safety etc. Due to the limited space, we focus the analysis on several key areas, i.e. 2D and 3D object detection in perception, depth estimation from cameras, multiple sensor fusion on the data, feature and task level respectively, behavior modelling and prediction of vehicle driving and pedestrian trajectories.


title: Loss-of-entanglement prediction of a controlled-PHASE gate in the framework of steepest-entropy-ascent quantum thermodynamics

abstract: As has been shown elsewhere, a reasonable model of the loss of entanglement or correlation that occurs in quantum computations is one which assumes that they can effectively be predicted by a framework that presupposes the presence of irreversibilities internal to the system. It is based on the steepest-entropy-ascent principle and is used here to reproduce the behavior of a controlled-PHASE gate in good agreement with experimental data. The results show that the loss of entanglement predicted is related to the irreversibilities in a nontrivial way, providing a possible alternative approach that warrants exploration to that conventionally used to predict the loss of entanglement. The results provide a means for understanding this loss in quantum protocols from a nonequilibrium thermodynamic standpoint. This framework permits the development of strategies for extending either the maximum fidelity of the computation or the entanglement time.

categories: quant-ph cs.ET physics.atom-ph physics.comp-ph


title: The Effects of Driver Coupling and Automation Impedance on Emergency Steering Interventions

abstract: Automatic emergency steering maneuvers can be used to avoid more obstacles than emergency braking alone. While a steer-by-wire system can decouple the driver who might act as a disturbance during the emergency steering maneuver, the alternative in which the steering wheel remains coupled can enable the driver to cover for automation faults and conform to regulations that require the driver to retain control authority. In this paper we present results from a driving simulator study with 48 participants in which we tested the performance of three emergency steering intervention schemes. In the first scheme, the driver was decoupled and the automation system had full control over the vehicle. In the second and third schemes, the driver was coupled and the automation system was either given a high impedance or a low impedance. Two types of unexpected automation faults were also simulated. Results showed that a high impedance automation system results in significantly fewer collisions during intended steering interventions but significantly higher collisions during automation faults when compared to a low impedance automation system. Moreover, decoupling the driver did not seem to significantly influence the time required to hand back control to the driver. When coupled, drivers were able to cover for a faulty automation system and avoid obstacles to a certain degree, though differences by condition were significant for only one type of automation fault.


title: Robust Grouped Variable Selection Using Distributionally Robust Optimization

abstract: We propose a Distributionally Robust Optimization (DRO) formulation with a Wasserstein-based uncertainty set for selecting grouped variables under perturbations on the data for both linear regression and classification problems. The resulting model offers robustness explanations for Grouped Least Absolute Shrinkage and Selection Operator (GLASSO) algorithms and highlights the connection between robustness and regularization. We prove probabilistic bounds on the out-of-sample loss and the estimation bias, and establish the grouping effect of our estimator, showing that coefficients in the same group converge to the same value as the sample correlation between covariates approaches 1. Based on this result, we propose to use the spectral clustering algorithm with the Gaussian similarity function to perform grouping on the predictors, which makes our approach applicable without knowing the grouping structure a priori. We compare our approach to an array of alternatives and provide extensive numerical results on both synthetic data and a real large dataset of surgery-related medical records, showing that our formulation produces an interpretable and parsimonious model that encourages sparsity at a group level and is able to achieve better prediction and estimation performance in the presence of outliers.


title: Detection and Locating Cyber and Physical Stresses in Smart Grids using Graph Signal Processing

abstract: Smart grids are large and complex cyber physical infrastructures that require real-time monitoring for ensuring the security and reliability of the system. Monitoring the smart grid involves analyzing continuous data-stream from various measurement devices deployed throughout the system, which are topologically distributed and structurally interrelated. In this paper, graph signal processing (GSP) has been used to represent and analyze the power grid measurement data. It is shown that GSP can enable various analyses for the power grid's structured data and dynamics of its interconnected components. Particularly, the effects of various cyber and physical stresses in the power grid are evaluated and discussed both in the vertex and the graph-frequency domains of the signals. Several techniques for detecting and locating cyber and physical stresses based on GSP techniques have been presented and their performances have been evaluated and compared. The presented study shows that GSP can be a promising approach for analyzing the power grid's data.


title: Existence of minimizers for the SDRI model in 2d: wetting and dewetting regime with mismatch strain

abstract: The model introduced in [Kholmatov-Piovano 2020] in the framework of the theory on Stress-Driven Rearrangement Instabilities (SDRI) [Asaro-Tiller 1972; Grinfeld 1993} for the morphology of crystalline materials under stress is considered. As in [Kholmatov-Piovano 2020] and in agreement with the models in [Lowengrub et al. 2009; Spencer 1999], a mismatch strain, rather than a Dirichlet condition as in [Crismale-Friedrich 2020], is considered to include into the analysis the lattice mismatch between the crystal and possible adjacent (supporting) materials. The existence of solutions is established in dimension two in the absence of graph-like assumptions and of the restriction to a finite number $m$ of connected components for the free boundary of the region occupied by the crystalline material, thus extending previous results for epitaxially strained thin films and material cavities. Due to the lack of compactness and lower semicontinuity for the sequences of $m$-minimizers, i.e., minimizers among configurations with at most $m$ connected boundary components, a minimizing candidate is directly constructed, and then shown to be a minimizer by means of uniform density estimates and the convergence of $m$-minimizers' energies to the energy infimum as $m\to\infty$. Finally, regularity properties for the morphology satisfied by every minimizer are established.


title: Proposed Model of the Giant Thermal Hall Effect in Two-Dimensional Superconductors: An Extension to the Superconducting Fluctuations Regime

abstract: We extend the thermodynamic approach for the description of the thermal Hall effect in the vicinity of a superconducting phase transition, in the fluctuation dominated regime. We show that the Hall heat conductivity is proportional to the product of temperature derivatives of the chemical potential and of the magnetization of the system. We argue that the latter derivative shows the strong singularity in the vicinity of the phase transition, while the former does not contain the characteristic for fermionic systems smallness (T /EF ), what additionally increases the effect. We derive the analytical formula predicting the temperature dependence of the thermal Hall conductivity in the vicinity of the critical temperature for different magnetic fields. Moreover, we study the phenomenon in the regime of quantum fluctuations, in the vicinity of the second critical field and at very low temperatures. We demonstrate how it fades away in a full agreement with the third law of thermodynamics. The developed approach qualitatively explains the recently observed giant thermal Hall effect in cuprates [1].


title: Dynamical mean-field theory for stochastic gradient descent in Gaussian mixture classification

abstract: We analyze in a closed form the learning dynamics of stochastic gradient descent (SGD) for a single-layer neural network classifying a high-dimensional Gaussian mixture where each cluster is assigned one of two labels. This problem provides a prototype of a non-convex loss landscape with interpolating regimes and a large generalization gap. We define a particular stochastic process for which SGD can be extended to a continuous-time limit that we call stochastic gradient flow. In the full-batch limit, we recover the standard gradient flow. We apply dynamical mean-field theory from statistical physics to track the dynamics of the algorithm in the high-dimensional limit via a self-consistent stochastic process. We explore the performance of the algorithm as a function of the control parameters shedding light on how it navigates the loss landscape.

categories: cs.LG cond-mat.dis-nn math.ST stat.ML stat.TH


title: Probabilities of first order sentences on sparse random relational structures: An application to definability on random CNF formulas

abstract: We extend the convergence law for sparse random graphs proven by Lynch to arbitrary relational languages. We consider a finite relational vocabulary $\sigma$ and a first order theory $T$ for $\sigma$ composed of symmetry and anti-reflexivity axioms. We define a binomial random model of finite $\sigma$-structures that satisfy $T$ and show that first order properties have well defined asymptotic probabilities when the expected number of tuples satisfying each relation in $\sigma$ is linear. It is also shown that these limit probabilities are well-behaved with respect to several parameters that represent the density of tuples in each relation $R$ in the vocabulary $\sigma$. An application of these results to the problem of random Boolean satisfiability is presented. We show that in a random $k$-CNF formula on $n$ variables, where each possible clause occurs with probability $\sim c/n^{k-1}$, independently any first order property of $k$-CNF formulas that implies unsatisfiability does almost surely not hold as $n$ tends to infinity.


title: Models for plasma kinetics during simultaneous therapeutic plasma exchange and extracorporeal membrane oxygenation

abstract: This paper focuses on the derivation and simulation of mathematical models describing new plasma fraction in blood for patients undergoing simultaneous extracorporeal membrane oxygenation and therapeutic plasma exchange. Models for plasma exchange with either veno-arterial or veno-venous extracorporeal membrane oxygenation are considered. Two classes of models are derived for each case, one in the form of an algebraic delay equation and another in the form of a system of delay differential equations. In special cases, our models reduce to single compartment ones for plasma exchange that have been validated with experimental data. We also show that the algebraic delay equations are forward Euler discretizations of the delay differential equations, with timesteps equal to transit times through model compartments. Numerical simulations are performed to compare different model types, to investigate the impact of plasma device port switching on the efficiency of the exchange process, and to study the sensitivity of the models to their parameters.


title: Geometrization of trigonometric solutions of the associative and classical Yang-Baxter equations

abstract: We describe a geometric construction of all nondegenerate trigonometric solutions of the associative and classical Yang-Baxter equations. In the associative case the solutions come from symmetric spherical orders over the irreducible nodal curve of arithmetic genus $1$, while in the Lie case they come from spherical sheaves of Lie algebras over the same curve.


abstract: Stochastic Gradient Algorithms (SGAs) are ubiquitous in computational statistics, machine learning and optimisation. Recent years have brought an influx of interest in SGAs, and the non-asymptotic analysis of their bias is by now well-developed. However, relatively little is known about the optimal choice of the random approximation (e.g mini-batching) of the gradient in SGAs as this relies on the analysis of the variance and is problem specific. While there have been numerous attempts to reduce the variance of SGAs, these typically exploit a particular structure of the sampled distribution by requiring a priori knowledge of its density's mode. It is thus unclear how to adapt such algorithms to non-log-concave settings. In this paper, we construct a Multi-index Antithetic Stochastic Gradient Algorithm (MASGA) whose implementation is independent of the structure of the target measure and which achieves performance on par with Monte Carlo estimators that have access to unbiased samples from the distribution of interest. In other words, MASGA is an optimal estimator from the mean square error-computational cost perspective within the class of Monte Carlo estimators. We prove this fact rigorously for log-concave settings and verify it numerically for some examples where the log-concavity assumption is not satisfied.

categories: stat.ML cs.LG math.PR math.ST stat.CO stat.TH


title: Electromagnetic Ion-Ion Instabilities in Space Plasmas: Effects of Suprathermal Populations

abstract: In collision-poor plasmas from space, three distinct ion-ion instabilities can be driven by the proton beams streaming along the background magnetic field: left-hand resonant, non-resonant, and right-hand resonant instabilities. These instabilities are in general investigated considering only idealized proton beams with Maxwellian velocity distributions, and ignoring the implications of suprathermal populations, usually reproduced by the Kappa power-laws. Moreover, the existing theories minimize the kinetic effects of electrons, assuming them isotropic and Maxwellian distributed. In an attempt to overcome these limitations, in the present paper we present the results of an extended investigation of ion-ion instabilities, which show that their dispersion and stability properties (e.g. growth rates, wave frequencies, and the unstable wave numbers) are highly sensitive to the influence of suprathermal populations and anisotropic electrons. These results offer valuable explanations for the origin of the enhanced low-frequency fluctuations, frequently observed in space plasmas and associated with proton beams.


title: The nuclear pore complex as an entropic gate: theory and simulation

abstract: Protein chains of the (FG)$_n$ ($n \simeq$ 300) type cap the cytoplasmatic side of the nucleopore complex, which connects the nucleus to the remainder of an eukaryotic cell. We study the properties of three fundamental polymer models that represent these filaments using Monte Carlo computer simulations. Random walks and the worm like chain model cannot account for the unusual size selectivity of the pore, while a two-dimensional arrangement of intrinsically disordered block copolymers with a high content of $\alpha$-helices is in agreement with the biochemical findings. We predict a linear increase of the free energy barrier of protein transport through the pore with increasing protein diameter, which can be probed experimentally using atomic force microscopy or optical tweezers.


title: PeopleMap: Visualization Tool for Mapping Out Researchers using Natural Language Processing

abstract: Discovering research expertise at institutions can be a difficult task. Manually curated university directories easily become out of date and they often lack the information necessary for understanding a researcher's interests and past work, making it harder to explore the diversity of research at an institution and identify research talents. This results in lost opportunities for both internal and external entities to discover new connections and nurture research collaboration. To solve this problem, we have developed PeopleMap, the first interactive, open-source, web-based tool that visually "maps out" researchers based on their research interests and publications by leveraging embeddings generated by natural language processing (NLP) techniques. PeopleMap provides a new engaging way for institutions to summarize their research talents and for people to discover new connections. The platform is developed with ease-of-use and sustainability in mind. Using only researchers' Google Scholar profiles as input, PeopleMap can be readily adopted by any institution using its publicly-accessible repository and detailed documentation.


title: Privacy-Cost Management in Smart Meters with Mutual Information-Based Reinforcement Learning

abstract: The rapid development and expansion of the Internet of Things (IoT) paradigm has drastically increased the collection and exchange of data between sensors and systems, a phenomenon that raises serious privacy concerns in some domains. In particular, Smart Meters (SMs) share fine-grained electricity consumption of households with utility providers that can potentially violate users' privacy as sensitive information is leaked through the data. In order to enhance privacy, the electricity consumers can exploit the availability of physical resources such as a rechargeable battery (RB) to shape their power demand as dictated by a Privacy-Cost Management Unit (PCMU). In this paper, we present a novel method to learn the PCMU policy using Deep Reinforcement Learning (DRL). We adopt the mutual information (MI) between the user's demand load and the masked load seen by the power grid as a reliable and general privacy measure. Unlike previous studies, we model the whole temporal correlation in the data to learn the MI in its general form and use a neural network to estimate the MI-based reward signal to guide the PCMU learning process. This approach is combined with a model-free DRL algorithm known as the Deep Double Q-Learning (DDQL) method. The performance of the complete DDQL-MI algorithm is assessed empirically using an actual SMs dataset and compared with simpler privacy measures. Our results show significant improvements over state-of-the-art privacy-aware demand shaping methods.


title: A note on the Tur\'an number of disjoint union of wheels

abstract: The Tur\'an number of a graph $H$, $\text{ex}(n,H)$, is the maximum number of edges in a graph on $n$ vertices which does not have $H$ as a subgraph. A wheel $W_n$ is an $n$-vertex graph formed by connecting a single vertex to all vertices of a cycle $C_{n-1}$. Let $mW_{2k+1}$ denote the $m$ vertex-disjoint copies of $W_{2k+1}$. For sufficiently large $n$, we determine the Tur\'an number and all extremal graphs for $mW_{2k+1}$. We also provide the Tur\'an number and all extremal graphs for $W^{h}:=\bigcup\limits^m_{i=1}W_{k_i}$ when $n$ is sufficiently large, where the number of even wheels is $h$ and $h>0$.


title: Non-LTE Calculations of the Mg I 12.32 $\mu$m Line in a Flaring Atmosphere

abstract: The infrared Mg I lines near 12 microns are a pair of emission lines which are magnetically sensitive and have been used to measure solar magnetic fields. Here we calculate the response of the Mg I 12.32 $\mu$m line during a flare and find that in our modeling this line has a complicated behavior. At the beginning of the flare heating, this line shows an intensity dimming at the line center. The intensity then increases when heating continues, with increasing contributions from the heated layers in the chromosphere. The line formation height and the line width also increase as a result. As for the polarized line profiles, we find that flare heating tends to decrease the Zeeman splitting width and attenuates the Stokes $V$ lobe intensity. The wider features in the Stokes $V$ profiles are more pronounced during flare heating, which should be considered when performing magnetic field inversions.


title: Uncertainty promotes neuroreductionism: A behavioral online study on folk psychological causal inference from neuroimaging data

abstract: Introduction. Increased efforts in neuroscience try to understand mental disorders as brain disorders. In the present study we investigate how common a neuroreductionist inclination is among highly educated people. In particular, we shed light on implicit presuppositions of mental disorders little is known about in the public, exemplified here by the case of Body Integrity Dysphoria (BID) that is considered a mental disorder for the first time in ICD-11. Methods. Identically graphed, simulated data of mind-brain correlations were shown in three contexts with presumably different presumptions about causality. 738 highly-educated laymen rated plausibility of causality attribution from brain to mind and from mind to brain for correlations between brain structural properties and mental phenomena. We contrasted participants' plausibility ratings of causality in the contexts of commonly perceived brain-lesion induced behavior (aphasia), behavior-induced training effects (piano playing), and a newly described mental disorder (BID). Results. The findings reveal the expected context-dependent modulation of causality attributions in the contexts of aphasia and piano playing. Furthermore, we observed a significant tendency to more readily attribute causal inference from brain to mind than vice versa with respect to BID. Conclusion. In some contexts, exemplified here by aphasia and piano playing, unidirectional causality attributions may be justified. However, with respect to BID, we critically discuss presumably unjustified neuroreductionist inclinations under causal uncertainty. Finally, we emphasize the need for a presupposition-free approach in psychiatry.


title: Towards Unified Dialogue System Evaluation: A Comprehensive Analysis of Current Evaluation Protocols

abstract: As conversational AI-based dialogue management has increasingly become a trending topic, the need for a standardized and reliable evaluation procedure grows even more pressing. The current state of affairs suggests various evaluation protocols to assess chat-oriented dialogue management systems, rendering it difficult to conduct fair comparative studies across different approaches and gain an insightful understanding of their values. To foster this research, a more robust evaluation protocol must be set in place. This paper presents a comprehensive synthesis of both automated and human evaluation methods on dialogue systems, identifying their shortcomings while accumulating evidence towards the most effective evaluation dimensions. A total of 20 papers from the last two years are surveyed to analyze three types of evaluation protocols: automated, static, and interactive. Finally, the evaluation dimensions used in these papers are compared against our expert evaluation on the system-user dialogue data collected from the Alexa Prize 2020.


title: Black Hole Quasinormal Modes and Seiberg-Witten Theory

abstract: We present new analytic results on black hole perturbation theory. Our results are based on a novel relation to four-dimensional $\mathcal{N}=2$ supersymmetric gauge theories. We propose an exact version of Bohr-Sommerfeld quantization conditions on quasinormal mode frequencies in terms of the Nekrasov partition function in a particular phase of the $\Omega$-background. Our quantization conditions also enable us to find exact expressions of eigenvalues of spin-weighted spheroidal harmonics. We test the validity of our conjecture by comparing against known numerical results for Kerr black holes as well as for Schwarzschild black holes. Some extensions are also discussed.


title: Escape rate and conditional escape rate from a probabilistic point of view

abstract: We prove that for a sequence of nested sets $\{U_n\}$ with $\Lambda = \cap_n U_n$ a measure zero set, the localized escape rate converges to the extremal index of $\Lambda$, provided that the dynamical system is $\phi$-mixing at polynomial speed. We also establish the general equivalence between the local escape rate for entry times and the local escape rate for returns.


title: Continual Learning for Affective Computing

abstract: Real-world application requires affect perception models to be sensitive to individual differences in expression. As each user is different and expresses differently, these models need to personalise towards each individual to adequately capture their expressions and thus, model their affective state. Despite high performance on benchmarks, current approaches fall short in such adaptation. In this work, we propose the use of Continual Learning (CL) for affective computing as a paradigm for developing personalised affect perception.


title: Consolidating Commonsense Knowledge

abstract: Commonsense reasoning is an important aspect of building robust AI systems and is receiving significant attention in the natural language understanding, computer vision, and knowledge graphs communities. At present, a number of valuable commonsense knowledge sources exist, with different foci, strengths, and weaknesses. In this paper, we list representative sources and their properties. Based on this survey, we propose principles and a representation model in order to consolidate them into a Common Sense Knowledge Graph (CSKG). We apply this approach to consolidate seven separate sources into a first integrated CSKG. We present statistics of CSKG, present initial investigations of its utility on four QA datasets, and list learned lessons.


title: Peter Pan Discs: finding Neverland's parameters

abstract: Peter Pan discs are a recently discovered class of long-lived discs around low-mass stars that survive for an order of magnitude longer than typical discs. In this paper we use disc evolutionary models to determine the required balance between initial conditions and the magnitude of dispersal processes for Peter Pan discs to be primordial. We find that we require low transport ($\alpha\sim10^{-4}$), extremely low external photoevaporation ($\leq10^{-9}{\rm M_{\odot}/yr}$), and relatively high disc masses ($>0.25M_*$) to produce discs with ages and accretion rates consistent with Peter Pan discs. Higher transport ($\alpha = 10^{-3}$) results in disc lifetimes that are too short and even lower transport ($\alpha = 10^{-5}$) leads to accretion rates smaller than those observed. The required external photoevaporation rates are so low that primordial Peter Pan discs will have formed in rare environments on the periphery of low-mass star-forming regions, or deeply embedded, and as such have never subsequently been exposed to higher amounts of UV radiation. Given that such an external photoevaporation scenario is rare, the required disc parameters and accretion properties may reflect the initial conditions and accretion rates of a much larger fraction of the discs around low-mass stars.


title: Auto-correlation functions of Sato-Tate distributions and identities of symplectic characters

abstract: The Sato-Tate distributions for genus 2 curves (conjecturally) describe the statistics of numbers of rational points on the curves. In this paper, we explicitly compute the auto-correlation functions of Sato-Tate distributions for genus 2 curves as sums of irreducible characters of symplectic groups. Our computations bring about families of identities involving irreducible characters of symplectic groups $Sp(2m)$ for all $m \in \mathbb Z_{\ge 1}$, which have interest in their own rights.


title: Geometric Solutions for General Actuator Routing on Inflated-Beam Soft Growing Robots

abstract: Continuum and soft robots can leverage complex actuator shapes to take on useful shapes while actuating only a few of their many degrees of freedom. Continuum robots that also grow increase the range of potential shapes that can be actuated and enable easier access to constrained environments. Existing models for describing the complex kinematics involved in general actuation of continuum robots rely on simulation or well-behaved stress-strain relationships, but the non-linear behavior of the thin-walled inflated-beams used in growing robots makes these techniques difficult to apply. Here we derive kinematic models of single, generally routed tendon paths on a soft pneumatic backbone of inextensible but flexible material from geometric relationships alone. This allows for forward modeling of the resulting shapes with only knowledge of the geometry of the system. We show that this model can accurately predict the shape of the whole robot body and how the model changes with actuation type. We also demonstrate the use of this kinematic model for inverse design, where actuator designs are found based on desired final robot shapes. We deploy these designed actuators on soft pneumatic growing robots to show the benefits of simultaneous growth and shape change.


title: Stability of neckpinch singularities

abstract: In this paper, we study the stability of neckpinch singularities. We show that if a mean curvature flow $\{M_t\}$ develops only finitely many neckpinch singularities at the first singular time, then the mean curvature flow starting at any sufficiently small perturbation of $M_0$ can also develop only neckpinch type singularities at the first singular time. We also show stability of nondegenerate neckpinch singularities in the above sense, which speaks in favor of stability of Type I singularities.


title: Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learning

abstract: Dancing to music is one of human's innate abilities since ancient times. In machine learning research, however, synthesizing dance movements from music is a challenging problem. Recently, researchers synthesize human motion sequences through autoregressive models like recurrent neural network (RNN). Such an approach often generates short sequences due to an accumulation of prediction errors that are fed back into the neural network. This problem becomes even more severe in the long motion sequence generation. Besides, the consistency between dance and music in terms of style, rhythm and beat is yet to be taken into account during modeling. In this paper, we formalize the music-conditioned dance generation as a sequence-to-sequence learning problem and devise a novel seq2seq architecture to efficiently process long sequences of music features and capture the fine-grained correspondence between music and dance. Furthermore, we propose a novel curriculum learning strategy to alleviate error accumulation of autoregressive models in long motion sequence generation, which gently changes the training process from a fully guided teacher-forcing scheme using the previous ground-truth movements, towards a less guided autoregressive scheme mostly using the generated movements instead. Extensive experiments show that our approach significantly outperforms the existing state-of-the-arts on automatic metrics and human evaluation. We also make a demo video to demonstrate the superior performance of our proposed approach at https://www.youtube.com/watch?v=lmE20MEheZ8.


title: Tools for quantum simulation with ultracold atoms in optical lattices

abstract: After many years of development of the basic tools, quantum simulation with ultracold atoms has now reached the level of maturity where it can be used to investigate complex quantum processes. Planning of new experiments and upgrading existing set-ups depends crucially on a broad overview of the available techniques, their specific advantages and limitations. This Technical Review aims to provide a comprehensive compendium of the state of the art. We discuss the basic principles, the available techniques and their current range of applications. Focusing on the simulation of varied phenomena in solid-state physics using optical lattice experiments, we review their basics, the necessary techniques and the accessible physical parameters. We outline how to control and use interactions with external potentials and between the atoms, and how to design new synthetic gauge fields and spin-orbit coupling. We discuss the latest progress in site-resolved techniques using quantum gas microscopes, and describe the unique features of quantum simulation experiments with two-electron atomic species.


title: On Goal-Oriented Multiobjective Embedded Optimization for System Performance Assessment

abstract: In this short note, we discuss a goal-oriented multiobjective optimization problem for system performance assessment. The objective function for such optimization problem, which is usually a composite of different performance indices corresponding to different operating conditions or scenarios in the system, is then posed as a goal-oriented multiobjective optimization problem. The (sub)-optimal solution(s) for such nonlinear optimization problem can be solved using a Sequential Quadratic Programming algorithm.


title: DNS Tunneling: A Deep Learning based Lexicographical Detection Approach

abstract: Domain Name Service is a trusted protocol made for name resolution, but during past years some approaches have been developed to use it for data transfer. DNS Tunneling is a method where data is encoded inside DNS queries, allowing information exchange through the DNS. This characteristic is attractive to hackers who exploit DNS Tunneling method to establish bidirectional communication with machines infected with malware with the objective of exfiltrating data or sending instructions in an obfuscated way. To detect these threats fast and accurately, the present work proposes a detection approach based on a Convolutional Neural Network (CNN) with a minimal architecture complexity. Due to the lack of quality datasets for evaluating DNS Tunneling connections, we also present a detailed construction and description of a novel dataset that contains DNS Tunneling domains generated with five well-known DNS tools. Despite its simple architecture, the resulting CNN model correctly detected more than 92% of total Tunneling domains with a false positive rate close to 0.8%.


title: IMF Programs and Economic Growth in the DRC

abstract: At the end of 2012 the International Monetary Fund (IMF) has suspended its financial assistance to the Democratic Republic of the Congo (DRC). Due to inflationary pressures which occurred in the last quarter of 2016, several decision-makers called for a reopening of a formal cooperation with the IMF. This process was formally completed in December 2019. The restart of IMF programs was greeted with satisfaction by politicians and widely commented in the media. However, recent history shows that the DRC managed to achieve exceptional economic performance, between 2012 and 2016, without being in a formal cooperation with the IMF. Some people wonder whether IMF assistance is a curse for recipient countries? We argue that the underlying problem has nothing to do with accepting or not the IMF assistance, but rather in the ability of policy makers to establish effective leadership and good governance for the development and implementation supporting structural reforms.


title: Remarkable band gap renormalization via dimensionality of the layered material C3B

abstract: Layer-dependent electronic and structural properties of emerging graphitic carbon boron compound C3B are investigated using both density functional theory and the GW approximation. We discover that, in contrast to a moderate quasiparticle band gap of 2.55 eV for monolayer C3B, the calculated quasiparticle band gap of perfectly stacked bulk phase C3B is as small as 0.17 eV. Therefore, our results suggest that layered material C3B exhibits a remarkably large band gap renormalization of over 2.3 eV due to the interlayer coupling and screening effects, providing a single material with an extraordinary band gap tunability. The quasiparticle band gap of monolayer C3B is also over 1.0 eV larger than that of C3N, a closely related two-dimensional semiconductor. Detailed inspections of the near-edge electronic states reveal that the conduction and valence band edges of C3B are formed by out-of-plane and in-plane electronic states, respectively, suggesting an interesting possibility of tuning the band edges of such layered material separately by modulating the in-plane and out-of-plane interactions.


title: Bayesian Modelling of Pattern Formation from One Snapshot of Pattern

abstract: Partial differential equations (PDE) have been widely used to reproduce patterns in nature and to give insight into the mechanism underlying pattern formation. Although many PDE models have been proposed, they rely on the pre-request knowledge of physical laws and symmetries, and developing a model to reproduce a given desired pattern remains difficult. We propose a novel method, referred to as Bayesian modelling of PDE (BM-PDE), to estimate the best dynamical PDE for one snapshot of a target pattern under the stationary state without ground truth. We apply BM-PDE to nontrivial patterns,such as quasi-crystals (QCs), a double gyroid and Frank Kasper structures. By using the estimated parameters for the approximant of QCs, we successfully generate, for the first time,three-dimensional dodecagonal QCs from a PDE model. Our method works for noisy patterns and the pattern synthesised without the ground truth parameters, which are required for the application toward experimental data.


title: Tight frames over the quaternions and equiangular lines

abstract: We show that much of the theory of finite tight frames can be generalised to vector spaces over the quaternions. This includes the variational characterisation, group frames, and the characterisations of projective and unitary equivalence. We are particularly interested in sets of equiangular lines (equi-isoclinic subspaces) and the groups associated with them, and how to move them between the spaces $\Rd$, $\Cd$ and $\Hd$. We present and discuss the analogue of Zauner's conjecture for equiangular lines in $\Hd$.


title: Algebraic criteria for stable diffeomorphism of spin 4-manifolds

abstract: We study closed, connected, spin 4-manifolds up to stabilisation by connected sums with copies of $S^2 \times S^2$. For a fixed fundamental group, there are primary, secondary and tertiary obstructions, which together with the signature lead to a complete stable classification. The primary obstruction exactly detects $\mathbb{CP}^2$-stable diffeomorphism and was previously related to algebraic invariants by Kreck and the authors. In this article we formulate conjectural relationships of the secondary and tertiary obstructions with algebraic invariants: the secondary obstruction should be determined by the (stable) equivariant intersection form and the tertiary obstruction via a $\tau$-invariant recording intersection data between 2-spheres, with trivial algebraic self-intersection, and their Whitney discs. We prove our conjectures for the following classes of fundamental groups: groups of cohomological dimension at most 3, right-angled Artin groups, abelian groups, and finite groups with quaternion or abelian 2-Sylow subgroups. We apply our theory to give a complete algebraic stable classification of spin $4$-manifolds with fundamental group $\mathbb{Z} \times \mathbb{Z}/2$.


title: Loop currents in ladder cuprates: A dynamical mean field theory study

abstract: We investigate the possibility of spontaneous loop currents in the two-leg ladder cuprate Sr$_{14-x}$Ca$_x$Cu$_{24}$O$_{41}$ by applying cluster dynamical mean field theory (CDMFT) to a seven-band Hubbard model for that compound, with an exact diagonalization solver. We sample several values of the local interaction $U_d$ and of the Cu-O energy difference $E_{pd}$, by applying an external field that induces loop currents. We find no instance of spontaneous loop currents once the external field is brought to zero.


title: Dark energy as generalised superfluid excitations

abstract: In this paper we present a generic form of the cosmological Equation of State derived from the formalism of Statistical Mechanics, assuming that a cosmic acceleration scenario can be interpreted as a system of quasi-particles. By considering a generalised superfluidity approach, in which the energy spectrum can be modulated via a parameter $s$, a negative equation of state arises as excitations associated with an \textit{exotic} superfluid system. We show that for $s\sim 0.293$, $w\simeq-1$, which can be related to the standard equation of state for the $\Lambda$CDM model.


title: ROOTS: Object-Centric Representation and Rendering of 3D Scenes

abstract: A crucial ability of human intelligence is to build up models of individual 3D objects from partial scene observations. Recent works achieve object-centric generation but without the ability to infer the representation, or achieve 3D scene representation learning but without object-centric compositionality. Therefore, learning to represent and render 3D scenes with object-centric compositionality remains elusive. In this paper, we propose a probabilistic generative model for learning to build modular and compositional 3D object models from partial observations of a multi-object scene. The proposed model can (i) infer the 3D object representations by learning to search and group object areas and also (ii) render from an arbitrary viewpoint not only individual objects but also the full scene by compositing the objects. The entire learning process is unsupervised and end-to-end. In experiments, in addition to generation quality, we also demonstrate that the learned representation permits object-wise manipulation and novel scene generation, and generalizes to various settings. Results can be found on our project website: https://sites.google.com/view/roots3d


title: Sovereign: User-Controlled Smart Homes

abstract: Recent years have witnessed the rapid deployment of smart homes; most of them are controlled by remote servers in the cloud. Such designs raise security and privacy concerns for end users. In this paper, we describe the design of Sovereign, a home IoT system framework that provides end users complete control of their home IoT systems. Sovereign lets home IoT devices and applications communicate via application-named data and secures data directly. This enables direct, secure, one-to-one and one-to-many device-to-device communication over wireless broadcast media. Sovereign utilizes semantic names to construct usable security solutions. We implement Sovereign as a publish-subscribe-based development platform together with a prototype home IoT controller. Our preliminary evaluation shows that Sovereign provides a systematic, easy-to-use solution to user-controlled, self-contained smart homes running on existing IoT hardware without imposing noticeable overhead.


title: Nonlocal magnon entanglement generation in coupled hybrid cavity systems

abstract: We investigate dynamical generation of macroscopic nonlocal entanglements between two remote massive magnon-superconducting-circuit hybrid systems. Two fiber-coupled microwave cavities are employed to serve as an interaction channel connecting two sets of macroscopic hybrid units each containing a magnon (hosted by a Yttrium-Iron-Garnet sphere) and a superconducting-circuit qubit. Surprisingly, it is found that stronger coupling does not necessarily mean faster entanglement generation. The proposed hybrid system allows the existence of an optimal fiber coupling strength that requests the shortest amount of time to generate a systematic maximal entanglement. Our theoretical results are shown to be within the scope of specific parameters that can be achieved with current technology. The noise effects on the implementation of systems are also treated in a general environment suggesting the robustness of entanglement generation. Our discrete-variable qubit-like entanglement theory of magnons may lead to direct applications in various quantum information tasks.


title: Out-of-equilibrium Monte Carlo simulations of a classical gas with Bose-Einstein statistics

abstract: Algorithms to determine transition probabilities in Monte Carlo simulations are tested using a system of classical particles with effective interactions which reproduce Bose-Einstein statistics. The system is appropriate for testing different Monte Carlo simulation methods in out-of-equilibrium situations since non equivalent results are produced. We compare mobility numerical results obtained with transition probabilities derived from Glauber and Metropolis algorithms. Then, we compare these with a recent method, the interpolation algorithm, appropriate for non-equilibrium systems in homogeneous substrata and without phase transitions. The results of mobility obtained from the interpolation algorithm are qualitatively verified with molecular dynamics simulations for low concentrations.


title: Kalman Filter Based Multiple Person Head Tracking

abstract: For multi-target tracking, target representation plays a crucial rule in performance. State-of-the-art approaches rely on the deep learning-based visual representation that gives an optimal performance at the cost of high computational complexity. In this paper, we come up with a simple yet effective target representation for human tracking. Our inspiration comes from the fact that the human body goes through severe deformation and inter/intra occlusion over the passage of time. So, instead of tracking the whole body part, a relative rigid organ tracking is selected for tracking the human over an extended period of time. Hence, we followed the tracking-by-detection paradigm and generated the target hypothesis of only the spatial locations of heads in every frame. After the localization of head location, a Kalman filter with a constant velocity motion model is instantiated for each target that follows the temporal evolution of the targets in the scene. For associating the targets in the consecutive frames, combinatorial optimization is used that associates the corresponding targets in a greedy fashion. Qualitative results are evaluated on four challenging video surveillance dataset and promising results has been achieved.


title: Sample Efficient Reinforcement Learning via Low-Rank Matrix Estimation

abstract: We consider the question of learning $Q$-function in a sample efficient manner for reinforcement learning with continuous state and action spaces under a generative model. If $Q$-function is Lipschitz continuous, then the minimal sample complexity for estimating $\epsilon$-optimal $Q$-function is known to scale as ${\Omega}(\frac{1}{\epsilon^{d_1+d_2 +2}})$ per classical non-parametric learning theory, where $d_1$ and $d_2$ denote the dimensions of the state and action spaces respectively. The $Q$-function, when viewed as a kernel, induces a Hilbert-Schmidt operator and hence possesses square-summable spectrum. This motivates us to consider a parametric class of $Q$-functions parameterized by its "rank" $r$, which contains all Lipschitz $Q$-functions as $r \to \infty$. As our key contribution, we develop a simple, iterative learning algorithm that finds $\epsilon$-optimal $Q$-function with sample complexity of $\widetilde{O}(\frac{1}{\epsilon^{\max(d_1, d_2)+2}})$ when the optimal $Q$-function has low rank $r$ and the discounting factor $\gamma$ is below a certain threshold. Thus, this provides an exponential improvement in sample complexity. To enable our result, we develop a novel Matrix Estimation algorithm that faithfully estimates an unknown low-rank matrix in the $\ell_\infty$ sense even in the presence of arbitrary bounded noise, which might be of interest in its own right. Empirical results on several stochastic control tasks confirm the efficacy of our "low-rank" algorithms.


title: Weighted Lasso Estimates for Sparse Logistic Regression: Non-asymptotic Properties with Measurement Error

abstract: When we are interested in high-dimensional system and focus on classification performance, the $\ell_{1}$-penalized logistic regression is becoming important and popular. However, the Lasso estimates could be problematic when penalties of different coefficients are all the same and not related to the data. We proposed two types of weighted Lasso estimates depending on covariates by the McDiarmid inequality. Given sample size $n$ and dimension of covariates $p$, the finite sample behavior of our proposed methods with a diverging number of predictors is illustrated by non-asymptotic oracle inequalities such as $\ell_{1}$-estimation error and squared prediction error of the unknown parameters. We compare the performance of our methods with former weighted estimates on simulated data, then apply these methods to do real data analysis.


title: Analysis of Trade-offs in Fair Principal Component Analysis Based on Multi-objective Optimization

abstract: In dimensionality reduction problems, the adopted technique may produce disparities between the representation errors of different groups. For instance, in the projected space, a specific class can be better represented in comparison with another one. In some situations, this unfair result may introduce ethical concerns. Aiming at overcoming this inconvenience, a fairness measure can be considered when performing dimensionality reduction through Principal Component Analysis. However, a solution that increases fairness tends to increase the overall re-construction error. In this context, this paper proposes to address this trade-off by means of a multi-objective-based approach. For this purpose, we adopt a fairness measure associated with the disparity between the representation errors of different groups. Moreover, we investigate if the solution of a classical Principal Component Analysis can be used to find a fair projection. Numerical experiments attest that a fairer result can be achieved with a very small loss in the overall reconstruction error.


title: Conformal Inference of Counterfactuals and Individual Treatment Effects

abstract: Evaluating treatment effect heterogeneity widely informs treatment decision making. At the moment, much emphasis is placed on the estimation of the conditional average treatment effect via flexible machine learning algorithms. While these methods enjoy some theoretical appeal in terms of consistency and convergence rates, they generally perform poorly in terms of uncertainty quantification. This is troubling since assessing risk is crucial for reliable decision-making in sensitive and uncertain environments. In this work, we propose a conformal inference-based approach that can produce reliable interval estimates for counterfactuals and individual treatment effects under the potential outcome framework. For completely randomized or stratified randomized experiments with perfect compliance, the intervals have guaranteed average coverage in finite samples regardless of the unknown data generating mechanism. For randomized experiments with ignorable compliance and general observational studies obeying the strong ignorability assumption, the intervals satisfy a doubly robust property which states the following: the average coverage is approximately controlled if either the propensity score or the conditional quantiles of potential outcomes can be estimated accurately. Numerical studies on both synthetic and real datasets empirically demonstrate that existing methods suffer from a significant coverage deficit even in simple models. In contrast, our methods achieve the desired coverage with reasonably short intervals.


title: Chow groups and $L$-derivatives of automorphic motives for unitary groups

abstract: In this article, we study the Chow group of the motive associated to a tempered global $L$-packet $\pi$ of unitary groups of even rank with respect to a CM extension, whose global root number is $-1$. We show that, under some restrictions on the ramification of $\pi$, if the central derivative $L'(1/2,\pi)$ is nonvanishing, then the $\pi$-nearly isotypic localization of the Chow group of a certain unitary Shimura variety over its reflex field does not vanish. This proves part of the Beilinson--Bloch conjecture for Chow groups and $L$-functions, which generalizes the Birch and Swinnerton-Dyer conjecture. Moreover, assuming the modularity of Kudla's generating functions of special cycles, we explicitly construct elements in a certain $\pi$-nearly isotypic subspace of the Chow group by arithmetic theta lifting, and compute their heights in terms of the central derivative $L'(1/2,\pi)$ and local doubling zeta integrals. This confirms the conjectural arithmetic inner product formula proposed by one of us, which generalizes the Gross--Zagier formula to higher dimensional motives.


title: The stable Derrida--Retaux system at criticality

abstract: The Derrida--Retaux recursive system was investigated by Derrida and Retaux (2014) as a hierarchical renormalization model in statistical physics. A prediction of Derrida and Retaux (2014) on the free energy has recently been rigorously proved (Chen, Dagard, Derrida, Hu, Lifshits and Shi (2019+)), confirming the Berezinskii--Kosterlitz--Thouless-type phase transition in the system. Interestingly, it has been established in Chen, Dagard, Derrida, Hu, Lifshits and Shi (2019+) that the prediction is valid only under a certain integrability assumption on the initial distribution, and a new type of universality result has been shown when this integrability assumption is not satisfied. We present a unified approach for systems satisfying a certain domination condition, and give an upper bound for derivatives of all orders of the moment generating function. When the integrability assumption is not satisfied, our result allows to identify the large-time order of magnitude of the product of the moment generating functions at criticality, confirming and completing a previous result in Collet, Eckmann, Glaser and Martin (1984).


title: On-the-fly Closed-loop Autonomous Materials Discovery via Bayesian Active Learning

abstract: Active learning - the field of machine learning (ML) dedicated to optimal experiment design, has played a part in science as far back as the 18th century when Laplace used it to guide his discovery of celestial mechanics [1]. In this work we focus a closed-loop, active learning-driven autonomous system on another major challenge, the discovery of advanced materials against the exceedingly complex synthesis-processes-structure-property landscape. We demonstrate autonomous research methodology (i.e. autonomous hypothesis definition and evaluation) that can place complex, advanced materials in reach, allowing scientists to fail smarter, learn faster, and spend less resources in their studies, while simultaneously improving trust in scientific results and machine learning tools. Additionally, this robot science enables science-over-the-network, reducing the economic impact of scientists being physically separated from their labs. We used the real-time closed-loop, autonomous system for materials exploration and optimization (CAMEO) at the synchrotron beamline to accelerate the fundamentally interconnected tasks of rapid phase mapping and property optimization, with each cycle taking seconds to minutes, resulting in the discovery of a novel epitaxial nanocomposite phase-change memory material.


title: Gender disparity in the authorship of biomedical research publications during the COVID-19 pandemic

abstract: Preliminary evidence suggests that women, including female researchers, are disproportionately affected by the COVID-19 pandemic in terms of unequal distribution of childcare, elderly care and other kinds of domestic and emotional labor. Sudden lockdowns and abrupt shifts in daily routines have disproportionate consequences on their productivity, which is reflected by a sudden drop in research output in biomedical research, consequently affecting the number of female authors of scientific publications. We investigate the proportion of male and female researchers who published scientific papers during the COVID-19 pandemic, using bibliometric data from biomedical preprint servers and selected Springer-Nature journals. Our findings document a decrease in the number of publications by female authors in biomedical field during the global pandemic. This effect is particularly pronounced for papers related to COVID-19, indicating that women are producing fewer publications related to COVID-19 research. This sudden increase in the gender gap is persistent across the ten countries with the highest number of researchers. These results should be used to inform the scientific community of the worrying trend in COVID-19 research and the disproportionate effect that the pandemic has on female academics.


title: Emora STDM: A Versatile Framework for Innovative Dialogue System Development

abstract: This demo paper presents Emora STDM (State Transition Dialogue Manager), a dialogue system development framework that provides novel workflows for rapid prototyping of chat-based dialogue managers as well as collaborative development of complex interactions. Our framework caters to a wide range of expertise levels by supporting interoperability between two popular approaches, state machine and information state, to dialogue management. Our Natural Language Expression package allows seamless integration of pattern matching, custom NLP modules, and database querying, that makes the workflows much more efficient. As a user study, we adopt this framework to an interdisciplinary undergraduate course where students with both technical and non-technical backgrounds are able to develop creative dialogue managers in a short period of time.


title: Quantum jump simulation in three-level systems using photonic Gaussian modes

abstract: Multi-level quantum systems loose coherence due to quantum jumps or spontaneous decay between their internal levels. Here we propose a way to simulate experimentally a three-level system under quantum jump using a three-mode photonic system. We simulated three different dynamics of spontaneous decay in a three-level atomic system: cascade decay, $\Lambda$ decay and $V$ decay. With an attenuated light coherent source at the photon level, we prepared a photonic qutrit state encoded in the parallel path of Gaussian modes. By exploring periodical phase modulation in spatial light modulator, the corresponding dynamical maps for quantum jumps were implemented in terms of the Kraus operator decomposition. With image measurements with an intensified charged-coupled device (ICCD) camera we obtain the diagonal elements of the initial state density matrix. Measuring the image and interference patterns of the evolved qutrit state we verified experimentally the variation of the populations and the decoherence effects caused by the quantum jumps in the three-level system for the three-level decay configurations.


title: Learning Continuous-Time Dynamics by Stochastic Differential Networks

abstract: Learning continuous-time stochastic dynamics is a fundamental and essential problem in modeling sporadic time series, whose observations are irregular and sparse in both time and dimension. For a given system whose latent states and observed data are high-dimensional, it is generally impossible to derive a precise continuous-time stochastic process to describe the system behaviors. To solve the above problem, we apply Variational Bayesian method and propose a flexible continuous-time stochastic recurrent neural network named Variational Stochastic Differential Networks (VSDN), which embeds the complicated dynamics of the sporadic time series by neural Stochastic Differential Equations (SDE). VSDNs capture the stochastic dependency among latent states and observations by deep neural networks. We also incorporate two differential Evidence Lower Bounds to efficiently train the models. Through comprehensive experiments, we show that VSDNs outperform state-of-the-art continuous-time deep learning models and achieve remarkable performance on prediction and interpolation tasks for sporadic time series.


title: Frequency measurements of transitions from the $2^{3\!}P_2$ state to the $5^{1\!}D_2$, $5^{3\!}S_1$, and $5^{3\!}D$ states in ultracold helium

abstract: We perform laser absorption spectroscopy with ultracold $^4$He atoms to measure the energy intervals between the $2^{3\!} P_2$ level and five levels in the n = 5 manifold. The laser light perturbs the cold atomic cloud during the production of Bose-Einstein condensates and decreases the phase space density, causing a measurable decrease in the number of atoms in the final condensate. We improve on the precision of previous measurements by at least an order of magnitude, and report the first observation of the spin-forbidden $2^{3\!}P_2 - 5^{1\!}D_2$ transition in helium. Theoretical transition energies agree with the observed values within our experimental uncertainty.


title: Implicit Kernel Attention

abstract: \textit{Attention} computes the dependency between representations, and it encourages the model to focus on the important selective features. Attention-based models, such as Transformer and graph attention network (GAT), are widely utilized for sequential data and graph-structured data. This paper suggests a new interpretation and generalized structure of the attention in Transformer and GAT. For the attention in Transformer and GAT, we derive that the attention is a product of two parts: 1) the RBF kernel to measure the similarity of two instances and 2) the exponential of $L^{2}$ norm to compute the importance of individual instances. From this decomposition, we generalize the attention in three ways. First, we propose implicit kernel attention with an implicit kernel function instead of manual kernel selection. Second, we generalize $L^{2}$ norm as the $L^{p}$ norm. Third, we extend our attention to structured multi-head attention. Our generalized attention shows better performance on classification, translation, and regression tasks.