title: Description of resonant inelastic x-ray scattering in correlated metals

abstract: To fully capitalize on the potential and versatility of resonant inelastic x-ray scattering (RIXS), it is essential to develop the capability to interpret different RIXS contributions through calculations, including the dependence on momentum transfer, from first-principles for correlated materials. Toward that objective, we present new methodology for calculating the full RIXS response of a correlated metal in an unbiased fashion. Through comparison of measurements and calculations that tune the incident photon energy over a wide portion of the Fe L$_3$ absorption resonance of the example material BaFe$_2$As$_2$, we show that the RIXS response in BaFe$_2$As$_2$ is dominated by the direct channel contribution, including the Raman-like response below threshold, which we explain as a consequence of the finite core-hole lifetime broadening. Calculations are initially performed within the first-principles Bethe-Salpeter framework, which we then significantly improve by convolution with an effective spectral function for the intermediate-state excitation. We construct this spectral function, also from first-principles, by employing the cumulant expansion of the Green's function and performing a real-time time dependent density functional theory calculation of the response of the electronic system to the perturbation of the intermediate-state excitation. Importantly, this allows us to evaluate the indirect RIXS response from first-principles, accounting for the full periodicity of the crystal structure and with dependence on the momentum transfer.


title: A posteriori verification of the positivity of solutions to elliptic boundary value problems

abstract: The purpose of this paper is to develop a unified a posteriori method for verifying the positivity of solutions of elliptic boundary value problems by assuming neither $H^2$-regularity nor $ L^{\infty} $-error estimation, but only $ H^1_0 $-error estimation. In [J. Comput. Appl. Math, Vol. 370, (2020) 112647], we proposed two approaches to verify the positivity of solutions of several semilinear elliptic boundary value problems. However, some cases require $ L^{\infty} $-error estimation and, therefore, narrow applicability. In this paper, we extend one of the approaches and combine it with a priori error bounds for Laplacian eigenvalues to obtain a unified method that has wide application. We describe how to evaluate some constants required to verify the positivity of desired solutions. We apply our method to several problems, including those to which the previous method is not applicable.


title: Deterministic Distributed Vertex Coloring: Simpler, Faster, and without Network Decomposition

abstract: We present a simple deterministic distributed algorithm that computes a $(\Delta+1)$-vertex coloring in $O(\log^2 \Delta \cdot \log n)$ rounds. The algorithm can be implemented with $O(\log n)$-bit messages. The algorithm can also be extended to the more general $(degree+1)$-list coloring problem. Obtaining a polylogarithmic-time deterministic algorithm for $(\Delta+1)$-vertex coloring had remained a central open question in the area of distributed graph algorithms since the 1980s, until a recent network decomposition algorithm of Rozho\v{n} and Ghaffari [STOC'20]. The current state of the art is based on an improved variant of their decomposition, which leads to an $O(\log^5 n)$-round algorithm for $(\Delta+1)$-vertex coloring. Our coloring algorithm is completely different and considerably simpler and faster. It solves the coloring problem in a direct way, without using network decomposition, by gradually rounding a certain fractional color assignment until reaching an integral color assignments. Moreover, via the approach of Chang, Li, and Pettie [STOC'18], this improved deterministic algorithm also leads to an improvement in the complexity of randomized algorithms for $(\Delta+1)$-coloring, now reaching the bound of $O(\log^3\log n)$ rounds. As a further application, we also provide faster deterministic distributed algorithms for the following variants of the vertex coloring problem. In graphs of arboricity $a$, we show that a $(2+\epsilon)a$-vertex coloring can be computed in $O(\log^3 a\cdot\log n)$ rounds. We also show that for $\Delta\geq 3$, a $\Delta$-coloring of a $\Delta$-colorable graph $G$ can be computed in $O(\log^2 \Delta\cdot\log^2 n)$ rounds.


title: Auxiliary Sequence Labeling Tasks for Disfluency Detection

abstract: Detecting disfluencies in spontaneous speech is an important preprocessing step in natural language processing and speech recognition applications. Existing works for disfluency detection have focused on designing a single objective only for disfluency detection, while auxiliary objectives utilizing linguistic information of a word such as named entity or part-of-speech information can be effective. In this paper, we focus on detecting disfluencies on spoken transcripts and propose a method utilizing named entity recognition (NER) and part-of-speech (POS) as auxiliary sequence labeling (SL) tasks for disfluency detection. First, we investigate cases that utilizing linguistic information of a word can prevent mispredicting important words and can be helpful for the correct detection of disfluencies. Second, we show that training a disfluency detection model with auxiliary SL tasks can improve its F-score in disfluency detection. Then, we analyze which auxiliary SL tasks are influential depending on baseline models. Experimental results on the widely used English Switchboard dataset show that our method outperforms the previous state-of-the-art in disfluency detection.


title: Multiple Stellar Evolution: a population synthesis algorithm to model the stellar, binary, and dynamical evolution of multiple-star systems

abstract: In recent years, observations have shown that multiple-star systems such as hierarchical triple and quadruple-star systems are common, especially among massive stars. They are potential sources of interesting astrophysical phenomena such as compact object mergers, leading to supernovae, and gravitational wave events. However, many uncertainties remain in their often complex evolution. Here, we present the population synthesis code Multiple Stellar Evolution (MSE), designed to rapidly model the stellar, binary, and dynamical evolution of multiple-star systems. MSE includes a number of new features not present in previous population synthesis codes: (1) an arbitrary number of stars, as long as the initial system is hierarchical, (2) dynamic switching between secular and direct N-body integration for efficient computation of the gravitational dynamics, (3) treatment of mass transfer in eccentric orbits, which occurs commonly in multiple-star systems, (4) a simple treatment of tidal, common-envelope, and mass transfer evolution in which the accretor is a binary instead of a single star, (5) taking into account planets within the stellar system, and (6) including gravitational perturbations from passing field stars. MSE, written primarily in the C++ language, will be made publicly available and has few prerequisites; a convenient Python interface is provided. We give a detailed description of MSE and illustrate how to use the code in practice. We demonstrate its operation in a number of examples.


title: Coherent wave control in complex media with arbitrary wavefronts

abstract: Wavefront shaping (WFS) has emerged as powerful tool to control the propagation of diverse wave phenomena (light, sound, microwaves, ...) in disordered matter for applications including imaging, communication, energy transfer, micromanipulation, and scattering anomalies. Nonetheless, in practice the necessary coherent control of multiple input channels remains a vexing problem. Here, we overcome this difficulty by doping the disordered medium with programmable meta-atoms in order to adapt it to an imposed arbitrary incoming wavefront. Besides lifting the need for carefully shaped incident wavefronts, our approach also unlocks new opportunities such as sequentially achieving different functionalities with the same arbitrary wavefront. We demonstrate our concept experimentally for electromagnetic waves using programmable metasurfaces in a chaotic cavity, with applications to focusing with the generalized Wigner-Smith operator as well as coherent perfect absorption. We expect our fundamentally new perspective on coherent wave control to facilitate the transition of intricate WFS protocols into real applications for various wave phenomena.


title: SENSAR: A Visual Tool for Intelligent Robots for Collaborative Human-Robot Interaction

abstract: Establishing common ground between an intelligent robot and a human requires communication of the robot's intention, behavior, and knowledge to the human to build trust and assure safety in a shared environment. This paper introduces SENSAR (Seeing Everything iN Situ with Augmented Reality), an augmented reality robotic system that enables robots to communicate their sensory and cognitive data in context over the real-world with rendered graphics, allowing a user to understand, correct, and validate the robot's perception of the world. Our system aims to support human-robot interaction research by establishing common ground where the perceptions of the human and the robot align.


title: Data model as agile basis for evolving calibration software

abstract: We design the imaging data calibration and reduction software for MICADO, the First Light near-IR instrument on the Extremely Large Telescope. In this process we have hit the limit of what can be achieved with a detailed software design that is primarily captured in pdf/word documents. Trade-offs between hardware and calibration software are required to meet stringent science requirements. To support such trade-offs, more software needs to be developed in the early phases of the project: simulators, archives, prototype recipes and pipelines. This requires continuous and efficient exchange of evolving designs between the software and hardware groups, which is hard to achieve with manually maintained documents. This, and maintaining the consistency between the design documents and various software components is possible with a machine readable version of the design. We construct a detailed design that is readable by both software and humans. From this the design documentation, prototype pipelines and data archives are generated automatically. We present the implementation of such an approach for the calibration software detailed design for the ELT MICADO imager which is based on expertise and lessons learned in earlier projects (e.g. OmegaCAM, MUSE, Euclid).


title: Particles to Partial Differential Equations Parsimoniously

abstract: Equations governing physico-chemical processes are usually known at microscopic spatial scales, yet one suspects that there exist equations, e.g. in the form of Partial Differential Equations (PDEs), that can explain the system evolution at much coarser, meso- or macroscopic length scales. Discovering those coarse-grained effective PDEs can lead to considerable savings in computation-intensive tasks like prediction or control. We propose a framework combining artificial neural networks with multiscale computation, in the form of equation-free numerics, for efficient discovery of such macro-scale PDEs directly from microscopic simulations. Gathering sufficient microscopic data for training neural networks can be computationally prohibitive; equation-free numerics enable a more parsimonious collection of training data by only operating in a sparse subset of the space-time domain. We also propose using a data-driven approach, based on manifold learning and unnormalized optimal transport of distributions, to identify macro-scale dependent variable(s) suitable for the data-driven discovery of said PDEs. This approach can corroborate physically motivated candidate variables, or introduce new data-driven variables, in terms of which the coarse-grained effective PDE can be formulated. We illustrate our approach by extracting coarse-grained evolution equations from particle-based simulations with a priori unknown macro-scale variable(s), while significantly reducing the requisite data collection computational effort.

categories: stat.ML cs.LG physics.comp-ph physics.data-an


title: Topology optimized multi-functional mechanically reconfigurable meta-optics studied at microwave frequencies

abstract: Metasurfaces advanced the field of optics by reducing the thickness of optical components and merging multiple functionalities into a single layer device. However, this generally comes with a reduction in performance, especially for multifunctional and broadband applications. Three-dimensional metastructures can provide the necessary degrees of freedom for advanced applications, while maintaining minimal thickness. This work explores 3D mechanically reconfigurable devices that perform focusing, spectral demultiplexing, and polarization sorting based on mechanical configuration. As proof of concept, a rotatable device, auxetic device, and a shearing-based device are designed with adjoint-based topology optimization, 3D-printed, and measured at microwave frequencies (7.6-11.6 GHz) in an anechoic chamber.


title: Kaplan-Meier based tests for exponentiality in the presence of censoring

abstract: In this paper we test the composite hypothesis that lifetimes follow an exponential distribution based on observed randomly right censored data. Testing this hypothesis is complicated by the presence of this censoring, due to the fact that not all lifetimes are observed. To account for this complication, we propose modifications to tests based on the empirical characteristic function and Laplace transform. In the full sample case these empirical functions can be expressed as integrals with respect to the empirical distribution function of the lifetimes. We propose replacing this estimate of the distribution function by the Kaplan-Meier estimate. The resulting test statistics can be expressed in easily calculable forms in terms of summations of functionals of the observed data. Additionally, a general framework for goodness-of-fit testing, in the presence of random right censoring, is outlined. A Monte Carlo study is performed, the results of which indicate that the newly modified tests generally outperform the existing tests. A practical application, concerning initial remission times of leukemia patients, is discussed along with some concluding remarks and avenues for future research.


title: Stiff-PINN: Physics-Informed Neural Network for Stiff Chemical Kinetics

abstract: Recently developed physics-informed neural network (PINN) has achieved success in many science and engineering disciplines by encoding physics laws into the loss functions of the neural network, such that the network not only conforms to the measurements, initial and boundary conditions but also satisfies the governing equations. This work first investigates the performance of PINN in solving stiff chemical kinetic problems with governing equations of stiff ordinary differential equations (ODEs). The results elucidate the challenges of utilizing PINN in stiff ODE systems. Consequently, we employ Quasi-Steady-State-Assumptions (QSSA) to reduce the stiffness of the ODE systems, and the PINN then can be successfully applied to the converted non/mild-stiff systems. Therefore, the results suggest that stiffness could be the major reason for the failure of the regular PINN in the studied stiff chemical kinetic systems. The developed Stiff-PINN approach that utilizes QSSA to enable PINN to solve stiff chemical kinetics shall open the possibility of applying PINN to various reaction-diffusion systems involving stiff dynamics.

categories: math.NA cs.NA physics.chem-ph physics.comp-ph


title: Automated Discovery of Mathematical Definitions in Text with Deep Neural Networks

abstract: Automatic definition extraction from texts is an important task that has numerous applications in several natural language processing fields such as summarization, analysis of scientific texts, automatic taxonomy generation, ontology generation, concept identification, and question answering. For definitions that are contained within a single sentence, this problem can be viewed as a binary classification of sentences into definitions and non-definitions. In this paper, we focus on automatic detection of one-sentence definitions in mathematical texts, which are difficult to separate from surrounding text. We experiment with several data representations, which include sentence syntactic structure and word embeddings, and apply deep learning methods such as the Convolutional Neural Network (CNN) and the Long Short-Term Memory network (LSTM), in order to identify mathematical definitions. Our experiments demonstrate the superiority of CNN and its combination with LSTM, when applied on the syntactically-enriched input representation. We also present a new dataset for definition extraction from mathematical texts. We demonstrate that this dataset is beneficial for training supervised models aimed at extraction of mathematical definitions. Our experiments with different domains demonstrate that mathematical definitions require special treatment, and that using cross-domain learning is inefficient for that task.


title: A Fast Hybrid Cascade Network for Voxel-based 3D Object Classification

abstract: Voxel-based 3D object classification has been thoroughly studied in recent years. Most previous methods convert the classic 2D convolution into a 3D form that will be further applied to objects with binary voxel representation for classification. However, the binary voxel representation is not very effective for 3D convolution in many cases. In this paper, we propose a hybrid cascade architecture for voxel-based 3D object classification. It consists of three stages composed of fully connected and convolutional layers, dealing with easy, moderate, and hard 3D models respectively. Both accuracy and speed can be balanced in our proposed method. By giving each voxel a signed distance value, an obvious gain regarding the accuracy can be observed. Besides, the mean inference time can be speeded up hugely compared with the state-of-the-art point cloud and voxel based methods.


title: 3D simulations of vertical displacement events in tokamaks: A benchmark of M3D-C$^1$, NIMROD and JOREK

abstract: In recent years, the nonlinear 3D magnetohydrodynamic codes JOREK, M3D-C$^1$ and NIMROD developed the capability of modelling realistic 3D vertical displacement events (VDEs) including resistive walls. In this paper, a comprehensive 3D VDE benchmark is presented between these state of the art codes. The simulated case is based on an experimental NSTX plasma but with a simplified rectangular wall. In spite of pronounced differences between physics models and numerical methods, the comparison shows very good agreement in the relevant quantities used to characterize disruptions such as the 3D wall forces and energy decay. This benchmark does not only bring confidence regarding the use of the mentioned codes for disruption studies, but also shows differences with respect to the used models (e.g. reduced versus full MHD models). The simulations show important 3D features for a NSTX plasma such as the self-consistent evolution of the halo current and the origin of the wall forces. In contrast to other reduced MHD models based on an ordering in the aspect ratio, the ansatz based JOREK reduced MHD model allows capturing the 3D dynamics even in the spherical tokamak limit considered here.


title: The homology of permutation racks

abstract: Despite a blossoming of research activity on racks and their homology for over two decades, with a record of diverse applications to central parts of contemporary mathematics, there are still very few examples of racks whose homology has been fully calculated. In this paper, we compute the entire integral homology of all permutation racks. Our method of choice involves homotopical algebra, which was brought to bear on the homology of racks only recently. For our main result, we establish a spectral sequence, which reduces the problem to one in equivariant homology, and for which we show that it always degenerates. The blueprint given in this paper demonstrates the high potential for further exploitation of these techniques.


title: A note on Cohen-Macaulay descent

abstract: We investigate the behavior of Cohen-Macaulay defect undertaking tensor product with a perfect module. Consequently, we study the perfect defect of a module. As an application, we connect to associated prime ideals of tensor products.


title: Computational methods and fast hybrid stochastic simulations for triangulation sensing and identifying principles of cell navigation in the brain

abstract: Brownian simulations can be used to generate statistics relevant for studying molecular interactions or trafficking. However, the concurrent simulation of many Brownian trajectories at can become computationally intractable. Replacing detailed Brownian simulations by a rate model was the basis of Gillespie's algorithm, but requires one to disregard spatial information. However, this information is crucial in molecular and cellular biology. Alternatively one can use a hybrid approach, generating Brownian paths only in a small region where the spatial organization is relevant and avoiding it in the remainder of the domain. Here we review the recent progress of hybrid methods and simulations in the context of cell sensing and guidance via external chemical gradients. Specifically, we highlight the reconstruction of the location of a point source in 2D and 3D from diffusion fluxes arriving at narrow windows located on the cell. We discuss cases in which these windows are located on the boundary of the 2D or 3D half-space, on a disk in free space, inside a 2D corridor, or a 3D ball. The hybrid method in question performs Brownian simulations only inside a region of interest. It uses the Neumann-Green's function for the mentioned geometries to generate exact mappings exit and entry points when the trajectory leaves the region, thus avoiding the explicit computation of Brownian paths in an infinite domain. Matched asymptotics is used to compute the probability fluxes to small windows and we review how such an approach can be used to reconstruct the location of a point source and estimating the uncertainty in the source reconstruction due to an additive perturbation present in the fluxes. We also review the influence of various window configurations on the source position recovery. Finally, we discuss potential applications in developmental cell biology and possible computational principles.


title: AAAI FSS-20: Artificial Intelligence in Government and Public Sector Proceedings

abstract: Proceedings of the AAAI Fall Symposium on Artificial Intelligence in Government and Public Sector, Washington, DC, USA, November 13-14, 2020


title: Balanced Crown Decomposition for Connectivity Constraints

abstract: We introduce the balanced crown decomposition that captures the structure imposed on graphs by their connected induced subgraphs of a given size. Such subgraphs are a popular modeling tool in various application areas, where the non-local nature of the connectivity condition usually results in very challenging algorithmic tasks. The balanced crown decomposition is a combination of a crown decomposition and a balanced partition which makes it applicable to graph editing as well as graph packing and partitioning problems. We illustrate this by deriving improved kernelization and approximation algorithms for a variety of such problems. In particular, through this structure, we obtain the first constant-factor approximation for the Balanced Connected Partition (BCP) problem, where the task is to partition a vertex-weighted graph into $k$ connected components of approximately equal weight. We derive a 3-approximation for the two most commonly used objectives of maximizing the weight of the lightest component or minimizing the weight of the heaviest component.


title: Negative Magneto-Resistance in a Long Superconducting Wires: Theory and Experiments

abstract: The effect of negative magnetoresistance for thin superconducting wire was considered in a simple model. These phenomena originated from competition of two mechanism: fluctuations of the order parameter and quasiparticles charge imbalance which accompanies each phase slip event. First process results in conventional positive magnetoresistance while the second mechanism gives the negative contributions. Simple analytical formula is obtained for the negative magnetic resistance caused by both the thermodynamics (TAPS) and quantum fluctuations. Theoretical results are compared with experimental data and demonstrate good agreement between theory and experiment.


title: MinkLoc3D: Point Cloud Based Large-Scale Place Recognition

abstract: The paper presents a learning-based method for computing a discriminative 3D point cloud descriptor for place recognition purposes. Existing methods, such as PointNetVLAD, are based on unordered point cloud representation. They use PointNet as the first processing step to extract local features, which are later aggregated into a global descriptor. The PointNet architecture is not well suited to capture local geometric structures. Thus, state-of-the-art methods enhance vanilla PointNet architecture by adding different mechanism to capture local contextual information, such as graph convolutional networks or using hand-crafted features. We present an alternative approach, dubbed MinkLoc3D, to compute a discriminative 3D point cloud descriptor, based on a sparse voxelized point cloud representation and sparse 3D convolutions. The proposed method has a simple and efficient architecture. Evaluation on standard benchmarks proves that MinkLoc3D outperforms current state-of-the-art. Our code is publicly available on the project website: https://github.com/jac99/MinkLoc3D


title: Davydov Splitting, Resonance Effect and Phonon Dynamics in CVD grown Layered MoS2

abstract: We present a comprehensive temperature dependent Raman measurements for horizontally aligned CVD grown layered MoS2 in a temperature range of 4 to 330 K under resonance condition. Our analysis of temperature dependent phonon frequency shift and linewidth suggest a finite role of three and four phonon anharmonic effect. We observed Davydov splitting of the out-of-plane (A1g ) and in-plane (E12g ) modes, attributed to the weak interlayer interaction, and reflected in the appearance of additional modes with decreasing temperature for both 3 layers and few layers system. We also observed that the number of Davydov splitting components are more in few layers as compared to 3L MoS2, suggesting it increases with increasing number of layers. Temperature evaluation of the Raman spectra shows that the Davydov splitting, especially for A1g mode, is very strong and well resolved at low temperature. We note that A1g mode shows splitting at low temperature, while E12g mode is splitted even at room temperature, and that suggests to prominent role of A1g mode to the interlayer interaction. Further, the temperature dependence tuning of resonance effect is observed, via almost sixty fold increase in the intensity of the phonon modes at low temperature.


title: Scalable Approximate Bayesian Computation for Growing Network Models via Extrapolated and Sampled Summaries

abstract: Approximate Bayesian computation (ABC) is a simulation-based likelihood-free method applicable to both model selection and parameter estimation. ABC parameter estimation requires the ability to forward simulate datasets from a candidate model, but because the sizes of the observed and simulated datasets usually need to match, this can be computationally expensive. Additionally, since ABC inference is based on comparisons of summary statistics computed on the observed and simulated data, using computationally expensive summary statistics can lead to further losses in efficiency. ABC has recently been applied to the family of mechanistic network models, an area that has traditionally lacked tools for inference and model choice. Mechanistic models of network growth repeatedly add nodes to a network until it reaches the size of the observed network, which may be of the order of millions of nodes. With ABC, this process can quickly become computationally prohibitive due to the resource intensive nature of network simulations and evaluation of summary statistics. We propose two methodological developments to enable the use of ABC for inference in models for large growing networks. First, to save time needed for forward simulating model realizations, we propose a procedure to extrapolate (via both least squares and Gaussian processes) summary statistics from small to large networks. Second, to reduce computation time for evaluating summary statistics, we use sample-based rather than census-based summary statistics. We show that the ABC posterior obtained through this approach, which adds two additional layers of approximation to the standard ABC, is similar to a classic ABC posterior. Although we deal with growing network models, both extrapolated summaries and sampled summaries are expected to be relevant in other ABC settings where the data are generated incrementally.


title: Two-photon processes in conformal QCD: Resummation of the descendants of leading-twist operators

abstract: Using some techniques of conformal field theories, we find a closed expression for the contribution of leading twist operators and their descendants, obtained by adding total derivatives, to the operator product expansion (OPE) of two electromagnetic currents in QCD. Our expression resums contributions of all twists and to all orders in perturbation theory up to corrections proportional to the QCD $\beta$-function. At tree level and to twist-four accuracy, our result agrees with the expression derived earlier by a different method. The results are directly applicable to deeply-virtual Compton scattering and, e.g., $\gamma\gamma^\ast$ annihilation in two mesons. As a byproduct, we derive a simple representation for the OPE of two scalar currents that is convenient for applications.


title: Coherent Power Scaling in Photonic Crystal Surface Emitting Laser Arrays

abstract: A key benefit of photonic crystal surface emitting lasers (PCSELs) is the abillity to increase output power through scaling the emission area while mainting high quality single mode emission, allowing them to close the brightness gap which exists between semiconductor lasers and gas and fibre lasers. However, there are practical limits to the size, and hence power, of an individual PCSEL device and there are trade-offs between single-mode stability and parasitic in-plane losses with increasing device size. In this paper we discuss 2D coherent arrays as an approach to area and coherent power scaling of PCSELs. We demonstrate in two and three element PCSEL arrays an increase in the differential efficiency of the system due to a reduction in in-plane loss.


title: Generalized max-weight policies in stochastic matching

abstract: We consider a matching system where items arrive one by one at each node of a compatibility network according to Poisson processes and depart from it as soon as they are matched to a compatible item. The matching policy considered is a generalized max-weight policy where decisions can be noisy. Additionally, some of the nodes may have impatience, i.e. leave the system before being matched. Using specific properties of the max-weight policy, we construct several Lyapunov functions, including a simple quadratic one. This allows us to establish stability results, to construct bounds for the stationary mean and variances of the total amount of customers in the system, and to prove exponential convergence speed towards the stationary measure. We finally illustrate some of these results using simulations on toy examples.


title: The Geometry of Special Monoids

abstract: A monoid is said to be special if it admits a presentation in which all defining relations are of the form $w = 1$. Groups are familiar examples of special monoids. This article studies the geometric and structural properties of the Cayley graphs of finitely presented special monoids, building on work by Zhang and Gray-Steinberg. It is shown that the right Cayley graph $\Gamma$ of a special monoid $M$ is a context-free graph, in the sense of Muller & Schupp, if and only if the group of units of $M$ is virtually free. This generalises the geometric aspect of the well-known Muller-Schupp Theorem from groups to special monoids. Furthermore, we completely characterise when the monadic second order theory of $\Gamma$ is decidable: this is precisely when the group of units is virtually free. This completely answers for the class of special monoids a question of Kuske & Lohrey from 2006. As a corollary, we obtain that the rational subset membership problem for $M$ is decidable when the group of units of $M$ is virtually free, extending results of Kambites & Render. We also show that the class of special monoids with virtually free group of units is the same as the class of special monoids with right Cayley graph quasi-isometric to a tree as undirected graphs. The above results are proven by developing two general constructions for graphs which preserve context-freeness, of independent interest. The first takes a context-free graph and constructs a tree of copies of this graph. The second is a bounded determinisation of the resulting tree of copies.


title: Alternative dark matter phenomenology in a general $U(1)_X$ extension of the Standard Model

abstract: The existence of the neutrino mass and flavor mixing have been experimentally verified. These phenomena strongly motivate to extend the Standard Model (SM). Amongst many possibilities, a simple and interesting extension of the SM can be investigated using a general U$(1)_X$ extension of the SM gauge group. Demanding the cancellation of the gauge and mixed gauge gravity anomalies, three right handed neutrinos are introduced in this model where the U$(1)_X$ charge assignment becomes a linear combination of U$(1)_{\rm{B-L}}$ and U$(1)_Y$ hyper-charges. After the U$(1)_X$ breaking, an additional neutral gauge boson, $Z^\prime$ is evolved and the neutrino mass is generated by the seesaw mechanism. In such a model we investigate the properties of a Dark Matter (DM) candidate which is a massive weakly interacting particle and Dirac type in nature. The stability of the DM is protected by its U$(1)_X$ charge. Using the current bounds on the search results of $Z^\prime$ at the Large Hadron Collider (LHC) and the dark matter relic abundance we find a phenomenologically viable parameter space of our scenario.


title: Estimating Linear Mixed Effects Models with Truncated Normally Distributed Random Effects

abstract: Linear Mixed Effects (LME) models have been widely applied in clustered data analysis in many areas including marketing research, clinical trials, and biomedical studies. Inference can be conducted using maximum likelihood approach if assuming Normal distributions on the random effects. However, in many applications of economy, business and medicine, it is often essential to impose constraints on the regression parameters after taking their real-world interpretations into account. Therefore, in this paper we extend the classical (unconstrained) LME models to allow for sign constraints on its overall coefficients. We propose to assume a symmetric doubly truncated Normal (SDTN) distribution on the random effects instead of the unconstrained Normal distribution which is often found in classical literature. With the aforementioned change, difficulty has dramatically increased as the exact distribution of the dependent variable becomes analytically intractable. We then develop likelihood-based approaches to estimate the unknown model parameters utilizing the approximation of its exact distribution. Simulation studies have shown that the proposed constrained model not only improves real-world interpretations of results, but also achieves satisfactory performance on model fits as compared to the existing model.


title: Learning to Localize in New Environments from Synthetic Training Data

abstract: Most existing approaches for visual localization either need a detailed 3D model of the environment or, in the case of learning-based methods, must be retrained for each new scene. This can either be very expensive or simply impossible for large, unknown environments, for example in search-and-rescue scenarios. Although there are learning-based approaches that operate scene-agnostically, the generalization capability of these methods is still outperformed by classical approaches. In this paper, we present an approach that can generalize to new scenes by applying specific changes to the model architecture, including an extended regression part, the use of hierarchical correlation layers, and the exploitation of scale and uncertainty information. Our approach outperforms the 5-point algorithm using SIFT features on equally big images and additionally surpasses all previous learning-based approaches that were trained on different data. It is also superior to most of the approaches that were specifically trained on the respective scenes. We also evaluate our approach in a scenario where only very few reference images are available, showing that under such more realistic conditions our learning-based approach considerably exceeds both existing learning-based and classical methods.


title: Strong first order electroweak phase transition in 2HDM confronting future Z & Higgs factories

abstract: The electroweak phase transition can be made first order by extending the Standard Model (SM) Higgs sector with extra scalars. The same new physics can explain the matter-antimatter asymmetry of the universe by supplying an extra source of CP violation and sphaleron processes. In this paper we study the existence of a strong first order electroweak phase transition (SFOEWPT) in the type-I and type-II two Higgs doublet models (2HDM). We focus on how the SFOEWPT requirement constraints the spectrum of non-SM Higgs. Through a parameter space scan, we find that SFOEWPT suggests upper limits on the masses of heavy Higgs $m_{A/H/H^\pm}$, which is less than 1 TeV. High temperature expansion and Higgs vacuum uplifting is used for an analytical understanding of our results. We also study the probe ability on SFOEWPT from Higgs and $Z$-pole precision measurements at the one-loop level at future Higgs & $Z$ factories. And together with theoretical constraints, sizeable loop corrections require $m_A \approx m_{H^\pm} > m_H$ to meet SFOEWPT condition in Type-II 2HDM.


title: Idealised Turbulent Wake With Steady, Non-Uniform Ambient Density Stratification

abstract: Density stratification in geophysical environments can be non-uniform, particularly in thermohaline staircases and atmospheric layer transitions. Non-uniform stratification, however, is often approximated by the average ambient density change with height. This approximation is frequently made in numerical simulations because it greatly simplifies the calculations. In this paper, direct numerical simulations using $4096 \times 2048 \times 2048$ grid points to resolve an idealised turbulent wake in a non-uniformly stratified fluid are analysed to understand the consequences of assuming linear stratification. For flows with the same average change in density with height, but varied local stratification $d\bar \rho(z)/dz$, flow dynamics are dependent on the ratio $\xi=\delta_{\cal U}/\delta_{\rho}$, where $\delta_{\cal U}$ and $\delta_{\rho}$ are characteristic velocity and density vertical scale heights of the mean flow. Results suggest that a stably stratified flow will demonstrate characteristics similar to nonstratified flow when $\xi > 2$, even though the average stratification is quite strong. In particular, the results show that mixing is enhanced when $\xi > 2$.


title: Learning Autocompletion from Real-World Datasets

abstract: Code completion is a popular software development tool integrated into all major IDEs. Many neural language models have achieved promising results in completion suggestion prediction on synthetic benchmarks. However, a recent study When Code Completion Fails: a Case Study on Real-World Completions demonstrates that these results may not translate to improvements in real-world performance. To combat this effect, we train models on real-world code completion examples and find that these models outperform models trained on committed source code and working version snapshots by 12.8% and 13.8% accuracy respectively. We observe this improvement across modeling technologies and show through A/B testing that it corresponds to a 6.2% increase in programmers' actual autocompletion usage. Furthermore, our study characterizes a large corpus of logged autocompletion usages to investigate why training on real-world examples leads to stronger models.


title: Lagrangian multiforms for Kadomtsev-Petviashvili (KP) and the Gelfand-Dickey hierarchy

abstract: We present, for the first time, a Lagrangian multiform for the complete Kadomtsev-Petviashvili (KP) hierarchy -- a single variational object that generates the whole hierarchy and encapsulates its integrability. By performing a reduction on this Lagrangian multiform, we also obtain Lagrangian multiforms for the Gelfand-Dickey hierarchy of hierarchies, comprising, amongst others, the Korteweg-de Vries and Boussinesq hierarchies.


title: Dynamic sensitivities and Initial Margin via Chebyshev Tensors

abstract: This paper presents how to use Chebyshev Tensors to compute dynamic sensitivities of financial instruments within a Monte Carlo simulation. Dynamic sensitivities are then used to compute Dynamic Initial Margin as defined by ISDA (SIMM). The technique is benchmarked against the computation of dynamic sensitivities obtained by using pricing functions like the ones found in risk engines. We obtain high accuracy and computational gains for FX swaps and Spread Options.


title: Augmenting transferred representations for stock classification

abstract: Stock classification is a challenging task due to high levels of noise and volatility of stocks returns. In this paper we show that using transfer learning can help with this task, by pre-training a model to extract universal features on the full universe of stocks of the S$\&$P500 index and then transferring it to another model to directly learn a trading rule. Transferred models present more than double the risk-adjusted returns than their counterparts trained from zero. In addition, we propose the use of data augmentation on the feature space defined as the output of a pre-trained model (i.e. augmenting the aggregated time-series representation). We compare this augmentation approach with the standard one, i.e. augmenting the time-series in the input space. We show that augmentation methods on the feature space leads to $20\%$ increase in risk-adjusted return compared to a model trained with transfer learning but without augmentation.


title: A first estimate of $\eta/s$ in Au+Au reactions at E$_{\rm lab}=1.23$ $A$GeV

abstract: The HADES experiment at GSI has recently provided data on the flow coefficients $v_1,...,v_4$ for protons in Au+Au reactions at $E_{\rm lab} = 1.23$~$A$GeV (or $\sqrt{s_\mathrm{NN}}=2.4$ GeV). This data allows to estimate the shear viscosity over entropy ratio, $\eta/s$ at low energies via a coarse graining analysis of the UrQMD transport simulations of the flow harmonics in comparison to the experimental data. By this we can provide for the first time an estimate of $\eta/s\approx0.65\pm0.15$ (or $(8\pm2)\,(4\pi)^{-1}$) at such low energies.


title: Data Augmentation For Children's Speech Recognition -- The "Ethiopian" System For The SLT 2021 Children Speech Recognition Challenge

abstract: This paper presents the "Ethiopian" system for the SLT 2021 Children Speech Recognition Challenge. Various data processing and augmentation techniques are proposed to tackle children's speech recognition problem, especially the lack of the children's speech recognition training data issue. Detailed experiments are designed and conducted to show the effectiveness of each technique, across different speech recognition toolkits and model architectures. Step by step, we explain how we come up with our final system, which provides the state-of-the-art results in the SLT 2021 Children Speech Recognition Challenge, with 21.66% CER on the Track 1 evaluation set (4th place overall), and 16.53% CER on the Track 2 evaluation set (1st place overall). Post-challenge analysis shows that our system actually achieves 18.82% CER on the Track 1 evaluation set, but we submitted the wrong version to the challenge organizer for Track 1.


title: Artificial Intelligence Decision Support for Medical Triage

abstract: Applying state-of-the-art machine learning and natural language processing on approximately one million of teleconsultation records, we developed a triage system, now certified and in use at the largest European telemedicine provider. The system evaluates care alternatives through interactions with patients via a mobile application. Reasoning on an initial set of provided symptoms, the triage application generates AI-powered, personalized questions to better characterize the problem and recommends the most appropriate point of care and time frame for a consultation. The underlying technology was developed to meet the needs for performance, transparency, user acceptance and ease of use, central aspects to the adoption of AI-based decision support systems. Providing such remote guidance at the beginning of the chain of care has significant potential for improving cost efficiency, patient experience and outcomes. Being remote, always available and highly scalable, this service is fundamental in high demand situations, such as the current COVID-19 outbreak.


title: A note on discrete Heisenberg uniqueness pairs for the parabola

abstract: We discuss on Heisenberg uniqueness pairs for the parabola given by discrete sequences along straight lines. Our method consists in linking the problem at hand with recent uniqueness results for the Fourier transform.


title: Uniqueness Criteria for the Fock Quantization of Dirac Fields and Applications in Hybrid Loop Quantum Cosmology

abstract: In generic curved spacetimes, the unavailability of a natural choice of vacuum state introduces a serious ambiguity in the Fock quantization of fields. In this review, we study the case of fermions described by a Dirac field in several cosmological spacetimes, and present recent results about well-motivated criteria that ensure the uniqueness in the selection of a vacuum up to unitary transformations. These criteria are based on two requirements. First, the invariance of the vacuum under the symmetries of the Dirac equations in the considered spacetime. Second, the unitary implementability of the Heisenberg dynamics of the annihilation and creation operators when the curved spacetime is treated as a fixed background. This last requirement not only permits the uniqueness of the Fock quantization but, remarkably, it also determines an essentially unique splitting between the phase space variables assigned to the background and the fermionic annihilation and creation variables. We first consider Dirac fields in cosmological spacetimes of 2+1 dimensions and then discuss the more relevant case of 3+1 dimensions. We use this analysis to investigate the hybrid loop quantization of a flat Friedmann-Lema\^itre-Robertson-Walker background cosmology coupled to a perturbative Dirac field. Among the Fock quantizations for the fermionic perturbations allowed by our criteria, we further restrict the choice of vacuum by demanding a finite fermionic backreaction and, moreover, by diagonalizing the fermionic contribution to the total Hamiltonian in the asymptotic limit of large wave numbers of the Dirac modes. Finally, we argue in support of the uniquess of the vacuum state selected by the extension of this diagonalization condition beyond the ultraviolet regime, proving that it picks out the standard Poincar\'e and Bunch-Davies vacua for fixed flat and de Sitter background spacetimes, respectively.


title: Think Global, Act Local: Gossip and Client Audits in Verifiable Data Structures

abstract: In recent years, there has been increasing recognition of the benefits of having services provide auditable logs of data, as demonstrated by the deployment of Certificate Transparency and the development of other transparency projects. Most proposed systems, however, rely on a gossip protocol by which users can be assured that they have the same view of the log, but the few gossip protocols that do exist today are not suited for near-term deployment. Furthermore, they assume the presence of global sets of auditors, who must be blindly trusted to correctly perform their roles, in order to achieve their stated transparency goals. In this paper, we address both of these issues by proposing a gossip protocol and a verifiable registry, Mog, in which users can perform their own auditing themselves. We prove the security of our protocols and demonstrate via experimental evaluations that they are performant in a variety of potential near-term deployments.


title: Exterior-point Optimization for Sparse and Low-rank Optimization

abstract: Many problems of substantial current interest in machine learning, statistics, and data science can be formulated as sparse and low-rank optimization problems. In this paper, we present the nonconvex exterior-point optimization solver NExOS -- a first-order algorithm tailored to sparse and low-rank optimization problems. We consider the problem of minimizing a convex function over a nonconvex constraint set, where the set can be decomposed as the intersection of a compact convex set and a nonconvex set involving sparse or low-rank constraints. Unlike the convex relaxation approaches, NExOS finds a locally optimal point of the original problem by solving a sequence of penalized problems with strictly decreasing penalty parameters by exploiting the nonconvex geometry. NExOS solves each penalized problem by applying a first-order algorithm, which converges linearly to a local minimum of the corresponding penalized formulation under regularity conditions. Furthermore, the local minima of the penalized problems converge to a local minimum of the original problem as the penalty parameter goes to zero. We then implement and test NExOS on many instances from a wide variety of sparse and low-rank optimization problems, empirically demonstrating that our algorithm outperforms specialized methods.


title: Triangular research and innovation collaborations in the European area

abstract: In the current study, we examine the multiplex network of patents and European Framework Programmes (FPs) aiming to uncover temporal variations in the formation patterns of triangles (a fully connected network between any three nodes). More specifically, the multiplex network consists of two layers whose nodes are the NUTS2 regions. On the first layer we depict the regions of the inventors that collaborated for the creation of a patent, and on the second those of the scientists in European Framework Programme (FP) funded projects. A link between two nodes exists when scientists or inventors from different regions collaborate. We split the network temporally into 28 shorter sub-networks with a span of 6 years each, and calculate the number of triangles formed at the end of the 6-year period. Next, we shuffle the data creating again 28 six-year randomized networks, in order to identify whether there is a hidden mechanism that favors a non-random behavior. Real and shuffled data are compared using a z-score, a measure of the differences of standard deviations between them. In addition, we repeat the same analysis using the clustering coefficient, which is the number of triangles over the number of triples (possible triangles). The results show that triangular FP collaborations tend to be favored over random ones, while in patents the case is strongly the opposite. Furthermore, results using triangles tend to be more comprehensive as opposed to those of the clustering coefficient. Finally, we identify which NUTS2 regions frequently exhibit a high clustering coefficient in either of the layers, and we present a map with these values for all regions. The results of this research can help policy making organizations understand the spatial dimension of subsidized research and patented innovation collaboration networks.


title: Refer, Reuse, Reduce: Generating Subsequent References in Visual and Conversational Contexts

abstract: Dialogue participants often refer to entities or situations repeatedly within a conversation, which contributes to its cohesiveness. Subsequent references exploit the common ground accumulated by the interlocutors and hence have several interesting properties, namely, they tend to be shorter and reuse expressions that were effective in previous mentions. In this paper, we tackle the generation of first and subsequent references in visually grounded dialogue. We propose a generation model that produces referring utterances grounded in both the visual and the conversational context. To assess the referring effectiveness of its output, we also implement a reference resolution system. Our experiments and analyses show that the model produces better, more effective referring utterances than a model not grounded in the dialogue context, and generates subsequent references that exhibit linguistic patterns akin to humans.


title: Multi-Agent Reinforcement Learning for Channel Assignment and Power Allocation in Platoon-Based C-V2X Systems

abstract: We consider the problem of joint channel assignment and power allocation in underlaid cellular vehicular-to-everything (C-V2X) systems where multiple vehicle-to-network (V2N) uplinks share the time-frequency resources with multiple vehicle-to-vehicle (V2V) platoons that enable groups of connected and autonomous vehicles to travel closely together. Due to the nature of high user mobility in vehicular environment, traditional centralized optimization approach relying on global channel information might not be viable in C-V2X systems with large number of users. Utilizing a multi-agent reinforcement learning (RL) approach, we propose a distributed resource allocation (RA) algorithm to overcome this challenge. Specifically, we model the RA problem as a multi-agent system. Based solely on the local channel information, each platoon leader, acting as an agent, collectively interacts with each other and accordingly selects the optimal combination of sub-band and power level to transmit its signals. Toward this end, we utilize the double deep Q-learning algorithm to jointly train the agents under the objectives of simultaneously maximizing the sum-rate of V2N links and satisfying the packet delivery probability of each V2V link in a desired latency limitation. Simulation results show that our proposed RL-based algorithm provides a close performance compared to that of the well-known exhaustive search algorithm.


title: Masked Face Image Classification with Sparse Representation based on Majority Voting Mechanism

abstract: Sparse approximation is the problem to find the sparsest linear combination for a signal from a redundant dictionary, which is widely applied in signal processing and compressed sensing. In this project, I manage to implement the Orthogonal Matching Pursuit (OMP) algorithm and Sparse Representation-based Classification (SRC) algorithm, then use them to finish the task of masked image classification with majority voting. Here the experiment was token on the AR data-set, and the result shows the superiority of OMP algorithm combined with SRC algorithm over masked face image classification with an accuracy of 98.4%.


title: Absorption-selected galaxies trace the low-mass, late-type, star-forming population at $z\sim2-3$

abstract: We report on the stellar content, half-light radii and star formation rates of a sample of 10 known high-redshift ($z\gtrsim 2$) galaxies selected on strong neutral hydrogen (HI) absorption (log(N(HI)/cm$^{-2})>19$) toward background quasars. We use observations from the {\it Hubble Space Telescope} (HST) Wide Field Camera 3 in three broad-band filters to study the spectral energy distribution(SED) of the galaxies. Using careful quasar point spread function subtraction, we study their galactic environments, and perform the first systematic morphological characterisation of such absorption-selected galaxies at high redshifts. Our analysis reveals complex, irregular hosts with multiple star-forming clumps. At a spatial sampling of 0.067 arcsec per pixel (corresponding to 0.55 kpc at the median redshift of our sample), 40% of our sample requires multiple S\'ersic components for an accurate modelling of the observed light distributions. Placed on the mass-size relation and the `main sequence' of star-forming galaxies, we find that absorption-selected galaxies at high redshift extend known relations determined from deep luminosity-selected surveys to an order of magnitude lower stellar mass, with objects primarily composed of star-forming, late-type galaxies. We measure half-light radii in the range $r_{1/2} \sim$ 0.4 to 2.6 kpc based on the reddest band (F160W) to trace the oldest stellar populations, and stellar masses in the range $\log (\mathrm{M}_{\star}/\mathrm{M}_{\odot}) \sim$ 8 to 10 derived from fits to the broad-band SED. Spectroscopic and SED-based star formation rates are broadly consistent, and lie in the range log(SFR/M$_{\odot} $yr$^{-1}$) $\sim$0.0 to 1.7.


title: Spectral clustering on spherical coordinates under the degree-corrected stochastic blockmodel

abstract: Spectral clustering is a popular method for community detection in network graphs: starting from a matrix representation of the graph, the nodes are clustered on a low dimensional projection obtained from a truncated spectral decomposition of the matrix. Estimating correctly the number of communities and the dimension of the reduced latent space is critical for good performance of spectral clustering algorithms. Furthermore, many real-world graphs, such as enterprise computer networks studied in cyber-security applications, often display heterogeneous within-community degree distributions. Such heterogeneous degree distributions are usually not well captured by standard spectral clustering algorithms. In this article, a novel spectral clustering algorithm is proposed for community detection under the degree-corrected stochastic blockmodel. The proposed method is based on a transformation of the spectral embedding to spherical coordinates, and a novel modelling assumption in the transformed space. The method allows for simultaneous and automated selection of the number of communities and the latent dimension for spectral embeddings of graphs with uneven node degrees. Results show improved performance over competing methods in representing computer networks.


title: Hybrid Loop Quantum Cosmology: An Overview

abstract: Loop Quantum Gravity is a nonperturbative and background independent program for the quantization of General Relativity. Its underlying formalism has been applied successfully to the study of cosmological spacetimes, both to test the principles and techniques of the theory and to discuss its physical consequences. These applications have opened a new area of research known as Loop Quantum Cosmology. The hybrid approach addresses the quantization of cosmological systems that include fields. This proposal combines the description of a finite number of degrees of freedom using Loop Quantum Cosmology, typically corresponding to a homogeneous background, and a Fock quantization of the field content of the model. In this review we first present a summary of the foundations of homogeneous Loop Quantum Cosmology and we then revisit the hybrid quantization approach, applying it to the study of Gowdy spacetimes with linearly polarized gravitational waves on toroidal spatial sections, and to the analysis of cosmological perturbations in preinflationary and inflationary stages of the Universe. The main challenge is to extract predictions about quantum geometry effects that eventually might be confronted with cosmological observations. This is the first extensive review of the hybrid approach in the literature on Loop Quantum Cosmology.


title: Non-Abelian Quantum Transport and Thermosqueezing Effects

abstract: Modern quantum experiments provide examples of transport with non-commuting quantities, offering a tool to understand the interplay between thermal and quantum effects. Here we set forth a theory for non-Abelian transport in the linear response regime. Our key insight is to use generalized Gibbs ensembles with non-commuting charges as the basic building blocks and strict charge-preserving unitaries in a collisional setup. The linear response framework is then built using a collisional model between two reservoirs. We show that the transport coefficients obey Onsager reciprocity. Moreover, we find that quantum coherence, associated to the non-commutativity, acts so as to reduce the net entropy production, when compared to the case of commuting transport. This therefore provides a clear connection between quantum coherent transport and dissipation. As an example, we study heat and squeezing fluxes in bosonic systems, characterizing a set of thermosqueezing coefficients with potential applications in metrology and heat-to-work conversion in the quantum regime.


title: Universal conductance of a PT-symmetric Luttinger liquid after a quantum quench

abstract: We study the non-equilibrium dynamics and transport of a PT-symmetric Luttinger liquid (LL) after an interaction quench. The system is prepared in domain wall initial state. After a quantum quench to spatially homogeneous, PT-symmetric LL, the domain wall develops into a flat central region that spreads out ballistically faster than the conventional Lieb-Robinson maximal speed. By evaluating the current inside the regular lightcone, we find a universal conductance $e^2/h$, insensitive to the strength of the PT-symmetric interaction. On the other hand, by repeating the very same time evolution with a hermitian LL Hamiltonian, the conductance is heavily renormalized by the hermitian interaction as $e^2/hK$ with $K$ the LL parameter. Our analytical results are tested numerically, confirming the universality of the conductance in the non-hermitian realm.


title: On proportional volume sampling for experimental design in general spaces

abstract: Optimal design for linear regression is a fundamental task in statistics. For finite design spaces, recent progress has shown that random designs drawn using proportional volume sampling (PVS) lead to approximation guarantees for A-optimal design. PVS strikes the balance between design nodes that jointly fill the design space, while marginally staying in regions of high mass under the solution of a relaxed convex version of the original problem. In this paper, we examine some of the statistical implications of a new variant of PVS for (possibly Bayesian) optimal design. Using point process machinery, we treat the case of a generic Polish design space. We show that not only are the A-optimality approximation guarantees preserved, but we obtain similar guarantees for D-optimal design that tighten recent results. Moreover, we show that PVS can be sampled in polynomial time. Unfortunately, in spite of its elegance and tractability, we demonstrate on a simple example that the practical implications of general PVS are likely limited. In the second part of the paper, we focus on applications and investigate the use of PVS as a subroutine for stochastic search heuristics. We demonstrate that PVS is a robust addition to the practitioner's toolbox, especially when the regression functions are nonstandard and the design space, while low-dimensional, has a complicated shape (e.g., nonlinear boundaries, several connected components).


title: On random convex chains, orthogonal polynomials, PF sequences and probabilistic limit theorems

abstract: Let $T$ be the triangle in the plane with vertices $(0,0)$, $(0,1)$ and $(0,1)$. The convex hull of $(0,1)$, $(1,0)$ and $n$ independent random points uniformly distributed in $T$ is the random convex chain $T_n$. A three-term recursion for the probability generating function $G_n$ of the number $f_0(T_n)$ of vertices of $T_n$ is proved. Via the link to orthogonal polynomials it is shown that $G_n$ has precisely $n$ distinct real roots in $(-\infty,0]$ and that the sequence $p_k^{(n)}:=\mathbb{P}(f_0(T_n)=k)$, $k=1,\ldots,n$, is a Polya frequency (PF) sequence. A selection of probabilistic consequences of this surprising and remarkable fact are discussed in detail.


title: Reduced-Rank Regression with Operator Norm Error

abstract: A common data analysis task is the reduced-rank regression problem: $$\min_{\textrm{rank-}k \ X} \|AX-B\|,$$ where $A \in \mathbb{R}^{n \times c}$ and $B \in \mathbb{R}^{n \times d}$ are given large matrices and $\|\cdot\|$ is some norm. Here the unknown matrix $X \in \mathbb{R}^{c \times d}$ is constrained to be of rank $k$ as it results in a significant parameter reduction of the solution when $c$ and $d$ are large. In the case of Frobenius norm error, there is a standard closed form solution to this problem and a fast algorithm to find a $(1+\varepsilon)$-approximate solution. However, for the important case of operator norm error, no closed form solution is known and the fastest known algorithms take singular value decomposition time. We give the first randomized algorithms for this problem running in time $$(nnz{(A)} + nnz{(B)} + c^2) \cdot k/\varepsilon^{1.5} + (n+d)k^2/\epsilon + c^{\omega},$$ up to a polylogarithmic factor involving condition numbers, matrix dimensions, and dependence on $1/\varepsilon$. Here $nnz{(M)}$ denotes the number of non-zero entries of a matrix $M$, and $\omega$ is the exponent of matrix multiplication. As both (1) spectral low rank approximation ($A = B$) and (2) linear system solving ($n = c$ and $d = 1$) are special cases, our time cannot be improved by more than a $1/\varepsilon$ factor (up to polylogarithmic factors) without a major breakthrough in linear algebra. Interestingly, known techniques for low rank approximation, such as alternating minimization or sketch-and-solve, provably fail for this problem. Instead, our algorithm uses an existential characterization of a solution, together with Krylov methods, low degree polynomial approximation, and sketching-based preconditioning.


title: Nondegenerate Neural Codes and Obstructions to Closed-Convexity

abstract: Previous work on convexity of neural codes has produced codes that are open-convex but not closed-convex -- or vice-versa. However, why a code is one but not the other, and how to detect such discrepancies are open questions. We tackle these questions in two ways. First, we investigate the concept of degeneracy introduced by Cruz et al., and extend their results to show that nondegeneracy precisely captures the situation when taking closures or interiors of open or closed realizations, respectively, yields another realization of the code. Second, we give the first general criteria for precluding a code from being closed-convex (without ruling out open-convexity), unifying ad-hoc geometric arguments in prior works. One criterion is built on a phenomenon we call a rigid structure, while the other can be stated algebraically, in terms of the neural ideal of the code. These results complement existing criteria having the opposite purpose: precluding open-convexity but not closed-convexity. Finally, we show that a family of codes shown by Jeffs to be not open-convex is in fact closed-convex and realizable in dimension two.


title: MPRNet: Multi-Path Residual Network for Lightweight Image Super Resolution

abstract: Lightweight super resolution networks have extremely importance for real-world applications. In recent years several SR deep learning approaches with outstanding achievement have been introduced by sacrificing memory and computational cost. To overcome this problem, a novel lightweight super resolution network is proposed, which improves the SOTA performance in lightweight SR and performs roughly similar to computationally expensive networks. Multi-Path Residual Network designs with a set of Residual concatenation Blocks stacked with Adaptive Residual Blocks: ($i$) to adaptively extract informative features and learn more expressive spatial context information; ($ii$) to better leverage multi-level representations before up-sampling stage; and ($iii$) to allow an efficient information and gradient flow within the network. The proposed architecture also contains a new attention mechanism, Two-Fold Attention Module, to maximize the representation ability of the model. Extensive experiments show the superiority of our model against other SOTA SR approaches.


title: FPGA-based Hyrbid Memory Emulation System

abstract: Hybrid memory systems, comprised of emerging non-volatile memory (NVM) and DRAM, have been proposed to address the growing memory demand of applications. Emerging NVM technologies, such as phase-change memories (PCM), memristor, and 3D XPoint, have higher capacity density, minimal static power consumption and lower cost per GB. However, NVM has longer access latency and limited write endurance as opposed to DRAM. The different characteristics of two memory classes point towards the design of hybrid memory systems containing multiple classes of main memory. In the iterative and incremental development of new architectures, the timeliness of simulation completion is critical to project progression. Hence, a highly efficient simulation method is needed to evaluate the performance of different hybrid memory system designs. Design exploration for hybrid memory systems is challenging, because it requires emulation of the full system stack, including the OS, memory controller, and interconnect. Moreover, benchmark applications for memory performance test typically have much larger working sets, thus taking even longer simulation warm-up period. In this paper, we propose a FPGA-based hybrid memory system emulation platform. We target at the mobile computing system, which is sensitive to energy consumption and is likely to adopt NVM for its power efficiency. Here, because the focus of our platform is on the design of the hybrid memory system, we leverage the on-board hard IP ARM processors to both improve simulation performance while improving accuracy of the results. Thus, users can implement their data placement/migration policies with the FPGA logic elements and evaluate new designs quickly and effectively. Results show that our emulation platform provides a speedup of 9280x in simulation time compared to the software counterpart Gem5.


title: Musical analysis of Stravinski's "The Rite of Spring" based on computational methods

abstract: Stravinski's "The Rite of Spring" is one of the most well-known pieces from the classical contemporary music repertoire. However, its analysis has aroused different opinions within its construction and compositional foundations. In this sense, I here proposed my own manual analysis and a computational approach which aims to find a similar analysis, giving the opportunity of discovering new possible points of view and supplying the current deficiencies of the Musi"c Computing common analysis systems.


title: Informed Source Extraction With Application to Acoustic Echo Reduction

abstract: Informed speaker extraction aims to extract a target speech signal from a mixture of sources given prior knowledge about the desired speaker. Recent deep learning-based methods leverage a speaker discriminative model that maps a reference snippet uttered by the target speaker into a single embedding vector that encapsulates the characteristics of the target speaker. However, such modeling deliberately neglects the time-varying properties of the reference signal. In this work, we assume that a reference signal is available that is temporally correlated with the target signal. To take this correlation into account, we propose a time-varying source discriminative model that captures the temporal dynamics of the reference signal. We also show that existing methods and the proposed method can be generalized to non-speech sources as well. Experimental results demonstrate that the proposed method significantly improves the extraction performance when applied in an acoustic echo reduction scenario.


title: Maximal Speed of Quantum Propagation

abstract: For Schroedinger equations with both time-independent and time-dependent Kato potentials, we give a simple proof of the maximal speed bound. The latter states that the probability to find the quantum system outside the ball of radius proportional to the time lapsed decays as an inverse power of time. We give an explicit expression for the constant of proportionality in terms of the maximal energy available to the initial condition. For the time-independent part of the interaction, we require neither decay at infinity nor smoothness.


title: Nanoantennas Design for THz Communication: Material Selection and Performance Enhancement

abstract: In the development of terahertz (THz) communication systems, the nanoantenna is the most significant component. Especially, the focus is to design highly directive antennas, because it enhances the performance of the overall system by compensating the large path loss at THz and thus improves the signal-to-noise ratio. This paper presents suitable material for nanoantenna design and the advancement in their performance for THz communications. Copper, Graphene, and carbon nanotube materials are used as promising candidates for nanoantenna design. The performance of nanoantennas is carried out by analyzing the properties and behavior of the material at THz. Results show that the Graphene nanoantenna provides better performance in terms of miniaturization, directivity, and radiation efficiency. Further, the performance enhancement of the nanoantenna at THz is studied by dynamically adjusting the surface conductivity via the chemical potential of Graphene using the electric field effect. The performance of the nanoantenna is enhanced in terms of high miniaturization, high directivity, low reflection, frequency reconfiguration, and stable impedance. The THz nanoantennas using Graphene have the potential to be used for THz communication systems. In view of the smart THz wireless environment; this paper finally presents a THz Hypersurface using Graphene meta-atoms. The user-side Graphene nanoantennas and environment-side Graphene Hypersurface can build a promising smart THz wireless environment.


title: Noise sensitivity of percolation via differential inequalities

abstract: Consider critical Bernoulli percolation in the plane. We give a new proof of the sharp noise sensitivity theorem shown by Garban, Pete and Schramm. Contrary to the previous approaches, we do not use any spectral tool. We rather study differential inequalities satisfied by a dynamical four-arm event, in the spirit of Kesten's proof of scaling relations. We also obtain new results in dynamical percolation. In particular, we prove that the Hausdorff dimension of the set of times with both primal and dual percolation equals $2/3$ a.s.


title: Parameterized Explainer for Graph Neural Network

abstract: Despite recent progress in Graph Neural Networks (GNNs), explaining predictions made by GNNs remains a challenging open problem. The leading method independently addresses the local explanations (i.e., important subgraph structure and node features) to interpret why a GNN model makes the prediction for a single instance, e.g. a node or a graph. As a result, the explanation generated is painstakingly customized for each instance. The unique explanation interpreting each instance independently is not sufficient to provide a global understanding of the learned GNN model, leading to a lack of generalizability and hindering it from being used in the inductive setting. Besides, as it is designed for explaining a single instance, it is challenging to explain a set of instances naturally (e.g., graphs of a given class). In this study, we address these key challenges and propose PGExplainer, a parameterized explainer for GNNs. PGExplainer adopts a deep neural network to parameterize the generation process of explanations, which enables PGExplainer a natural approach to explaining multiple instances collectively. Compared to the existing work, PGExplainer has better generalization ability and can be utilized in an inductive setting easily. Experiments on both synthetic and real-life datasets show highly competitive performance with up to 24.7\% relative improvement in AUC on explaining graph classification over the leading baseline.


title: Response to "Comment on Universal Lindblad Equation for open quantum systems"

abstract: In a recent comment, Lee and Yeo show that the Gibbs state is not generically an exact steady state of the Universal Lindblad Equation (ULE) that we developed in Phys. Rev. B 102, 115109 (2020). This non-controversial observation is precisely as expected for open quantum systems with finite system-bath coupling, where transition rates may be comparable to or larger than the level spacing of the system, and we made no claim to the contrary in our paper. The comment by Lee and Yeo hence highlights that the ULE captures contributions to the steady state due to finite system-bath coupling that are beyond the reach of master equations that rely on rotating wave approximations. In this response we further clarify the nature of our analytical and numerical results.


title: Relation between charging times and storage properties of nanoporous supercapacitors

abstract: Investigating the correlations between dynamic and static storage properties of nanoporous electrodes is beneficial for further progress of supercapacitors-based technologies. While the dependence of the capacitance on the pores' sizes is well described by classical Density Functional Theory (c-DFT), the lack of dynamic c-DFT extension capable for correct estimation of the charging time has been noted in the literature. Here, we develop a dynamic model of the electrolyte inside nanopores based on c-DFT and realistically describing both the time-dependent charging process and maximum static capacitance. Our calculations show that the charging starts with a square-root dependency of the total charge on time and then follows two subsequent exponential trends with significantly different time scales that agree with published simulations. We demonstrate that the full charging time corresponds to the timescale of either the first or the second exponential trend depending on the pores' size. Also, we find analytical expressions to fit the timescales for a wide range of parameters. Derived correlations provide the relation of charging time to pores' size, applied voltage, and final ions' densities inside the pore, making these expressions useful to design supercapacitors with an optimal combination of power and energy characteristics.


title: Distributed Design of Glocal Controllers via Hierarchical Model Decomposition

abstract: This paper proposes a distributed design method of controllers having a glocal (global/local) information structure for large-scale network systems. Distributed design, independent design of all subcontrollers that constitute a structured controller, facilitates scalable controller synthesis. While existing distributed design methods confine attention to the decentralized or distributed information structures, this study addresses distributed design of glocal-structured controllers. Glocal control exploits the nature that network system's behavior can typically be represented as a superposition of spatially local fluctuations and global interarea oscillations by incorporating a global coordinating subcontroller with local decentralized subcontrollers. The key idea to distributed design of glocal controllers is to represent the original network system as a hierarchical cascaded system composed of reduced-order models representing the global and local dynamics, referred to as hierarchical model decomposition. Distributed design is achieved by independently designing and implementing subcontrollers for the reduced-order models while preserving the cascade structure. This paper provides a condition for existence of the hierarchical model decomposition, a specific representation of the hierarchical system, a clustering method appropriate for the proposed approach, and a robust extension. Numerical examples of a power grid evidence the practical relevance of the proposed method.


title: Sparse time-varying parameter VECMs with an application to modeling electricity prices

abstract: In this paper we propose a time-varying parameter (TVP) vector error correction model (VECM) with heteroskedastic disturbances. We propose tools to carry out dynamic model specification in an automatic fashion. This involves using global-local priors, and postprocessing the parameters to achieve truly sparse solutions. Depending on the respective set of coefficients, we achieve this via minimizing auxiliary loss functions. Our two-step approach limits overfitting and reduces parameter estimation uncertainty. We apply this framework to modeling European electricity prices. When considering daily electricity prices for different markets jointly, our model highlights the importance of explicitly addressing cointegration and nonlinearities. In a forecast exercise focusing on hourly prices for Germany, our approach yields competitive metrics of predictive accuracy.


title: Origins of size effects in initially dislocation-free single-crystal metallic micro- and nanocubes

abstract: We report phenomenal yield strengths, up to one fourth of the theoretical strength of silver, recorded in microcompression testing of initially dislocation free silver micro and nanocubes synthesized from a multistep seed growth process. These high strengths and the massive strain bursts that occur upon yield are results of the initially dislocation free single crystal structure of the pristine samples that yield through spontaneous nucleation of dislocations. When the pristine samples are exposed to a focused ion beam to fabricate pillars and then compressed, the dramatic strain burst does not occur, and they yield at a quarter of the strength of their pristine counterparts. Regardless of the defect state of the samples prior to testing, a size effect is apparent, where the yield strength increases as the sample size decreases. Since dislocation starvation and the single arm source mechanisms cannot explain a size effect on yield strength in dislocation free samples, we investigate the dislocation nucleation mechanisms controlling the size effect through careful experimental observations and molecular statics simulations. We find that intrinsic or extrinsic symmetry breakers such as surface defects, edge roundness, external sample shape, or a high vacancy concentration can influence dislocation nucleation, and thus contribute to the size effect on yield strength in initially dislocation-free samples.


title: Piezoelectric networks and ferroelectric moir\'e superlattice domains in twistronic WS$_2$/MoS$_2$ and WSe$_2$/MoSe$_2$ bilayers

abstract: Twistronic van der Waals heterostrutures offer exciting opportunities for engineering optoelectronic properties of nanomaterials. Here, we use multiscale modeling to study trapping of charge carriers and excitons by ferroelectric polarisation and piezoelectric charges by domain structures in twistronic WX$_2$/MoX$_2$ bilayers (X=S,Se). For almost aligned 2H-type bilayers, we find that holes and electrons are trapped in the opposite -- WMo and XX (tungsten over molybdenum {\it versus} overlaying chalcogens) -- corners of the honeycomb domain wall network, swapping their position at a twist angle $0.2^{\circ}$, with XX corners providing $30$\,meV deep traps for the interlayer excitons for all angles. In 3R-type bilayers, both electrons and holes are trapped in triangular "3R stacking" domains, where WX$_2$ chalcogens set over MoX$_2$ molybdenums, which act as $130$\,meV deep quantum boxes for interlayer excitons for twist angles $\lesssim 1^{\circ}$, for larger angles shifting towards domain wall network XX stacking sites.


title: A Field-Theoretic Model for Chemotaxis in Run and Tumble Particles

abstract: In this paper we develop a field-theoretic description for run and tumble chemotaxis, based on a density functional description of crystalline materials modified to capture orientational ordering. We show that this framework, with its in-built multi-particle interactions, soft-core repulsion and elasticity is ideal for describing continuum collective phases with particle resolution, but on diffusive timescales. We show that our model exhibits particle aggregation in an externally imposed constant attractant field, as is observed for phototactic or thermotactic agents. We also show that this model captures particle aggregation through self-chemotaxis, an important mechanism that aids quorum dependent cellular interactions.


title: Context-Bounded Verification of Liveness Properties for Multithreaded Shared-Memory Programs

abstract: We study context-bounded verification of liveness properties of multi-threaded, shared-memory programs, where each thread can spawn additional threads. Our main result shows that context-bounded fair termination is decidable for the model; context-bounded implies that each spawned thread can be context switched a fixed constant number of times. Our proof is technical, since fair termination requires reasoning about the composition of unboundedly many threads each with unboundedly large stacks. In fact, techniques for related problems, which depend crucially on replacing the pushdown threads with finite-state threads, are not applicable. Instead, we introduce an extension of vector addition systems with states (VASS), called VASS with balloons (VASSB), as an intermediate model; it is an infinite-state model of independent interest. A VASSB allows tokens that are themselves markings (balloons). We show that context bounded fair termination reduces to fair termination for VASSB. We show the latter problem is decidable by showing a series of reductions: from fair termination to configuration reachability for VASSB and thence to the reachability problem for VASS. For a lower bound, fair termination is known to be non-elementary already in the special case where threads run to completion (no context switches). We also show that the simpler problem of context-bounded termination is 2EXPSPACE-complete, matching the complexity bound---and indeed the techniques---for safety verification. Additionally, we show the related problem of fair starvation, which checks if some thread can be starved along a fair run, is also decidable in the context-bounded case. The decidability employs an intricate reduction from fair starvation to fair termination. Like fair termination, this problem is also non-elementary.


title: Single- to many-body crossover of a quantum carpet

abstract: Strongly interacting many-body system of bosons exhibiting the quantum carpet pattern is investigated exactly by using Gaudin solutions. We show that this highly coherent design usually present in noninteracting, single-body scenarios gets destroyed by weak-to-moderate interatomic interactions in an ultracold bosonic gas trapped in a box potential. However, it becomes revived in a very strongly interacting regime, when the system undergoes fermionization. We track the whole single- to many-body crossover, providing an analysis of de- and rephasing present in the system.


title: Neural Spatio-Temporal Point Processes

abstract: We propose a new class of parameterizations for spatio-temporal point processes which leverage Neural ODEs as a computational method and enable flexible, high-fidelity models of discrete events that are localized in continuous time and space. Central to our approach is a combination of continuous-time neural networks with two novel neural architectures, i.e., Jump and Attentive Continuous-time Normalizing Flows. This approach allows us to learn complex distributions for both the spatial and temporal domain and to condition non-trivially on the observed event history. We validate our models on data sets from a wide variety of contexts such as seismology, epidemiology, urban mobility, and neuroscience.


title: Interpretable, calibrated neural networks for analysis and understanding of inelastic neutron scattering data

abstract: Deep neural networks provide flexible frameworks for learning data representations and functions relating data to other properties and are often claimed to achieve 'super-human' performance in inferring relationships between input data and desired property. In the context of inelastic neutron scattering experiments, however, as in many other scientific scenarios, a number of issues arise: (i) scarcity of labelled experimental data, (ii) lack of uncertainty quantification on results, and (iii) lack of interpretability of the deep neural networks. In this work we examine approaches to all three issues. We use simulated data to train a deep neural network to distinguish between two possible magnetic exchange models of a half-doped manganite. We apply the recently developed deterministic uncertainty quantification method to provide error estimates for the classification, demonstrating in the process how important realistic representations of instrument resolution in the training data are for reliable estimates on experimental data. Finally we use class activation maps to determine which regions of the spectra are most important for the final classification result reached by the network.


title: Bayesian Reconstruction of Fourier Pairs

abstract: In a number of data-driven applications such as detection of arrhythmia, interferometry or audio compression, observations are acquired indistinctly in the time or frequency domains: temporal observations allow us to study the spectral content of signals (e.g., audio), while frequency-domain observations are used to reconstruct temporal/spatial data (e.g., MRI). Classical approaches for spectral analysis rely either on i) a discretisation of the time and frequency domains, where the fast Fourier transform stands out as the \textit{de facto} off-the-shelf resource, or ii) stringent parametric models with closed-form spectra. However, the general literature fails to cater for missing observations and noise-corrupted data. Our aim is to address the lack of a principled treatment of data acquired indistinctly in the temporal and frequency domains in a way that is robust to missing or noisy observations, and that at the same time models uncertainty effectively. To achieve this aim, we first define a joint probabilistic model for the temporal and spectral representations of signals, to then perform a Bayesian model update in the light of observations, thus jointly reconstructing the complete (latent) time and frequency representations. The proposed model is analysed from a classical spectral analysis perspective, and its implementation is illustrated through intuitive examples. Lastly, we show that the proposed model is able to perform joint time and frequency reconstruction of real-world audio, healthcare and astronomy signals, while successfully dealing with missing data and handling uncertainty (noise) naturally against both classical and modern approaches for spectral estimation.


title: Stable Sample Compression Schemes: New Applications and an Optimal SVM Margin Bound

abstract: We analyze a family of supervised learning algorithms based on sample compression schemes that are stable, in the sense that removing points from the training set which were not selected for the compression set does not alter the resulting classifier. We use this technique to derive a variety of novel or improved data-dependent generalization bounds for several learning algorithms. In particular, we prove a new margin bound for SVM, removing a log factor. The new bound is provably optimal. This resolves a long-standing open question about the PAC margin bounds achievable by SVM.


title: Short Term Electricity Market Designs: Identified Challenges and Promising Solutions

abstract: The electricity market, which was initially designed for dispatchable power plants and inflexible demand, is being increasingly challenged by new trends, such as the high penetration of intermittent renewables and the transformation of the consumers energy space. To accommodate these new trends and improve the performance of the market, several modifications to current market designs have been proposed in the literature. Given the vast variety of these proposals, this paper provides a comprehensive investigation of the modifications proposed in the literature as well as a detailed assessment of their suitability for improving market performance under the continuously evolving electricity landscape. To this end, first, a set of criteria for an ideal market design is proposed, and the barriers present in current market designs hindering the fulfillment of these criteria are identified. Then, the different market solutions proposed in the literature, which could potentially mitigate these barriers, are extensively explored. Finally, a taxonomy of the proposed solutions is presented, highlighting the barriers addressed by each proposal and the associated implementation challenges. The outcomes of this analysis show that even though each barrier is addressed by at least one proposed solution, no single proposal is able to address all the barriers simultaneously. In this regard, a future-proof market design must combine different elements of proposed solutions to comprehensively mitigate market barriers and overcome the identified implementation challenges. Thus, by thoroughly reviewing this rich body of literature, this paper introduces key contributions enabling the advancement of the state-of-the-art towards increasingly efficient electricity market.


title: Geometry Perspective Of Estimating Learning Capability Of Neural Networks

abstract: The paper uses statistical and differential geometric motivation to acquire prior information about the learning capability of an artificial neural network on a given dataset. The paper considers a broad class of neural networks with generalized architecture performing simple least square regression with stochastic gradient descent (SGD). The system characteristics at two critical epochs in the learning trajectory are analyzed. During some epochs of the training phase, the system reaches equilibrium with the generalization capability attaining a maximum. The system can also be coherent with localized, non-equilibrium states, which is characterized by the stabilization of the Hessian matrix. The paper proves that neural networks with higher generalization capability will have a slower convergence rate. The relationship between the generalization capability with the stability of the neural network has also been discussed. By correlating the principles of high-energy physics with the learning theory of neural networks, the paper establishes a variant of the Complexity-Action conjecture from an artificial neural network perspective.


title: Some properties of solutions of It\^o equations with drift in $L_{d+1}$

abstract: This paper is a natural continuation of [8], where strong Markov processes are constructed in time inhomogeneous setting with Borel measurable uniformly bounded and uniformly nondegenerate diffusion and drift in $L_{d+1}(\mathbb{R}^{d+1})$. Here we study some properties of these processes such as higher summability of Green's functions, boundedness of resolvent operators in Lebesgue spaces, establish It\^o's formula, and so on.


title: From Eye-blinks to State Construction: Diagnostic Benchmarks for Online Representation Learning

abstract: We present three new diagnostic prediction problems inspired by classical-conditioning experiments to facilitate research in online prediction learning. Experiments in classical conditioning show that animals such as rabbits, pigeons, and dogs can make long temporal associations that enable multi-step prediction. To replicate this remarkable ability, an agent must construct an internal state representation that summarizes its interaction history. Recurrent neural networks can automatically construct state and learn temporal associations. However, the current training methods are prohibitively expensive for online prediction -- continual learning on every time step -- which is the focus of this paper. Our proposed problems test the learning capabilities that animals readily exhibit and highlight the limitations of the current recurrent learning methods. While the proposed problems are nontrivial, they are still amenable to extensive testing and analysis in the small-compute regime, thereby enabling researchers to study issues in isolation, ultimately accelerating progress towards scalable online representation learning methods.


title: The Origin of LAMOST J1109+7459

abstract: We report a comprehensive Chemo-dynamical analysis of LAMOST J1109+0754, a relatively bright (V = 12.8), extremely metal-poor ([Fe/H] = $-3.17$), and prograde ($J_\phi$ and $V_\phi$ $> 0$) star, with a strong \textit{r}-process enhancement ([Eu/Fe] = $+$0.94 $\pm$ 0.12, [Ba/Fe] = $-$0.52 $\pm$ 0.15). 31 chemical abundances (from Lithium to Thorium) were derived. We suggest a possible progenitor with stellar mass of 13.4-29.5 M$_\odot$. We argue that J1109+0754 is representative of the main \textit{r}-process component due to the well agreement with the scaled-solar \textit{r}-process component. We analyze the orbital history of this star in a {\it time-varying Galactic potential}, based on a Milky-Way analogue model extracted from \texttt{Illustris-TNG} simulations. Using this model, we carry out a statistical estimation of the phase-space coordinates of J1109+0754 at a young cosmic age. Collectively, the calculated motions, the derived chemistry, and the results from the cosmological simulations suggest that LAMOST J1109+0754 most likely formed in a low-mass dwarf galaxy, and belongs to the Galactic outer-halo population.