title: How degenerate is the parametrization of neural networks with the ReLU activation function?

abstract: Neural network training is usually accomplished by solving a non-convex optimization problem using stochastic gradient descent. Although one optimizes over the networks parameters, the main loss function generally only depends on the realization of the neural network, i.e. the function it computes. Studying the optimization problem over the space of realizations opens up new ways to understand neural network training. In particular, usual loss functions like mean squared error and categorical cross entropy are convex on spaces of neural network realizations, which themselves are non-convex. Approximation capabilities of neural networks can be used to deal with the latter non-convexity, which allows us to establish that for sufficiently large networks local minima of a regularized optimization problem on the realization space are almost optimal. Note, however, that each realization has many different, possibly degenerate, parametrizations. In particular, a local minimum in the parametrization space needs not correspond to a local minimum in the realization space. To establish such a connection, inverse stability of the realization map is required, meaning that proximity of realizations must imply proximity of corresponding parametrizations. We present pathologies which prevent inverse stability in general, and, for shallow networks, proceed to establish a restricted space of parametrizations on which we have inverse stability w.r.t. to a Sobolev norm. Furthermore, we show that by optimizing over such restricted sets, it is still possible to learn any function which can be learned by optimization over unrestricted sets.


title: Disk masses in the Orion Molecular Cloud-2: distinguishing time and environment

abstract: The mass evolution of protoplanetary disks is driven by both internal processes and external factors, such as photoevaporation. Disentangling these two effects, however, has remained difficult. We measure the dust masses of a sample of 132 disks in the Orion Molecular Cloud (OMC)-2 region, and compare them to (i) externally photoevaporated disks in the Trapezium cluster, and (ii) disks in nearby low-mass star forming regions (SFRs). This allows us to test if initial disk properties are the same in high- and low-mass SFRs, and enables a direct measurement of the effect of external photoevaporation on disks. A ~ $20' \times 4'$ mosaic of 3 mm continuum observations from the Atacama Large Millimeter/submillimeter Array (ALMA) was used to measure the fluxes of 132 disks and 35 protostars >0.5 pc away from the Trapezium. We identify and characterize a sample of 34 point sources not included in the Spitzer catalog on which the sample is based. Of the disks, 37 (28%) are detected, with masses ranging from 7-270 M_e. The detection rate for protostars is higher at 69%. Disks near the Trapezium are found to be less massive by a factor $0.18^{+0.18}_{-0.11}$, implying a mass loss rate of $8\times10^{-8}$ M_sun/yr. Our observations allow us to distinguish the impact of time and environment on disk evolution in a single SFR. The disk mass distribution in OMC-2 is statistically indistinguishable from that in nearby low-mass SFRs, like Lupus and Taurus. We conclude that age is the main factor determining the evolution of these disks. This result is robust with respect to assumptions of dust temperature, sample incompleteness and biases. The difference between the OMC-2 and Trapezium cluster samples is consistent with mass loss driven by far-ultraviolet radiation near the Trapezium. Together, this implies that in isolation, disk formation and evolution proceed similarly, regardless of cloud mass.


title: Mechanical interplay between cell shape and actin cytoskeleton organization

abstract: We investigate the mechanical interplay between the spatial organization of the actin cytoskeleton and the shape of animal cells adhering on micropillar arrays. Using a combination of analytical work, computer simulations and in vitro experiments, we demonstrate that the orientation of the stress fibers strongly influences the geometry of the cell edge. In the presence of a uniformly aligned cytoskeleton, the cell edge can be well approximated by elliptical arcs, whose eccentricity reflects the degree of anisotropy of the cell's internal stresses. Upon modeling the actin cytoskeleton as a nematic liquid crystal, we further show that the geometry of the cell edge feeds back on the organization of the stress fibers by altering the length scale at which these are confined. This feedback mechanism is controlled by a dimensionless number, the anchoring number, representing the relative weight of surface-anchoring and bulk-aligning torques. Our model allows to predict both cellular shape and the internal structure of the actin cytoskeleton and is in good quantitative agreement with experiments on fibroblastoid (GD$\beta$1,GD$\beta$3) and epithelioid (GE$\beta$1, GE$\beta$3) cells.


title: Spanning Trees in Graphs of High Minimum Degree with a Universal Vertex II: A Tight Result

abstract: We prove that, if $m$ is sufficiently large, every graph on $m+1$ vertices that has a universal vertex and minimum degree at least $\lfloor \frac{2m}{3} \rfloor$ contains each tree $T$ with $m$ edges as a subgraph. Our result confirms, for large $m$, an important special case of a conjecture by Havet, Reed, Stein, and Wood. The present paper builds on the results of a companion paper in which we proved the statement for all trees having a vertex that is adjacent to many leaves.


title: Atomic-scale manipulation and in situ characterization with scanning tunneling microscopy

abstract: Scanning tunneling microscope (STM) has presented a revolutionary methodology to the nanoscience and nanotechnology. It enables imaging the topography of surfaces, mapping the distribution of electronic density of states, and manipulating individual atoms and molecules, all at the atomic resolution. In particular, the atom manipulation capability has evolved from fabricating individual nanostructures towards the scalable production of the atomic-sized devices bottom-up. The combination of precision synthesis and in situ characterization of the atomically precise structures has enabled direct visualization of many quantum phenomena and fast proof-of-principle testing of quantum device functions with real-time feedback to guide the improved synthesis. In this article, several representative examples are reviewed to demonstrate the recent development of atomic scale manipulation. Especially, the review focuses on the progress that address the quantum properties by design through the precise control of the atomic structures in several technologically relevant materials systems. Besides conventional STM manipulations and electronic structure characterization with single-probe STM, integration of multiple atomically precisely controlled probes in a multiprobe STM system vastly extends the capability of in situ characterization to a new dimension where the charge and spin transport behaviors can be examined from mesoscopic to atomic length scale. The automation of the atomic scale manipulation and the integration with the well-established lithographic processes would further push this bottom-up approach to a new level that combines reproducible fabrication, extraordinary programmability, and the ability to produce large-scale arrays of quantum structures.


title: MCP: Learning Composable Hierarchical Control with Multiplicative Compositional Policies

abstract: Humans are able to perform a myriad of sophisticated tasks by drawing upon skills acquired through prior experience. For autonomous agents to have this capability, they must be able to extract reusable skills from past experience that can be recombined in new ways for subsequent tasks. Furthermore, when controlling complex high-dimensional morphologies, such as humanoid bodies, tasks often require coordination of multiple skills simultaneously. Learning discrete primitives for every combination of skills quickly becomes prohibitive. Composable primitives that can be recombined to create a large variety of behaviors can be more suitable for modeling this combinatorial explosion. In this work, we propose multiplicative compositional policies (MCP), a method for learning reusable motor skills that can be composed to produce a range of complex behaviors. Our method factorizes an agent's skills into a collection of primitives, where multiple primitives can be activated simultaneously via multiplicative composition. This flexibility allows the primitives to be transferred and recombined to elicit new behaviors as necessary for novel tasks. We demonstrate that MCP is able to extract composable skills for highly complex simulated characters from pre-training tasks, such as motion imitation, and then reuse these skills to solve challenging continuous control tasks, such as dribbling a soccer ball to a goal, and picking up an object and transporting it to a target location.


title: Uplifting AdS3/CFT2 to Flat Space Holography

abstract: Four-dimensional (4D) flat Minkowski space admits a foliation by hyperbolic slices. Euclidean AdS3 slices fill the past and future lightcones of the origin, while dS3 slices fill the region outside the lightcone. The resulting link between 4D asymptotically flat quantum gravity and AdS3/CFT2 is explored in this paper. The 4D superrotations in the extended BMS4 group are found to act as the familiar conformal transformations on the 3D hyperbolic slices, mapping each slice to itself. The associated 4D superrotation charge is constructed in the covariant phase space formalism. The soft part gives the 2D stress tensor, which acts on the celestial sphere at the boundary of the hyperbolic slices, and is shown to be an uplift to 4D of the familiar 3D holographic AdS3 stress tensor. Finally, we find that 4D quantum gravity contains an unexpected second, conformally soft, dimension (2, 0) mode that is symplectically paired with the celestial stress tensor.


title: Impact of de-synchronization and drift on soliton-based Kerr frequency combs in the presence of pulsed driving fields

abstract: Pulsed driving of Kerr microresonators represents a promising avenue for the efficient generation of soliton states associated with coherent optical frequency combs. The underlying physics has not, however, yet been comprehensively investigated. Here, we report on a numerical and theoretical study of the impact of de-synchronization between the periodic pump field and the train of solitons circulating in the cavity. We show that de-synchronization can affect the soliton configurations that can be sustained for given parameters, and that it can be leveraged to guarantee operation in the attractive single-soliton regime. We also reveal that the interplay between pump-resonator de-synchronization and stimulated Raman scattering can give rise to rich dynamics that explain salient features observed in recent experiments. Our work elucidates the dynamics of Kerr cavity solitons in the presence of pulsed driving fields, and could facilitate the development of efficient microresonator frequency comb systems.


title: Can three-body recombination purify a quantum gas?

abstract: Three-body recombination in quantum gases is traditionally associated with heating, but it was recently found that it can also cool the gas. We show that in a partially condensed three-dimensional homogeneous Bose gas three-body loss could even purify the sample, that is, reduce the entropy per particle and increase the condensed fraction $\eta$. We predict that the evolution of $\eta$ under continuous three-body loss can, depending on small changes in the initial conditions, exhibit two qualitatively different behaviours - if it is initially above a certain critical value, $\eta$ increases further, whereas clouds with lower initial $\eta$ evolve towards a thermal gas. These dynamical effects should be observable under realistic experimental conditions.

categories: cond-mat.quant-gas cond-mat.stat-mech physics.atom-ph quant-ph


title: Laser machined ultrathin microscale platinum thermometers on transparent oxide substrates

abstract: Ultrathin microscale resistive thermometers are of key value to many applications. Here we have fabricated a laser machined 50 ${\mu}$m wide and 50 nm thick serpentine Pt thin film sensor capable of sensing temperatures up to 650 ${^\circ}$ C over multiple heating and cooling cycles. Various materials and associated processing conditions were studied, including both sapphire and silica as transparent substrates, alumina and TiO2 as adhesion layers, and lastly alumina and silicon oxide as capping layer. In-situ resistance monitoring helps to verify the multi-cycle stability of the sensor and guide the optimization. 10 ${\mu}$m sized sensors can be laser machined but will not survive multiple heating and cooling cycles. We demonstrate that the sensors with amorphous Ge thin layers can also repeatably measure temperatures up to 650 ${^\circ}$ C. It is anticipated that this sensor can be used for fast and high spatial resolution temperature probing for laser processing applications.


title: A Condition Number for Hamiltonian Monte Carlo

abstract: Hamiltonian Monte Carlo is a popular sampling technique for smooth target densities. The scale lengths of the target have long been known to influence integration error and sampling efficiency. However, quantitative measures intrinsic to the target have been lacking. In this paper, we restrict attention to the multivariate Gaussian and the leapfrog integrator, and obtain a condition number corresponding to sampling efficiency. This number, based on the spectral and Schatten norms, quantifies the number of leapfrog steps needed to efficiently sample. We demonstrate its utility by using this condition number to analyze HMC preconditioning techniques. We also find the condition number of large inverse Wishart matrices, from which we derive burn-in heuristics.


title: Non-linear Nernst effect in bilayer WTe$_2$

abstract: Unlike the conventional (linear) anomalous Nernst effect, the non-linear anomalous Nernst effect (NLANE) can survive in an inversion symmetry broken system even in the presence of time-reversal symmetry. Using semiclassical Boltzmann transport theory, we derive the general expression of the non-linear anomalous Nernst coefficient as the second-order response function to the applied temperature gradient. We find that the non-linear Nernst current, which flows perpendicular to the temperature gradient even in the absence of a magnetic field, arises due to the Berry curvature of the states near the Fermi surface, and thus is associated with purely a Fermi surface contribution. We apply these results to bilayer WTe$_2$, which is an inversion broken but time reversal symmetric type-II Weyl semimetal supporting chiral Weyl fermions. By tuning the spin-orbit coupling, we show that the sign of the NLANE can change in this system. Together with the angular dependence, we calculate the temperature and chemical potential dependencies of NLANE in bilayer WTe$_2$, and predict specific experimental signatures that can be checked in experiments.


title: Efficient Reduction in Shape Parameter Space Dimension for Ship Propeller Blade Design

abstract: In this work, we present the results of a ship propeller design optimization campaign carried out in the framework of the research project PRELICA, funded by the Friuli Venezia Giulia regional government. The main idea of this work is to operate on a multidisciplinary level to identify propeller shapes that lead to reduced tip vortex-induced pressure and increased efficiency without altering the thrust. First, a specific tool for the bottom-up construction of parameterized propeller blade geometries has been developed. The algorithm proposed operates with a user defined number of arbitrary shaped or NACA airfoil sections, and employs arbitrary degree NURBS to represent the chord, pitch, skew and rake distribution as a function of the blade radial coordinate. The control points of such curves have been modified to generate, in a fully automated way, a family of blade geometries depending on as many as 20 shape parameters. Such geometries have then been used to carry out potential flow simulations with the Boundary Element Method based software PROCAL. Given the high number of parameters considered, such a preliminary stage allowed for a fast evaluation of the performance of several hundreds of shapes. In addition, the data obtained from the potential flow simulation allowed for the application of a parameter space reduction methodology based on active subspaces (AS) property, which suggested that the main propeller performance indices are, at a first but rather accurate approximation, only depending on a single parameter which is a linear combination of all the original geometric ones. AS analysis has also been used to carry out a constrained optimization exploiting response surface method in the reduced parameter space, and a sensitivity analysis based on such surrogate model. The few selected shapes were finally used to set up high fidelity RANS simulations and select an optimal shape.


title: SciTokens: Demonstrating Capability-Based Access to Remote Scientific Data using HTCondor

abstract: The management of security credentials (e.g., passwords, secret keys) for computational science workflows is a burden for scientists and information security officers. Problems with credentials (e.g., expiration, privilege mismatch) cause workflows to fail to fetch needed input data or store valuable scientific results, distracting scientists from their research by requiring them to diagnose the problems, re-run their computations, and wait longer for their results. SciTokens introduces a capabilities-based authorization infrastructure for distributed scientific computing, to help scientists manage their security credentials more reliably and securely. SciTokens uses IETF-standard OAuth JSON Web Tokens for capability-based secure access to remote scientific data. These access tokens convey the specific authorizations needed by the workflows, rather than general-purpose authentication impersonation credentials, to address the risks of scientific workflows running on distributed infrastructure including NSF resources (e.g., LIGO Data Grid, Open Science Grid, XSEDE) and public clouds (e.g., Amazon Web Services, Google Cloud, Microsoft Azure). By improving the interoperability and security of scientific workflows, SciTokens 1) enables use of distributed computing for scientific domains that require greater data protection and 2) enables use of more widely distributed computing resources by reducing the risk of credential abuse on remote systems. In this extended abstract, we present the results over the past year of our open source implementation of the SciTokens model and its deployment in the Open Science Grid, including new OAuth support added in the HTCondor 8.8 release series.


title: Noncommutative approach to disclose a Higgs group

abstract: A noncommutative(NC) version for a global $O(N)$ scalar field theory is proposed and an alternative investigation about how noncommutative drives spontaneous symmetry breaking (SSB) is explored. Indeed, we show that the noncommutativity plays an important role in such mechanism, i.e., it is possible to show that there is a Higgs group with no more than two Higgs bosons. In this scenario, we establish two mutually exclusive options: one Higgs boson with mass at 125 GeV and other at 750 GeV -- 2 TeV excess does not imply a 2 TeV mass resonance -- or two Higgs bosons with mass-degenerate near 125~GeV, where 2 TeV and 750 GeV excesses do not imply a 2 TeV and 750 GeV masses resonance.


title: An Exact Formula for the Prime Counting Function

abstract: This paper discusses a few main topics in Number Theory, such as the M\"{o}bius function and its generalization, leading up to the derivation of neat power series for the prime counting function, $\pi(x)$, and the prime-power counting function, $J(x)$. Among its main findings, we can cite the extremely useful inversion formula for Dirichlet series (given $F_a(s)$, we know $a(n)$, which implies the Riemann hypothesis, and enabled the creation of a formula for $\pi(x)$ in the first place), and the realization that sums of divisors and the M\"{o}bius function are particular cases of a more general concept. From this result, one concludes that it's not necessary to resort to the zeros of the analytic continuation of the zeta function to obtain $\pi(x)$.


title: Uniqueness in inverse cavity scattering problems with phaseless near-field data

abstract: This paper is concerned with the uniqueness of inverse acoustic scattering problem for cavities with the modulus of the near-fields. With the aid of the reference ball technique and the superpositions of two point sources as the incident waves, we rigorously prove that the location and shape of the cavity as well as its boundary condition can be uniquely determined by the modulus of near-fields at an admissible surface. To our knowledge, this is the first uniqueness result in inverse cavity scattering problems with phaseless near-field data. In this paper, we make use of the phaseless near-field data incurred by the cavity and the point sources, and thus the configuration is more feasible in practice.


title: Randomized Reference Classifier with Gaussian Distribution and Soft Confusion Matrix Applied to the Improving Weak Classifiers

abstract: In this paper, an issue of building the RRC model using probability distributions other than beta distribution is addressed. More precisely, in this paper, we propose to build the RRR model using the truncated normal distribution. Heuristic procedures for expected value and the variance of the truncated-normal distribution are also proposed. The proposed approach is tested using SCM-based model for testing the consequences of applying the truncated normal distribution in the RRC model. The experimental evaluation is performed using four different base classifiers and seven quality measures. The results showed that the proposed approach is comparable to the RRC model built using beta distribution. What is more, for some base classifiers, the truncated-normal-based SCM algorithm turned out to be better at discovering objects coming from minority classes.


title: Close Binary Galaxies: Application to Source of Energy and Expansion in Universe

abstract: Applying the microscopic nuclear physics ideas for fusion reactions to macroscopic galactic systems, we study the evolution of the compact binary galaxy in mass asymmetry (transfer) coordinate. The conditions for the formation of stable symmetric binary galaxy are analyzed. The role of symmetrization of asymmetric binary galaxy in the transformation of gravitational energy into internal energy of galaxies accompanied by the release of a large amount of energy during the symmetrization process is revealed.


title: In-DRAM Bulk Bitwise Execution Engine

abstract: Many applications heavily use bitwise operations on large bitvectors as part of their computation. In existing systems, performing such bulk bitwise operations requires the processor to transfer a large amount of data on the memory channel, thereby consuming high latency, memory bandwidth, and energy. In this paper, we describe Ambit, a recently-proposed mechanism to perform bulk bitwise operations completely inside main memory. Ambit exploits the internal organization and analog operation of DRAM-based memory to achieve low cost, high performance, and low energy. Ambit exposes a new bulk bitwise execution model to the host processor. Evaluations show that Ambit significantly improves the performance of several applications that use bulk bitwise operations, including databases.


title: Special uniform decay rate of local energy for the wave equation with variable coefficients on an exterior domain

abstract: We consider the wave equation with variable coefficients on an exterior domain in $\R^n$($n\ge 2$). We are interested in finding a special uniform decay rate of local energy different from the constant coefficient wave equation. More concretely, if the dimensional $n$ is even, whether the uniform decay rate of local energy for the wave equation with variable coefficients can break through the limit of polynomial and reach exponential; if the dimensional $n$ is odd, whether the uniform decay rate of local energy for the wave equation with variable coefficients can hold exponential as the constant coefficient wave equation . \quad \ \ We propose a cone and establish Morawetz's multipliers in a version of the Riemannian geometry to derive uniform decay of local energy for the wave equation with variable coefficients. We find that the cone with polynomial growth is closely related to the uniform decay rate of the local energy. More concretely, for radial solutions, when the cone has polynomial of degree $\frac{n}{2k-1}$ growth, the uniform decay rate of local energy is exponential; when the cone has polynomial of degree $\frac{n}{2k}$ growth, the uniform decay rate of local energy is polynomial at most. In addition, for general solutions, when the cone has polynomial of degree $n$ growth, we prove that the uniform decay rate of local energy is exponential under suitable Riemannian metric. It is worth pointing out that such results are independent of the parity of the dimension $n$, which is the main difference with the constant coefficient wave equation. Finally, for general solutions, when the cone has polynomial of degree $m$ growth, where $m$ is any positive constant, we prove that the uniform decay rate of the local energy is of primary polynomial under suitable Riemannian metric.


title: A Feature-Based Bayesian Method for Content Popularity Prediction in Edge-Caching Networks

abstract: Edge-caching is recognized as an efficient technique for future wireless cellular networks to improve network capacity and user-perceived quality of experience. Due to the random content requests and the limited cache memory, designing an efficient caching policy is a challenge. To enhance the performance of caching systems, an accurate content request prediction algorithm is essential. Here, we introduce a flexible model, a Poisson regressor based on a Gaussian process, for the content request distribution in stationary environments. Our proposed model can incorporate the content features as side information for prediction enhancement. In order to learn the model parameters, which yield the Poisson rates or alternatively content popularities, we invoke the Bayesian approach which is very robust against over-fitting. However, the posterior distribution in the Bayes formula is analytically intractable to compute. To tackle this issue, we apply a Monte Carlo Markov Chain (MCMC) method to approximate the posterior distribution. Two types of predictive distributions are formulated for the requests of existing contents and for the requests of a newly-added content. Finally, simulation results are provided to confirm the accuracy of the developed content popularity learning approach.


title: Synthesizing Functional Reactive Programs

abstract: Functional Reactive Programming (FRP) is a paradigm that has simplified the construction of reactive programs. There are many libraries that implement incarnations of FRP, using abstractions such as Applicative, Monads, and Arrows. However, finding a good control flow, that correctly manages state and switches behaviors at the right times, still poses a major challenge to developers. An attractive alternative is specifying the behavior instead of programming it, as made possible by the recently developed logic: Temporal Stream Logic (TSL). However, it has not been explored so far how Control Flow Models (CFMs), as synthesized from TSL specifications, can be turned into executable code that is compatible with libraries building on FRP. We bridge this gap, by showing that CFMs are indeed a suitable formalism to be turned into Applicative, Monadic, and Arrowized FRP. We demonstrate the effectiveness of our translations on a real-world kitchen timer application, which we translate to a desktop application using the Arrowized FRP library Yampa, a web application using the Monadic threepenny-gui library, and to hardware using the Applicative hardware description language ClaSH.


title: A model of brain morphological changes related to aging and Alzheimer's disease from cross-sectional assessments

abstract: In this study we propose a deformation-based framework to jointly model the influence of aging and Alzheimer's disease (AD) on the brain morphological evolution. Our approach combines a spatio-temporal description of both processes into a generative model. A reference morphology is deformed along specific trajectories to match subject specific morphologies. It is used to define two imaging progression markers: 1) a morphological age and 2) a disease score. These markers can be computed locally in any brain region. The approach is evaluated on brain structural magnetic resonance images (MRI) from the ADNI database. The generative model is first estimated on a control population, then, for each subject, the markers are computed for each acquisition. The longitudinal evolution of these markers is then studied in relation with the clinical diagnosis of the subjects and used to generate possible morphological evolution. In the model, the morphological changes associated with normal aging are mainly found around the ventricles, while the Alzheimer's disease specific changes are more located in the temporal lobe and the hippocampal area. The statistical analysis of these markers highlights differences between clinical conditions even though the inter-subject variability is quiet high. In this context, the model can be used to generate plausible morphological trajectories associated with the disease. Our method gives two interpretable scalar imaging biomarkers assessing the effects of aging and disease on brain morphology at the individual and population level. These markers confirm an acceleration of apparent aging for Alzheimer's subjects and can help discriminate clinical conditions even in prodromal stages. More generally, the joint modeling of normal and pathological evolutions shows promising results to describe age-related brain diseases over long time scales.


title: Phase integral of asteroids

abstract: The values of the phase integral q were determined for asteroids using (i) a numerical integration of the brightness phase functions over a wide phase-angle range and (ii) the relations between q and the G parameter of the HG-function and q and the G1, G2 parameters of the HG1G2-function. The phase-integral values for asteroids of different albedo range from 0.34 to 0.54 with an average value of 0.44. These values can be used for the determination of the Bond albedo of asteroids. Estimates for the phase-integral values using the G1 and G2 parameters are in very good agreement with the available observational data. We recommend using the HG1G2-function for the determination of the phase integral. Comparison of the phase integrals of asteroids and planetary satellites shows that asteroids have systematically lower values of q.


title: New Long Lived Particles Searches in Heavy Ion Collisions at the LHC

abstract: We show that heavy ion collisions at the LHC provide a promising environment to search for signatures with displaced vertices in well-motivated New Physics scenarios. Compared to proton collisions, they offer several advantages, i) the number of parton level interactions per collision is larger, ii) there is no pile-up, iii) the lower instantaneous luminosity compared to proton collisions allows to operate the LHC experiments with very loose triggers, and iv) there are new production mechanisms that are absent in proton collisions. In the present work we focus on the third point and show that the modification of the triggers alone can increase the number of observable events by orders of magnitude if the long lived particles are predominantly produced with low transverse momentum. Our results show that collisions of ions lighter than lead are well-motivated from the viewpoint of searches for New Physics. We illustrate this for the example of heavy neutrinos in the Neutrino Minimal Standard Model.


title: Plane-Based Optimization of Geometry and Texture for RGB-D Reconstruction of Indoor Scenes

abstract: We present a novel approach to reconstruct RGB-D indoor scene with plane primitives. Our approach takes as input a RGB-D sequence and a dense coarse mesh reconstructed by some 3D reconstruction method on the sequence, and generate a lightweight, low-polygonal mesh with clear face textures and sharp features without losing geometry details from the original scene. To achieve this, we firstly partition the input mesh with plane primitives, simplify it into a lightweight mesh next, then optimize plane parameters, camera poses and texture colors to maximize the photometric consistency across frames, and finally optimize mesh geometry to maximize consistency between geometry and planes. Compared to existing planar reconstruction methods which only cover large planar regions in the scene, our method builds the entire scene by adaptive planes without losing geometry details and preserves sharp features in the final mesh. We demonstrate the effectiveness of our approach by applying it onto several RGB-D scans and comparing it to other state-of-the-art reconstruction methods.


title: The hyperelliptic theta map and osculating projections

abstract: Let $C$ be a hyperelliptic curve of genus $g\geq 3$. In this paper we give a new geometric description of the theta map for moduli spaces of rank 2 semistable vector bundles on $C$ with trivial determinant. In order to do this, we describe a fibration of (a birational model of) the moduli space, whose fibers are GIT quotients $(\mathbb{P}^1)^{2g}//PGL(2)$. Then, we identify the restriction of the theta map to these GIT quotients with some explicit degree two osculating projection. As a corollary of this construction, we obtain a birational inclusion of a fibration in Kummer $(g-1)$-folds over $\mathbb{P}^g$ inside the ramification locus of the theta map.


title: The Kepler Smear Campaign: Light curves for 102 Very Bright Stars

abstract: We present the first data release of the Kepler Smear Campaign, using collateral 'smear' data obtained in the Kepler four-year mission to reconstruct light curves of 102 stars too bright to have been otherwise targeted. We describe the pipeline developed to extract and calibrate these light curves, and show that we attain photometric precision comparable to stars analyzed by the standard pipeline in the nominal Kepler mission. In this paper, aside from publishing the light curves of these stars, we focus on 66 red giants for which we detect solar-like oscillations, characterizing 33 of these in detail with spectroscopic chemical abundances and asteroseismic masses as benchmark stars. We also classify the whole sample, finding nearly all to be variable, with classical pulsations and binary effects. All source code, light curves, TRES spectra, and asteroseismic and stellar parameters are publicly available as a Kepler legacy sample.


title: Generalized Vaidya solutions in bimetric gravity

abstract: In general relativity, the endpoint of spherically symmetric gravitational collapse is a Schwarzschild--[(A)dS] black hole. In bimetric gravity, it has been speculated that a static end state must also be Schwarzschild--[(A)dS]. To this end, we present a set of exact solutions, including collapsing massless dust particles. For these, the speculation is confirmed.


title: Dynamical origin of flavor hierarchies in a warped extra dimension

abstract: Extensions of the Standard Model featuring a warped extra dimension compactified on an $S^1/\mathbb{Z}_2$ orbifold, in which the fermions and gauge bosons live in the bulk of the fifth dimension, offer one of the most compelling mechanisms for addressing both the hierarchy problem and the flavor puzzle of the Standard Model. However, the five-dimensional mass terms of bulk fermions must be odd functions on the orbifold, and as such they should be described by a field depending on the coordinate of the extra dimension. We demonstrate the feasibility of dynamically generating these fermion bulk masses with a bulk scalar field in warped extra dimensions. The bulk scalar acquires a vacuum expectation value, which is odd under the orbifold symmetry and gives rise to the fermion bulk masses through non-universal Yukawa-like interactions. Like in the conventional Randall-Sundrum setup, the localization of the different fermion zero modes along the extra dimension naturally explains the observed flavor structure and four-dimensional mass hierarchy of the SM fermions. We study the phenomenological implications of the backreaction on the metric and the modified fermion profiles due to the bulk scalar field on electroweak precision and flavor observables. Using up-to-date data, we show that the contributions to the $S$, $T$, and $\epsilon_K$ parameters require the mass of the first Kaluza-Klein gluon resonance to be of order 14 and 10 TeV in the minimal and the custodial model, respectively, regardless of the effect of the backreaction. Furthermore, effective flavor-changing interactions among the SM fermions induced by the bulk scalar are discussed. We also comment on the potential impact of the Higgs portal interaction of the bulk scalar on the couplings of the Higgs boson.


title: The effects of dynamical substructure on Milky Way mass estimates from the high velocity tail of the local stellar halo

abstract: We investigate the impact of dynamical streams and substructure on estimates of the local escape speed and total mass of Milky Way-mass galaxies from modelling the high velocity tail of local halo stars. We use a suite of high-resolution, magneto-hydrodynamical cosmological zoom-in simulations, which resolve phase space substructure in local volumes around solar-like positions. We show that phase space structure varies significantly between positions in individual galaxies and across the suite. Substructure populates the high velocity tail unevenly and leads to discrepancies in the mass estimates. We show that a combination of streams, sample noise and truncation of the high velocity tail below the escape speed leads to a distribution of mass estimates with a median that falls below the true value by $\sim 20 \%$, and a spread of a factor of 2 across the suite. Correcting for these biases, we derive a revised value for the Milky Way mass presented in Deason et al. of $1.29 ^{+0.37}_{-0.47} \times 10^{12}$ $\rm M_{\odot}$.


title: Transport in bilayer graphene near charge neutrality: Which scattering mechanisms are important?

abstract: Using the semiclassical quantum Boltzmann equation (QBE), we numerically calculate the DC transport properties of bilayer graphene near charge neutrality. We find, in contrast to prior discussions, that phonon scattering is crucial even at temperatures below 40K. Nonetheless, electron-electron scattering still dominates over phonon collisions allowing a hydrodynamic approach. We introduce a simple two-fluid hydrodynamic model of electrons and holes interacting via Coulomb drag and compare our results to the full QBE calculation. We show that the two-fluid model produces quantitatively accurate results for conductivity, thermopower, and thermal conductivity.


title: Misalignment & Co.: (Pseudo-)scalar and vector dark matter with curvature couplings

abstract: Motivated by their potential role as dark matter, we study the cosmological evolution of light scalar and vector fields non-minimally coupled to gravity. Our focus is on a situation where the dominant contribution to the energy density arises from the misalignment mechanism. In addition, we also discuss the possibility that dark matter is generated in a stochastic scenario or from inflationary fluctuations. Even small deviations in the non-minimal couplings from the standard scenarios lead to significant qualitative and quantitative changes. This is due to the curvature-coupling driven superhorizon evolution of the homogeneous field and the non-zero momentum modes during inflation. Both the relic density yield and the large-scale density fluctuations are affected. For the misalignment mechanism, this results in a weakening of the isocurvature constraints and opens up new viable regions of parameter space.


title: Dirac Spin Liquid on the Spin-1/2 Triangular Heisenberg Antiferromagnet

abstract: We study the spin liquid candidate of the spin-$1/2$ $J_1$-$J_2$ Heisenberg antiferromagnet on the triangular lattice by means of density matrix renormalization group (DMRG) simulations. By applying an external Aharonov-Bohm flux insertion in an infinitely long cylinder, we find unambiguous evidence for gapless $U(1)$ Dirac spin liquid behavior. The flux insertion overcomes the finite size restriction for energy gaps and clearly shows gapless behavior at the expected wave-vectors. Using the DMRG transfer matrix, the low-lying excitation spectrum can be extracted, which shows characteristic Dirac cone structures of both spinon-bilinear and monopole excitations. Finally, we confirm that the entanglement entropy follows the predicted universal response under the flux insertion.


title: High-Resolution Radiative Transfer Modelling of M33

abstract: In this work, we characterise the contributions from both ongoing star formation and the ambient radiation field in Local Group galaxy M33, as well as estimate the scale of the local dust-energy balance (i.e. the scale at which the dust is re-emitting starlight generated in that same region) in this galaxy through high-resolution radiative transfer (RT) modelling, with defined stellar and dust geometries. We have characterised the spectral energy distribution (SED) of M33 from UV to sub-mm wavelengths, at a spatial scale of 100 pc. We constructed input maps of the various stellar and dust geometries for use in the RT modelling. By modifying our dust mix (fewer very small carbon grains and a lower silicate-to-carbon ratio as compared to the Milky Way), we can much better fit the sub-mm dust continuum. Using this new dust composition, we find that we are able to well reproduce the observed SED of M33 using our adopted model. In terms of stellar attenuation by dust, we find a reasonably strong, broad UV bump, as well as significant systematic differences in the amount of dust attenuation when compared to standard SED modelling. We also find discrepancies in the residuals of the spiral arms versus the diffuse interstellar medium (ISM), indicating a difference in properties between these two regimes. The dust emission is dominated by heating due to the young stellar populations at all wavelengths ($\sim$80% at 10 $\mu$m to $\sim$50% at 1 mm). We find that the local dust-energy balance is restored at spatial scales greater than around 1.5 kpc.


title: A fundamental test for stellar feedback recipes in galaxy simulations

abstract: Direct comparisons between galaxy simulations and observations that both reach scales < 100 pc are strong tools to investigate the cloud-scale physics of star formation and feedback in nearby galaxies. Here we carry out such a comparison for hydrodynamical simulations of a Milky Way-like galaxy, including stochastic star formation, HII region and supernova feedback, and chemical post-processing at 8 pc resolution. Our simulation shows excellent agreement with almost all kpc-scale and larger observables, including total star formation rates, radial profiles of CO, HI, and star formation through the galactic disc, mass ratios of the ISM components, both whole-galaxy and resolved Kennicutt-Schmidt relations, and giant molecular cloud properties. However, we find that our simulation does not reproduce the observed de-correlation between tracers of gas and star formation on < 100 pc scales, known as the star formation 'uncertainty principle', which indicates that observed clouds undergo rapid evolutionary lifecycles. We conclude that the discrepancy is driven by insufficiently-strong pre-supernova feedback in our simulation, which does not disperse the surrounding gas completely, leaving star formation tracer emission too strongly associated with molecular gas tracer emission, inconsistent with observations. This result implies that the cloud-scale de-correlation of gas and star formation is a fundamental test for feedback prescriptions in galaxy simulations, one that can fail even in simulations that reproduce all other macroscopic properties of star-forming galaxies.


title: The formation of low metallicity globular clusters in dwarf galaxy mergers

abstract: We present a hydro-dynamical simulation at sub-parsec and few solar mass resolution of a merger between two gas-rich dwarf galaxies. Our simulation includes a detailed model for the multi-phase interstellar medium (ISM) and is able to follow the entire formation history of spatially resolved star clusters, including feedback from individual massive stars. Shortly after the merger we find a population of $\sim 900$ stellar clusters with masses above $10^{2.5}\; \rm{M_\odot}$ and a cluster mass function (CMF), which is well fitted with a power-law with a slope of $\alpha=-1.70\pm0.08$. We describe here in detail the formation of the three most massive clusters (M$_{*} \gtrsim 10^5$ M$_\odot$), which populate the high-mass end of the CMF. The simulated clusters form rapidly on a timescale of $6$-$8$ Myr in converging flows of dense gas. The embedded merger phase has extremely high star formation rate surface densities of $\Sigma_\mathrm{SFR}>10\; \mathrm{M}_\odot\; \mathrm{yr}^{-1}\; \mathrm{kpc}^{-2}$ and thermal gas pressures in excess of $P_{\rm th}\sim10^7 \; \mathrm{k}_{\rm B}\;(\rm K\;\mathrm{cm}^{-3})^{-1}$. The formation process is terminated by rapid gas expulsion driven by the first generation of supernovae, after which the cluster centers relax and both their structure and kinematics become indistinguishable from observed local globular clusters. The simulation presented here provides a general model for the formation of metal-poor globular clusters in chemically unevolved starbursting environments of low-mass dwarf galaxies, which are common at high redshifts.


title: CHORUS. III. Photometric and Spectroscopic Properties of Ly$\alpha$ Blobs at $z=4.9-7.0$

abstract: We report the Subaru Hyper Suprime-Cam (HSC) discovery of two Ly$\alpha$ blobs (LABs), dubbed z70-1 and z49-1 at $z=6.965$ and $z=4.888$ respectively, that are Ly$\alpha$ emitters with a bright ($\log L_{\rm Ly\alpha}/{\rm [erg\ s^{-1}]}>43.4$) and spatially-extended Ly$\alpha$ emission, and present the photometric and spectroscopic properties of a total of seven LABs; the two new LABs and five previously-known LABs at $z=5.7-6.6$. The z70-1 LAB shows the extended Ly$\alpha$ emission with a scale length of $1.4\pm 0.2$ kpc, about three times larger than the UV continuum emission, making z70-1 the most distant LAB identified to date. All of the 7 LABs, except z49-1, exhibit no AGN signatures such as X-ray emission, {\sc Nv}$\lambda$1240 emission, or Ly$\alpha$ line broadening, while z49-1 has a strong {\sc Civ}$\lambda$1548 emission line indicating an AGN on the basis of the UV-line ratio diagnostics. We carefully model the point-spread functions of the HSC images, and conduct two-component exponential profile fitting to the extended Ly$\alpha$ emission of the LABs. The Ly$\alpha$ scale lengths of the core (star-forming region) and the halo components are $r_{\rm c}=0.6-1.2$ kpc and $r_{\rm h}=2.0-13.8$ kpc, respectively. The average $r_{\rm h}$ of the LABs falls on the extrapolation of the $r_{\rm h}$-Ly$\alpha$ luminosity relation of the Ly$\alpha$ halos around VLT/MUSE star-forming galaxies at the similar redshifts, suggesting that typical LABs at $z\gtrsim5$ are not special objects, but star-forming galaxies at the bright end.


title: Simulating cosmological substructure in the solar neighbourhood

abstract: We explore the predictive power of cosmological, hydrodynamical simulations for stellar phase space substructure and velocity correlations with the Auriga simulations and Aurigaia mock-Gaia catalogues. We show that at the solar circle the Auriga simulations commonly host phase space structures in the stellar component that have constant orbital energies and arise from accreted subhaloes. These structures can persist for a few Gyrs, even after coherent streams in position space have been erased. We also explore velocity two-point correlation functions and find this diagnostic is not deterministic for particular clustering patterns in phase space. Finally, we explore these structure diagnostics with the Aurigaia catalogues and show that the current catalogues have the ability to recover some structures in phase space but careful consideration is required to separate physical structures from numerical structures arising from catalogue generation methods.


title: On the Rates of Convergence in Learning of Optimal Temporally Fair Schedulers

abstract: Multi-user schedulers are designed to achieve optimal average system utility (e.g. throughput) subject to a set of fairness criteria. In this work, scheduling under temporal fairness constraints is considered. Prior works have shown that a class of scheduling strategies called threshold based strategies (TBSs) achieve optimal system utility under temporal fairness constraints. The optimal TBS thresholds are determined as a function of the channel statistics. In order to provide performance guarantees for TBSs in practical scenarios --- where the scheduler learns the optimal thresholds based on the empirical observations of the channel realizations --- it is necessary to evaluate the rates of convergence of TBS thresholds to the optimal value. In this work, these rates of convergence and the effect on the resulting system utility are investigated. It is shown that the best estimate of the threshold vector is at least $\omega(\frac{1}{\sqrt{t}})$ away from the optimal value, where $t$ is the number of observations of the independent and identically distributed channel realizations. Furthermore, it is shown that under long-term fairness constraints, the scheduler may achieve an average utility that is higher than the optimal long-term utility by violating the fairness criteria for a long initial period. Consequently, the resulting system utility may converge to its optimal long-term value from above. The results are verified by providing simulations of practical scheduling scenarios.


title: Nonlinear Poisson effect governed by mechanical critical transition

abstract: Under extensional strain, fiber networks can exhibit an anomalously large and nonlinear Poisson effect accompanied by a dramatic transverse contraction and volume reduction for applied strains as small as a few percent. We demonstrate that this phenomenon is controlled by a collective mechanical phase transition that occurs at a critical uniaxial strain that depends on network connectivity. This transition is punctuated by an anomalous peak in the apparent Poisson's ratio and other critical signatures such as diverging nonaffine strain fluctuations.


title: Resolved Molecular Gas and Star Formation Properties of the Strongly Lensed z=2.26 Galaxy SDSS J0901+1814

abstract: We present ~1" resolution (~2 kpc in the source plane) observations of the CO(1-0), CO(3-2), Halpha, and [N II] lines in the strongly-lensed z=2.26 star-forming galaxy SDSS J0901+1814. We use these observations to constrain the lensing potential of a foreground group of galaxies, and our source-plane reconstructions indicate that SDSS J0901+1814 is a nearly face-on (i~30 degrees) massive disk with r_{1/2}>~4 kpc for its molecular gas. Using our new magnification factors (mu_tot~30), we find that SDSS J0901+1814 has a star formation rate (SFR) of 268^{+63}_{-61} M_sun/yr, M_gas=(1.6^{+0.3}_{-0.2})x10^11x(alpha_CO/4.6) M_sun, and M_star=(9.5^{+3.8}_{-2.8})x10^10 M_sun, which places it on the star-forming galaxy "main sequence." We use our matched high-angular resolution gas and SFR tracers (CO and Halpha, respectively) to perform a spatially resolved (pixel-by-pixel) analysis of SDSS J0901+1814 in terms of the Schmidt-Kennicutt relation. After correcting for the large fraction of obscured star formation (SFR_Halpha/SFR_TIR=0.054^{+0.015}_{-0.014}), we find SDSS J0901+1814 is offset from "normal" star-forming galaxies to higher star formation efficiencies independent of assumptions for the CO-to-H_2 conversion factor. Our mean best-fit index for the Schmidt-Kennicutt relation for SDSS J0901+1814, evaluated with different CO lines and smoothing levels, is n=1.54+/-0.13; however, the index may be affected by gravitational lensing, and we find n=1.24+/-0.02 when analyzing the source-plane reconstructions. While the Schmidt-Kennicutt index largely appears unaffected by which of the two CO transitions we use to trace the molecular gas, the source-plane reconstructions and dynamical modeling suggest that the CO(1-0) emission is more spatially extended than the CO(3-2) emission.


title: Grating Lobe Suppression in Metasurface Antenna Arrays with a Waveguide Feed Layer

abstract: Metasurface antenna arrays, formed by tiling multiple metasurface subapertures, offer an alternative architecture to electrically large beamsteering arrays often used in radar and communications. The advantages offered by metasurfaces are enabled by the use of passive, tunable radiating elements. While these metamaterial elements do not exhibit the full range of phase tuning as can be obtained with phase shifters, they can be engineered to provide a similar level of performance with much lower power requirements and circuit complexity. Due to the limited phase and magnitude control, however, larger metasurface apertures can be susceptible to strong grating lobes which result from an unwanted periodic magnitude response that accompanies an ideal phase pattern. In this work, we combine antenna theory with analytical modeling of metamaterial elements to mathematically reveal the source of such grating lobes. To circumvent this problem, we introduce a compensatory waveguide feed layer designed to suppress grating lobes in metasurface antennas. The waveguide feed layer helps metasurface antennas approach the performance of phased arrays from an improved hardware platform, poising metasurface antennas to impact a variety of beamforming applications.


title: Relaxation Runge-Kutta Methods: Conservation and stability for Inner-Product Norms

abstract: We further develop a simple modification of Runge--Kutta methods that guarantees conservation or stability with respect to any inner-product norm. The modified methods can be explicit and retain the accuracy and stability properties of the unmodified Runge--Kutta method. We study the properties of the modified methods and show their effectiveness through numerical examples, including application to entropy-stability for first-order hyperbolic PDEs.


title: Conjunctive Queries with Theta Joins Under Updates

abstract: Modern application domains such as Composite Event Recognition (CER) and real-time Analytics require the ability to dynamically refresh query results under high update rates. Traditional approaches to this problem are based either on the materialization of subresults (to avoid their recomputation) or on the recomputation of subresults (to avoid the space overhead of materialization). Both techniques have recently been shown suboptimal: instead of materializing results and subresults, one can maintain a data structure that supports efficient maintenance under updates and can quickly enumerate the full query output, as well as the changes produced under single updates. Unfortunately, these data structures have been developed only for aggregate-join queries composed of equi-joins, limiting their applicability in domains such as CER where temporal joins are commonplace. In this paper, we present a new approach for dynamically evaluating queries with multi-way theta-joins under updates that is effective in avoiding both materialization and recomputation of results, while supporting a wide range of applications. To do this we generalize Dynamic Yannakakis, an algorithm for dynamically processing acyclic equi-join queries. In tandem, and of independent interest, we generalize the notions of acyclicity and free-connexity to arbitrary theta-joins and show how to compute corresponding join trees. We instantiate our framework to the case where theta-joins are only composed of equalities and inequalities and experimentally compare our algorithm to state of the art CER systems as well as incremental view maintenance engines. Our approach performs consistently better than the competitor systems with up to two orders of magnitude improvements in both time and memory consumption.


title: Computationally Efficient Feature Significance and Importance for Machine Learning Models

abstract: We develop a simple and computationally efficient significance test for the features of a machine learning model. Our forward-selection approach applies to any model specification, learning task and variable type. The test is non-asymptotic, straightforward to implement, and does not require model refitting. It identifies the statistically significant features as well as feature interactions of any order in a hierarchical manner, and generates a model-free notion of feature importance. Experimental and empirical results illustrate its performance.


title: Symmetries in the SME gravity sector: A study in the first-order formalism

abstract: A method to find the symmetries of a theory in the first order formalism of gravity is presented. This method is applied to the minimal gravity sector of the Standard Model Extension. It is argued that no inconsistencies arise when Lorentz violation is explicit and the relation between Lorentz violation and invariance under (active) diffeomorphisms is clearly exposed.


title: Supercontinuum generation in varying-dispersion and birefringent silicon waveguide

abstract: Ability to selectively enhance the amplitude and maintain high coherence of the supercontinuum signal with long pulses is gaining significance. In this work an extra degree of freedom afforded by varying the dispersion profile of a waveguide is utilized to selectively enhance supercontinuum. As much as 16 dB signal enhancement in the telecom window and 100 nm of wavelength extension is achieved with a cascaded waveguide, compared to a fixed dispersion waveguide. Waveguide tapering, in particular with increasing width, is determined to have a flatter and more coherent supercontinuum than a fixed dispersion waveguide when longer input pulses are used. Furthermore, due to the strong birefringence of an asymmetric silicon waveguide the supercontinuum signal is broadened by pumping simultaneously with both quasitransverse electric (TE) and quasi-transverse magnetic (TM) mode in the anomalous dispersion regime. Thus, by controlling the dispersion for the two modes selective signal generation is obtained. Such waveguides offer several advantages over optical fiber as the variation in dispersion can be controlled with greater flexibility in an integrated platform. This work paves the way forward for various applications in fields ranging from medicine to telecom where specific wavelength windows need to be targeted.


title: AutoRegressive Planet Search: Application to the Kepler Mission

abstract: The 4-year light curves of 156,717 stars observed with NASA's Kepler mission are analyzed using the AutoRegressive Planet Search (ARPS) methodology described by Caceres et al. (2019). The three stages of processing are: maximum likelihood ARIMA modeling of the light curves to reduce stellar brightness variations; constructing the Transit Comb Filter periodogram to identify transit-like periodic dips in the ARIMA residuals; Random Forest classification trained on Kepler Team confirmed planets using several dozen features from the analysis. Orbital periods between 0.2 and 100 days are examined. The result is a recovery of 76% of confirmed planets, 97% when period and transit depth constraints are added. The classifier is then applied to the full Kepler dataset; 1,004 previously noticed and 97 new stars have light curve criteria consistent with the confirmed planets, after subjective vetting removes clear False Alarms and False Positive cases. The 97 Kepler ARPS Candidate Transits mostly have periods $P<10$ days; many are UltraShort Period hot planets with radii $<1$% of the host star. Extensive tabular and graphical output from the ARPS time series analysis is provided to assist in other research relating to the Kepler sample.


title: Parity singlets and doublets of massive spin-3 particles in $D=2+1$ via Nother gauge embedding

abstract: Here we demonstrate that the sixth order (in derivatives) spin-3 self-dual model can be obtained from the fifth order self-dual model via a Noether Gauge Embedding (NGE) of longitudinal Weyl transformations $\eta_{(\mu\nu}\partial_{\alpha)}\Phi$. In the case of doublet models we can show that the massive spin-3 Singh-Hagen theory is dual to a fourth and to a sixth order theory, via a double round of the NGE procedure by imposing traceless longitudinal (reparametrization-like) symmetries $\partial_{(\mu}\tilde{\xi}_{\nu\alpha)}$ in the first round and transverse Weyl transformations $\eta_{(\mu\nu}\psi^T_{\alpha)}$ in the second one. Our procedure automatically furnishes the dual maps between the corresponding fields.


title: Thermodynamic and Thermoelectric Properties of CoFeYGe (Y= Ti, Cr) Quaternary Heusler Alloys: First Principle Calculations

abstract: Utilizing a material in thermoelectric applications requires a mechanical, thermal, and lattice stability as well a high figure of merit (ZT). In this work, we present the structural, electronic, magnetic, mechanical, thermodynamic, dynamic, and thermoelectric properties of CoFeYGe (Y = Ti, Cr) quaternary Heusler compounds using the density functional theory (DFT). The calculated mechanical properties and phonon dispersions reveal that the structures of these compounds are stable. Both CoFeCrGe and CoFeTiGe compounds show a ferromagnetic and ferrimagnetic half-metallic behavior with band gaps of 0.41 and 0.38 eV, respectively. The lattice thermal conductivity (\k{appa}L) exhibits low values that reach 3.01 W/(m.K) (3.47 W/(m.K)) for CoFeCrGe (CoFeTiGe) at 1100 K. The optical phonon modes have a large contribution of 60.2% (70.9 %) to \k{appa}L value for CoFeCrGe (CoFeTiGe). High ZT values of 0.71 and 0.65 were obtained for CoFeCrGe and CoFeTiGe, respectively. Based on our calculations, CoFeCrGe and CoFeTiGe combine both good spintronic and thermoelectric behaviors that may be used in spin injection applications.


title: Distributional Policy Optimization: An Alternative Approach for Continuous Control

abstract: We identify a fundamental problem in policy gradient-based methods in continuous control. As policy gradient methods require the agent's underlying probability distribution, they limit policy representation to parametric distribution classes. We show that optimizing over such sets results in local movement in the action space and thus convergence to sub-optimal solutions. We suggest a novel distributional framework, able to represent arbitrary distribution functions over the continuous action space. Using this framework, we construct a generative scheme, trained using an off-policy actor-critic paradigm, which we call the Generative Actor Critic (GAC). Compared to policy gradient methods, GAC does not require knowledge of the underlying probability distribution, thereby overcoming these limitations. Empirical evaluation shows that our approach is comparable and often surpasses current state-of-the-art baselines in continuous domains.


title: Copy this Sentence

abstract: Attention is an operation that selects some largest element from some set, where the notion of largest is defined elsewhere. Applying this operation to sequence to sequence mapping results in significant improvements to the task at hand. In this paper we provide the mathematical definition of attention and examine its application to sequence to sequence models. We highlight the exact correspondences between machine learning implementations of attention and our mathematical definition. We provide clear evidence of effectiveness of attention mechanisms evaluating models with varying degrees of attention on a very simple task: copying a sentence. We find that models that make greater use of attention perform much better on sequence to sequence mapping tasks, converge faster and are more stable.


title: The mechanism for the exceptionally high tear strength of carbon black/Hevea natural rubber vulcanizates

abstract: Natural rubber vucanizates containing 0-50 phr of a fine carbon black (N115,d=27nm) were prepared and tensile strengths of normal (no pre-cut) and edge pre-cut specimens were determined. Normal tensile strengths of all vulcanizates were similar. At the relatively slow strain rate experienced wholesale by normal uncut specimens, all vulcanizates, prior to crack initiation, strain-crystallized sufficiently to be strong. However, pre-cut specimens experience increased strain rate at a cut tip. Magnification of the strain rate increases as cut depth c increases. Fracture in the gum NR and vulcanizates with up to 14 phr of black occurred by simple forward crack growth from a cut tip, and all exhibited a critical cut size, above which strength dropped abruptly. Furthermore, for these lightly filled samples, strength and critical cut size decreased with increased black content. This indicates less strain-crystalliation before rupture of pre-cut specimens, when levels of black are low. This effect is attributerd to rapid straining at a cut tip and hindering of the chain mobility necessary for crystallization. When black content was increased to 15 phr, with 1 mm<c<2 mm, about 50% of specimens retained simple lateral fracture and were weak, but the other 50% developed deviated cracks (knotty tearing) and were significantly stronger than corresponding pre-cut gum specimens, especially at large c. High strength with sufficient black levels are attributed to increased strain-crystallization and super-blunting (multiple cracks) at a cut tip. These inhibit forward crack growth. For carbon black to enhance strain-crystallization relative to the gum, it appears there must be enough of it to form a bound rubber/black network. If the black concentration is less than this percolation threshold, strain-crystallization is hindered at a cut tip.


title: The distinguishing number and distinguishing chromatic number for posets

abstract: In this paper we introduce the concepts of the distinguishing number and the distinguishing chromatic number of a poset. For a distributive lattice $L$ and its set $Q_L$ of join-irreducibles, we use classic lattice theory to show that any linear extension of $Q_L$ generates a distinguishing 2-coloring of $L$. We prove general upper bounds for the distinguishing chromatic number and particular upper bounds for the Boolean lattice and for divisibility lattices. In addition, we show that the distinguishing number of any twin-free Cohen-Macaulay planar lattice is at most 2.


title: The Core Logic Paradox

abstract: This paper provides a proof that Tennant's logical system entails a paradox that is called Core logic paradox, in reference to the new name given by Tennant to his intuitionistic relevant logic.


title: A different perspective on the problem of time in quantum gravity

abstract: The perspective is advanced that the time parameter in quantum mechanics corresponds to the time coordinate in a Minkowski flat spacetime local approximation to the actual dynamical curved spacetime of General Relativity, rather than to an external Newtonian reference frame. There is no incompatibility, as generally assumed in the extensively discussed "problem of time" in Quantum Gravity.


title: Optoelectronic Properties and Defect Physics of Lead-free Photovoltaic Absorbers Cs$_2$Au$^{I}$Au$^{III}$X$_6$ (X=I, Br)

abstract: Stability and toxicity issues with the hybrid lead iodide perovskite MAPbI$_3$ necessitate a hunt for potential alternatives. Here, we shed light on promising photovoltaic properties of gold mixed-valence halide perovskites Cs$_2$Au$_2$X$_6$ (X = I, Br, Cl). They satisfy fundamental requirements such as nontoxicity, better stability, a band gap in the visible range, and a low excitonic binding energy. Our study shows a favorable electronic structure, resulting in a high optical-transition strength, and thus a sharp rise in the absorption spectrum near the band gap. This, in turn, yields a very high short-circuit current density and hence higher simulated efficiency compared with MAPbI$_3$. However, careful investigation of defect physics reveals the possibility of deep-level defects (such as V$_X$ , V$_{Cs}$, X$_{Au}$, X$_{Cs}$, Au$_i$, and Au$_X$ , X = I, Br), depending on the growth conditions. These can act as carrier traps and become detrimental to photovoltaic performance. The present study should help in taking necessary precautions in synthesizing these compounds in a controlled chemical environment, which should minimize performance limiting defects and pave the way for future studies on this class of materials.


title: Exploring itinerant states in divalent hexaborides using rare-earth $L$ edge resonant inelastic X-ray scattering

abstract: We present a study of resonant inelastic X-ray scattering (RIXS) spectra collected at the rare-earth $L$ edges of divalent hexaborides YbB$_6$ and EuB$_6$. In both systems, RIXS-active features are observed at two distinct resonances separated by $\sim10$ eV in incident energy, with angle-dependence suggestive of distinct photon scattering processes. RIXS spectra collected at the divalent absorption peak strongly resemble the unoccupied 5$d$ density of states calculated using density functional theory, an occurrence we ascribe to transitions between weakly-dispersing 4$f$ and strongly dispersing 5$d$ states. In addition, anomalous resonant scattering is observed at higher incident energy, where no corresponding absorption feature is present. Our results suggest the far-reaching utility of $L$-edge RIXS in determining the itinerant-state properties of $f$-electron materials.


title: Accelerating Langevin Sampling with Birth-death

abstract: A fundamental problem in Bayesian inference and statistical machine learning is to efficiently sample from multimodal distributions. Due to metastability, multimodal distributions are difficult to sample using standard Markov chain Monte Carlo methods. We propose a new sampling algorithm based on a birth-death mechanism to accelerate the mixing of Langevin diffusion. Our algorithm is motivated by its mean field partial differential equation (PDE), which is a Fokker-Planck equation supplemented by a nonlocal birth-death term. This PDE can be viewed as a gradient flow of the Kullback-Leibler divergence with respect to the Wasserstein-Fisher-Rao metric. We prove that under some assumptions the asymptotic convergence rate of the nonlocal PDE is independent of the potential barrier, in contrast to the exponential dependence in the case of the Langevin diffusion. We illustrate the efficiency of the birth-death accelerated Langevin method through several analytical examples and numerical experiments.


title: Why Didn't You Listen to Me? Comparing User Control of Human-in-the-Loop Topic Models

abstract: To address the lack of comparative evaluation of Human-in-the-Loop Topic Modeling (HLTM) systems, we implement and evaluate three contrasting HLTM modeling approaches using simulation experiments. These approaches extend previously proposed frameworks, including constraints and informed prior-based methods. Users should have a sense of control in HLTM systems, so we propose a control metric to measure whether refinement operations' results match users' expectations. Informed prior-based methods provide better control than constraints, but constraints yield higher quality topics.


title: Interpreting a Recurrent Neural Network's Predictions of ICU Mortality Risk

abstract: Deep learning has demonstrated success in many applications; however, their use in healthcare has been limited due to the lack of transparency into how they generate predictions. Algorithms such as Recurrent Neural Networks (RNNs) when applied to Electronic Medical Records (EMR) introduce additional barriers to transparency because of the sequential processing of the RNN and the multi-modal nature of EMR data. This work seeks to improve transparency by: 1) introducing Learned Binary Masks (LBM) as a method for identifying which EMR variables contributed to an RNN model's risk of mortality (ROM) predictions for critically ill children; and 2) applying KernelSHAP for the same purpose. Given an individual patient, LBM and KernelSHAP both generate an attribution matrix that shows the contribution of each input feature to the RNN's sequence of predictions for that patient. Attribution matrices can be aggregated in many ways to facilitate different levels of analysis of the RNN model and its predictions. Presented are three methods of aggregations and analyses: 1) over volatile time periods within individual patient predictions, 2) over populations of ICU patients sharing specific diagnoses, and 3) across the general population of critically ill children.


title: Fair is Better than Sensational:Man is to Doctor as Woman is to Doctor

abstract: Analogies such as "man is to king as woman is to X" are often used to illustrate the amazing power of word embeddings. Concurrently, they have also been used to expose how strongly human biases are encoded in vector spaces built on natural language, like "man is to computer programmer as woman is to homemaker". Recent work has shown that analogies are in fact not such a diagnostic for bias, and other methods have been proven to be more apt to the task. However, beside the intrinsic problems with the analogy task as a bias detection tool, in this paper we show that a series of issues related to how analogies have been implemented and used might have yielded a distorted picture of bias in word embeddings. Human biases are present in word embeddings and need to be addressed. Analogies, though, are probably not the right tool to do so. Also, the way they have been most often used has exacerbated some possibly non-existing biases and perhaps hid others. Because they are still widely popular, and some of them have become classics within and outside the NLP community, we deem it important to provide a series of clarifications that should put well-known, and potentially new cases into the right perspective.


title: Maximal Violation of a Broad Class of Bell Inequalities and Its Implications on Self-Testing

abstract: In quantum information, lifting is a systematic procedure that can be used to derive---when provided with a seed Bell inequality---other Bell inequalities applicable in more complicated Bell scenarios. It is known that the procedure of lifting introduced by Pironio [J. Math. Phys. A 46, 062112 (2005)] preserves the facet-defining property of a Bell inequality. Lifted Bell inequalities therefore represent a broad class of Bell inequalities that can be found in {\em all} Bell scenarios. Here, we show that the maximal value of {\em any} lifted Bell inequality is preserved for both the set of nonsignaling correlations and quantum correlations. Despite the degeneracy in the maximizers of such inequalities, we show that the ability to self-test a quantum state is preserved under these lifting operations. In addition, except for outcome-lifting, local measurements that are self-testable using the original Bell inequality---despite the degeneracy---can also be self-tested using {\em any} lifted Bell inequality derived therefrom. While it is not possible to self-test {\em all} the positive-operator-valued measure elements using an outcome-lifted Bell inequality, we show that partial, but robust self-testing statements on the underlying measurements can nonetheless be made from the quantum violation of these lifted inequalities. We also highlight the implication of our observations on the usefulness of using lifted Bell-like inequalities as a device-independent witnesses for entanglement depth. The impact of the aforementioned degeneracy on the geometry of the quantum set of correlations is briefly discussed.


title: Modeling Smart Contracts Activities: A Tensor Based Approach

abstract: Smart contracts are autonomous software executing predefined conditions. Two of the biggest advantages of the smart contracts are secured protocols and transaction costs reduction. On the Ethereum platform, an open-source blockchain-based platform, smart contracts implement a distributed virtual machine on the distributed ledger. To avoid denial of service attacks and monetize the services, payment transactions are executed whenever code is being executed between contracts. It is thus natural to investigate if predictive analysis is capable to forecast these interactions. We have addressed this issue and propose an innovative application of the tensor decomposition CANDECOMP/PARAFAC to the temporal link prediction of smart contracts. We introduce a new approach leveraging stochastic processes for series predictions based on the tensor decomposition that can be used for smart contracts predictive analytics.


title: Non-Negative PARATUCK2 Tensor Decomposition Combined to LSTM Network For Smart Contracts Profiling

abstract: Smart contracts are programs stored and executed on a blockchain. The Ethereum platform, an open-source blockchain-based platform, has been designed to use these programs offering secured protocols and transaction costs reduction. The Ethereum Virtual Machine performs smart contracts runs, where the execution of each contract is limited to the amount of gas required to execute the operations described in the code. Each gas unit must be paid using Ether, the crypto-currency of the platform. Due to smart contracts interactions evolving over time, analyzing the behavior of smart contracts is very challenging. We address this challenge in our paper. We develop for this purpose an innovative approach based on the non-negative tensor decomposition PARATUCK2 combined with long short-term memory (LSTM) to assess if predictive analysis can forecast smart contracts interactions over time. To validate our methodology, we report results for two use cases. The main use case is related to analyzing smart contracts and allows shedding some light into the complex interactions among smart contracts. In order to show the generality of our method on other use cases, we also report its performance on video on demand recommendation.


title: Gradient Descent can Learn Less Over-parameterized Two-layer Neural Networks on Classification Problems

abstract: Recently, several studies have proven the global convergence and generalization abilities of the gradient descent method for two-layer ReLU networks. Most studies especially focused on the regression problems with the squared loss function, except for a few, and the importance of the positivity of the neural tangent kernel has been pointed out. On the other hand, the performance of gradient descent on classification problems using the logistic loss function has not been well studied, and further investigation of this problem structure is possible. In this work, we demonstrate that the separability assumption using a neural tangent model is more reasonable than the positivity condition of the neural tangent kernel and provide a refined convergence analysis of the gradient descent for two-layer networks with smooth activations. A remarkable point of our result is that our convergence and generalization bounds have much better dependence on the network width in comparison to related studies. Consequently, our theory provides a generalization guarantee for less over-parameterized two-layer networks, while most studies require much higher over-parameterization.


title: Thwarting finite difference adversarial attacks with output randomization

abstract: Adversarial examples pose a threat to deep neural network models in a variety of scenarios, from settings where the adversary has complete knowledge of the model and to the opposite "black box" setting. Black box attacks are particularly threatening as the adversary only needs access to the input and output of the model. Defending against black box adversarial example generation attacks is paramount as currently proposed defenses are not effective. Since these types of attacks rely on repeated queries to the model to estimate gradients over input dimensions, we investigate the use of randomization to thwart such adversaries from successfully creating adversarial examples. Randomization applied to the output of the deep neural network model has the potential to confuse potential attackers, however this introduces a tradeoff between accuracy and robustness. We show that for certain types of randomization, we can bound the probability of introducing errors by carefully setting distributional parameters. For the particular case of finite difference black box attacks, we quantify the error introduced by the defense in the finite difference estimate of the gradient. Lastly, we show empirically that the defense can thwart two adaptive black box adversarial attack algorithms.


title: SelectNet: Learning to Sample from the Wild for Imbalanced Data Training

abstract: Supervised learning from training data with imbalanced class sizes, a commonly encountered scenario in real applications such as anomaly/fraud detection, has long been considered a significant challenge in machine learning. Motivated by recent progress in curriculum and self-paced learning, we propose to adopt a semi-supervised learning paradigm by training a deep neural network, referred to as SelectNet, to selectively add unlabelled data together with their predicted labels to the training dataset. Unlike existing techniques designed to tackle the difficulty in dealing with class imbalanced training data such as resampling, cost-sensitive learning, and margin-based learning, SelectNet provides an end-to-end approach for learning from important unlabelled data "in the wild" that most likely belong to the under-sampled classes in the training data, thus gradually mitigates the imbalance in the data used for training the classifier. We demonstrate the efficacy of SelectNet through extensive numerical experiments on standard datasets in computer vision.


title: Computing Genera of Satellite Tunnel Number One Knots and Torti-rational Knots

abstract: The genus of satellite tunnel number one knots and torti-rational knots is computed using the tools introduced by Floyd and Hatcher. An implementation of an algorithm is given to compute genus and slopes of minimal genus Seifert surfaces for such knots.


title: Scaling Up Collaborative Filtering Data Sets through Randomized Fractal Expansions

abstract: Recommender system research suffers from a disconnect between the size of academic data sets and the scale of industrial production systems. In order to bridge that gap, we propose to generate large-scale user/item interaction data sets by expanding pre-existing public data sets. Our key contribution is a technique that expands user/item incidence matrices matrices to large numbers of rows (users), columns (items), and non-zero values (interactions). The proposed method adapts Kronecker Graph Theory to preserve key higher order statistical properties such as the fat-tailed distribution of user engagements, item popularity, and singular value spectra of user/item interaction matrices. Preserving such properties is key to building large realistic synthetic data sets which in turn can be employed reliably to benchmark recommender systems and the systems employed to train them. We further apply our stochastic expansion algorithm to the binarized MovieLens 20M data set, which comprises 20M interactions between 27K movies and 138K users. The resulting expanded data set has 1.2B ratings, 2.2M users, and 855K items, which can be scaled up or down.


title: Strong Single- and Two-Photon Luminescence Enhancement by Nonradiative Energy Transfer across Layered Heterostructure

abstract: The strong light-matter interaction in monolayer transition metal dichalcogenides (TMDs) is promising for nanoscale optoelectronics with their direct band gap nature and the ultra-fast radiative decay of the strongly bound excitons these materials host. However, the impeded amount of light absorption imposed by the ultra-thin nature of the monolayers impairs their viability in photonic applications. Using a layered heterostructure of a monolayer TMD stacked on top of strongly absorbing, non-luminescent, multi-layer SnSe2, we show that both single-photon and two-photon luminescence from the TMD monolayer can be enhanced by a factor of 14 and 7.5, respectively. This is enabled through inter-layer dipole-dipole coupling induced non-radiative Forster resonance energy transfer (FRET) from SnSe2 underneath which acts as a scavenger of the light unabsorbed by the monolayer TMD. The design strategy exploits the near-resonance between the direct energy gap of SnSe2 and the excitonic gap of monolayer TMD, the smallest possible separation between donor and acceptor facilitated by van der Waals heterojunction, and the in-plane orientation of dipoles in these layered materials. The FRET driven uniform single- and twophoton luminescence enhancement over the entire junction area is advantageous over the local enhancement in quantum dot or plasmonic structure integrated 2D layers, and is promising for improving quantum efficiency in imaging, optoelectronic, and photonic applications.


title: Deep density ratio estimation for change point detection

abstract: In this work, we propose new objective functions to train deep neural network based density ratio estimators and apply it to a change point detection problem. Existing methods use linear combinations of kernels to approximate the density ratio function by solving a convex constrained minimization problem. Approximating the density ratio function using a deep neural network requires defining a suitable objective function to optimize. We formulate and compare objective functions that can be minimized using gradient descent and show that the network can effectively learn to approximate the density ratio function. Using our deep density ratio estimation objective function results in better performance on a seizure detection task than other (kernel and neural network based) density ratio estimation methods and other window-based change point detection algorithms. We also show that the method can still support other neural network architectures, such as convolutional networks.


title: CASS: Cross Adversarial Source Separation via Autoencoder

abstract: This paper introduces a cross adversarial source separation (CASS) framework via autoencoder, a new model that aims at separating an input signal consisting of a mixture of multiple components into individual components defined via adversarial learning and autoencoder fitting. CASS unifies popular generative networks like auto-encoders (AEs) and generative adversarial networks (GANs) in a single framework. The basic building block that filters the input signal and reconstructs the $i$-th target component is a pair of deep neural networks $\mathcal{EN}_i$ and $\mathcal{DE}_i$ as an encoder for dimension reduction and a decoder for component reconstruction, respectively. The decoder $\mathcal{DE}_i$ as a generator is enhanced by a discriminator network $\mathcal{D}_i$ that favors signal structures of the $i$-th component in the $i$-th given dataset as guidance through adversarial learning. In contrast with existing practices in AEs which trains each Auto-Encoder independently, or in GANs that share the same generator, we introduce cross adversarial training that emphasizes adversarial relation between any arbitrary network pairs $(\mathcal{DE}_i,\mathcal{D}_j)$, achieving state-of-the-art performance especially when target components share similar data structures.


title: A foliation of the ball by complete holomorphic discs

abstract: We show that the open unit ball $\mathbb{B}^n$ of $\mathbb{C}^n$ $(n>1)$ admits a nonsingular holomorphic foliation by complete properly embedded holomorphic discs.


title: BPS states in the Minahan-Nemeschansky $E_7$ theory

abstract: We use the method of spectral networks to calculate BPS degeneracies in the Minahan-Nemeschansky $E_7$ theory, as representations of the $E_7$ flavor symmetry. Our results provide another example of a pattern noticed earlier in the Minahan-Nemeschansky $E_6$ theory: when the electromagnetic charge is $n$ times a primitive charge, the BPS index is a positive integer multiple of $(-1)^{n+1} n$. We also calculate BPS degeneracies in the Minahan-Nemeschansky $E_6$ theory for larger charges than were previously computed.


title: Contextual Bandit Learning for Machine Type Communications in the Null Space of Multi-Antenna Systems

abstract: In this paper, a novel approach based on the concept of opportunistic spatial orthogonalization (OSO) is proposed for interference management between machine type communications (MTC) and conventional cellular communications. In particular, a cellular system is considered with a multi-antenna BS in which a receive beamformer is designed to maximize the rate of a cellular user, and, a machine type aggregator (MTA) that receives data from a large set of MTDs. If there is a large number of MTDs to choose from for transmission at each time for each beamformer, one MTD can be selected such that it causes almost no interference on the BS. A comprehensive analytical study of the characteristics of such interference from several MTDs on the same beamformer is carried out. It is proven that, for each beamformer, an MTD exists such that the interference on the BS is negligible. However, the optimal implementation of OSO requires the CSI of all the links in the BS, which is not practical for MTC. To solve this problem, an online learning method based on the concept of contextual multi-armed bandits (MAB) learning is proposed. Simulation results show that is possible to implement OSO with no CSI from MTDs to the BS.


title: Adaptive Function-on-Scalar Regression with a Smoothing Elastic Net

abstract: This paper presents a new methodology, called AFSSEN, to simultaneously select significant predictors and produce smooth estimates in a high-dimensional function-on-scalar linear model with a sub-Gaussian errors. Outcomes are assumed to lie in a general real separable Hilbert space, H, while parameters lie in a subspace known as a Cameron Martin space, K, which are closely related to Reproducing Kernel Hilbert Spaces, so that parameter estimates inherit particular properties, such as smoothness or periodicity, without enforcing such properties on the data. We propose a regularization method in the style of an adaptive Elastic Net penalty that involves mixing two types of functional norms, providing a fine tune control of both the smoothing and variable selection in the estimated model. Asymptotic theory is provided in the form of a functional oracle property, and the paper concludes with a simulation study demonstrating the advantage of using AFSSEN over existing methods in terms of prediction error and variable selection.


title: Scale Invariant Power Iteration

abstract: Power iteration has been generalized to solve many interesting problems in machine learning and statistics. Despite its striking success, theoretical understanding of when and how such an algorithm enjoys good convergence property is limited. In this work, we introduce a new class of optimization problems called scale invariant problems and prove that they can be efficiently solved by scale invariant power iteration (SCI-PI) with a generalized convergence guarantee of power iteration. By deriving that a stationary point is an eigenvector of the Hessian evaluated at the point, we show that scale invariant problems indeed resemble the leading eigenvector problem near a local optimum. Also, based on a novel reformulation, we geometrically derive SCI-PI which has a general form of power iteration. The convergence analysis shows that SCI-PI attains local linear convergence with a rate being proportional to the top two eigenvalues of the Hessian at the optimum. Moreover, we discuss some extended settings of scale invariant problems and provide similar convergence results for them. In numerical experiments, we introduce applications to independent component analysis, Gaussian mixtures, and non-negative matrix factorization. Experimental results demonstrate that SCI-PI is competitive to state-of-the-art benchmark algorithms and often yield better solutions.


title: Neural Stochastic Differential Equations: Deep Latent Gaussian Models in the Diffusion Limit

abstract: In deep latent Gaussian models, the latent variable is generated by a time-inhomogeneous Markov chain, where at each time step we pass the current state through a parametric nonlinear map, such as a feedforward neural net, and add a small independent Gaussian perturbation. This work considers the diffusion limit of such models, where the number of layers tends to infinity, while the step size and the noise variance tend to zero. The limiting latent object is an It\^o diffusion process that solves a stochastic differential equation (SDE) whose drift and diffusion coefficient are implemented by neural nets. We develop a variational inference framework for these \textit{neural SDEs} via stochastic automatic differentiation in Wiener space, where the variational approximations to the posterior are obtained by Girsanov (mean-shift) transformation of the standard Wiener process and the computation of gradients is based on the theory of stochastic flows. This permits the use of black-box SDE solvers and automatic differentiation for end-to-end inference. Experimental results with synthetic data are provided.


title: Naive Feature Selection: Sparsity in Naive Bayes

abstract: Due to its linear complexity, naive Bayes classification remains an attractive supervised learning method, especially in very large-scale settings. We propose a sparse version of naive Bayes, which can be used for feature selection. This leads to a combinatorial maximum-likelihood problem, for which we provide an exact solution in the case of binary data, or a bound in the multinomial case. We prove that our bound becomes tight as the marginal contribution of additional features decreases. Both binary and multinomial sparse models are solvable in time almost linear in problem size, representing a very small extra relative cost compared to the classical naive Bayes. Numerical experiments on text data show that the naive Bayes feature selection method is as statistically effective as state-of-the-art feature selection methods such as recursive feature elimination, $l_1$-penalized logistic regression and LASSO, while being orders of magnitude faster. For a large data set, having more than with $1.6$ million training points and about $12$ million features, and with a non-optimized CPU implementation, our sparse naive Bayes model can be trained in less than 15 seconds.


title: A COLD Approach to Generating Optimal Samples

abstract: Optimising discrete data for a desired characteristic using gradient-based methods involves projecting the data into a continuous latent space and carrying out optimisation in this space. Carrying out global optimisation is difficult as optimisers are likely to follow gradients into regions of the latent space that the model has not been exposed to during training; samples generated from these regions are likely to be too dissimilar to the training data to be useful. We propose Constrained Optimisation with Latent Distributions (COLD), a constrained global optimisation procedure to find samples with high values of a desired property that are similar to yet distinct from the training data. We find that on MNIST, our procedure yields optima for each of three different objectives, and that enforcing tighter constraints improves the quality and increases the diversity of the generated images. On the ChEMBL molecular dataset, our method generates a diverse set of new molecules with drug-likeness scores similar to those of the highest-scoring molecules in the training data. We also demonstrate a computationally efficient way to approximate the constraint when evaluating it exactly is computationally expensive.


title: A functorial approach to Gabriel $k$-quiver constructions for coalgebras and pseudocompact algebras

abstract: We define the path coalgebra and Gabriel quiver constructions as functors between the category of $k$-quivers and the category of pointed $k$-coalgebras, for $k$ a field. We define a congruence relation on the coalgebra side, show that the functors above respect this relation, and prove that the induced Gabriel $k$-quiver functor is left adjoint to the corresponding path coalgebra functor. We dualize, obtaining adjoint pairs of functors (contravariant and covariant) for pseudocompact algebras. Using these tools we describe precisely to what extent presentations of coalgebras and algebras in terms of path objects are unique, giving an application to homogeneous algebras.


title: Topological Hall Effect and Emergent Skyrmion Crystal in Manganite-Iridate Oxide Interfaces

abstract: Scalar spin chirality is expected to induce a finite contribution to the Hall response at low temperatures. We study this spin-chirality-driven Hall effect, known as the topological Hall effect, at the manganite side of the interface between La$_{1-x}$Sr$_{x}$MnO$_{3}$ and SrIrO$_3$. The ferromagnetic double-exchange hopping at the manganite layer, in conjunction with the Dzyaloshinskii-Moriya (DM) interaction which arises at the interface due to broken inversion symmetry and strong spin-orbit coupling from the iridate layer, could produce a skyrmion-crystal (SkX) phase in the presence of an external magnetic field. Using the Monte Carlo technique and a two-orbital spin-fermion model for manganites, supplemented by an in-plane DM interaction, we obtain phase diagrams which reveal at low temperatures a clear SkX phase and also a low-field spin-spiral phase. Increasing temperature, a skyrmion-gas phase, precursor of the SkX phase upon cooling, was identified. The topological Hall effect primarily appears in the SkX phase, as observed before in oxide heterostructures. We conclude that the manganite-iridate superlattices provide another useful platform to explore a plethora of unconventional magnetic and transport properties.