title: Extremal black hole scattering at O(G^3): graviton dominance, eikonal exponentiation, and differential equations

abstract: We use $\mathcal N=8$ supergravity as a toy model for understanding the dynamics of black hole binary systems via the scattering amplitudes approach. We compute the conservative part of the classical scattering angle of two extremal (half-BPS) black holes with minimal charge misalignment at $\mathcal O(G^3)$ using the eikonal approximation and effective field theory, finding agreement between both methods. We construct the massive loop integrands by Kaluza-Klein reduction of the known $D$-dimensional massless integrands. To carry out integration we formulate a novel method for calculating the post-Minkowskian expansion with exact velocity dependence, by solving velocity differential equations for the Feynman integrals subject to modified boundary conditions that isolate conservative contributions from the potential region. Motivated by a recent result for universality in massless scattering, we compare the scattering angle to the result found by Bern et. al. in Einstein gravity and find that they coincide in the high-energy limit, suggesting graviton dominance at this order.


title: Dark matter or correlated errors: Systematics of the AMS-02 antiproton excess

abstract: Several studies have pointed out an excess in the AMS-02 antiproton spectrum at rigidities of 10-20 GV. Its spectral properties were found to be consistent with a dark-matter particle of mass 50-100 GeV which annihilates hadronically at roughly the thermal rate. In this work, we reinvestigate the antiproton excess including all relevant sources of systematic errors. Most importantly, we perform a realistic estimate of the correlations in the AMS-02 systematic error which could potentially "fake" a dark-matter signal. The dominant systematics in the relevant rigidity range originate from uncertainties in the cross sections for absorption of cosmic rays within the detector material. For the first time, we calculate their correlations within the full Glauber-Gribov theory of inelastic scattering. The AMS-02 correlations enter our spectral search for dark matter in the form of covariance matrices which we make publicly available for the cosmic-ray community. We find that the global significance of the antiproton excess is reduced to below 1 $\sigma$ once all systematics, including the derived AMS-02 error correlations, are taken into account. No significant preference for a dark-matter signal in the AMS-02 antiproton data is found in the mass range 10-10000 GeV.


title: Density functional approach to correlated moire states: itinerant magnetism

abstract: Two-dimensional moire superlattices have recently emerged as a fertile ground for creating novel electronic phases of matter with unprecedented control. Despite intensive efforts, theoretical investigation of correlated moire systems has been challenged by the large number of atoms in a superlattice unit cell and the inherent difficulty of treating electron correlation. The physics of correlated moire systems is governed by low-energy electrons in a coarse-grained long-wavelength potential, unlike the singular Coulomb potential of atomically-spaced ions in natural solids. Motivated by the separation between moire and atomic length scales, in this work we apply density functional theory to study directly the continuum model of interacting electrons in the periodic moire potential. Using this quantitatively accurate method, we predict itinerant spin-valley ferromagnetism in transition metal dichalchogenide heterobilayers, which originates from the constructive interplay between moire potential and Coulomb interaction in a two-dimensional electron system.


title: GW190412 as a Third-Generation Black Hole Merger from a Super Star Cluster

abstract: We explore the possibility that GW190412, a binary black hole merger with a non-equal-mass ratio and significantly spinning primary, was formed through repeated black hole mergers in a dense super star cluster. Using a combination of semi-analytic prescriptions for the remnant spin and recoil kick of black hole mergers, we show that the mass ratio and spin of GW190412 are consistent with a binary black hole whose primary component has undergone two successive mergers from a population of $\sim 10M_{\odot}$ black holes in a high-metallicity environment. We then explore the production of GW190412-like analogs in the CMC Cluster Catalog, a grid of 148 $N$-body star cluster models, as well as a new model, behemoth, with nearly $10^7$ particles and initial conditions taken from a cosmological MHD simulation of galaxy formation. We show that the production of binaries with GW190412-like masses and spins is dominated by massive super star clusters with high metallicities and large central escape speeds. While many are observed in the local universe, our results suggest that a careful treatment of these massive clusters, many of which may have been disrupted before the present day, is necessary to characterize the production of unique gravitational-wave events produced through dynamics.


title: Dark Matter Capture by Atomic Nuclei

abstract: We propose a new strategy to search for a particular type of dark matter via nuclear capture. If the dark matter particle carries baryon number, as motivated by a class of theoretical explanations of the matter-antimatter asymmetry of the universe, it can mix with the neutron and be captured by an atomic nucleus. The resulting state de-excites by emitting a single photon or a cascade of photons with a total energy of up to several MeV. The exact value of this energy depends on the dark matter mass. We investigate the prospects for detecting dark matter capture signals in current and future neutrino and dark matter direct detection experiments.


title: Ticking-clock performance enhanced by nonclassical temporal correlations

abstract: We investigate the role of nonclassical temporal correlations in enhancing the performance of ticking clocks in a discrete-time scenario. We show that the problem of optimal models for ticking clocks is related to the violation of Leggett-Garg-type temporal inequalities formulated in terms of, possibly invasive, sequential measurements, but on a system with a bounded memory capacity. Ticking clocks inspire the derivation of a family of temporal inequalities showing a gap between classical and quantum correlations, despite involving no input. We show that quantum ticking-clock models achieving accuracy beyond the classical bound are also those violating Leggett-Garg-type temporal inequalities for finite sequences and we investigate their continuous-time limit. Interestingly, we show that optimal classical clock models in the discrete-time scenario do not have a well-defined continuous-time limit, a feature that is absent in quantum models.


title: From Navier-Stokes to Maxwell via Einstein

abstract: We revisit the cutoff surface formulation of fluid-gravity duality in the context of the classical double copy. The spacetimes in this fluid-gravity duality are algebraically special, with Petrov type II when the spacetime is four dimensional. We find two special classes of fluids whose dual spacetimes exhibit higher algebraic speciality: constant vorticity flows have type D gravity duals, while potential flows map to type N spacetimes. Using the Weyl version of the classical double copy, we construct associated single-copy gauge fields for both cases, finding that constant vorticity fluids map to a solenoid gauge field. Additionally we find the scalar in a potential flow fluid maps to the zeroth copy scalar.


title: Astrophysical implications of GW190412 as a remnant of a previous black-hole merger

abstract: Two of the dominant channels to produce merging stellar-mass black-hole binaries are believed to be the isolated evolution of binary stars in the field and dynamical formation in star clusters. The first reported black-hole binary event from the third LIGO/Virgo observing run (GW190412) is unusual in that it has unequal masses, nonzero effective spin, and nonzero primary spin at 90\% confidence interval. We show that this event should be exceedingly rare in the context of both the field and cluster formation scenarios. Interpreting GW190412 as a remnant of a previous black-hole merger provides a promising route to explain its features. If GW190412 indeed formed hierarchically, we show that the region of the parameter space that is best motivated from an astrophysical standpoint (low natal spins and light clusters) cannot accommodate the observation. We analyze public GW190412 LIGO/Virgo data with a Bayesian prior where the more massive black hole resulted from a previous merger, and find that this interpretation is equally supported by the data. If the heavier component of GW190412 is indeed a merger remnant, then its spin magnitude is $\chi_1=0.56_{-0.21}^{+0.19}$, which is higher than the value previously reported by the LIGO/Virgo collaboration.


title: Is the gap in the DS Tau disc hiding a planet?

abstract: Recent mm-wavelength surveys performed with the Atacama Large Millimeter Array (ALMA) have revealed protoplanetary discs characterized by rings and gaps. A possible explanation for the origin of such rings is the tidal interaction with an unseen planetary companion. The protoplanetary disc around DS Tau shows a wide gap in the ALMA observation at 1.3 mm. We construct a hydrodynamical model for the dust continuum observed by ALMA assuming the observed gap is carved by a planet between one and five Jupiter masses. We fit the shape of the radial intensity profile along the disc major axis varying the planet mass, the dust disc mass, and the evolution time of the system. The best fitting model is obtained for a planet with $M_{\rm p}=3.5\,M_{\rm Jup}$ and a disc with $M_{\rm dust}= 9.6\cdot10^{-5}\,M_{\odot}$. Starting from this result, we also compute the expected signature of the planet in the gas kinematics, as traced by CO emission. We find that such a signature (in the form of a "kink" in the channel maps) could be observed by ALMA with a velocity resolution between $0.2-0.5\,\rm{kms}^{-1}$ and a beam size between 30 and 50 mas.


title: Balancing Objectives in Counseling Conversations: Advancing Forwards or Looking Backwards

abstract: Throughout a conversation, participants make choices that can orient the flow of the interaction. Such choices are particularly salient in the consequential domain of crisis counseling, where a difficulty for counselors is balancing between two key objectives: advancing the conversation towards a resolution, and empathetically addressing the crisis situation. In this work, we develop an unsupervised methodology to quantify how counselors manage this balance. Our main intuition is that if an utterance can only receive a narrow range of appropriate replies, then its likely aim is to advance the conversation forwards, towards a target within that range. Likewise, an utterance that can only appropriately follow a narrow range of possible utterances is likely aimed backwards at addressing a specific situation within that range. By applying this intuition, we can map each utterance to a continuous orientation axis that captures the degree to which it is intended to direct the flow of the conversation forwards or backwards. This unsupervised method allows us to characterize counselor behaviors in a large dataset of crisis counseling conversations, where we show that known counseling strategies intuitively align with this axis. We also illustrate how our measure can be indicative of a conversation's progress, as well as its effectiveness.


title: ConvoKit: A Toolkit for the Analysis of Conversations

abstract: This paper describes the design and functionality of ConvoKit, an open-source toolkit for analyzing conversations and the social interactions embedded within. ConvoKit provides an unified framework for representing and manipulating conversational data, as well as a large and diverse collection of conversational datasets. By providing an intuitive interface for exploring and interacting with conversational data, this toolkit lowers the technical barriers for the broad adoption of computational methods for conversational analysis.


title: Thermal transport in a weakly magnetized hot QCD medium

abstract: The thermal transport coefficients in a weakly magnetized quark-gluon plasma have been investigated within the ambit of a quasiparticle model to encode the effects of the realistic equation of state. The presence of a weak magnetic field leads to the Hall-type conductivity associated with thermal transport in the medium. An effective covariant kinetic theory has been employed to quantify the thermal dissipation while incorporating the mean field contributions in the medium. The interplay of thermal transport and electric charge transport in the weakly magnetized medium has been explored in terms of the Wiedemann-Franz law. Strong violation of the Wiedemann-Franz law has been observed in temperature regimes near to the transition temperature. The behaviour of thermal conductivity in the strong magnetic field limit has also been studied. It is observed that both the magnetic field and equation of state have a significant impact on the thermal dissipation in the medium.


title: Transient Drude Response Dominates Near-Infrared Pump-Probe Reflectivity in Nodal-Line Semimetals ZrSiS and ZrSiSe

abstract: The ultrafast optical response of two nodal-line semimetals, ZrSiS and ZrSiSe, was studied in the near-infrared using transient reflectivity. The two materials exhibit similar responses, characterized by two features, well resolved in time and energy. The first transient feature decays after a few hundred femtoseconds, while the second lasts for nanoseconds. Using Drude-Lorentz fits of the materials' equilibrium reflectance, we show that the fast response is well-represented by a decrease of the Drude plasma frequency, and the second feature by an increase of the Drude scattering rate. This directly connects the transient data to a physical picture in which carriers, after being excited away from the Fermi energy, return to that vicinity within a few hundred femtoseconds by sharing their excess energy with the phonon bath, resulting in a hot lattice that relaxes only through slow diffusion processes (ns). The emerging picture reveals that the sudden change of the density of carriers at the Fermi level instantaneously modifies the transport properties of the materials on a timescale not compatible with electron phonon thermalization and is largely driven by the reduced density of states at the nodal line.


title: Ferroelectric 180 degree walls are mechanically softer than the domains they separate

abstract: Domain walls are functionally different from the domains they separate, but little is known about their mechanical properties. Using scanning probe microscopy, we have measured the mechanical response of ferroelectric 180o domain walls and observed that, despite separating domains that are mechanically identical (non-ferroelastic), the walls are mechanically distinct -- softer -- compared to the domains. This effect has been observed in different ferroelectric materials (LiNbO3, BaTiO3, PbTiO3) and with different morphologies (from single crystals to thin films) so it appears to be universal. We propose a theoretical framework that explains the domain wall softening and justifies that the effect should be common to all ferroelectrics.


title: Non-Wilson-Fisher kinks of $O(N)$ numerical bootstrap: from the deconfined phase transition to a putative new family of CFTs

abstract: It is well established that the $O(N)$ Wilson-Fisher (WF) CFT sits at a kink of the numerical bounds from bootstrapping four point function of $O(N)$ vector. Moving away from the WF kinks, there indeed exists another family of kinks (dubbed non-WF kinks) on the curve of $O(N)$ numerical bounds. Different from the $O(N)$ WF kinks that exist for arbitary $N$ in $2<d<4$ dimensions, the non-WF kinks exist in arbitrary dimensions but only for a large enough $N>N_c(d)$ in a given dimension $d$. In this paper we have achieved a thorough understanding for few special cases of these non-WF kinks. The first case is the $O(4)$ bootstrap in 2d, where the non-WF kink turns out to be the $SU(2)_1$ Wess-Zumino-Witten (WZW) model, and all the $SU(2)_{k>2}$ WZW models saturate the numerical bound on the left side of the kink. We further carry out dimensional continuation of the 2d $SU(2)_1$ kink towards the 3d $SO(5)$ deconfined phase transition. We find the kink disappears at around $d=2.7$ dimensions indicating the $SO(5)$ deconfined phase transition is weakly first order. The second interesting observation is, the $O(2)$ bootstrap bound does not show any kink in 2d ($N_c=2$), but is surprisingly saturated by the 2d free boson CFT (also called Luttinger liquid) all the way on the numerical curve. The last case is the $N=\infty$ limit, where the non-WF kink sits at $(\Delta_\phi, \Delta_T)=(d-1, 2d)$ in $d$ dimensions. We manage to write down its analytical four point function in arbitrary dimensions, which equals to the subtraction of correlation functions of a free fermion theory and generalized free theory. An important feature of this solution is the existence of a full tower of conserved higher spin current. We speculate that a new family of CFTs will emerge at non-WF kinks for finite $N$, in a similar fashion as $O(N)$ WF CFTs originating from free boson at $N=\infty$.


title: A family of $C^1$ quadrilateral finite elements

abstract: We present a novel family of $C^1$ quadrilateral finite elements, which define global $C^1$ spaces over a general quadrilateral mesh with vertices of arbitrary valency. The elements extend the construction by (Brenner and Sung, J. Sci. Comput., 2005), which is based on polynomial elements of tensor-product degree $p\geq 6$, to all degrees $p \geq 3$. Thus, we call the family of $C^1$ finite elements Brenner-Sung quadrilaterals. The proposed $C^1$ quadrilateral can be seen as a special case of the Argyris isogeometric element of (Kapl, Sangalli and Takacs, CAGD, 2019). The quadrilateral elements possess similar degrees of freedom as the classical Argyris triangles. Just as for the Argyris triangle, we additionally impose $C^2$ continuity at the vertices. In this paper we focus on the lower degree cases, that may be desirable for their lower computational cost and better conditioning of the basis: We consider indeed the polynomial quadrilateral of (bi-)degree~$5$, and the polynomial degrees $p=3$ and $p=4$ by employing a splitting into $3\times3$ or $2\times2$ polynomial pieces, respectively. The proposed elements reproduce polynomials of total degree $p$. We show that the space provides optimal approximation order. Due to the interpolation properties, the error bounds are local on each element. In addition, we describe the construction of a simple, local basis and give for $p\in\{3,4,5\}$ explicit formulas for the B\'{e}zier or B-spline coefficients of the basis functions. Numerical experiments by solving the biharmonic equation demonstrate the potential of the proposed $C^1$ quadrilateral finite element for the numerical analysis of fourth order problems, also indicating that (for $p=5$) the proposed element performs comparable or in general even better than the Argyris triangle with respect to the number of degrees of freedom.


title: Dual matroid polytopes and internal activity of independence complexes

abstract: Shelling orders are a ubiquitous tool used to understand invariants of cell complexes. Significant effort has been made to develop techniques to decide when a given complex is shellable. However, empirical evidence shows that some shelling orders are better than others. In this article, we explore this phenomenon in the case of matroid independence complexes. Based on a new relation between shellability of dual matroid polytopes and independence complexes, we outline a systematic way to investigate and compare different shellings orders. We explain how our new tools recast and deepen various classical results to the language of geometry, and suggest new heuristics for addressing two old conjectures due to Simon and Stanley. Furthermore, we present freely available software which can be used to experiment with these new geometric ideas.


title: Rapid Evolution of Type II Spicules Observed in Goode Solar Telescope On-Disk H-alpha Images

abstract: We analyze ground-based chromospheric data acquired at a high temporal cadence of 2 s in wings of the H$\alpha$ spectral line using Goode Solar Telescope (GST) operating at the Big Bear Solar Observatory. We inspected a 30 minute long H$\alpha$-0.08~nm data set to find that rapid blue-shifted H$\alpha$ excursions (RBEs), which are a cool component of type II spicules, experience very rapid morphological changes on the time scales of the order of 1 second. Unlike typical reconnection jets, RBEs very frequently appear \textit{in situ} without any clear evidence of H$\alpha$ material being injected from below. Their evolution includes inverted "Y", "V", "N", and parallel splitting (doubling) patterns as well as sudden formation of a diffuse region followed by branching. We also find that the same feature may undergo several splitting episodes within about 1 min time interval.


title: Invariance of Plurigenera and boundedness for Generalized Pairs

abstract: In this note, we survey some recent developments in birational geometry concerning the boundedness of algebraic varieties. We delineate a strategy to extend some of these results to the case of generalized pairs, first introduced by Birkar and Zhang, when the associated log canonical divisor is ample, and the volume is fixed. In this context, we show a version of deformation invariance of plurigenera for generalized pairs. We conclude by discussing an application to the boundedness of varieties of Kodaira dimension $\kappa(X)=\dim(X)-1$.


title: STINet: Spatio-Temporal-Interactive Network for Pedestrian Detection and Trajectory Prediction

abstract: Detecting pedestrians and predicting future trajectories for them are critical tasks for numerous applications, such as autonomous driving. Previous methods either treat the detection and prediction as separate tasks or simply add a trajectory regression head on top of a detector. In this work, we present a novel end-to-end two-stage network: Spatio-Temporal-Interactive Network (STINet). In addition to 3D geometry modeling of pedestrians, we model the temporal information for each of the pedestrians. To do so, our method predicts both current and past locations in the first stage, so that each pedestrian can be linked across frames and the comprehensive spatio-temporal information can be captured in the second stage. Also, we model the interaction among objects with an interaction graph, to gather the information among the neighboring objects. Comprehensive experiments on the Lyft Dataset and the recently released large-scale Waymo Open Dataset for both object detection and future trajectory prediction validate the effectiveness of the proposed method. For the Waymo Open Dataset, we achieve a bird-eyes-view (BEV) detection AP of 80.73 and trajectory prediction average displacement error (ADE) of 33.67cm for pedestrians, which establish the state-of-the-art for both tasks.


title: Large equilateral sets in subspaces of $\ell_\infty^n$ of small codimension

abstract: For fixed $k$ we prove exponential lower bounds on the equilateral number of subspaces of $\ell_{\infty}^n$ of codimension $k$. In particular, we show that if the unit ball of a normed space of dimension $n$ is a centrally symmetric polytope with at most $\frac{4n}{3}-o(n)$ pairs of facets, then it has an equilateral set of cardinality at least $n+1$. These include subspaces of codimension $2$ of $\ell_{\infty}^{n+2}$ for $n\geq 9$ and of codimension $3$ of $\ell_{\infty}^{n+3}$ for $n\geq 15$.


title: New Herbig-Haro objects and outflows in Mon R1 association

abstract: We present results of the narrow-band Halpha and [SII] imaging survey of Mon R1 association, performed with the 1 m Schmidt telescope of the Byurakan Observatory. Our observations covered one degree field near the center of the association. As a result of this study twenty new Herbig-Haro knots were discovered, some of which form collimated outflows. Among the most extended ones are HH 1203 and HH 1196, which have a length near one parsec or even more. In the course of search for the probable sources of HH objects several new nebulous stars were found. A list of all nebulous stellar objects in the Mon R1 area under study is presented, with the detailed description of most interesting objects. The near infrared data from the GLIMPSE360 and WISE surveys allowed to find several more objects, related to Mon R1, some of them with optical counterparts, as well as to outline at least three probable H_2 collimated flows from the deeply embedded pre-main-sequence objects. The probable members of Mon R1 were selected by their distances, their bolometric luminosities and extinctions were estimated. Among the outflow sources three embedded objects with luminosities greater than 10 L(sun) were found. The mean distance to Mon R1 complex is estimated as 715 pc.


title: View Invariant Human Body Detection and Pose Estimation from Multiple Depth Sensors

abstract: Point cloud based methods have produced promising results in areas such as 3D object detection in autonomous driving. However, most of the recent point cloud work focuses on single depth sensor data, whereas less work has been done on indoor monitoring applications, such as operation room monitoring in hospitals or indoor surveillance. In these scenarios multiple cameras are often used to tackle occlusion problems. We propose an end-to-end multi-person 3D pose estimation network, Point R-CNN, using multiple point cloud sources. We conduct extensive experiments to simulate challenging real world cases, such as individual camera failures, various target appearances, and complex cluttered scenes with the CMU panoptic dataset and the MVOR operation room dataset. Unlike most of the previous methods that attempt to use multiple sensor information by building complex fusion models, which often lead to poor generalization, we take advantage of the efficiency of concatenating point clouds to fuse the information at the input level. In the meantime, we show our end-to-end network greatly outperforms cascaded state-of-the-art models.


title: VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation

abstract: Behavior prediction in dynamic, multi-agent systems is an important problem in the context of self-driving cars, due to the complex representations and interactions of road components, including moving agents (e.g. pedestrians and vehicles) and road context information (e.g. lanes, traffic lights). This paper introduces VectorNet, a hierarchical graph neural network that first exploits the spatial locality of individual road components represented by vectors and then models the high-order interactions among all components. In contrast to most recent approaches, which render trajectories of moving agents and road context information as bird-eye images and encode them with convolutional neural networks (ConvNets), our approach operates on a vector representation. By operating on the vectorized high definition (HD) maps and agent trajectories, we avoid lossy rendering and computationally intensive ConvNet encoding steps. To further boost VectorNet's capability in learning context features, we propose a novel auxiliary task to recover the randomly masked out map entities and agent trajectories based on their context. We evaluate VectorNet on our in-house behavior prediction benchmark and the recently released Argoverse forecasting dataset. Our method achieves on par or better performance than the competitive rendering approach on both benchmarks while saving over 70% of the model parameters with an order of magnitude reduction in FLOPs. It also outperforms the state of the art on the Argoverse dataset.


title: Nonclassical energy squeezing of a macroscopic mechanical oscillator

abstract: Optomechanics and electromechanics have made it possible to prepare macroscopic mechanical oscillators in their quantum ground states, in quadrature squeezed states, and in entangled states of motion. In addition to coaxing ever larger and more tangible objects into a regime of quantum behavior, this new capability has encouraged ideas of using mechanical oscillators in the processing and communication of quantum information and as precision force sensors operating beyond the standard quantum limit. But the effectively linear interaction between motion and light or electricity precludes access to the broader class of quantum states of motion, such as cat states or energy squeezed states. Indeed, early optomechanical proposals noted the possibility to escape this restriction by creating strong quadratic coupling of motion to light. Although there have been experimental demonstrations of quadratically coupled optomechanical systems, these have not yet accessed nonclassical states of motion. Here we create nonclassical states by quadratically coupling motion to the energy levels of a Cooper-pair box (CPB) qubit. By monitoring the qubit's transition frequency, we detect the oscillator's phonon distribution rather than its position. Through microwave frequency drives that change both the state of the oscillator and qubit, we then dissipatively stabilize the oscillator in a state with a large mean phonon number of 43 and sub-Poissonian number fluctuations of approximately 3. In this energy squeezed state we observe a striking feature of the quadratic coupling: the recoil of the mechanical oscillator caused by qubit transitions, closely analogous to the vibronic transitions in molecules.


title: Shrinkage estimation for dose-response modeling in phase II trials with multiple schedules

abstract: Recently, phase II trials with multiple schedules (frequency of administrations) have become more popular, for instance in the development of treatments for atopic dermatitis. If the relationship of the dose and response is described by a parametric model, a simplistic approach is to pool doses from different schedules. However, this approach ignores the potential heterogeneity in dose-response curves between schedules. A more reasonable approach is the partial pooling, i.e. certain parameters of the dose-response curves are shared, while others are allowed to vary. Rather than using schedule-specific fixed-effects, we propose a Bayesian hierarchical model with random-effects to model the between-schedule heterogeneity with regard to certain parameters. Schedule-specific dose-response relationships can then be estimated using shrinkage estimation. Considering Emax models, the proposed method displayed desirable performance in terms of the mean absolute error and the coverage probabilities for the dose-response curve compared to the complete pooling. Furthermore, it outperformed the partial pooling with schedule-specific fixed-effects by producing lower mean absolute error and shorter credible intervals. The methods are illustrated using simulations and a phase II trial example in atopic dermatitis. A publicly available R package, \texttt{ModStan}, is developed to automate the implementation of the proposed method (\href{https://github.com/gunhanb/ModStan}{https://github.com/gunhanb/ModStan}).


title: On Designing Secure and Robust Scan Chain for Protecting Obfuscated Logic

abstract: In this paper, we assess the security and testability of the state-of-the-art design-for-security (DFS) architectures in the presence of scan-chain locking/obfuscation, a group of solution that has previously proposed to restrict unauthorized access to the scan chain. We discuss the key leakage vulnerability in the recently published prior-art DFS architectures. This leakage relies on the potential glitches in the DFS architecture that could lead the adversary to make a leakage condition in the circuit. Also, we demonstrate that the state-of-the-art DFS architectures impose some substantial architectural drawbacks that moderately affect both test flow and design constraints. We propose a new DFS architecture for building a secure scan chain architecture while addressing the potential of key leakage. The proposed architecture allows the designer to perform the structural test with no limitation, enabling an untrusted foundry to utilize the scan chain for manufacturing fault testing without needing to access the scan chain. Our proposed solution poses negligible limitation/overhead on the test flow, as well as the design criteria.


title: Femtosecond-laser-induced nanoscale blisters in polyimide thin films through nonlinear absorption

abstract: Nonlinear absorption of femtosecond laser pulses provides a unique opportunity to confine energy deposition in any medium to a region that is below the focal diameter of a pulse. Illumination of a polymer film through a transparent high bandgap material such as glass, followed by nonlinear absorption of 800 nm light in polymers, allows us to further restrict absorption to a very thin layer along the propagation direction. We demonstrate this confinement by simulating femtosecond-laser-induced polymer modification by linear, two-photon and three-photon absorption, and discuss the control over energy absorption in polymers that multiphoton processes offer. Energy deposited behind a thin polymer film induces a protruding blister. We present experimental results of blister diameter and height scaling with pulse energy. Using 0.95 NA focussing, we obtained laser-induced blisters with diameters as small as 700 nm suggesting blister-based Laser-Induced Forward Transfer is possible on and below the single-micron scale. Sub-micrometer blister formation using femtosecond lasers also offers a novel method of direct, precise laser-writing of microstructures on films with single laser pulses. This method is a possible alternative to lithography, laser milling, and laser-based additive machining which leaves the surface composition unchanged.


title: Comparison of Monge-Amp\`ere capacities

abstract: Let $(X,\omega)$ be a compact K\"ahler manifold. We prove that all Monge-Amp\`ere capacities are comparable. Using this we give an alternative direct proof of the integration by parts formula for non-pluripolar products recently proved by M. Xia.


title: Non-Perturbative Completion of Hopf-Algebraic Dyson-Schwinger Equations

abstract: For certain quantum field theories, the Kreimer-Connes Hopf-algebraic approach to renormalization reduces the Dyson-Schwinger equations to a system of non-linear ordinary differential equations for the expansion coefficients of the renormalized Green's function. We apply resurgent asymptotic analysis to find the trans-series solutions which provide the non-perturbative completion of these formal Dyson-Schwinger expansions. We illustrate the general approach with the concrete example of four dimensional massless Yukawa theory, connecting with the exact functional solution found by Broadhurst and Kreimer. The trans-series solution is associated with the iterative form of the Dyson-Schwinger equations, and displays renormalon-like structure of integer-repeated Borel singularities. Extraction of the Stokes constant is possible due to a property we call `functional resurgence'.


title: Large Zero Point Density Fluctuations in Fluids

abstract: Zero point density fluctuations in a liquid and their potential observation by light scattering are discussed. It is suggested that there are two distinct effects of interest. One gives an average number of scattered photons, and depends upon an inverse power of the photon wavelength. The second effect arises in the scattering of finite size photon wave packets and depends upon an inverse power of the spatial size of the wave packet. This effect appears as large fluctuations in the number of scattered photons, and is analogous to the vacuum fluctuations of spacetime averages of the energy density in quantum field theory.


title: Packings, sausages and catastrophes

abstract: In this survey we give an overview about some of the main results on parametric densities, a concept which unifies the theory of finite (free) packings and the classical theory of infinite packings.


title: Extended Insertion Functions for Opacity Enforcement

abstract: Opacity is a confidentiality property that holds when certain secret strings of a given system cannot be revealed to an outside observer under any system activity. Opacity violations stimulate the study of opacity enforcement strategies. Among other methodologies, opacity has been enforced using insertion mechanisms, i.e., output obfuscation mechanisms that are allowed to insert fictitious output symbols before actual system outputs, in order to preserve opacity. This paper studies and analyzes more powerful extended insertion mechanisms, which can insert symbols before and after an actual system output, thus, providing opacity to a wider class of systems. In order to address practical considerations, the paper also introduces event insertion constraints (i.e., the case when only specific symbols can be inserted before and/or after an actual system output). For each case, we construct an appropriate verifier that can be used to obtain necessary and sufficient conditions for checking opacity enforceability.


title: Controlling Overestimation Bias with Truncated Mixture of Continuous Distributional Quantile Critics

abstract: The overestimation bias is one of the major impediments to accurate off-policy learning. This paper investigates a novel way to alleviate the overestimation bias in a continuous control setting. Our method---Truncated Quantile Critics, TQC,---blends three ideas: distributional representation of a critic, truncation of critics prediction, and ensembling of multiple critics. Distributional representation and truncation allow for arbitrary granular overestimation control, while ensembling provides additional score improvements. TQC outperforms the current state of the art on all environments from the continuous control benchmark suite, demonstrating 25% improvement on the most challenging Humanoid environment.


title: Interfacial layering in the electric double layer of ionic liquids

abstract: Ions in ionic liquids and concentrated electrolytes reside in a crowded, strongly-interacting environment, leading to the formation of discrete layers of charges at interfaces. Here, we propose a continuum theory that captures the transition from overscreening-- alternating layers of excess charge at low surface potential, to overcrowding-- the formation of dense layers of charge of the same sign at high surface potential. The model outputs slowly-decaying oscillations in the charge density with a wavelength of single ion diameters, as shown by analysis of the gradient expansion. The gradient expansion suggests a new structure for partial differential equations describing the electrostatic potential at charged interfaces. We find quantitative agreement between the theory and molecular simulations in the differential capacitance and concentration profiles.


title: Probabilistic neural networks for fluid flow surrogate modeling and data recovery

abstract: We consider the use of probabilistic neural networks for fluid flow {surrogate modeling} and data recovery. This framework is constructed by assuming that the target variables are sampled from a Gaussian distribution conditioned on the inputs. Consequently, the overall formulation sets up a procedure to predict the hyperparameters of this distribution which are then used to compute an objective function given training data. We demonstrate that this framework has the ability to provide for prediction confidence intervals based on the assumption of a probabilistic posterior, given an appropriate model architecture and adequate training data. The applicability of the present framework to cases with noisy measurements and limited observations is also assessed. To demonstrate the capabilities of this framework, we consider canonical regression problems of fluid dynamics from the viewpoint of reduced-order modeling and spatial data recovery for four canonical data sets. The examples considered in this study arise from (1) the shallow water equations, (2) a two-dimensional cylinder flow, (3) the wake of NACA0012 airfoil with a Gurney flap, and (4) the NOAA sea surface temperature data set. The present results indicate that the probabilistic neural network not only produces a machine-learning-based fluid flow {surrogate} model but also systematically quantifies the uncertainty therein to assist with model interpretability.


title: Towards Robustness against Unsuspicious Adversarial Examples

abstract: Despite the remarkable success of deep neural networks, significant concerns have emerged about their robustness to adversarial perturbations to inputs. While most attacks aim to ensure that these are imperceptible, physical perturbation attacks typically aim for being unsuspicious, even if perceptible. However, there is no universal notion of what it means for adversarial examples to be unsuspicious. We propose an approach for modeling suspiciousness by leveraging cognitive salience. Specifically, we split an image into foreground (salient region) and background (the rest), and allow significantly larger adversarial perturbations in the background, while ensuring that cognitive salience of background remains low. We describe how to compute the resulting non-salience-preserving dual-perturbation attacks on classifiers. We then experimentally demonstrate that our attacks indeed do not significantly change perceptual salience of the background, but are highly effective against classifiers robust to conventional attacks. Furthermore, we show that adversarial training with dual-perturbation attacks yields classifiers that are more robust to these than state-of-the-art robust learning approaches, and comparable in terms of robustness to conventional attacks.


title: Weakly associative algebras, Poisson algebras and quantization

abstract: We introduce the notion of weakly associative algebra and its relations with the notion of nonassociative Poisson algebras.


title: A Quantum G\"odelian Hunch

abstract: What if the paradoxical nature of quantum theory could find its source in some undecidability analog to that of G\"odel's incompleteness theorem ? This essay aims at arguing for such G\"odelian hunch via two case studies. Firstly, using a narrative based on the Newcomb problem, the theological motivational origin of quantum contextuality is introduced in order to show how this result might be related to a Liar-like undecidability. A topological generalization of contextuality by Abramsky et al. in which the logical structure of quantum contextuality is compared with "Liar cycles" is also presented. Secondly, the measurement problem is analyzed as emerging from a logical error. A personal analysis of the related Wigner's friend thought experiment and and a recent paradox by Frauchiger and Renner is presented, by introducing the notion of "meta-contextuality" as a Liar-like feature underlying the neo-Copenhagen interpretations of quantum theory. Finally, this quantum G\"odelian hunch opens a discussion of the paradoxical nature of quantum physics and the emergence of time itself from self-contradiction.


title: Pruning Algorithms to Accelerate Convolutional Neural Networks for Edge Applications: A Survey

abstract: With the general trend of increasing Convolutional Neural Network (CNN) model sizes, model compression and acceleration techniques have become critical for the deployment of these models on edge devices. In this paper, we provide a comprehensive survey on Pruning, a major compression strategy that removes non-critical or redundant neurons from a CNN model. The survey covers the overarching motivation for pruning, different strategies and criteria, their advantages and drawbacks, along with a compilation of major pruning techniques. We conclude the survey with a discussion on alternatives to pruning and current challenges for the model compression community.


title: Fulde-Ferrell states in unequally charged Fermi gases

abstract: Atoms with different internal states can exhibit different responses to an artificial magnetic field. An atomic gas mixture of two different components can therefore be interpreted as a mixture of two atomic gases carrying different synthetic charges. We consider the superfluid state of such unequally charged Fermi gases coupled to a magnetic field via the orbital effect and trapped in a torus geometry. The orbital coupling to the magnetic field favors an inhomogeneous superfluid state with optimum finite center-of-mass momentum pairing. The resulting population-balanced orbital Fulde-Ferrell (FF) state is robust against the magnetic field and does not undergo pair breaking unlike the conventional BCS and Fulde-Ferrell-Larkin-Ovchinnikov type pairing states under the Zeeman effect. We contrast the homogeneous and inhomogeneous cases emphasizing the advantages of the unequally charged systems and present their momentum distributions. We conclude that an unequally charged atomic Fermi gas system orbitally coupled to an artificial magnetic field provides an ideal candidate for experimental realization of the FF state.


title: Adversarial Learning for Supervised and Semi-supervised Relation Extraction in Biomedical Literature

abstract: Adversarial training is a technique of improving model performance by involving adversarial examples in the training process. In this paper, we investigate adversarial training with multiple adversarial examples to benefit the relation extraction task. We also apply adversarial training technique in semi-supervised scenarios to utilize unlabeled data. The evaluation results on protein-protein interaction and protein subcellular localization task illustrate adversarial training provides improvement on the supervised model, and is also effective on involving unlabeled data in the semi-supervised training case. In addition, our method achieves state-of-the-art performance on two benchmarking datasets.


title: Dynamics and bifurcations in multistable 3-cell neural networks

abstract: We disclose the generality of the intrinsic mechanisms underlying multistability in reciprocally inhibitory 3-cell circuits composed of simplified, low-dimensional models of oscillatory neurons, as opposed to those of a detailed Hodgkin- Huxley type . The computational reduction to return maps for the phase-lags between neurons reveals a rich multiplicity of rhythmic patterns in such circuits. We perform a detailed bifurcation analysis to show how such rhythms can emerge, disappear, and gain or lose stability, as the parameters of the individual cells and the synapses are varied.


title: A multi-scale problem for viscous heat-conducting fluids in fast rotation

abstract: In the present paper, we study the combined incompressible and fast rotation limits for the full Navier-Stokes-Fourier system with Coriolis, centrifugal and gravitational forces, in the regime of small Mach, Froude and Rossby numbers and for general ill-prepared initial data. We consider both the isotropic scaling (where all the numbers have the same order of magnitude) and the multi-scale case (where some effect is predominant with respect to the others). In the case when the Mach number is of higher order than the Rossby number, we prove that the limit dynamics is described by an incompressible Oberbeck-Boussinesq system, where the velocity field is horizontal (according to the Taylor-Proudman theorem), but vertical effects on the temperature equation are not negligible. Instead, when the Mach and Rossby numbers have the same order of magnitude, and in absence of the centrifugal force, we show convergence to a quasi-geostrophic equation for a stream function of the limit velocity field, coupled with a transport-diffusion equation for a new unknown, which links the target density and temperature profiles. The proof of the convergence is based on a compensated compactness argument. The key point is to identify some compactness properties hidden in the system of acoustic-Poincar\'e waves. Compared to previous results, our method enables first of all to treat the whole range of parameters in the multi-scale problem, and also to consider a low Froude number regime with the somehow critical choice $Fr=\sqrt{Ma}$, where $Ma$ is the Mach number. This allows us to capture some (low) stratification effects in the limit.


title: On a logarithmic sum related to a natural quadratic sieve

abstract: We study the sum $\Sigma_q(U)=\sum_{\substack{d,e\leq U\\(de,q)=1}}\frac{\mu(d)\mu(e)}{[d,e]}\log\left(\frac{U}{d}\right)\log\left(\frac{U}{e}\right)$, $U>1$, so that a continuous, monotonic and explicit version of Selberg's sieve can be stated. Thanks to Barban-Vehov (1968), Motohashi (1974) and Graham (1978), it has been long known, but never explicitly, that $\Sigma_1(U)$ is asymptotic to $\log(U)$. In this article, we discover not only that $\Sigma_q(U)\sim\frac{q}{\varphi(q)}\log(U)$ for all $q\in\mathbb{Z}_{>0}$, but also we find a closed-form expression for its secondary order term of $\Sigma_q(U)$, a constant $\mathfrak{s}_q$, which we are able to estimate explicitly when $q=v\in\{1,2\}$. We thus have $\Sigma_v(U)= \frac{v}{\varphi(v)}\log(U)-\mathfrak{s}_v+O_v^*\left(\frac{K_v}{\log(U)}\right)$, for some explicit constant $K_v > 0$, where $\mathfrak{s}_1=0.60731\ldots$ and $\mathfrak{s}_2=1.4728\ldots$. As an application, we show how our result gives an explicit version of the Brun-Titchmarsh theorem within a range.


title: Rational dynamical systems, $S$-units, and $D$-finite power series

abstract: Let $K$ be an algebraically closed field of characteristic zero and let $G$ be a finitely generated subgroup of the multiplicative group of $K$. We consider $K$-valued sequences of the form $a_n:=f(\varphi^n(x_0))$, where $\varphi\colon X\to X$ and $f\colon X\to\mathbb{P}^1$ are rational maps defined over $K$ and $x_0\in X$ is a point whose forward orbit avoids the indeterminacy loci of $\varphi$ and $f$. Many classical sequences from number theory and algebraic combinatorics fall under this dynamical framework, and we show that the set of $n$ for which $a_n\in G$ is a finite union of arithmetic progressions along with a set of Banach density zero. In addition, we show that if $a_n\in G$ for every $n$ and $X$ is irreducible and the $\varphi$ orbit of $x$ is Zariski dense in $X$ then there are a multiplicative torus $\mathbb{G}_m^d$ and maps $\Psi:\mathbb{G}_m^d \to \mathbb{G}_m^d$ and $g:\mathbb{G}_m^d \to \mathbb{G}_m$ such that $a_n = g\circ \Psi^n(y)$ for some $y\in \mathbb{G}_m^d$. We then obtain results about the coefficients of $D$-finite power series using these facts.


title: Maximum size intersecting families of bounded minimum positive co-degree

abstract: Let $\mathcal{H}$ be an $r$-uniform hypergraph. The \emph{minimum positive co-degree} of $\mathcal{H}$, denoted by $\delta_{r-1}^+(\mathcal{H})$, is the minimum $k$ such that if $S$ is an $(r-1)$-set contained in a hyperedge of $\mathcal{H}$, then $S$ is contained in at least $k$ hyperedges of $\mathcal{H}$. For $r\geq k$ fixed and $n$ sufficiently large, we determine the maximum possible size of an intersecting $r$-uniform $n$-vertex hypergraph with minimum positive co-degree $\delta_{r-1}^+(\mathcal{H}) \geq k$ and characterize the unique hypergraph attaining this maximum. This generalizes the Erd\H os-Ko-Rado theorem which corresponds to the case $k=1$. Our proof is based on the delta-system method.


title: Strain localization and failure of disordered particle rafts with tunable ductility during tensile deformation

abstract: Quasi-static tensile experiments were performed for a model disordered solid consisting of a two-dimensional raft of polydisperse floating granular particles with capillary attractions. The ductility is tuned by controlling the capillary interaction range, which varies with the particle size. During the tensile tests, after an initial period of elastic deformation, strain localization occurs and leads to the formation of a shear band at which the pillar later fails. In this process, small particles with long-ranged interactions can endure large plastic deformations without forming significant voids, while large particles with short-range interactions fail dramatically by fracturing at small deformation. Particle-level structure was measured, and the strain-localized region was found to have higher structural anisotropy than the bulk. Local interactions between anisotropic sites and particle rearrangements were the main mechanisms driving strain localization and the subsequent failure, and significant differences of such interactions exist between ductile and brittle behaviors.


title: The Gini Index of an Integer Partition

abstract: The Gini index is a number that attempts to measure how equitably a resource is distributed throughout a population, and is commonly used in economics as a measurement of inequality of wealth or income. The Gini index is often defined as the area between the Lorenz curve of a distribution and the line of equality, normalized to be between zero and one. In this fashion, we define a Gini index on the set of integer partitions and show that it is closely related to the second elementary symmetric polynomial, and the dominance order on partitions. We conclude with a generating function for the Gini index, and discuss how it can be used to find lower bounds on the width of the dominance lattice.


title: Optical phase conjugation in backward Raman amplification

abstract: Compression of an intense laser pulse using backward Raman amplification (BRA) in plasma, followed by vacuum focusing to a small spot size, can produce unprecedented ultrarelativistic laser intensities. The plasma density inhomogeneity during BRA, however, causes laser phase and amplitude distortions, limiting the pulse focusability. To solve the issue of distortion, we investigate the use of optical phase conjugation as the seed pulse for BRA. We show that the phase conjugated laser pulses can retain focusability in the nonlinear pump-depletion regime of BRA, but not so easily in the linear amplification regime. This somewhat counter-intuitive result is because the nonlinear pump-depletion regime features a shorter amplification distance, and hence less phase distortion due to wave-wave interaction, than the linear amplification regime.


title: RotEqNet: Rotation-Equivariant Network for Fluid Systems with Symmetric High-Order Tensors

abstract: In the recent application of scientific modeling, machine learning models are largely applied to facilitate computational simulations of fluid systems. Rotation symmetry is a general property for most symmetric fluid systems. However, in general, current machine learning methods have no theoretical way to guarantee rotational symmetry. By observing an important property of contraction and rotation operation on high-order symmetric tensors, we prove that the rotation operation is preserved via tensor contraction. Based on this theoretical justification, in this paper, we introduce Rotation-Equivariant Network (RotEqNet) to guarantee the property of rotation-equivariance for high-order tensors in fluid systems. We implement RotEqNet and evaluate our claims through four case studies on various fluid systems. The property of error reduction and rotation-equivariance is verified in these case studies. Results from the comparative study show that our method outperforms conventional methods, which rely on data augmentation.

categories: cs.CE cs.LG physics.comp-ph physics.flu-dyn stat.ML


title: Burr, Lomax, Pareto, and Logistic Distributions from Ultrasound Speckle

abstract: After 100 years of theoretical treatment of speckle patterns from coherent illumination, there remain some open questions about the nature of ultrasound speckle from soft vascularized tissues. A recent hypothesis is that the fractal branching vasculature is responsible for the dominant echo pattern from organs such as the liver. In that case an analysis of cylindrical scattering structures arranged across a power law distribution of sizes is warranted. Using a simple model of echo strength and basic transformation rules from probability, we derive the first order statistics of speckle considering the amplitude, the intensity, and the natural log of amplitude. The results are given by long tailed distributions that have been studied in the statistics literature for other fields. Examples are given from simulations and animal studies, and the theoretical fit to these preliminary data support the overall framework as a plausible model for characterizing ultrasound speckle statistics.

categories: physics.med-ph eess.IV eess.SP physics.data-an


title: Incremental Learning for End-to-End Automatic Speech Recognition

abstract: In this paper, we propose an incremental learning method for end-to-end Automatic Speech Recognition (ASR) which enables an ASR system to perform well on new tasks while maintaining the performance on its originally learned ones. To mitigate catastrophic forgetting during incremental learning, we design a novel explainability-based knowledge distillation for ASR models, which is combined with a response-based knowledge distillation to maintain the original model's predictions and the "reason" for the predictions. Our method works without access to the training data of original tasks, which addresses the cases where the previous data is no longer available or joint training is costly. Results on a multi-stage sequential training task show that our method outperforms existing ones in mitigating forgetting. Furthermore, in two practical scenarios, compared to the target-reference joint training method, the performance drop of our method is 0.02% Character Error Rate (CER), which is 97% smaller than the drops of the baseline methods.


title: Explainable Matrix -- Visualization for Global and Local Interpretability of Random Forest Classification Ensembles

abstract: Over the past decades, classification models have proven to be essential machine learning tools given their potential and applicability in various domains. In these years, the north of the majority of the researchers had been to improve quantitative metrics, notwithstanding the lack of information about models' decisions such metrics convey. This paradigm has recently shifted, and strategies beyond tables and numbers to assist in interpreting models' decisions are increasing in importance. Part of this trend, visualization techniques have been extensively used to support classification models' interpretability, with a significant focus on rule-based models. Despite the advances, the existing approaches present limitations in terms of visual scalability, and the visualization of large and complex models, such as the ones produced by the Random Forest (RF) technique, remains a challenge. In this paper, we propose Explainable Matrix (ExMatrix), a novel visualization method for RF interpretability that can handle models with massive quantities of rules. It employs a simple yet powerful matrix-like visual metaphor, where rows are rules, columns are features, and cells are rules predicates, enabling the analysis of entire models and auditing classification results. ExMatrix applicability is confirmed via different examples, showing how it can be used in practice to promote RF models interpretability.


title: Cross-Language Transfer Learning, Continuous Learning, and Domain Adaptation for End-to-End Automatic Speech Recognition

abstract: In this paper, we demonstrate the efficacy of transfer learning and continuous learning for various automatic speech recognition (ASR) tasks. We start with a pre-trained English ASR model and show that transfer learning can be effectively and easily performed on: (1) different English accents, (2) different languages (German, Spanish and Russian) and (3) application-specific domains. Our experiments demonstrate that in all three cases, transfer learning from a good base model has higher accuracy than a model trained from scratch. It is preferred to fine-tune large models than small pre-trained models, even if the dataset for fine-tuning is small. Moreover, transfer learning significantly speeds up convergence for both very small and very large target datasets.


title: Learning Stable Models for Prediction and Control

abstract: This paper demonstrates the benefits of imposing stability on data-driven Koopman operators. The data-driven identification of stable Koopman operators (DISKO) is implemented using an algorithm \cite{mamakoukas_stableLDS2020} that computes the nearest \textit{stable} matrix solution to a least-squares reconstruction error. As a first result, we derive a formula that describes the prediction error of Koopman representations for an arbitrary number of time steps, and which shows that stability constraints can improve the predictive accuracy over long horizons. As a second result, we determine formal conditions on basis functions of Koopman operators needed to satisfy the stability properties of an underlying nonlinear system. As a third result, we derive formal conditions for constructing Lyapunov functions for nonlinear systems out of stable data-driven Koopman operators, which we use to verify stabilizing control from data. Lastly, we demonstrate the benefits of DISKO in prediction and control with simulations using a pendulum and a quadrotor and experiments with a pusher-slider system. The paper is complemented with a video: \url{https://sites.google.com/view/learning-stable-koopman}.


title: Deep Residual Network based food recognition for enhanced Augmented Reality application

abstract: Deep neural network based learning approaches is widely utilized for image classification or object detection based problems with remarkable outcomes. Realtime Object state estimation of objects can be used to track and estimate the features that the object of the current frame possesses without causing any significant delay and misclassification. A system that can detect the features of such objects in the present state from camera images can be used to enhance the application of Augmented Reality for improving user experience and delivering information in a much perceptual way. The focus behind this paper is to determine the most suitable model to create a low-latency assistance AR to aid users by providing them nutritional information about the food that they consume in order to promote healthier life choices. Hence the dataset has been collected and acquired in such a manner, and we conduct various tests in order to identify the most suitable DNN in terms of performance and complexity and establish a system that renders such information realtime to the user.


title: An Attestation Architecture for Blockchain Networks

abstract: If blockchain networks are to become the building blocks of the infrastructure for the future digital economy, then several challenges related to the resiliency and survivability of blockchain networks need to be addressed. The survivability of a blockchain network is influenced by the diversity of its nodes. Trustworthy device-level attestations permits nodes in a blockchain network to provide truthful evidence regarding their current configuration, operational state, keying material and other system attributes. In the current work we review the recent developments towards a standard attestation architecture and evidence conveyance protocols. We explore the applicability and benefits of a standard attestation architecture to blockchain networks. Finally, we discuss a number of open challenges related to node attestations that has arisen due to changing model of blockchain network deployments, such as the use virtualization and containerization technologies for nodes in cloud infrastructures.


title: Multiple ergodic averages for tempered functions

abstract: Following Frantzikinakis' approach on averages for Hardy field functions of different growth, we add to the topic by studying the corresponding averages for tempered functions, a class which also contains functions that oscillate and is in general more restrictive to deal with. Our main result is the existence and the explicit expression of the $L^2$-norm limit of the aforementioned averages, which turns out, as in the Hardy field case, to be the "expected" one. The main ingredients are the use of, the now classical, PET induction (introduced by Bergelson), covering a more general case, namely a "nice" class of tempered functions (developed by Chu-Frantzikinakis-Host for polynomials and Frantzikinakis for Hardy field functions) and some equidistribution results on nilmanifolds (analogous to the ones of Frantzikinakis' for the Hardy field case).


title: On finite field arithmetic in characteristic $2$

abstract: We are interested in extending normal bases of $\mathbf{F}_{\!2^n}/\mathbf{F}_{\!2}$ to bases of $\mathbf{F}_{\!2^{nd}}/\mathbf{F}_{\!2}$ which allow fast arithmetic in $\mathbf{F}_{\!2^{nd}}$. This question has been recently studied by Thomson and Weir in case $d$ is equal to $2$. We construct efficient extended bases in case $d$ is equal to $3$ and $4$. We also give conditions under which Thomson-Weir construction can be combined with ours.


title: A structure-preserving staggered semi-implicit finite volume scheme for continuum mechanics

abstract: We propose a new pressure-based structure-preserving (SP) and quasi asymptotic preserving (AP) staggered semi-implicit finite volume scheme for the unified first order hyperbolic formulation of continuum mechanics. The unified model is based on the theory of symmetric-hyperbolic and thermodynamically compatible (SHTC) systems and includes the description of elastic and elasto-plastic solids in the nonlinear large-strain regime as well as viscous and inviscid heat-conducting fluids, which correspond to the stiff relaxation limit of the model. In the absence of relaxation source terms, the homogeneous PDE system is endowed with two stationary linear differential constraints (involutions), which require the curl of distortion field and the curl of the thermal impulse to be zero for all times. In the stiff relaxation limit, the unified model tends asymptotically to the compressible Navier-Stokes equations. The new structure-preserving scheme presented in this paper can be proven to be exactly curl-free for the homogeneous part of the PDE system, i.e. in the absence of relaxation source terms. We furthermore prove that the scheme is quasi asymptotic preserving in the stiff relaxation limit, in the sense that the numerical scheme reduces to a consistent second-order accurate discretization of the compressible Navier-Stokes equations when the relaxation times tend to zero. Last but not least, the proposed scheme is suitable for the simulation of all Mach number flows thanks to its conservative formulation and the implicit discretization of the pressure terms.

categories: physics.flu-dyn cs.NA math.NA physics.comp-ph


title: Pricing Path-Dependent Derivatives under Multiscale Stochastic Volatility Models: a Malliavin Representation

abstract: In this paper we derive a efficient Monte Carlo approximation for the price of path-dependent derivatives under the multiscale stochastic volatility models of Fouque \textit{et al}. Using the formulation of this pricing problem under the functional It\^o calculus framework and making use of Greek formulas from Malliavin calculus, we derive a representation for the first-order approximation of the price of path-dependent derivatives in the form $\mathbb{E}[\mbox{payoff} \times \mbox{weight}]$. The weight is known in closed form and depends only on the group market parameters arising from the calibration of the multiscale stochastic volatility to the market's implied volatility. Moreover, only simulations of the Black-Scholes model is required. We exemplify the method for a couple path-dependent derivatives.


title: Attentional Bottleneck: Towards an Interpretable Deep Driving Network

abstract: Deep neural networks are a key component of behavior prediction and motion generation for self-driving cars. One of their main drawbacks is a lack of transparency: they should provide easy to interpret rationales for what triggers certain behaviors. We propose an architecture called Attentional Bottleneck with the goal of improving transparency. Our key idea is to combine visual attention, which identifies what aspects of the input the model is using, with an information bottleneck that enables the model to only use aspects of the input which are important. This not only provides sparse and interpretable attention maps (e.g. focusing only on specific vehicles in the scene), but it adds this transparency at no cost to model accuracy. In fact, we find slight improvements in accuracy when applying Attentional Bottleneck to the ChauffeurNet model, whereas we find that the accuracy deteriorates with a traditional visual attention model.


title: A superatom picture of collective nonclassical light emission and dipole blockade in atom arrays

abstract: We show that two-time, second-order correlations of scattered photons from planar arrays and chains of atoms display nonclassical features that can be described by a superatom picture of the canonical single-atom $g_2(\tau)$ resonance fluorescence result. For the superatom, the single-atom linewidth is replaced by the linewidth of the underlying collective low light-intensity eigenmode. Strong light-induced dipole-dipole interactions lead to a correlated response, suppressed joint photon detection events, and dipole blockade that inhibits multiple excitations of the collective atomic state. For targeted subradiant modes, nonclassical nature of emitted light can be dramatically enhanced even compared with that of a single atom.

categories: physics.atom-ph cond-mat.quant-gas physics.optics quant-ph


title: Exploring the turbulent velocity gradients at different scales from the perspective of the strain-rate eigenframe

abstract: Expressing the evolution equations for the filtered velocity gradient tensor (FVGT) in the strain-rate eigenframe provides an insightful way to disentangle and understand various processes such as strain self-amplification, vortex stretching and tilting, and to consider their properties at different scales in the flow. Using data from Direct Numerical Simulation (DNS) of the forced Navier-Stokes equation, we consider the relative importance of local and non-local terms in the FVGT eigenframe equations across the scales using statistical analysis. The analysis of the eigenframe rotation-rate, that drives vorticity tilting, shows that the anisotropic pressure Hessian plays a key role, with the sub-grid stress making an important contribution outside the dissipation range, and the local spinning due to vorticity making a much smaller contribution. The results also show the striking behavior that the vorticity tilting term remains highly intermittent even at relatively large scales. We derive a generalization of the Lumley triangle that allows us to show that the pressure Hessian has a preference for two-component axisymmetric configurations at small scales, with a transition to a more isotropic state at larger scales. Correlations between the sub-grid stress and other terms in the eigenframe equations are considered, highlighting the coupling between the sub-grid and nonlinear amplification terms, with the sub-grid term playing an important role in regularizing the system. These results provide useful guidelines for improving Lagrangian models of the FVGT, since current models fail to capture a number of subtle features observed in our results.


title: Is Deep Reinforcement Learning Ready for Practical Applications in Healthcare? A Sensitivity Analysis of Duel-DDQN for Hemodynamic Management in Sepsis Patients

abstract: The potential of Reinforcement Learning (RL) has been demonstrated through successful applications to games such as Go and Atari. However, while it is straightforward to evaluate the performance of an RL algorithm in a game setting by simply using it to play the game, evaluation is a major challenge in clinical settings where it could be unsafe to follow RL policies in practice. Thus, understanding sensitivity of RL policies to the host of decisions made during implementation is an important step toward building the type of trust in RL required for eventual clinical uptake. In this work, we perform a sensitivity analysis on a state-of-the-art RL algorithm (Dueling Double Deep Q-Networks)applied to hemodynamic stabilization treatment strategies for septic patients in the ICU. We consider sensitivity of learned policies to input features, embedding model architecture, time discretization, reward function, and random seeds. We find that varying these settings can significantly impact learned policies, which suggests a need for caution when interpreting RL agent output.


title: Construction of coherent states for Morse potential: A su(2)-like approach

abstract: We propose a generalized su(2) algebra that perfectly describes the discrete energy part of the Morse potential. Then, we examine particular examples and the approach can be applied to any Morse oscillator and to practically any physical system whose spectrum is finite. Further, we construct the Klauder coherent state for Morse potential satisfying the resolution of identity with a positive measure, obtained through the solution of truncated Stieltjes moment problem. The time evolution of the uncertainty relation of the constructed coherent states is analyzed. The uncertainty relation is more localized for small values of radius of convergence.


title: Time-scale analysis non-local diffusion systems, applied to disease models

abstract: The objective of the present paper is to use the well known Ross-Macdonald models as a prototype, incorporating spatial movements, identifying different times scales and proving a singular perturbation result using a system of local and non-local diffusion. This results can be applied to the prototype model, where the vector has a fast dynamics, local in space, and the host has a slow dynamics, non-local in space.


title: Temporal Common Sense Acquisition with Minimal Supervision

abstract: Temporal common sense (e.g., duration and frequency of events) is crucial for understanding natural language. However, its acquisition is challenging, partly because such information is often not expressed explicitly in text, and human annotation on such concepts is costly. This work proposes a novel sequence modeling approach that exploits explicit and implicit mentions of temporal common sense, extracted from a large corpus, to build TACOLM, a temporal common sense language model. Our method is shown to give quality predictions of various dimensions of temporal common sense (on UDST and a newly collected dataset from RealNews). It also produces representations of events for relevant tasks such as duration comparison, parent-child relations, event coreference and temporal QA (on TimeBank, HiEVE and MCTACO) that are better than using the standard BERT. Thus, it will be an important component of temporal NLP.


title: Measuring the Algorithmic Efficiency of Neural Networks

abstract: Three factors drive the advance of AI: algorithmic innovation, data, and the amount of compute available for training. Algorithmic progress has traditionally been more difficult to quantify than compute and data. In this work, we argue that algorithmic progress has an aspect that is both straightforward to measure and interesting: reductions over time in the compute needed to reach past capabilities. We show that the number of floating-point operations required to train a classifier to AlexNet-level performance on ImageNet has decreased by a factor of 44x between 2012 and 2019. This corresponds to algorithmic efficiency doubling every 16 months over a period of 7 years. By contrast, Moore's Law would only have yielded an 11x cost improvement. We observe that hardware and algorithmic efficiency gains multiply and can be on a similar scale over meaningful horizons, which suggests that a good model of AI progress should integrate measures from both.


title: Knowledge Patterns

abstract: This paper describes a new technique, called "knowledge patterns", for helping construct axiom-rich, formal ontologies, based on identifying and explicitly representing recurring patterns of knowledge (theory schemata) in the ontology, and then stating how those patterns map onto domain-specific concepts in the ontology. From a modeling perspective, knowledge patterns provide an important insight into the structure of a formal ontology: rather than viewing a formal ontology simply as a list of terms and axioms, knowledge patterns views it as a collection of abstract, modular theories (the "knowledge patterns") plus a collection of modeling decisions stating how different aspects of the world can be modeled using those theories. Knowledge patterns make both those abstract theories and their mappings to the domain of interest explicit, thus making modeling decisions clear, and avoiding some of the ontological confusion that can otherwise arise. In addition, from a computational perspective, knowledge patterns provide a simple and computationally efficient mechanism for facilitating knowledge reuse. We describe the technique and an application built using them, and then critique its strengths and weaknesses. We conclude that this technique enables us to better explicate both the structure and modeling decisions made when constructing a formal axiom-rich ontology.


title: Magnetic Field Structure in Spheroidal Star-Forming Clouds. II. Estimating Field Structure from Observed Maps

abstract: This paper presents models to estimate the structure of density and magnetic field strength in spheroidal condensations, from maps of their column density and their polarization of magnetically aligned dust grains. The density model is obtained by fitting a column density map with an embedded p = 2 Plummer spheroid of any aspect ratio and inclination. The magnetic properties are based on the density model, on the Davis-Chandrasekhar-Fermi (DCF) model of Alfv\'enic fluctuations, and on the Spheroid Flux Freezing (SFF) model of mass and flux conservation in Paper I. The field strength model has the resolution of the column density map, which is finer than the resolution of the DCF estimate of field strength. The models are applied to ALMA observations of the envelope of the protostar BHR71 IRS1. Column density fits give the density model, from (2.0 +- 0.4) x 10^5 cm^-3 to (7 +- 1) x 10^7 cm^-3 . The density model predicts the field directions map, which fits the polarization map best within 1100 au, with standard deviation of angle differences 17{\deg}. In this region the DCF mean field strength is 0.7 +- 0.2 mG and the envelope mass is supercritical, with ratio of mass to magnetic critical mass 1.5 +- 0.4. The SFF field strength profile scales with the DCF field strength, from 60 x 10{\mu}G to 4+-1 mG. The spatial resolution of the SFF field strength estimate is finer than the DCF resolution by a factor ~7, and the peak SFF field strength exceeds the DCF field strength by a factor ~5.


title: Building a PubMed knowledge graph

abstract: PubMed is an essential resource for the medical domain, but useful concepts are either difficult to extract or are ambiguated, which has significantly hindered knowledge discovery. To address this issue, we constructed a PubMed knowledge graph (PKG) by extracting bio-entities from 29 million PubMed abstracts, disambiguating author names, integrating funding data through the National Institutes of Health (NIH) ExPORTER, collecting affiliation history and educational background of authors from ORCID, and identifying fine-grained affiliation data from MapAffil. Through the integration of the credible multi-source data, we could create connections among the bio-entities, authors, articles, affiliations, and funding. Data validation revealed that the BioBERT deep learning method of bio-entity extraction significantly outperformed the state-of-the-art models based on the F1 score (by 0.51%), with the author name disambiguation (AND) achieving a F1 score of 98.09%. PKG can trigger broader innovations, not only enabling us to measure scholarly impact, knowledge usage, and knowledge transfer, but also assisting us in profiling authors and organizations based on their connections with bio-entities. The PKG is freely available on Figshare (https://figshare.com/s/6327a55355fc2c99f3a2, simplified version that exclude PubMed raw data) and TACC website (http://er.tacc.utexas.edu/datasets/ped, full version).


title: Blockchain BFT Protocol for Complete Asynchronous Networks

abstract: Ethereum Research team has proposed a family of Casper blockchain consensus protocols for Ethereum 2.0. It has been shown in the literature that Casper Friendly Finality Gadget (Casper FFG) for Ethereum 2.0's beacon network cannot achieve liveness property in partially synchronous networks such as the Internet environment. The "Correct-by-Construction" family of Casper blockchain consensus protocols (CBC Casper) has been proposed as a finality gadget for the future release of Ethereum 2.0 blockchain. Unfortunately, neither constructive finality rule nor satisfactory liveness property has been obtained for CBC Casper, and it is commonly believed that CBC Casper could not achieve liveness property in asynchronous networks. This paper provides the first probabilistic CBC Casper protocol that achieves liveness property against (n-1)/3 Byzantine participants in complete asynchronous networks.


title: Semi-Supervised Multi-aspect Detection of Misinformation using Hierarchical Joint Decomposition

abstract: Distinguishing between misinformation and real information is one of the most challenging problems in today's interconnected world. The vast majority of the state-of-the-art in detecting misinformation is fully supervised, requiring a large number of high-quality human annotations. However, the availability of such annotations cannot be taken for granted, since it is very costly, time-consuming, and challenging to do so in a way that keeps up with the proliferation of misinformation. In this work, we are interested in exploring scenarios where the number of annotations is limited. In such scenarios, we investigate how tapping on a diverse number of resources that characterize a news article, henceforth referred to as "aspects" can compensate for the lack of labels. In particular, our contributions in this paper are twofold: 1) We propose the use of three different aspects: article content, context of social sharing behaviors, and host website/domain features, and 2) We introduce a principled tensor based embedding framework that combines all those aspects effectively. We propose HiJoD a 2-level decomposition pipeline which not only outperforms state-of-the-art methods with F1-scores of 74% and 81% on Twitter and Politifact datasets respectively but also is an order of magnitude faster than similar ensemble approaches.


abstract: Medical image computing has advanced rapidly with the advent of deep learning techniques such as convolutional neural networks. Deep convolutional neural networks can perform exceedingly well given full supervision. However, the success of such fully-supervised models for various image analysis tasks (e.g., anatomy or lesion segmentation from medical images) is limited to the availability of massive amounts of labeled data. Given small sample sizes, such models are prohibitively data biased with large domain shift. To tackle this problem, we propose a novel end-to-end medical image segmentation model, namely Progressive Adversarial Semantic Segmentation (PASS), which can make improved segmentation predictions without requiring any domain-specific data during training time. Our extensive experimentation with 8 public diabetic retinopathy and chest X-ray datasets, confirms the effectiveness of PASS for accurate vascular and pulmonary segmentation, both for in-domain and cross-domain evaluations.


title: Utility maximization under endogenous pricing

abstract: We study the expected utility maximization problem of a large investor who is allowed to make transactions on tradable assets in an incomplete financial market with endogenous permanent market impacts. The asset prices are assumed to follow a nonlinear price curve quoted in the market as the utility indifference curve of a representative liquidity supplier. We show that optimality can be fully characterized via a system of coupled forward-backward stochastic differential equations (FBSDEs) which corresponds to a non-linear backward stochastic partial differential equation (BSPDE). We show existence of solutions to the optimal investment problem and the FBSDEs in the case where the driver function of the representative market maker grows at least quadratically or the utility function of the large investor falls faster than quadratically or is exponential. Furthermore, we derive smoothness results for the existence of solutions of BSPDEs. Examples are provided when the market is complete or the utility function is exponential.


title: Fire-hose instability of inhomogeneous plasma flows with heat fluxes

abstract: We study the effects of heat flows and velocity shear on the parallel firehose instability in weakly collisional plasma flow. For this purpose we apply an anisotropic 16-moments MHD fluid closure model that takes into account the pressure and temperature anisotropy, as well as the effect of anisotropic heat flux. The linear stability analysis of the firehose modes is carried out in the incompressible limit, where the MHD flow is parallel to the background magnetic field, while the velocity is sheared in the direction transverse to the flow direction. It seems that an increase of the velocity shear parameter leads to higher growth rates of the firehose instability. The increase of the instability growth rate is most profound for perturbations with oblique wave-numbers $k_{\perp}/k_{\parallel} < 1$. The heat flux parameter introduces an asymmetry of the instability growth in the shear plane: perturbations with wave-vectors with a component in the direction of the velocity shear grow significantly stronger as compared to those with components in the opposite direction. We discuss the implications of the presented study on the observable features of the solar wind and possible measurements of local parameters of the solar wind based on the stability constraints set by the firehose instability.


title: The generators of $5$-class group of some fields of degree 20 over $\mathbb{Q}$

abstract: Let $\Gamma \,=\, \mathbb{Q}(\sqrt[5]{n})$ be a pure quintic field, where $n$ is a positive integer, $5^{th}$ power-free. Let $k_0\,=\,\mathbb{Q}(\zeta_5)$ be the cyclotomic field containing a primitive $5^{th}$ root of unity $\zeta_5$, and $k\,=\,\Gamma(\zeta_5)$ be the normal closure of $\Gamma$. Let $C_{k,5}$ be the $5$-component of the class group of k. The purpose of this paper is to determine generators of $C_{k,5}$, whenever it is of type $(5,5)$ and the rank of the group of ambiguous classes under the action of $Gal(k/k_0)\, =\,\langle \sigma\rangle$ is $1$.


title: Probing Linguistic Systematicity

abstract: Recently, there has been much interest in the question of whether deep natural language understanding models exhibit systematicity; generalizing such that units like words make consistent contributions to the meaning of the sentences in which they appear. There is accumulating evidence that neural models often generalize non-systematically. We examined the notion of systematicity from a linguistic perspective, defining a set of probes and a set of metrics to measure systematic behaviour. We also identified ways in which network architectures can generalize non-systematically, and discuss why such forms of generalization may be unsatisfying. As a case study, we performed a series of experiments in the setting of natural language inference (NLI), demonstrating that some NLU systems achieve high overall performance despite being non-systematic.


title: Advances in Quantum Deep Learning: An Overview

abstract: The last few decades have seen significant breakthroughs in the fields of deep learning and quantum computing. Research at the junction of the two fields has garnered an increasing amount of interest, which has led to the development of quantum deep learning and quantum-inspired deep learning techniques in recent times. In this work, we present an overview of advances in the intersection of quantum computing and deep learning by discussing the technical contributions, strengths and similarities of various research works in this domain. To this end, we review and summarise the different schemes proposed to model quantum neural networks (QNNs) and other variants like quantum convolutional networks (QCNNs). We also briefly describe the recent progress in quantum inspired classic deep learning algorithms and their applications to natural language processing.


title: Carboxyl and Amine Functionalized Carboranethiol SAMs on Au(111) : A Dispersion Corrected Density Functional Theory Study

abstract: The morphological and electronic properties of isolated and monolayer phases of carboxyl- and amine-functionalized carboranethiols on unreconstructed Au(111) were determined using density functional theory calculations by including van der Waals interactions. The groups are effective in the assembly of pristine adlayers on gold and also offer functionality when exposed at the SAM-environment interface. Anisotropy brought by both functional groups increases tilting of carboranethiols relative to the surface normal and absolute values of the dissociative chemisorption energies. Positional isomerization and the functional groups modify the molecular dipole moments which influnce the adsorption characteristics. Even though carboxylic acid and amine groups have different chemical properties, they have similar effects on the adsoprtion characteristics of carboranethiols. Dense packing favors intermolecular interactions which gives a stronger binding relative to isolated adsorption. The carboranethiols with the functional groups can be arranged in the same lateral direction or in a dimer conformation with molecues facing each other. Carboxyl and amine groups offer functionalization of cabranethiol SAMs and in conjuction with positional isomerization shift tunability ranges of the work function of gold to higher energies.


title: Transforming task representations to perform novel tasks

abstract: An important aspect of intelligence is the ability to adapt to a novel task without any direct experience (zero-shot), based on its relationship to previous tasks. Humans can exhibit this cognitive flexibility. By contrast, models that achieve superhuman performance in specific tasks often fail to adapt to even slight task alterations. To address this, we propose a general computational framework for adapting to novel tasks based on their relationship to prior tasks. We begin by learning vector representations of tasks. To adapt to new tasks, we propose meta-mappings, higher-order tasks that transform basic task representations. We demonstrate the effectiveness of this framework across a wide variety of tasks and computational paradigms, ranging from regression to image classification and reinforcement learning. We compare to both human adaptability and language-based approaches to zero-shot learning. Across these domains, meta-mapping is successful, often achieving 80-90% performance, without any data, on a novel task, even when the new task directly contradicts prior experience. We further show that meta-mapping can not only generalize to new tasks via learned relationships, but can also generalize using novel relationships unseen during training. Finally, using meta-mapping as a starting point can dramatically accelerate later learning on a new task, and reduce learning time and cumulative error substantially. Our results provide insight into a possible computational basis of intelligent adaptability and offer a possible framework for modeling cognitive flexibility and building more flexible artificial intelligence systems.


title: ST-MNIST -- The Spiking Tactile MNIST Neuromorphic Dataset

abstract: Tactile sensing is an essential modality for smart robots as it enables them to interact flexibly with physical objects in their environment. Recent advancements in electronic skins have led to the development of data-driven machine learning methods that exploit this important sensory modality. However, current datasets used to train such algorithms are limited to standard synchronous tactile sensors. There is a dearth of neuromorphic event-based tactile datasets, principally due to the scarcity of large-scale event-based tactile sensors. Having such datasets is crucial for the development and evaluation of new algorithms that process spatio-temporal event-based data. For example, evaluating spiking neural networks on conventional frame-based datasets is considered sub-optimal. Here, we debut a novel neuromorphic Spiking Tactile MNIST (ST-MNIST) dataset, which comprises handwritten digits obtained by human participants writing on a neuromorphic tactile sensor array. We also describe an initial effort to evaluate our ST-MNIST dataset using existing artificial and spiking neural network models. The classification accuracies provided herein can serve as performance benchmarks for future work. We anticipate that our ST-MNIST dataset will be of interest and useful to the neuromorphic and robotics research communities.


title: BOP-Elites, a Bayesian Optimisation algorithm for Quality-Diversity search

abstract: Quality Diversity (QD) algorithms such as MAP-Elites are a class of optimisation techniques that attempt to find a set of high-performing points from an objective function while enforcing behavioural diversity of the points over one or more interpretable, user chosen, feature functions. In this paper we propose the Bayesian Optimisation of Elites (BOP-Elites) algorithm that uses techniques from Bayesian Optimisation to explicitly model both quality and diversity with Gaussian Processes. By considering user defined regions of the feature space as 'niches' our task is to find the optimal solution in each niche. We propose a novel acquisition function to intelligently choose new points that provide the highest expected improvement to the ensemble problem of identifying the best solution in every niche. In this way each function evaluation enriches our modelling and provides insight to the whole problem, naturally balancing exploration and exploitation of the search space. The resulting algorithm is very effective in identifying the parts of the search space that belong to a niche in feature space, and finding the optimal solution in each niche. It is also significantly more sample efficient than simpler benchmark approaches. BOP-Elites goes further than existing QD algorithms by quantifying the uncertainty around our predictions and offering additional illumination of the search space through surrogate models.


title: A Showcase of the Use of Autoencoders in Feature Learning Applications

abstract: Autoencoders are techniques for data representation learning based on artificial neural networks. Differently to other feature learning methods which may be focused on finding specific transformations of the feature space, they can be adapted to fulfill many purposes, such as data visualization, denoising, anomaly detection and semantic hashing. This work presents these applications and provides details on how autoencoders can perform them, including code samples making use of an R package with an easy-to-use interface for autoencoder design and training, \texttt{ruta}. Along the way, the explanations on how each learning task has been achieved are provided with the aim to help the reader design their own autoencoders for these or other objectives.


title: LinCE: A Centralized Benchmark for Linguistic Code-switching Evaluation

abstract: Recent trends in NLP research have raised an interest in linguistic code-switching (CS); modern approaches have been proposed to solve a wide range of NLP tasks on multiple language pairs. Unfortunately, these proposed methods are hardly generalizable to different code-switched languages. In addition, it is unclear whether a model architecture is applicable for a different task while still being compatible with the code-switching setting. This is mainly because of the lack of a centralized benchmark and the sparse corpora that researchers employ based on their specific needs and interests. To facilitate research in this direction, we propose a centralized benchmark for Linguistic Code-switching Evaluation (LinCE) that combines ten corpora covering four different code-switched language pairs (i.e., Spanish-English, Nepali-English, Hindi-English, and Modern Standard Arabic-Egyptian Arabic) and four tasks (i.e., language identification, named entity recognition, part-of-speech tagging, and sentiment analysis). As part of the benchmark centralization effort, we provide an online platform at ritual.uh.edu/lince, where researchers can submit their results while comparing with others in real-time. In addition, we provide the scores of different popular models, including LSTM, ELMo, and multilingual BERT so that the NLP community can compare against state-of-the-art systems. LinCE is a continuous effort, and we will expand it with more low-resource languages and tasks.


title: ALLSTEPS: Curriculum-driven Learning of Stepping Stone Skills

abstract: Humans are highly adept at walking in environments with foot placement constraints, including stepping-stone scenarios where the footstep locations are fully constrained. Finding good solutions to stepping-stone locomotion is a longstanding and fundamental challenge for animation and robotics. We present fully learned solutions to this difficult problem using reinforcement learning. We demonstrate the importance of a curriculum for efficient learning and evaluate four possible curriculum choices compared to a non-curriculum baseline. Results are presented for a simulated human character, a realistic bipedal robot simulation and a monster character, in each case producing robust, plausible motions for challenging stepping stone sequences and terrains.