title: Reference-Centric Models for Grounded Collaborative Dialogue

abstract: We present a grounded neural dialogue model that successfully collaborates with people in a partially-observable reference game. We focus on a setting where two agents each observe an overlapping part of a world context and need to identify and agree on some object they share. Therefore, the agents should pool their information and communicate pragmatically to solve the task. Our dialogue agent accurately grounds referents from the partner's utterances using a structured reference resolver, conditions on these referents using a recurrent memory, and uses a pragmatic generation procedure to ensure the partner can resolve the references the agent produces. We evaluate on the OneCommon spatial grounding dialogue task (Udagawa and Aizawa 2019), involving a number of dots arranged on a board with continuously varying positions, sizes, and shades. Our agent substantially outperforms the previous state of the art for the task, obtaining a 20% relative improvement in successful task completion in self-play evaluations and a 50% relative improvement in success in human evaluations.


title: SMARRT: Self-Repairing Motion-Reactive Anytime RRT for Dynamic Environments

abstract: This paper addresses the fast replanning problem in dynamic environments with moving obstacles. Since for randomly moving obstacles the future states are unpredictable, the proposed method, called SMARRT, reacts to obstacle motions and revises the path in real-time based on the current interfering obstacle state (i.e., position and velocity). SMARRT is fast and efficient and performs collision checking only on the partial path segment close to the robot within a feasibility checking horizon. If the path is infeasible, then tree parts associated with the path inside the horizon are pruned while maintaining the maximal tree structure of already-explored regions. Then, a multi-resolution utility map is created to capture the environmental information used to compute the replanning utility for each cell on the multi-scale tiling. A hierarchical searching method is applied on the map to find the sampling cell efficiently. Finally, uniform samples are drawn within the sampling cell for fast replanning. The SMARRT method is validated via simulation runs, and the results are evaluated in comparison to four existing methods. The SMARRT method yields significant improvements in travel time, replanning time, and success rate compared against the existing methods.


title: Evaluating and Enhancing Candidate Clocking Systems for CHIME/FRB VLBI Outriggers

abstract: As the Canadian Hydrogen Intensity Mapping Experiment (CHIME) has become the leading instrument for detecting Fast Radio Bursts (FRBs), CHIME/FRB Outriggers will use very-long-baseline interferometry (VLBI) to localize FRBs with milliarcsecond precision. The CHIME site uses a passive hydrogen maser frequency standard in order to minimize localization errors due to clock delay. However, not all outrigger stations will have access to a maser. This report presents techniques used to evaluate clocks for use at outrigger sites without a maser. More importantly, the resulting algorithm provides calibration methods for clocks that do not initially meet the stability requirements for VLBI, thus allowing CHIME/FRB Outriggers to remain true to the goal of having milliarcsecond precision.


title: Electrical spectroscopy of the spin-wave dispersion and bistability in gallium-doped yttrium iron garnet

abstract: Yttrium iron garnet (YIG) is a magnetic insulator with record-low damping, allowing spin-wave transport over macroscopic distances. Doping YIG with gallium ions greatly reduces the demagnetizing field and introduces a perpendicular magnetic anisotropy, which leads to an isotropic spin-wave dispersion that facilitates spin-wave optics and spin-wave steering. Here, we characterize the dispersion of a gallium-doped YIG (Ga:YIG) thin film using electrical spectroscopy. We determine the magnetic anisotropy parameters from the ferromagnetic resonance frequency and use propagating spin wave spectroscopy in the Damon-Eshbach configuration to detect the small spin-wave magnetic fields of this ultrathin weak magnet over a wide range of wavevectors, enabling the extraction of the exchange constant $\alpha=1.3(2)\times10^{-12}$ J/m. The frequencies of the spin waves shift with increasing drive power, which eventually leads to the foldover of the spin-wave modes. Our results shed light on isotropic spin-wave transport in Ga:YIG and highlight the potential of electrical spectroscopy to map out the dispersion and bistability of propagating spin waves in magnets with a low saturation magnetization.


title: Singularities of the stress concentration in the presence of $C^{1,\alpha}$-inclusions with core-shell geometry

abstract: In high-contrast composites, if an inclusion is in close proximity to the matrix boundary, then the stress, which is represented by the gradient of a solution to the Lam\'{e} systems of linear elasticity, may exhibits the singularities with respect to the distance $\varepsilon$ between them. In this paper, we establish the asymptotic formulas of the stress concentration for core-shell geometry with $C^{1,\alpha}$ boundaries in all dimensions by precisely capturing all the blow-up factor matrices, as the distance $\varepsilon$ between interfacial boundaries of a core and a surrounding shell goes to zero. Further, a direct application of these blow-up factor matrices gives the optimal gradient estimates.


title: PAC Mode Estimation using PPR Martingale Confidence Sequences

abstract: We consider the problem of correctly identifying the \textit{mode} of a discrete distribution $\mathcal{P}$ with sufficiently high probability by observing a sequence of i.i.d. samples drawn from $\mathcal{P}$. This problem reduces to the estimation of a single parameter when $\mathcal{P}$ has a support set of size $K = 2$. After noting that this special case is tackled very well by prior-posterior-ratio (PPR) martingale confidence sequences \citep{waudby-ramdas-ppr}, we propose a generalisation to mode estimation, in which $\mathcal{P}$ may take $K \geq 2$ values. To begin, we show that the "one-versus-one" principle to generalise from $K = 2$ to $K \geq 2$ classes is more efficient than the "one-versus-rest" alternative. We then prove that our resulting stopping rule, denoted PPR-1v1, is asymptotically optimal (as the mistake probability is taken to $0$). PPR-1v1 is parameter-free and computationally light, and incurs significantly fewer samples than competitors even in the non-asymptotic regime. We demonstrate its gains in two practical applications of sampling: election forecasting and verification of smart contracts in blockchains.


title: Maser emission from the CO envelope of the asymptotic giant branch star W Hydrae

abstract: Observation of CO emission around asymptotic giant branch (AGB) stars is the primary method to determine gas mass-loss rates. While radiative transfer models have shown that molecular levels of CO can become mildly inverted, causing maser emission, CO maser emission has yet to be confirmed observationally. High-resolution observations of the CO emission around AGB stars now have the brightness temperature sensitivity to detect possible weak CO maser emission. We used high angular resolution observations taken with the Atacama Large Millimeter/submillimeter Array (ALMA) to observe the small-scale structure of CO $J=3-2$ emission around the oxygen-rich AGB star W Hya. We find CO maser emission amplifying the stellar continuum with an optical depth $\tau\approx-0.55$. The maser predominantly amplifies the limb of the star because CO $J=3-2$ absorption from the extended stellar atmosphere is strongest towards the centre of the star. The CO maser velocity corresponds to a previously observed variable component of high-frequency H$_2$O masers and with the OH maser that was identified as the amplified stellar image. This implies that the maser originates beyond the acceleration region and constrains the velocity profile since we find the population inversion primarily in the inner circumstellar envelope. We find that inversion can be explained by the radiation field at 4.6 $\mu$m and that the existence of CO maser emission is consistent with the estimated mass-loss rates for W Hya. However, the pumping mechanism requires a complex interplay between absorption and emission lines in the extended atmosphere. Excess from dust in the circumstellar envelope of W Hya is not sufficient to contribute significantly to the required radiation field at 4.6 $\mu$m. The interplay between molecular lines that cause the pumping can be constrained by future multi-level CO observations.


title: Solver-based Gradual Type Migration

abstract: Gradually typed languages allow programmers to mix statically and dynamically typed code, enabling them to incrementally reap the benefits of static typing as they add type annotations to their code. However, this type migration process is typically a manual effort with limited tool support. This paper examines the problem of \emph{automated type migration}: given a dynamic program, infer additional or improved type annotations. Existing type migration algorithms prioritize different goals, such as maximizing type precision, maintaining compatibility with unmigrated code, and preserving the semantics of the original program. We argue that the type migration problem involves fundamental compromises: optimizing for a single goal often comes at the expense of others. Ideally, a type migration tool would flexibly accommodate a range of user priorities. We present TypeWhich, a new approach to automated type migration for the gradually-typed lambda calculus with some extensions. Unlike prior work, which relies on custom solvers, TypeWhich produces constraints for an off-the-shelf MaxSMT solver. This allows us to easily express objectives, such as minimizing the number of necessary syntactic coercions, and constraining the type of the migration to be compatible with unmigrated code. We present the first comprehensive evaluation of GTLC type migration algorithms, and compare TypeWhich to four other tools from the literature. Our evaluation uses prior benchmarks, and a new set of ``challenge problems.'' Moreover, we design a new evaluation methodology that highlights the subtleties of gradual type migration. In addition, we apply TypeWhich to a suite of benchmarks for Grift, a programming language based on the GTLC. TypeWhich is able to reconstruct all human-written annotations on all but one program.


title: A note on the identity module in $c=0$ CFTs

abstract: It has long been understood that non-trivial Conformal Field Theories (CFTs) with vanishing central charge ($c=0$) are logarithmic. So far however, the structure of the identity module -- the (left and right) Virasoro descendants of the identity field -- had not been elucidated beyond the stress-energy tensor $T$ and its logarithmic partner $t$ (the solution of the "$c\to 0$ catastrophe"). In this paper, we determine this structure together with the associated OPE of primary fields up to level $h=\bar{h}=2$ for polymers and percolation CFTs. This is done by taking the $c\to 0$ limit of $O(n)$ and Potts models and combining recent results from the bootstrap with arguments based on conformal invariance and self-duality. We find that the structure contains a rank-3 Jordan cell involving the field $T\bar{T}$, and is identical for polymers and percolation. It is characterized in part by the common value of a non-chiral logarithmic coupling $a_0=-{25\over 48}$.

categories: hep-th cond-mat.stat-mech math-ph math.MP


title: The influence of Equation of State on impact dynamics between Pluto-like bodies

abstract: Impacts between planetary-sized bodies can explain the origin of satellites orbiting large ($R>500$~km) trans-Neptunian objects. Their water rich composition, along with the complex phase diagram of water, make it important to accurately model the wide range of thermodynamic conditions material experiences during an impact event and in the debris disk. Since differences in the thermodynamics may influence the system dynamics, we seek to evaluate how the choice of an equation of state (EOS) alters the system's evolution. Specifically, we compare two EOSs that are constructed by different approaches: either by a simplified analytic description (Tillotson), or by interpolation of tabulated data (Sesame). Approximately $50$ pairs of Smoothed Particle Hydrodynamics impact simulations were performed, with similar initial conditions but different EOSs, in the parameter space in which the Pluto-Charon binary is thought to form (slow impacts between Pluto-size, water rich bodies). Generally, we show that impact outcomes (e.g., circumplanetary debris disk) are consistent between EOSs. Some differences arise, importantly in the production of satellitesimals (large intact clumps) that form in the post-impact debris disk. When utilizing an analytic EOS, the emergence of satellitesimals is highly certain, while when using the tabulated EOS it is less common. This is because for the typical densities and energies experienced in these impacts, the analytic EOS predicts very low pressure values, leading to particles artificially aggregating by a tensile instability.


title: Entity-Based Knowledge Conflicts in Question Answering

abstract: Knowledge-dependent tasks typically use two sources of knowledge: parametric, learned at training time, and contextual, given as a passage at inference time. To understand how models use these sources together, we formalize the problem of knowledge conflicts, where the contextual information contradicts the learned information. Analyzing the behaviour of popular models, we measure their over-reliance on memorized information (the cause of hallucinations), and uncover important factors that exacerbate this behaviour. Lastly, we propose a simple method to mitigate over-reliance on parametric knowledge, which minimizes hallucination, and improves out-of-distribution generalization by 4%-7%. Our findings demonstrate the importance for practitioners to evaluate model tendency to hallucinate rather than read, and show that our mitigation strategy encourages generalization to evolving information (i.e., time-dependent queries). To encourage these practices, we have released our framework for generating knowledge conflicts.


title: Physics-based machine learning for modeling stochastic IP3-dependent calcium dynamics

abstract: We present a machine learning method for model reduction which incorporates domain-specific physics through candidate functions. Our method estimates an effective probability distribution and differential equation model from stochastic simulations of a reaction network. The close connection between reduced and fine scale descriptions allows approximations derived from the master equation to be introduced into the learning problem. This representation is shown to improve generalization and allows a large reduction in network size for a classic model of inositol trisphosphate (IP3) dependent calcium oscillations in non-excitable cells.

categories: cs.LG physics.chem-ph physics.comp-ph q-bio.NC


title: Generating Hyperbolic Isometry Groups by Elementary Matrices

abstract: We consider three families of groups: the Bianchi groups SL(2,O) where O is the ring of integers of an imaginary, quadratic field; the groups SL*(2,O) where O is a *-order of a definite, rational quaternion algebra with an orthogonal involution; and the groups SL(2,O) where O is an order of a definite, rational quaternion algebra. We show that such groups are generated by elementary matrices if and only if O is semi-Euclidean (or *-semi-Euclidean), which is a generalization of the usual notion of a Euclidean ring. The proofs are surprisingly simple and proceed by considering fundamental domains of Kleinian groups.


title: Limits to Electrical Mobility in Lead-Halide Perovskite Semiconductors

abstract: Semiconducting polycrystalline thin films are cheap to produce and can be deposited on flexible substrates, yet high-performance electronic devices usually utilize single-crystal semiconductors, owing to their superior electrical mobilities and longer diffusion lengths. Here we show that the electrical performance of polycrystalline films of metal-halide perovskites (MHPs) approaches that of single crystals at room temperature. Combining temperature-dependent terahertz conductivity measurements and ab initio calculations we uncover a complete picture of the origins of charge scattering in single crystals and polycrystalline films of CH$_3$NH$_3$PbI$_3$. We show that Fr\"ohlich scattering of charge carriers with multiple phonon modes is the dominant mechanism limiting mobility, with grain-boundary scattering further reducing mobility in polycrystalline films. We reconcile the large discrepancy in charge diffusion lengths between single crystals and films by considering photon reabsorption. Thus, polycrystalline films of MHPs offer great promise for devices beyond solar cells, including transistors and modulators.


title: Speaker Turn Modeling for Dialogue Act Classification

abstract: Dialogue Act (DA) classification is the task of classifying utterances with respect to the function they serve in a dialogue. Existing approaches to DA classification model utterances without incorporating the turn changes among speakers throughout the dialogue, therefore treating it no different than non-interactive written text. In this paper, we propose to integrate the turn changes in conversations among speakers when modeling DAs. Specifically, we learn conversation-invariant speaker turn embeddings to represent the speaker turns in a conversation; the learned speaker turn embeddings are then merged with the utterance embeddings for the downstream task of DA classification. With this simple yet effective mechanism, our model is able to capture the semantics from the dialogue content while accounting for different speaker turns in a conversation. Validation on three benchmark public datasets demonstrates superior performance of our model.


title: Enhanced Linear Dichroism of Flattened-Edge Black Phosphorus Nanoribbons

abstract: Black phosphorus is a material with an intrinsic anisotropy in electronic and optical properties due to its puckered honeycomb lattice. Optical absorption is different for incident light with linear polarization in the armchair and zigzag directions (linear dichroism). These directions are also used in the cuts of materials to create black phosphorus nanoribbons. Edges of nanoribbons usually have small reconstruction effects, with minor electronic effects. Here, we show a reconstruction of the armchair edge that introduces a new valence band, which flattens the puckered lattice and increases the linear dichroism extrinsically in the visible spectrum. This enhancement in linear dichroism is explained by the polarization selection rule, which considers the parity of the wave function to a reflection plane. The flattened-edge reconstruction originates from the inversion of chirality of the P atoms at the edges and significantly alters the entire optical absorption of the material. The flattened edges have potential applications in pseudospintronics, photodetectors and might provide new functionalities in optoelectronic and photonic devices.


title: Feasibility study of a proton CT system based on 4D-tracking and residual energy determination via time-of-flight

abstract: For dose calculations in ion beam therapy, it is vital to accurately determine the relative stopping power (RSP) distribution within the treated volume. Currently, RSP values are extrapolated from Hounsfield units (HU), measured with x-ray computed tomography (CT), which entails RSP inaccuracies due to conversion errors. A suitable method to improve the treatment plan accuracy is proton computed tomography (pCT). A typical pCT system consists of a tracking system and a separate residual energy (or range) detector to measure the RSP distribution directly. This paper introduces a novel pCT system based on a single detector technology, namely low gain avalanche detectors (LGADs). LGADs are fast 4D-tracking detectors, which can be used to simultaneously measure the particle position and time with precise timing and spatial resolution. In contrast to standard pCT systems, the residual energy is determined via a time-of-flight (TOF) measurement between different 4D-tracking stations. The design parameters for a realistic proton computed tomography system based on 4D-tracking detectors were studied and optimized using Monte Carlo simulations. The RSP accuracy and RSP resolution were measured inside the inserts of the CTP404 phantom to estimate the performance of the pCT system. After introducing a dedicated calibration procedure for the TOF calorimeter, RSP accuracies < 0.6 % could be achieved. Furthermore, the design parameters with the strongest impact on the RSP resolution were identified and a strategy to improve RSP resolution is proposed.


title: The Speed-Robustness Trade-Off for First-Order Methods with Additive Gradient Noise

abstract: We study the trade-off between convergence rate and sensitivity to stochastic additive gradient noise for first-order optimization methods. Ordinary Gradient Descent (GD) can be made fast-and-sensitive or slow-and-robust by increasing or decreasing the stepsize, respectively. However, it is not clear how such a trade-off can be navigated when working with accelerated methods such as Polyak's Heavy Ball (HB) or Nesterov's Fast Gradient (FG) methods. We consider three classes of functions: (1) smooth strongly convex quadratics, (2) smooth strongly convex functions, and (3) functions that satisfy the Polyak-Lojasiewicz property and have one-sided Lipschitz gradients. For each function class, we present a tractable way to compute the convergence rate and sensitivity to additive gradient noise for a broad family of first-order methods, and we present algorithm designs that trade off these competing performance metrics. Each design consists of a simple analytic update rule with two states of memory, similar to HB and FG. Moreover, each design has a scalar tuning parameter that explicitly trades off convergence rate and sensitivity to additive gradient noise. We numerically validate the performance of our designs by comparing their convergence rate and sensitivity to those of many other algorithms, and through simulations on Nesterov's "bad function".


title: Magnetic-Field-Dependent Stimulated Emission from Nitrogen-Vacancy Centres in Diamond

abstract: Negatively charged nitrogen-vacancy centres in diamond are promising quantum magnetic field sensors. Laser threshold magnetometry has been a theoretical approach for the improvement of NV-centre ensemble sensitivity via increased signal strength and magnetic field contrast. In this work we experimentally demonstrate laser threshold magnetometry. We use a macroscopic high-finesse laser cavity containing a highly NV-doped and low absorbing diamond gain medium that is pumped at 532nm and resonantly seeded at 710nm. This enables amplification of the signal power by stimulated emission of 64%. We show the magnetic-field dependency of the amplification and thus, demonstrate magnetic-field dependent stimulated emission from an NV-centre ensemble. This emission shows a record contrast of 33% and a maximum output power in the mW regime. These advantages of coherent read-out of NV-centres pave the way for novel cavity and laser applications of quantum defects as well as diamond NV magnetic field sensors with significantly improved sensitivity for the health, research and mining sectors.

categories: quant-ph cond-mat.mes-hall cond-mat.mtrl-sci physics.optics


title: Segre classes and invariants of singular varieties

abstract: Segre classes encode essential intersection-theoretic information concerning vector bundles and embeddings of schemes. In this paper we survey a range of applications of Segre classes to the definition and study of invariants of singular spaces. We will focus on several numerical invariants, on different notions of characteristic classes for singular varieties, and on classes of Le cycles. We precede the main discussion with a review of relevant background notions in algebraic geometry and intersection theory.


title: Band gap analysis and carrier localization in cation-disordered ZnGeN$_2$

abstract: Cation site disorder provides a degree of freedom in the growth of ternary nitrides for tuning the technologically relevant properties of a material system. For example, the band gap of ZnGeN$_2$ changes when the ordering of the structure deviates from that of its ground state. By combining the perspectives of carrier localization and defect states, we analyze the impact of different degrees of disordering on electronic properties in ZnGeN$_2$, addressing a gap in current studies which focus on dilute or fully disordered systems. The present study demonstrates changes in the density of states and localization of carriers in ZnGeN$_2$ calculated using band gap-corrected density functional theory and hybrid calculations on partially disordered supercells generated using the Monte Carlo method. We use localization and density of states to discuss the ill-defined nature of a band gap in a disordered material, comparing multiple definitions of the energy gap in the context of theory and experiment. Decreasing the order parameter results in a large reduction of the band gap in disordered cases. The reduction in band gap is due in part to isolated, localized states that form above the valence band continuum and are associated with nitrogen coordinated by more zinc than germanium. The prevalence of defect states in all but the perfectly ordered structure creates challenges for incorporating disordered ZnGeN$_2$ into optical devices, but the localization associated with these defects provides insight into mechanisms of electron/hole recombination in the material.


title: Gradient asymptotics of solutions to the Lam\'{e} systems in the presence of two nearly touching $C^{1,\gamma}$-inclusions in all dimensions

abstract: In this paper, we establish the asymptotic expressions for the gradient of a solution to the Lam\'{e} systems with partially infinity coefficients as two rigid $C^{1,\gamma}$-inclusions are very close but not touching. The novelty of these asymptotics, which improve and make complete the previous results of Chen-Li (JFA 2021), lies in that they show the optimality of the gradient blow-up rate in dimensions greater than two.


title: Mean Value Inequalities and Characterizations of Sobolev spaces on graded groups

abstract: We develop characterizations for Sobolev spaces of potential type on graded Lie groups, by means of Littlewood-Paley square functions, and Strichartz functionals involving second-order differences. A key role is played by some mean value inequalities that may be of independent interest. Indeed, the point-wise first-order inequality is generalized in two directions: on $L^p$-spaces and by considering second-order differences.


title: Cohomological Blow Ups of Graded Artinian Gorenstein Algebras Along Surjective Maps

abstract: We introduce the cohomological blow up of a graded Artinian Gorenstein (AG) algebra along a surjective map, which we term BUG (Blow Up Gorenstein) for short. This is intended to translate to an algebraic context the cohomology ring of a blow up of a projective manifold along a projective submanifold. We show, among other things, that a BUG is a connected sum, that it is the general fiber in a flat family of algebras, and that it preserves the strong Lefschetz property. We also show that standard graded compressed algebras are rarely BUGs, and we classify those BUGs that are complete intersections. We have included many examples throughout this manuscript.


title: Uncertainty Propagation Using Hybrid Methods

abstract: Small corrections in the argument of the latitude can be used to improve the accuracy of the SGP4 orbit propagator. These corrections have been obtained by applying the hybrid methodology for orbit propagation to SGP4, therefore yielding a hybrid version of this propagator. The forecasting part of the hybrid method is based on a state-space formulation of the exponential smoothing method. If the error terms that have to be considered during the model fitting process are taken as Gaussian noise, then the maximum-likelihood method can be applied so as to estimate the parameters of the exponential-smoothing model, as well as to compute the forecast together with its confidence interval. Finally, this hybrid SGP4 orbit propagator has been applied to data from Galileo-type orbits. This new propagator improves the accuracy of the classical SGP4, especially for short forecasting horizons.


title: The Flaws of Policies Requiring Human Oversight of Government Algorithms

abstract: As algorithms become an influential component of government decision-making around the world, policymakers have debated how governments can attain the benefits of algorithms while preventing the harms of algorithms. One mechanism that has become a centerpiece of global efforts to regulate government algorithms is to require human oversight of algorithmic decisions. Despite the widespread turn to human oversight, these policies rest on an uninterrogated assumption: that people are able to effectively oversee algorithmic decision-making. In this article, I survey 41 policies that prescribe human oversight of government algorithms and find that they suffer from two significant flaws. First, evidence suggests that people are unable to perform the desired oversight functions. Second, as a result of the first flaw, human oversight policies legitimize government uses of faulty and controversial algorithms without addressing the fundamental issues with these tools. Thus, rather than protect against the potential harms of algorithmic decision-making in government, human oversight policies provide a false sense of security in adopting algorithms and enable vendors and agencies to shirk accountability for algorithmic harms. In light of these flaws, I propose a shift from human oversight to institutional oversight as the central mechanism for regulating government algorithms. This institutional approach operates in two stages. First, agencies must justify that it is appropriate to incorporate an algorithm into decision-making and that any proposed forms of human oversight are supported by empirical evidence. Second, these justifications must receive democratic public review and approval before the agency can adopt the algorithm.


title: DC conductance and memory in 3D gravity

abstract: Transport properties are investigated in the two-dimensional dual dynamics of AdS$_{3}$ gravity. By providing boundary conditions that deform the ADM lapse and shift functions, we construct a lower dimensional model comprising two copies of chiral boson excitations with anisotropic scaling symmetry. Using bosonization, an electric current is identified. By means of the Kubo formula, we find a DC conductance depending on the level of the theory and the dynamical exponents. The bulk realization of the linear response is related to a type of gravitational memory emerging in the context of near-horizon boundary conditions. The process is adiabatic and represents a permanent spacetime deformation parametrized by anisotropic chiral bosons through a large gauge transformation.


title: Bound-state solutions of the Schr\"odinger equation for two novel potentials

abstract: We solve the one-dimensional Schr\"odinger equation for the bound states of two potential models with a rich structure as shown by their "spectral phase diagram". These potentials do not belong to the well-known class of exactly solvable problems. The solutions are finite series of square integrable functions written in terms of the Jacobi polynomials.


title: Instance-Conditioned GAN

abstract: Generative Adversarial Networks (GANs) can generate near photo realistic images in narrow domains such as human faces. Yet, modeling complex distributions of datasets such as ImageNet and COCO-Stuff remains challenging in unconditional settings. In this paper, we take inspiration from kernel density estimation techniques and introduce a non-parametric approach to modeling distributions of complex datasets. We partition the data manifold into a mixture of overlapping neighborhoods described by a datapoint and its nearest neighbors, and introduce a model, called instance-conditioned GAN (IC-GAN), which learns the distribution around each datapoint. Experimental results on ImageNet and COCO-Stuff show that IC-GAN significantly improves over unconditional models and unsupervised data partitioning baselines. Moreover, we show that IC-GAN can effortlessly transfer to datasets not seen during training by simply changing the conditioning instances, and still generate realistic images. Finally, we extend IC-GAN to the class-conditional case and show semantically controllable generation and competitive quantitative results on ImageNet; while improving over BigGAN on ImageNet-LT. Code and trained models to reproduce the reported results are available at https://github.com/facebookresearch/ic_gan.


title: Intrinsic ferroelectricity in Y-doped HfO2 thin films

abstract: Ferroelectric HfO2-based materials hold great potential for widespread integration of ferroelectricity into modern electronics due to their robust ferroelectric properties at the nanoscale and compatibility with the existing Si technology. Earlier work indicated that the nanometer crystal grain size was crucial for stabilization of the ferroelectric phase of hafnia. This constraint caused high density of unavoidable structural defects of the HfO2-based ferroelectrics, obscuring the intrinsic ferroelectricity inherited from the crystal space group of bulk HfO2. Here, we demonstrate the intrinsic ferroelectricity in Y-doped HfO2 films of high crystallinity. Contrary to the common expectation, we show that in the 5% Y-doped HfO2 epitaxial thin films, high crystallinity enhances the spontaneous polarization up to a record-high 50 {\mu}C/cm2 value at room temperature. The high spontaneous polarization persists at reduced temperature, with polarization values consistent with our theoretical predictions, indicating the dominant contribution from the intrinsic ferroelectricity. The crystal structure of these films reveals the Pca21 orthorhombic phase with a small rhombohedral distortion, underlining the role of the anisotropic stress and strain. These results open a pathway to controlling the intrinsic ferroelectricity in the HfO2-based materials and optimizing their performance in applications.


title: GPU Algorithms for Efficient Exascale Discretizations

abstract: In this paper we describe the research and development activities in the Center for Efficient Exascale Discretization within the US Exascale Computing Project, targeting state-of-the-art high-order finite-element algorithms for high-order applications on GPU-accelerated platforms. We discuss the GPU developments in several components of the CEED software stack, including the libCEED, MAGMA, MFEM, libParanumal, and Nek projects. We report performance and capability improvements in several CEED-enabled applications on both NVIDIA and AMD GPU systems.


title: Simultaneous Perception-Action Design via Invariant Finite Belief Sets

abstract: Although perception is an increasingly dominant portion of the overall computational cost for autonomous systems, only a fraction of the information perceived is likely to be relevant to the current task. To alleviate these perception costs, we develop a novel simultaneous perception-action design framework wherein an agent senses only the task-relevant information. This formulation differs from that of a partially observable Markov decision process, since the agent is free to synthesize not only its policy for action selection but also its belief-dependent observation function. The method enables the agent to balance its perception costs with those incurred by operating in its environment. To obtain a computationally tractable solution, we approximate the value function using a novel method of invariant finite belief sets, wherein the agent acts exclusively on a finite subset of the continuous belief space. We solve the approximate problem through value iteration in which a linear program is solved individually for each belief state in the set, in each iteration. Finally, we prove that the value functions, under an assumption on their structure, converge to their continuous state-space values as the sample density increases.


title: FBERT: A Neural Transformer for Identifying Offensive Content

abstract: Transformer-based models such as BERT, XLNET, and XLM-R have achieved state-of-the-art performance across various NLP tasks including the identification of offensive language and hate speech, an important problem in social media. In this paper, we present fBERT, a BERT model retrained on SOLID, the largest English offensive language identification corpus available with over $1.4$ million offensive instances. We evaluate fBERT's performance on identifying offensive content on multiple English datasets and we test several thresholds for selecting instances from SOLID. The fBERT model will be made freely available to the community.


title: On the Compression of Neural Networks Using $\ell_0$-Norm Regularization and Weight Pruning

abstract: Despite the growing availability of high-capacity computational platforms, implementation complexity still has been a great concern for the real-world deployment of neural networks. This concern is not exclusively due to the huge costs of state-of-the-art network architectures, but also due to the recent push towards edge intelligence and the use of neural networks in embedded applications. In this context, network compression techniques have been gaining interest due to their ability for reducing deployment costs while keeping inference accuracy at satisfactory levels. The present paper is dedicated to the development of a novel compression scheme for neural networks. To this end, a new form of $\ell_0$-norm-based regularization is firstly developed, which is capable of inducing strong sparseness in the network during training. Then, targeting the smaller weights of the trained network with pruning techniques, smaller yet highly effective networks can be obtained. The proposed compression scheme also involves the use of $\ell_2$-norm regularization to avoid overfitting as well as fine tuning to improve the performance of the pruned network. Experimental results are presented aiming to show the effectiveness of the proposed scheme as well as to make comparisons with competing approaches.


title: Gravitational radiation back-reaction from f-modes on neutron stars

abstract: The problem of the gravitational radiation damping of neutron star fundamental ($f$) mode oscillations has received considerable attention. Many studies have looked at the stability of such oscillations in rapidly rotating stars, calculating the growth/decay rate of the mode amplitude. In this paper, we look at the relatively neglected problem of the radiation reaction on the spin of the star. We specialise greatly to the so-called Kelvin modes: the modes of oscillation of (initially) non-rotating incompressible stars. We find the unexpected result that the excitation of a mode of angular momentum $\delta J$ on an initially non-rotating star ends up radiating an angular momentum $2 \delta J$ to infinity, leaving the star itself with a bulk angular momentum of $-\delta J$. This result is interesting in itself, and also will have implications for the angular momentum budgets of spinning down neutron stars, should such modes be excited.


title: Data Generation Method for Learning a Low-dimensional Safe Region in Safe Reinforcement Learning

abstract: Safe reinforcement learning aims to learn a control policy while ensuring that neither the system nor the environment gets damaged during the learning process. For implementing safe reinforcement learning on highly nonlinear and high-dimensional dynamical systems, one possible approach is to find a low-dimensional safe region via data-driven feature extraction methods, which provides safety estimates to the learning algorithm. As the reliability of the learned safety estimates is data-dependent, we investigate in this work how different training data will affect the safe reinforcement learning approach. By balancing between the learning performance and the risk of being unsafe, a data generation method that combines two sampling methods is proposed to generate representative training data. The performance of the method is demonstrated with a three-link inverted pendulum example.


title: A semi-supervised self-training method to develop assistive intelligence for segmenting multiclass bridge elements from inspection videos

abstract: Bridge inspection is an important step in preserving and rehabilitating transportation infrastructure for extending their service lives. The advancement of mobile robotic technology allows the rapid collection of a large amount of inspection video data. However, the data are mainly images of complex scenes, wherein a bridge of various structural elements mix with a cluttered background. Assisting bridge inspectors in extracting structural elements of bridges from the big complex video data, and sorting them out by classes, will prepare inspectors for the element-wise inspection to determine the condition of bridges. This paper is motivated to develop an assistive intelligence model for segmenting multiclass bridge elements from inspection videos captured by an aerial inspection platform. With a small initial training dataset labeled by inspectors, a Mask Region-based Convolutional Neural Network (Mask R-CNN) pre-trained on a large public dataset was transferred to the new task of multiclass bridge element segmentation. Besides, the temporal coherence analysis attempts to recover false negatives and identify the weakness that the neural network can learn to improve. Furthermore, a semi-supervised self-training (S$^3$T) method was developed to engage experienced inspectors in refining the network iteratively. Quantitative and qualitative results from evaluating the developed deep neural network demonstrate that the proposed method can utilize a small amount of time and guidance from experienced inspectors (3.58 hours for labeling 66 images) to build the network of excellent performance (91.8% precision, 93.6% recall, and 92.7% f1-score). Importantly, the paper illustrates an approach to leveraging the domain knowledge and experiences of bridge professionals into computational intelligence models to efficiently adapt the models to varied bridges in the National Bridge Inventory.


title: Kolmogorov's Equations for Jump Markov Processes and their Applications to Control Problems

abstract: This paper describes the structure of solutions to Kolmogorov's equations for nonhomogeneous jump Markov processes and applications of these results to control of jump stochastic systems. These equations were studied by Feller (1940), who clarified in 1945 in the errata to that paper that some of its results covered only nonexplosive Markov processes. In this work, which is largely of a survey nature, the case of explosive processes is also considered. This paper is based on the invited talk presented by the authors at the conference "Chebyshev-200", and it describes the results of their joined studies with Manasa Mandava (1984-2019).


title: Tanisaki witness relations for harmonic differential forms

abstract: Inspired by a series of conjectures related to higher coinvariant algebras, we present two families of relations involving harmonic differential forms of the symmetric group. Our relations, together with a novel bijection, are sufficient to give a filtration of the $1$-forms suggested by work of Haglund--Rhoades--Shimozono with composition factors given by Tanisaki quotients. These are "almost all" of the necessary relations in a certain asymptotic sense we make precise.


title: Interactive Treatment Planning in High Dose-Rate Brachytherapy for Gynecological Cancer

abstract: High dose-rate brachytherapy (HDRBT) is widely used for gynecological cancer treatment. Although commercial treatment planning systems (TPSs) have inverse optimization modules, it takes several iterations to adjust planning objectives to achieve a satisfactory plan. Interactive plan-modification modules enable modifying the plan and visualizing results in real time, but they update plans based on simple geometrical or heuristic algorithms, which cannot ensure resulting plan optimality. This project develops an interactive plan optimization module for HDRBT of gynecological cancer. By efficiently solving an optimization problem in real time, it allows a user to visualize a plan and interactively modify it to improve quality. We formulated an optimization problem with an objective function containing a weighted sum of doses to normal organs subject to user-specified target coverage. A user interface was developed that allows a user to adjust organ weights using scroll bars. With a simple mouse click, the optimization problem is solved in seconds with a highly efficient alternating-direction method of multipliers and a warm start optimization strategy. Resulting clinically relevant D2cc of organs are displayed immediately. This allows a user to intuitively adjust plans with satisfactory quality. We tested the effectiveness of our development in cervix cancer cases treated with a tandem-and-ovoid applicator. It took a maximum of 3 seconds to solve the optimization problem in each instance. With interactive optimization capability, a satisfactory plan can be obtained in <1 min. In our clinic, although the time for plan adjustment was typically <10min with simple interactive plan modification tools in TPS, the resulting plans do not ensure optimality. Our plans achieved on average 5% lower D2cc than clinical plans, while maintaining target coverage.


title: Consolidated theory of fluid thermodiffusion

abstract: We present the Onsager--Stefan--Maxwell thermodiffusion equations, which account for the Soret and Dufour effects in multicomponent fluids. Unlike transport laws derived from kinetic theory, this framework preserves the structure of the isothermal Stefan--Maxwell equations, separating the thermodynamic forces that drive diffusion from the force that drives heat flow. The Onsager--Stefan--Maxwell transport-coefficient matrix is symmetric, and the second law of thermodynamics imbues it with simple spectral characteristics. This new approach allows for heat to be considered as a pseudo-species and proves equivalent to both the intuitive extension of Fick's law and the generalized Stefan--Maxwell equations popularized by Bird, Stewart, and Lightfoot. A general inversion process facilitates the unique formulation of flux-explicit transport equations relative to any choice of convective reference velocity. Stefan--Maxwell diffusivities and thermal diffusion factors are tabulated for gaseous mixtures containing helium, argon, neon, krypton, and xenon. The framework is deployed to perform numerical simulations of steady three-dimensional thermodiffusion in a ternary gas.


title: Preliminary Wildfire Detection Using State-of-the-art PTZ (Pan, Tilt, Zoom) Camera Technology and Convolutional Neural Networks

abstract: Wildfires are uncontrolled fires in the environment that can be caused by humans or nature. In 2020 alone, wildfires in California have burned 4.2 million acres, damaged 10,500 buildings or structures, and killed more than 31 people, exacerbated by climate change and a rise in average global temperatures. This also means there has been an increase in the costs of extinguishing these treacherous wildfires. The objective of the research is to detect forest fires in their earlier stages to prevent them from spreading, prevent them from causing damage to a variety of things, and most importantly, reduce or eliminate the chances of someone dying from a wildfire. A fire detection system should be efficient and accurate with respect to extinguishing wildfires in their earlier stages to prevent the spread of them along with their consequences. Computer Vision is potentially a more reliable, fast, and widespread method we need. The current research in the field of preliminary fire detection has several problems related to unrepresentative data being used to train models and their existing varied amounts of label imbalance in the classes of their dataset. We propose a more representative and evenly distributed data through better settings, lighting, atmospheres, etc., and class distribution in the entire dataset. After thoroughly examining the results of this research, it can be inferred that they supported the datasets strengths by being a viable resource when tested in the real world on unfamiliar data. This is evident since as the model trains on the dataset, it is able to generalize on it, hence confirming this is a viable Machine Learning setting that has practical impact.


title: Winding Through: Crowd Navigation via Topological Invariance

abstract: We focus on robot navigation in crowded environments. The challenge of predicting the motion of a crowd around a robot makes it hard to ensure human safety and comfort. Recent approaches often employ end-to-end techniques for robot control or deep architectures for high-fidelity human motion prediction. While these methods achieve important performance benchmarks in simulated domains, dataset limitations and high sample complexity tend to prevent them from transferring to real-world environments. Our key insight is that a low-dimensional representation that captures critical features of crowd-robot dynamics could be sufficient to enable a robot to wind through a crowd smoothly. To this end, we mathematically formalize the act of passing between two agents as a rotation, using a notion of topological invariance. Based on this formalism, we design a cost functional that favors robot trajectories contributing higher passing progress and penalizes switching between different sides of a human. We incorporate this functional into a model predictive controller that employs a simple constant-velocity model of human motion prediction. This results in robot motion that accomplishes statistically significantly higher clearances from the crowd compared to state-of-the-art baselines while maintaining competitive levels of efficiency, across extensive simulations and challenging real-world experiments on a self-balancing robot.


title: An Efficient High-order Numerical Solver for Diffusion Equations with Strong Anisotropy

abstract: In this paper, we present an interior penalty discontinuous Galerkin finite element scheme for solving diffusion problems with strong anisotropy arising in magnetized plasmas for fusion applications. We demonstrate the accuracy produced by the high-order scheme and develop an efficient preconditioning technique to solve the corresponding linear system, which is robust to the mesh size and anisotropy of the problem. Several numerical tests are provided to validate the accuracy and efficiency of the proposed algorithm.


title: Numerical Simulation of the Coupling between Split-Ring Resonators and Antiferromagnetic Magnons

abstract: We report on the results of simulations of the terahertz response of a split ring resonator (SRR) metamaterial coupled to a hypothetical antiferromagnetic material characterized by a magnon resonance. The simulations were done using finite difference time domain (FDTD) techniques. By adjusting the magnon frequency we find a hybridization of the resonant normal modes of the SRR and the magnon manifested as an avoided crossing. By varying the physical separation between the metamaterial and the antiferromagnet with a dielectric spacer, we evaluated the coupling strength between the two.


title: Global and Local Interpretation of black-box Machine Learning models to determine prognostic factors from early COVID-19 data

abstract: The COVID-19 corona virus has claimed 4.1 million lives, as of July 24, 2021. A variety of machine learning models have been applied to related data to predict important factors such as the severity of the disease, infection rate and discover important prognostic factors. Often the usefulness of the findings from the use of these techniques is reduced due to lack of method interpretability. Some recent progress made on the interpretability of machine learning models has the potential to unravel more insights while using conventional machine learning models. In this work, we analyze COVID-19 blood work data with some of the popular machine learning models; then we employ state-of-the-art post-hoc local interpretability techniques(e.g.- SHAP, LIME), and global interpretability techniques(e.g. - symbolic metamodeling) to the trained black-box models to draw interpretable conclusions. In the gamut of machine learning algorithms, regressions remain one of the simplest and most explainable models with clear mathematical formulation. We explore one of the most recent techniques called symbolic metamodeling to find the mathematical expression of the machine learning models for COVID-19. We identify Acute Kidney Injury (AKI), initial Albumin level (ALBI), Aspartate aminotransferase (ASTI), Total Bilirubin initial(TBILI) and D-Dimer initial (DIMER) as major prognostic factors of the disease severity. Our contributions are- (i) uncover the underlying mathematical expression for the black-box models on COVID-19 severity prediction task (ii) we are the first to apply symbolic metamodeling to this task, and (iii) discover important features and feature interactions.


title: Recent advances in blood rheology: A review

abstract: Due to the potential impact on the diagnosis and treatment of various cardiovascular diseases, work on the rheology of blood has significantly expanded in the last decade, both experimentally and theoretically. Experimentally, blood has been confirmed to demonstrate a variety of non-Newtonian rheological characteristics, including pseudoplasticity, viscoelasticity, and thixotropy. New rheological experiments and the development of more controlled experimental protocols on more extensive, broadly physiologically characterized, human blood samples demonstrate the sensitivity of aspects of hemorheology to several physiological factors. For example, at high shear rates to the red blood cells elastically deformation, imparting viscoelasticity, while and at low shear rates, they form rouleaux structures that impart additional, thixotropic behavior. In addition to these advances in experimental methods and validated data sets, significant advances have also been made in both microscopic simulations and macroscopic, continuum, modeling, as well as novel, multiscale approaches. We outline and evaluate the most promising of these recent advances. Although we primarily focus on human blood rheology, we also discuss recent observations on variations across some animal species that provide some indication on evolutionary effects.


title: On the Thom conjecture in $CP^3$

abstract: What is the simplest smooth simply connected 4-manifold embedded in $CP^3$ homologous to a degree $d$ hypersurface $V_d$? A version of this question associated with Thom asks if $V_d$ has the smallest $b_2$ among all such manifolds. While this is true for degree at most $4$, we show that for all $d \geq 5$, there is a manifold $M_d$ in this homology class with $b_2(M_d) < b_2(V_d)$. This contrasts with the Kronheimer-Mrowka solution of the Thom conjecture about surfaces in $CP^2$, and is similar to results of Freedman for $2n$-manifolds in $CP^{n+1}$ with $n$ odd and greater than $1$.


title: Enhancing Self-Disclosure In Neural Dialog Models By Candidate Re-ranking

abstract: Neural language modelling has progressed the state-of-the-art in different downstream Natural Language Processing (NLP) tasks. One such area is of open-domain dialog modelling, neural dialog models based on GPT-2 such as DialoGPT have shown promising performance in single-turn conversation. However, such (neural) dialog models have been criticized for generating responses which although may have relevance to the previous human response, tend to quickly dissipate human interest and descend into trivial conversation. One reason for such performance is the lack of explicit conversation strategy being employed in human-machine conversation. Humans employ a range of conversation strategies while engaging in a conversation, one such key social strategies is Self-disclosure(SD). A phenomenon of revealing information about one-self to others. Social penetration theory (SPT) proposes that communication between two people moves from shallow to deeper levels as the relationship progresses primarily through self-disclosure. Disclosure helps in creating rapport among the participants engaged in a conversation. In this paper, Self-disclosure enhancement architecture (SDEA) is introduced utilizing Self-disclosure Topic Model (SDTM) during inference stage of a neural dialog model to re-rank response candidates to enhance self-disclosure in single-turn responses from from the model.


title: Length Regulation Drives Self-Organization in Filament-Motor Mixtures

abstract: Cytoskeletal networks form complex intracellular structures. Here we investigate a minimal model for filament-motor mixtures in which motors act as depolymerases and thereby regulate filament length. Combining agent-based simulations and hydrodynamic equations, we show that resource-limited length regulation drives the formation of filament clusters despite the absence of mechanical interactions between filaments. Even though the orientation of individual remains fixed, collective filament orientation emerges in the clusters, aligned orthogonal to their interfaces.


title: Remember the context! ASR slot error correction through memorization

abstract: Accurate recognition of slot values such as domain specific words or named entities by automatic speech recognition (ASR) systems forms the core of the Goal-oriented Dialogue Systems. Although it is a critical step with direct impact on downstream tasks such as language understanding, many domain agnostic ASR systems tend to perform poorly on domain specific or long tail words. They are often supplemented with slot error correcting systems but it is often hard for any neural model to directly output such rare entity words. To address this problem, we propose k-nearest neighbor (k-NN) search that outputs domain-specific entities from an explicit datastore. We improve error correction rate by conveniently augmenting a pretrained joint phoneme and text based transformer sequence to sequence model with k-NN search during inference. We evaluate our proposed approach on five different domains containing long tail slot entities such as full names, airports, street names, cities, states. Our best performing error correction model shows a relative improvement of 7.4% in word error rate (WER) on rare word entities over the baseline and also achieves a relative WER improvement of 9.8% on an out of vocabulary (OOV) test set.


title: PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models

abstract: Large pre-trained language models for textual data have an unconstrained output space; at each decoding step, they can produce any of 10,000s of sub-word tokens. When fine-tuned to target constrained formal languages like SQL, these models often generate invalid code, rendering it unusable. We propose PICARD (code and trained models available at https://github.com/ElementAI/picard), a method for constraining auto-regressive decoders of language models through incremental parsing. PICARD helps to find valid output sequences by rejecting inadmissible tokens at each decoding step. On the challenging Spider and CoSQL text-to-SQL translation tasks, we show that PICARD transforms fine-tuned T5 models with passable performance into state-of-the-art solutions.


title: Multigraphs from crossword puzzle grid designs

abstract: Crossword puzzles lend themselves to mathematical inquiry. Several authors have already described the arrangement of crossword grids and associated combinatorics of answer numbers. In this paper, we present a new graph-theoretic representation of crossword puzzle grid designs and describe the mathematical conditions placed on these graphs by well-known crossword construction conventions.


title: Stochastic Adversarial Koopman Model for Dynamical Systems

abstract: Dynamical systems are ubiquitous and are often modeled using a non-linear system of governing equations. Numerical solution procedures for many dynamical systems have existed for several decades, but can be slow due to high-dimensional state space of the dynamical system. Thus, deep learning-based reduced order models (ROMs) are of interest and one such family of algorithms along these lines are based on the Koopman theory. This paper extends a recently developed adversarial Koopman model (Balakrishnan \& Upadhyay, arXiv:2006.05547) to stochastic space, where the Koopman operator applies on the probability distribution of the latent encoding of an encoder. Specifically, the latent encoding of the system is modeled as a Gaussian, and is advanced in time by using an auxiliary neural network that outputs two Koopman matrices $K_{\mu}$ and $K_{\sigma}$. Adversarial and gradient losses are used and this is found to lower the prediction errors. A reduced Koopman formulation is also undertaken where the Koopman matrices are assumed to have a tridiagonal structure, and this yields predictions comparable to the baseline model with full Koopman matrices. The efficacy of the stochastic Koopman model is demonstrated on different test problems in chaos, fluid dynamics, combustion, and reaction-diffusion models. The proposed model is also applied in a setting where the Koopman matrices are conditioned on other input parameters for generalization and this is applied to simulate the state of a Lithium-ion battery in time. The Koopman models discussed in this study are very promising for the wide range of problems considered.


title: Generation of optical potentials for ultracold atoms using a superluminescent diode

abstract: We report on the realization and characterisation of optical potentials for ultracold atoms using a superluminescent diode. The light emitted by this class of diodes is characterised by high spatial coherence but low temporal coherence. On the one hand, this implies that it follows Gaussian propagation similar to lasers, allowing for high intensities and well-collimated beams. On the other, it significantly reduces those interference effects that lead to severe distortions in imaging. By using a high-resolution optical setup, we produce patterned optical potentials with a digital micromirror device and demonstrate that the quality of the patterns produced by our superluminescent diode is consistently and substantially higher than those produced by our laser. We show that the resulting optical potentials can be used to arrange the atoms in arbitrary structures and manipulate them dynamically. Our results can open new opportunities in the fields of quantum simulations and atomtronics.


title: HypoGen: Hyperbole Generation with Commonsense and Counterfactual Knowledge

abstract: A hyperbole is an intentional and creative exaggeration not to be taken literally. Despite its ubiquity in daily life, the computational explorations of hyperboles are scarce. In this paper, we tackle the under-explored and challenging task: sentence-level hyperbole generation. We start with a representative syntactic pattern for intensification and systematically study the semantic (commonsense and counterfactual) relationships between each component in such hyperboles. Next, we leverage the COMeT and reverse COMeT models to do commonsense and counterfactual inference. We then generate multiple hyperbole candidates based on our findings from the pattern, and train neural classifiers to rank and select high-quality hyperboles. Automatic and human evaluations show that our generation method is able to generate hyperboles creatively with high success rate and intensity scores.


title: Off-of-equilibrium effects on Kurtosis Along Strangeness-Neutral Trajectories

abstract: The Beam Energy Scan program at the Relativistic Heavy Ion Collider (RHIC) is searching for the QCD critical point. The main signal for the critical point is the kurtosis of the distribution of proton yields obtained on an event-by-event basis where one expects a peak at the critical point. However, its exact behavior is still an open question due to out-of-equilibrium effects and uncertainty in the equation of state. Here we use a simplistic hydrodynamic model that enforces strangeness-neutrality, selecting trajectories that pass close to the critical point. We vary the initial conditions to estimate the effect of out-of-equilibrium hydrodynamics on the kurtosis signal.


title: On the Whittaker range of the generalized metaplectic theta lift

abstract: The classical theta correspondence, based on the Weil representation, allows one to lift automorphic representations on symplectic groups or their double covers to automorphic representations on special orthogonal groups. It is of interest to vary the orthogonal group and describe the behavior in this theta tower (the Rallis tower). In prior work, the authors obtained an extension of the classical theta correspondence to higher degree metaplectic covers of symplectic and special orthogonal groups that is based on the tensor product of the Weil representation with another small representation. In this work we study the existence of generic lifts in the resulting theta tower. In the classical case, there are two orthogonal groups that may support a generic lift of an irreducible cuspidal automorphic representation of a symplectic group. We show that in general the Whittaker range consists of $r+1$ groups for the lift from the $r$-fold cover of a symplectic group. We also give a period criterion for the genericity of the lift at each step of the tower.


title: Bayesian inference of polymerase dynamics over the exclusion process

abstract: Transcription is a complex phenomenon that permits the conversion of genetic information into phenotype by means of an enzyme called RNA polymerase, which erratically moves along and scans the DNA template. We perform Bayesian inference over a paradigmatic mechanistic model of non-equilibrium statistical physics, i.e., the asymmetric exclusion processes in the hydrodynamic limit, assuming a Gaussian process prior for the polymerase progression rate as a latent variable. Our framework allows us to infer the speed of polymerases during transcription given their spatial distribution, whilst avoiding the explicit inversion of the system's dynamics. The results, which show processing rates strongly varying with genomic position and minor role of traffic-like congestion, may have strong implications for the understanding of gene expression.


title: Anisotropic MagnetoMemristance

abstract: In the last decade, nanoscale resistive devices with memory have been the subject of intense study because of their possible use in brain-inspired computing. However, operational endurance is one of the limiting factors in the adoption of such technology. For this reason, we discuss the emergence of current-induced memristance in magnetic materials, known for their durability. We show analytically and numerically that a single ferromagnetic layer can possess GHz memristance, due to a combination of two factors: a current-induced transfer of angular momentum (Zhang-Li torque) and the anisotropic magnetoresistance (AMR). We term the resulting effect the anisotropic magneto-memristance (AMM). We connect the AMM to the topology of the magnetization state, within a simple model of a 1-dimensional annulus-shaped magnetic layer, confirming the analytical results with micromagnetic simulations for permalloy. Our results open a new path towards the realization of single-layer magnetic memristive devices operating at GHz frequencies.

categories: cond-mat.mes-hall cond-mat.soft cond-mat.stat-mech nlin.PS


title: On the relation between the propagator matrix and the Marchenko focusing function

abstract: The propagator matrix "propagates" a full wave field from one depth level to another, accounting for all propagation angles and evanescent waves. The Marchenko focusing function forms the nucleus of data-driven Marchenko redatuming and imaging schemes, accounting for internal multiples. These seemingly different concepts appear to be closely related to each other. With this insight, the strong aspects of the propagator matrix (such as the handling of evanescent waves) can be transferred to the focusing function. Vice-versa, the propagator matrix inherits from the focusing function that it can be retrieved from the reflection response, which reduces its sensitivity to the subsurface model.


title: No Size Fits All: Automated Radio Configuration for LPWANs

abstract: Low power long-range networks like LoRa have become increasingly mainstream for Internet of Things deployments. Given the versatility of applications that these protocols enable, they support many data rates and bandwidths. Yet, for a given network that supports hundreds of devices over multiple miles, the network operator typically needs to specify the same configuration or among a small subset of configurations for all the client devices to communicate with the gateway. This one-size-fits-all approach is highly inefficient in large networks. We propose an alternative approach -- we allow network devices to transmit at any data rate they choose. The gateway uses the first few symbols in the preamble to classify the correct data rate, switches its configuration, and then decodes the data. Our design leverages the inherent asymmetry in outdoor IoT deployments where the clients are power-starved and resource-constrained, but the gateway is not. Our gateway design, Proteus, runs a neural network architecture and is backward compatible with existing LoRa protocols. Our experiments reveal that Proteus can identify the correct configuration with over 97% accuracy in both indoor and outdoor deployments. Our network architecture leads to a 3.8 to 11 times increase in throughput for our LoRa testbed.


title: Machine learning reveals how personalized climate communication can both succeed and backfire

abstract: Different advertising messages work for different people. Machine learning can be an effective way to personalise climate communications. In this paper we use machine learning to reanalyse findings from a recent study, showing that online advertisements increased some people's belief in climate change while resulting in decreased belief in others. In particular, we show that the effect of the advertisements could change depending on people's age and ethnicity.


title: Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Models

abstract: Can we get existing language models and refine them for zero-shot commonsense reasoning? This paper presents an initial study exploring the feasibility of zero-shot commonsense reasoning for the Winograd Schema Challenge by formulating the task as self-supervised refinement of a pre-trained language model. In contrast to previous studies that rely on fine-tuning annotated datasets, we seek to boost conceptualization via loss landscape refinement. To this end, we propose a novel self-supervised learning approach that refines the language model utilizing a set of linguistic perturbations of similar concept relationships. Empirical analysis of our conceptually simple framework demonstrates the viability of zero-shot commonsense reasoning on multiple benchmarks.


title: Minimizing AoI in Resource-Constrained Multi-Source Relaying Systems with Stochastic Arrivals

abstract: We consider a multi-source relaying system where the sources independently and randomly generate status update packets which are sent to the destination with the aid of a bufferaided relay through unreliable links. We formulate a stochastic optimization problem aiming to minimize the sum average age of information (AAoI) of sources under per-slot transmission capacity constraints and a long-run average resource constraint. To solve the problem, we recast it as a constrained Markov decision process (CMDP) problem and adopt the Lagrangian method. We analyze the structure of an optimal policy for the resulting MDP problem that possesses a switching-type structure. We propose an algorithm that obtains a stationary deterministic near-optimal policy, establishing a benchmark for the system. Simulation results show the effectiveness of our algorithm compared to benchmark algorithms.


title: Feasibility of Modeling Orthogonal Frequency-Division Multiplexing Communication Signals with Unsupervised Generative Adversarial Networks

abstract: High-quality recordings of radio frequency (RF) emissions from commercial communication hardware in realistic environments are often needed to develop and assess spectrum-sharing technologies and practices, e.g., for training and testing spectrum sensing algorithms and for interference testing. Unfortunately, the time-consuming, expensive nature of such data collections together with data-sharing restrictions pose significant challenges that limit data set availability. Furthermore, developing accurate models of real-world RF emissions from first principles is often very difficult because system parameters and implementation details are at best only partially known, and complex system dynamics are difficult to characterize. Hence, there is a need for flexible, data-driven methods that can leverage existing data sets to synthesize additional similar waveforms. One promising machine-learning approach is unsupervised deep generative modeling with generative adversarial networks (GANs). To date, GANs for RF communication signals have not been studied thoroughly. In this paper, we present the first in-depth investigation of generated signal fidelity for GANs trained with baseband orthogonal frequency-division multiplexing (OFDM) signals, where each subcarrier is digitally modulated with quadrature amplitude modulation (QAM). Building on prior GAN methods, we developed two novel GAN models and evaluated their performance using simulated data sets with known ground truth. Specifically, we investigated model performance with respect to increasing data set complexity over a range of OFDM parameters and conditions, including fading channels. The findings presented here inform the feasibility of use cases and provide a foundation for further investigations into deep generative models for RF communication signals.


title: Attention-based Contrastive Learning for Winograd Schemas

abstract: Self-supervised learning has recently attracted considerable attention in the NLP community for its ability to learn discriminative features using a contrastive objective. This paper investigates whether contrastive learning can be extended to Transfomer attention to tackling the Winograd Schema Challenge. To this end, we propose a novel self-supervised framework, leveraging a contrastive loss directly at the level of self-attention. Experimental analysis of our attention-based models on multiple datasets demonstrates superior commonsense reasoning capabilities. The proposed approach outperforms all comparable unsupervised approaches while occasionally surpassing supervised ones.


title: Toward Communication Efficient Adaptive Gradient Method

abstract: In recent years, distributed optimization is proven to be an effective approach to accelerate training of large scale machine learning models such as deep neural networks. With the increasing computation power of GPUs, the bottleneck of training speed in distributed training is gradually shifting from computation to communication. Meanwhile, in the hope of training machine learning models on mobile devices, a new distributed training paradigm called ``federated learning'' has become popular. The communication time in federated learning is especially important due to the low bandwidth of mobile devices. While various approaches to improve the communication efficiency have been proposed for federated learning, most of them are designed with SGD as the prototype training algorithm. While adaptive gradient methods have been proven effective for training neural nets, the study of adaptive gradient methods in federated learning is scarce. In this paper, we propose an adaptive gradient method that can guarantee both the convergence and the communication efficiency for federated learning.


title: An Empirical Comparison of Off-policy Prediction Learning Algorithms in the Four Rooms Environment

abstract: Many off-policy prediction learning algorithms have been proposed in the past decade, but it remains unclear which algorithms learn faster than others. We empirically compare 11 off-policy prediction learning algorithms with linear function approximation on two small tasks: the Rooms task, and the High Variance Rooms task. The tasks are designed such that learning fast in them is challenging. In the Rooms task, the product of importance sampling ratios can be as large as $2^{14}$ and can sometimes be two. To control the high variance caused by the product of the importance sampling ratios, step size should be set small, which in turn slows down learning. The High Variance Rooms task is more extreme in that the product of the ratios can become as large as $2^{14}\times 25$. This paper builds upon the empirical study of off-policy prediction learning algorithms by Ghiassian and Sutton (2021). We consider the same set of algorithms as theirs and employ the same experimental methodology. The algorithms considered are: Off-policy TD($\lambda$), five Gradient-TD algorithms, two Emphatic-TD algorithms, Tree Backup($\lambda$), Vtrace($\lambda$), and ABTD($\zeta$). We found that the algorithms' performance is highly affected by the variance induced by the importance sampling ratios. The data shows that Tree Backup($\lambda$), Vtrace($\lambda$), and ABTD($\zeta$) are not affected by the high variance as much as other algorithms but they restrict the effective bootstrapping parameter in a way that is too limiting for tasks where high variance is not present. We observed that Emphatic TD($\lambda$) tends to have lower asymptotic error than other algorithms, but might learn more slowly in some cases. We suggest algorithms for practitioners based on their problem of interest, and suggest approaches that can be applied to specific algorithms that might result in substantially improved algorithms.


title: Reflective and coreflective subcategories

abstract: Given any additive category $\mathcal{C}$ with split idempotents, pseudokernels and pseudocokernels, we show that a subcategory $\mathcal{B}$ is coreflective if, and only if, it is precovering, closed under direct summands and each morphism in $\mathcal{B}$ has a pseudocokernel in $\mathcal{C}$ that belongs to $\mathcal{B}$. We apply this result and its dual to, among others, preabelian and pretriangulated categories. As a consequence, we show that a subcategory of a preabelian category is coreflective if, and only it, it is precovering and closed under taking cokernels. On the other hand, if $\mathcal{C}$ is pretriangulated with split idempotents, then a subcategory $\mathcal{B}$ is coreflective and invariant under the suspension functor if, and only if, it is precovering and closed under taking direct summands and cones. These are extensions of well-known results for AB3 abelian and triangulated categories, respectively. By-side applications of these results allow us: a) To characterize the coreflective subcategories of a given AB3 abelian category which have a set of generators and are themselves abelian, abelian exact or module categories; b) to extend to module categories over arbitrary small preadditive categories a result of Gabriel and De la Pe\~na stating that all fully exact subcategories are bireflective; c) to show that, in any Grothendieck category, the direct limit closure of its subcategory of finitely presented objects is a coreflective subcategory.


title: Improved Latent Tree Induction with Distant Supervision via Span Constraints

abstract: For over thirty years, researchers have developed and analyzed methods for latent tree induction as an approach for unsupervised syntactic parsing. Nonetheless, modern systems still do not perform well enough compared to their supervised counterparts to have any practical use as structural annotation of text. In this work, we present a technique that uses distant supervision in the form of span constraints (i.e. phrase bracketing) to improve performance in unsupervised constituency parsing. Using a relatively small number of span constraints we can substantially improve the output from DIORA, an already competitive unsupervised parsing system. Compared with full parse tree annotation, span constraints can be acquired with minimal effort, such as with a lexicon derived from Wikipedia, to find exact text matches. Our experiments show span constraints based on entities improves constituency parsing on English WSJ Penn Treebank by more than 5 F1. Furthermore, our method extends to any domain where span constraints are easily attainable, and as a case study we demonstrate its effectiveness by parsing biomedical text from the CRAFT dataset.


title: Natural Multicontact Walking for Robotic Assistive Devices via Musculoskeletal Models and Hybrid Zero Dynamics

abstract: Generating stable walking gaits that yield natural locomotion when executed on robotic-assistive devices is a challenging task that often requires hand-tuning by domain experts. This paper presents an alternative methodology, where we propose the addition of musculoskeletal models directly into the gait generation process to intuitively shape the resulting behavior. In particular, we construct a multi-domain hybrid system model that combines the system dynamics with muscle models to represent natural multicontact walking. Provably stable walking gaits can then be generated for this model via the hybrid zero dynamics (HZD) method. We experimentally apply our integrated framework towards achieving multicontact locomotion on a dual-actuated transfemoral prosthesis, AMPRO3, for two subjects. The results demonstrate that enforcing muscle model constraints produces gaits that yield natural locomotion (as analyzed via comparison to motion capture data and electromyography). Moreover, gaits generated with our framework were strongly preferred by the non-disabled prosthetic users as compared to gaits generated with the nominal HZD method, even with the use of systematic tuning methods. We conclude that the novel approach of combining robotic walking methods (specifically HZD) with muscle models successfully generates anthropomorphic robotic-assisted locomotion.


title: Updated Ephemeris and Evidence for a Period Change in the Eclipsing Novalike Variable 1RXS J064434.5+334451

abstract: We report seven new eclipse timings for the novalike variable 1RXS J064434.5+334451. An analysis of our data, along with all previously available timings (36 published and 16 unpublished), yields a best-fitting linear ephemeris of BJD$_\mathrm{ecl} = 2,453,403.7611(2) + 0.269~374~43(2)~\mathrm{E}$. We find a somewhat improved fit with a quadratic ephemeris given by: BJD$_\mathrm{ecl} = 2,453,403.7598 + 0.269~374~87~\mathrm{E} - 2.0\times10^{-11}~\mathrm{E}^2$, which suggests that the orbital period may be decreasing at a rate given by $\dot P \simeq -1.5\times10^{-10}$.


title: Partially-Supervised Novel Object Captioning Leveraging Context from Paired Data

abstract: In this paper, we propose an approach to improve image captioning solution for images with novel objects that do not have caption labels in the training dataset. We refer to our approach as Partially-Supervised Novel Object Captioning (PS-NOC). PS-NOC is agnostic to model architecture, and primarily focuses on the training approach that uses existing fully paired image-caption data and the images with only the novel object detection labels (partially paired data). We create synthetic paired captioning data for novel objects by leveraging context from existing image-caption pairs. We then create pseudo-label captions for partially paired images with novel objects, and use this additional data to fine-tune the captioning model. We also propose a variant of SCST within PS-NOC, called SCST-F1, that directly optimizes the F1-score of novel objects. Using a popular captioning model (Up-Down) as baseline, PS-NOC sets new state-of-the-art results on held-out MS COCO out-of-domain test split, i.e., 85.9 F1-score and 103.8 CIDEr. This is an improvement of 85.9 and 34.1 points respectively compared to baseline model that does not use partially paired data during training. We also perform detailed ablation studies to demonstrate the effectiveness of our approach.


title: Nanoscale self-organisation and metastable non-thermal metallicity in Mott insulators

abstract: Mott transitions in real materials are first order and almost always associated with lattice distortions, both features promoting the emergence of nanotextured phases. This nanoscale self-organization creates spatially inhomogeneous regions, which can host and protect transient non-thermal electronic and lattice states triggered by light excitation. Here, we combine time-resolved X-ray microscopy with a Landau-Ginzburg functional approach for calculating the strain and electronic real-space configurations. We investigate V$_2$O$_3$, the archetypal Mott insulator in which nanoscale self-organization already exists in the low-temperature monoclinic phase and strongly affects the transition towards the high-temperature corundum metallic phase. Our joint experimental-theoretical approach uncovers a remarkable out-of-equilibrium phenomenon: the photo-induced stabilisation of the long sought monoclinic metal phase, which is absent at equilibrium and in homogeneous materials, but emerges as a metastable state solely when light excitation is combined with the underlying nanotexture of the monoclinic lattice.


title: Cosmic Ray Induced Mass-Independent Oxygen Isotope Exchange: A Novel Mechanism for Producing $^{16}$O depletions in the Early Solar System

abstract: A fundamental puzzle of our solar system's formation is understanding why the terrestrial bodies including the planets,comets,and asteroids are depleted in $^{16}$O compared to the Sun. The most favored mechanism,the selective photodissociation of CO gas to produce $^{16}$O depleted water,requires finely tuned mixing timescales to transport $^{16}$O depleted water from the cold outer solar system to exchange isotopically with dust grains to produce the $^{16}$O depleted planetary bodies observed today. Here we show that energetic particle irradiation of SiO$_2$ (and Al$_2$O$_3$) makes them susceptible to anomalous isotope exchange with H$_2$O ice at temperatures as low as 10 K. The observed magnitude of the anomalous isotope exchange (D$^{17}$O) is sufficient to generate the $^{16}$O depletion characteristic of the terrestrial bodies in the solar system. We calculated the cosmic-ray exposure times needed to produce the observed $^{16}$O depletions in silicate (SiO2) dust in the interstellar medium and early solar system and find that radiation damage induced oxygen isotope exchange could have rapidly (~10-100 yrs) depleted dust grains of $^{16}$O during the Sun's T-Tauri phase. Our model explains whythe oldest and most refractory minerals found in the solar system, the anhydrous Calcium with Aluminum Inclusions (CAIs),are generally $^{16}$O enriched compared to chondrules and the bulk terrestrial solids and provides a mechanism for producing $^{16}$O depleted grains very early in the solar system's history. Our findings have broad implications for the distribution of oxygen isotopes in the solar system, the interstellar medium, the formation of the planets and its building blocks as well as the nature of mass-independent isotope effects.


title: Discretization of Annular-Ring Diffraction Pattern for Large-Scale Photonics Beamforming

abstract: A solid-state active beamformer based on the annular-ring diffraction pattern is proposed for an integrated photonic platform. Such a circularly symmetric annular-ring aperture achieves radiating element limited FOV. Furthermore, it is demonstrated that a multi-annular-ring aperture with a fixed linear density of elements maintains the beam efficiency for larger apertures while reducing the beamwidth and side-lobe-level (SLL). A 255-element multi-annular-ring OPA with active beamforming is implemented in a standard photonics process. 510 phase and amplitude modulators enable beamforming and beam steering using this aperture. A row-column drive methodology reduces the required electrical drivers by more than a factor of 5.

categories: physics.optics cs.SY eess.SY physics.app-ph


title: VERITAS contributions to the 37th International Cosmic Ray Conference

abstract: Compilation of papers presented by the VERITAS Collaboration at the 37th International Cosmic Ray Conference (ICRC), held July 12 through July 23, 2021 (online) in Berlin, Germany.


title: TERP: Reliable Planning in Uneven Outdoor Environments using Deep Reinforcement Learning

abstract: We present a novel method for reliable robot navigation in uneven outdoor terrains. Our approach employs a novel fully-trained Deep Reinforcement Learning (DRL) network that uses elevation maps of the environment, robot pose, and goal as inputs to compute an attention mask of the environment. The attention mask is used to identify reduced stability regions in the elevation map and is computed using channel and spatial attention modules and a novel reward function. We continuously compute and update a navigation cost-map that encodes the elevation information or the level-of-flatness of the terrain using the attention mask. We then generate locally least-cost waypoints on the cost-map and compute the final dynamically feasible trajectory using another DRL-based method. Our approach guarantees safe, locally least-cost paths and dynamically feasible robot velocities in uneven terrains. We observe an increase of 35.18% in terms of success rate and, a decrease of 26.14% in the cumulative elevation gradient of the robot's trajectory compared to prior navigation methods in high-elevation regions. We evaluate our method on a Husky robot in real-world uneven terrains (~ 4m of elevation gain) and demonstrate its benefits.


title: Measuring Sample Quality in Algorithms for Intractable Normalizing Function Problems

abstract: Models with intractable normalizing functions have numerous applications. Because the normalizing constants are functions of the parameters of interest, standard Markov chain Monte Carlo cannot be used for Bayesian inference for these models. A number of algorithms have been developed for such models. Some have the posterior distribution as their asymptotic distribution. Other ``asymptotically inexact'' algorithms do not possess this property. There is limited guidance for evaluating approximations based on these algorithms. Hence it is very hard to tune them. We propose two new diagnostics that address these problems for intractable normalizing function models. Our first diagnostic, inspired by the second Bartlett identity, is in principle broadly applicable to Monte Carlo approximations beyond the normalizing function problem. We develop an approximate version of this diagnostic that is applicable to intractable normalizing function problems. Our second diagnostic is a Monte Carlo approximation to a kernel Stein discrepancy-based diagnostic introduced by Gorham and Mackey (2017). We provide theoretical justification for our methods and apply them to several algorithms in challenging simulated and real data examples including an Ising model, an exponential random graph model, and a Conway--Maxwell--Poisson regression model, obtaining interesting insights about the algorithms in these contexts.


title: Global stability of SAIRS epidemic models

abstract: We study an SAIRS-type epidemic model with vaccination, where the role of asymptomatic and symptomatic infectious individuals are explicitly considered in the transmission patterns of the disease. We provide a global stability analysis for the model. We determine the value of the basic reproduction number $\mathcal{R}_0$ and prove that the disease-free equilibrium is globally asymptotically stable if $\mathcal{R}_0<1$ and unstable if $\mathcal{R}_0>1$, condition under which a positive endemic equilibrium exists. We investigate the global stability of the endemic equilibrium for some variations of the original model under study and answer to an open problem proposed in Ansumali et al. \cite{ansumali2020modelling}. In the case of the SAIRS model without vaccination, we prove the global asymptotic stability of the disease-free equilibrium also when $\mathcal{R}_0=1$. We provide a thorough numerical exploration of our model, to validate our analytical results.


title: From Colors to Chemistry: A Combined Lenslet/Slicer IFS for Medium-Resolution Spectroscopy

abstract: We present the design and lab performance of a prototype lenslet-slicer hybrid integral field spectrograph (IFS), validating the concept for use in future instruments like SCALES/PSI-Red. By imaging extrasolar planets with IFS, it is possible to measure their chemical compositions, temperatures and masses. Many exoplanet-focused instruments use a lenslet IFS to make datacubes with spatial and spectral information used to extract spectral information of imaged exoplanets. Lenslet IFS architecture results in very short spectra and thus low spectral resolution. Slicer IFSs can obtain higher spectral resolution but at the cost of increased optical aberrations that propagate through the down-stream spectrograph and degrade the spatial information we can extract. We have designed a lenslet/slicer hybrid that combines the minimal aberrations of the lenslet IFS with the high spectral resolution of the slicer IFS. The slicer output f/\# matches the lenslet f/\# requiring only additional gratings.


title: Energy reconstruction in a liquid argon calorimeter cell using convolutional neural networks

abstract: The liquid argon ionization current in a sampling calorimeter cell can be analyzed to determine the energy of detected particles. In practice, experimental artifacts such as pileup and electronic noise make the inference of energy from current a difficult process. The beam intensity of the Large Hadron Collider will be significantly increased during the Phase-II long shut down of 2025-2027. Signal processing techniques that are used to extract the energy of detected particles in the ATLAS detector will suffer a significant loss in performance under these conditions. This paper compares the presently used optimal filter technique to convolutional neural networks for energy reconstruction in the ATLAS liquid argon hadronic end cap calorimeter. In particular, it is shown that convolutional neural networks trained with an appropriately tuned and novel loss function are able to outperform the optimal filter technique.


title: MURAL: Multimodal, Multitask Retrieval Across Languages

abstract: Both image-caption pairs and translation pairs provide the means to learn deep representations of and connections between languages. We use both types of pairs in MURAL (MUltimodal, MUltitask Representations Across Languages), a dual encoder that solves two tasks: 1) image-text matching and 2) translation pair matching. By incorporating billions of translation pairs, MURAL extends ALIGN (Jia et al. PMLR'21)--a state-of-the-art dual encoder learned from 1.8 billion noisy image-text pairs. When using the same encoders, MURAL's performance matches or exceeds ALIGN's cross-modal retrieval performance on well-resourced languages across several datasets. More importantly, it considerably improves performance on under-resourced languages, showing that text-text learning can overcome a paucity of image-caption examples for these languages. On the Wikipedia Image-Text dataset, for example, MURAL-base improves zero-shot mean recall by 8.1% on average for eight under-resourced languages and by 6.8% on average when fine-tuning. We additionally show that MURAL's text representations cluster not only with respect to genealogical connections but also based on areal linguistics, such as the Balkan Sprachbund.


title: D-REX: Dialogue Relation Extraction with Explanations

abstract: Existing research studies on cross-sentence relation extraction in long-form multi-party conversations aim to improve relation extraction without considering the explainability of such methods. This work addresses that gap by focusing on extracting explanations that indicate that a relation exists while using only partially labeled data. We propose our model-agnostic framework, D-REX, a policy-guided semi-supervised algorithm that explains and ranks relations. We frame relation extraction as a re-ranking task and include relation- and entity-specific explanations as an intermediate step of the inference process. We find that about 90% of the time, human annotators prefer D-REX's explanations over a strong BERT-based joint relation extraction and explanation model. Finally, our evaluations on a dialogue relation extraction dataset show that our method is simple yet effective and achieves a state-of-the-art F1 score on relation extraction, improving upon existing methods by 13.5%.