title: PAC-Bayesian Matrix Completion with a Spectral Scaled Student Prior

abstract: We study the problem of matrix completion in this paper. A spectral scaled Student prior is exploited to favour the underlying low-rank structure of the data matrix. We provide a thorough theoretical investigation for our approach through PAC-Bayesian bounds. More precisely, our PAC-Bayesian approach enjoys a minimax-optimal oracle inequality which guarantees that our method works well under model misspecification and under general sampling distribution. Interestingly, we also provide efficient gradient-based sampling implementations for our approach by using Langevin Monte Carlo. More specifically, we show that our algorithms are significantly faster than Gibbs sampler in this problem. To illustrate the attractive features of our inference strategy, some numerical simulations are conducted and an application to image inpainting is demonstrated.


title: High-quality level-crossing resonances under counterpropagating circularly polarized light waves for applications in atomic magnetometry

abstract: Level-crossing (LC) resonances in a buffer-gas-filled cesium vapor cell are studied under counterpropagating pump and probe light waves with opposite circular polarizations. The waves excite the D$_1$-line ground-state level $F_g$$=\,$$4$, while a transverse magnetic field (${\rm B}_x$$\perp$${\rm k}$) is scanned around zero to observe the resonance of electromagnetically induced absorption (EIA). It is shown that adding the pump light wave significantly improves the properties of the resonances in comparison with the commonly used scheme with a single light wave. As far as a small vapor cell ($\approx\,$0.1 cm$^3$) at relatively low temperature ($\approx\,$45-60$\,^\circ$C) is utilized, the results have good prospects for developing a low-power miniaturized atomic magnetometer.


title: Quantum transport evidence of topological band structures of kagome superconductor CsV3Sb5

abstract: We report the transport properties of kagome superconductor CsV$_{3}$Sb$_{5}$ single crystals at magnetic field up to 32 T. The Shubnikov de Haas (SdH) oscillations emerge at low temperature and four frequencies of $F_{\alpha}=$ 27 T, $F_{\beta}=$ 73 T, $F_{\epsilon}=$ 727 T, and $F_{\eta}=$ 786 T with relatively small cyclotron masses are observed. For $F_{\beta}$ and $F_{\epsilon}$, the Berry phases are close to $\pi$, providing a clear evidence of nontrivial topological band structures of CsV$_{3}$Sb$_{5}$. Furthermore, the consistence between theoretical calculations and experimental results implies that these frequencies can be assigned to the Fermi surfaces locating near the boundary of Brillouin zone and confirms that the structure with an inverse Star of David distortion could be the most stable structure at charge density wave state. These results will shed light on the nature of correlated topological physics in kagome material CsV$_{3}$Sb$_{5}$.


title: Spatiotemporal Deformable Scene Graphs for Complex Activity Detection

abstract: Long-term complex activity recognition and localisation can be crucial for decision making in autonomous systems such as smart cars and surgical robots. Here we address the problem via a novel deformable, spatiotemporal scene graph approach, consisting of three main building blocks: (i) action tube detection, (ii) the modelling of the deformable geometry of parts, and (iii) a graph convolutional network. Firstly, action tubes are detected in a series of snippets. Next, a new 3D deformable RoI pooling layer is designed for learning the flexible, deformable geometry of the constituent action tubes. Finally, a scene graph is constructed by considering all parts as nodes and connecting them based on different semantics such as order of appearance, sharing the same action label and feature similarity. We also contribute fresh temporal complex activity annotation for the recently released ROAD autonomous driving and SARAS-ESAD surgical action datasets and show the adaptability of our framework to different domains. Our method is shown to significantly outperform graph-based competitors on both augmented datasets.


title: Equilibrium current in a Weyl-semimetal - superconductor heterostructure

abstract: A heterostructure consisting of a magnetic Weyl semimetal and a conventional superconductor exhibits an equilibrium current parallel to the superconductor interface and perpendicular to the magnetization. Analyzing a minimal model, which as a function of parameters may be in a trivial magnetic insulator phase, a Weyl semimetal phase, or a three-dimensional weak Chern insulator phase, we find that the equilibrium current is sensitive to the presence of surface states, such as the topological Fermi-arc states of the Weyl semimetal or the chiral surface states of the weak Chern insulator. While there is a nonzero equilibrium current in all three phases, the appearance of the surface states in the topological regime leads to a reversal of the direction of the current, compared to the current direction for the trivial magnetic insulator phase. We discuss the interpretation of the surface-state contribution to the equilibrium current as a real-space realization of the superconductivity-enabled equilibrium chiral magnetic effect of a single chirality, predicted to occur in bulk Weyl superconductors.


title: Towards Standardising Reinforcement Learning Approaches for Production Scheduling Problems

abstract: Recent years have seen a rise in interest in terms of using machine learning, particularly reinforcement learning (RL), for production scheduling problems of varying degrees of complexity. The general approach is to break down the scheduling problem into a Markov Decision Process (MDP), whereupon a simulation implementing the MDP is used to train an RL agent. Since existing studies rely on (sometimes) complex simulations for which the code is unavailable, the experiments presented are hard, or, in the case of stochastic environments, impossible to reproduce accurately. Furthermore, there is a vast array of RL designs to choose from. To make RL methods widely applicable in production scheduling and work out their strength for the industry, the standardisation of model descriptions - both production setup and RL design - and validation scheme are a prerequisite. Our contribution is threefold: First, we standardize the description of production setups used in RL studies based on established nomenclature. Secondly, we classify RL design choices from existing publications. Lastly, we propose recommendations for a validation scheme focusing on reproducibility and sufficient benchmarking.


title: Probing artificial neural networks: insights from neuroscience

abstract: A major challenge in both neuroscience and machine learning is the development of useful tools for understanding complex information processing systems. One such tool is probes, i.e., supervised models that relate features of interest to activation patterns arising in biological or artificial neural networks. Neuroscience has paved the way in using such models through numerous studies conducted in recent decades. In this work, we draw insights from neuroscience to help guide probing research in machine learning. We highlight two important design choices for probes $-$ direction and expressivity $-$ and relate these choices to research goals. We argue that specific research goals play a paramount role when designing a probe and encourage future probing studies to be explicit in stating these goals.


title: Multilevel Bootstrap Particle Filter

abstract: We consider situations where the applicability of sequential Monte Carlo particle filters is compromised due to the expensive evaluation of the particle weights. To alleviate this problem, we propose a new particle filter algorithm based on the multilevel approach. We show that the resulting multilevel bootstrap particle filter (MLBPF) retains the strong law of large numbers as well as the central limit theorem of classical particle filters under mild conditions. Our numerical experiments demonstrate up to 85\% reduction in computation time compared to the classical bootstrap particle filter, in certain settings. While it should be acknowledged that this reduction is highly application dependent, and a similar gain should not be expected for all applications across the board, we believe that this substantial improvement in certain settings makes MLBPF an important addition to the family of sequential Monte Carlo methods.


title: Particle acceleration in strong MHD turbulence

abstract: Nonthermal acceleration of particles in magnetohydrodynamic (MHD) turbulence plays a central role in a wide variety of astrophysical sites. This physics is addressed here in the context of a strong turbulence, composed of coherent structures rather than waves, beyond the realm of quasilinear theory. The present description tracks the momentum of the particle through a sequence of frames in which the electric field vanishes, in the spirit of the original Fermi scenario. It connects the sources of energy gain (or loss) to the gradients of the velocity of the magnetic field lines, in particular the acceleration and the shear of their velocity flow projected along the field line direction, as well as their compression in the transverse plane. Those velocity gradients are subject to strong intermittency: they are spatially localized and their strengths obey power law distributions, as demonstrated through direct measurements in the incompressible MHD simulation of the Johns Hopkins University database. This intermittency impacts the acceleration process in a significant way, which opens up prospects for a rich phenomenology. In particular, the momentum distribution, which is here captured through an analytical random walk model, displays extended power law tails with soft-to-hard evolution in time, in general agreement with recent kinetic numerical simulations. Extensions to this description and possible avenues of exploration are discussed.


title: IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation

abstract: Natural language generation (NLG) benchmarks provide an important avenue to measure progress and develop better NLG systems. Unfortunately, the lack of publicly available NLG benchmarks for low-resource languages poses a challenging barrier for building NLG systems that work well for languages with limited amounts of data. Here we introduce IndoNLG, the first benchmark to measure natural language generation (NLG) progress in three low-resource -- yet widely spoken -- languages of Indonesia: Indonesian, Javanese, and Sundanese. Altogether, these languages are spoken by more than 100 million native speakers, and hence constitute an important use case of NLG systems today. Concretely, IndoNLG covers six tasks: summarization, question answering, chit-chat, and three different pairs of machine translation (MT) tasks. We collate a clean pretraining corpus of Indonesian, Sundanese, and Javanese datasets, Indo4B-Plus, which is used to pretrain our models: IndoBART and IndoGPT. We show that IndoBART and IndoGPT achieve competitive performance on all tasks -- despite using only one-fifth the parameters of a larger multilingual model, mBART-LARGE (Liu et al., 2020). This finding emphasizes the importance of pretraining on closely related, local languages to achieve more efficient learning and faster inference for very low-resource languages like Javanese and Sundanese.


title: Semantic Image Matting

abstract: Natural image matting separates the foreground from background in fractional occupancy which can be caused by highly transparent objects, complex foreground (e.g., net or tree), and/or objects containing very fine details (e.g., hairs). Although conventional matting formulation can be applied to all of the above cases, no previous work has attempted to reason the underlying causes of matting due to various foreground semantics. We show how to obtain better alpha mattes by incorporating into our framework semantic classification of matting regions. Specifically, we consider and learn 20 classes of matting patterns, and propose to extend the conventional trimap to semantic trimap. The proposed semantic trimap can be obtained automatically through patch structure analysis within trimap regions. Meanwhile, we learn a multi-class discriminator to regularize the alpha prediction at semantic level, and content-sensitive weights to balance different regularization losses. Experiments on multiple benchmarks show that our method outperforms other methods and has achieved the most competitive state-of-the-art performance. Finally, we contribute a large-scale Semantic Image Matting Dataset with careful consideration of data balancing across different semantic classes.


title: $Q^{2}$: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answering

abstract: Neural knowledge-grounded generative models for dialogue often produce content that is factually inconsistent with the knowledge they rely on, making them unreliable and limiting their applicability. Inspired by recent work on evaluating factual consistency in abstractive summarization, we propose an automatic evaluation metric for factual consistency in knowledge-grounded dialogue using automatic question generation and question answering. Our metric, denoted $Q^2$, compares answer spans using natural language inference (NLI), instead of token-based matching as done in previous work. To foster proper evaluation, we curate a novel dataset of dialogue system outputs for the Wizard-of-Wikipedia dataset, manually annotated for factual consistency. We perform a thorough meta-evaluation of $Q^2$ against other metrics using this dataset and two others, where it consistently shows higher correlation with human judgements.


title: Why Machine Learning Integrated Patient Flow Simulation?

abstract: Patient flow analysis can be studied from a clinical and or operational perspective using simulation. Traditional statistical methods such as stochastic distribution methods have been used to construct patient flow simulation submodels such as patient inflow, Length of Stay (LoS), Cost of Treatment (CoT) and Clinical Pathway (CP) models. However, patient inflow demonstrates seasonality, trend and variation over time. LoS, CoT and CP are significantly determined by attributes of patients and clinical and laboratory test results. For this reason, patient flow simulation models constructed using traditional statistical methods are criticized for ignoring heterogeneity and their contribution to personalized and value based healthcare. On the other hand, machine learning methods have proven to be efficient to study and predict admission rate, LoS, CoT, and CP. This paper, hence, describes why coupling machine learning with patient flow simulation is important and proposes a conceptual architecture that shows how to integrate machine learning with patient flow simulation.


title: Influence of the nano-grain depletion in photon-dominated regions: Application to the gas physics and chemistry in the Horsehead

abstract: The large disparity in physical conditions from the diffuse interstellar medium (ISM) to denser clouds such as photon-dominated regions (PDRs) triggers an evolution of the dust properties (i.e. composition, size, and shape). The gas physics and chemistry are tightly connected to these dust properties and are therefore affected by dust evolution and especially the nano-grain depletion in the outer irradiated part of PDRs. We highlight the influence of nano-grain depletion on the gas physics and chemistry in the Horsehead nebula, a prototypical PDR. We used a model for atomic and molecular gas in PDRs, the Meudon PDR code, using diffuse ISM-like dust and Horsehead-like dust to study the influence of nano-grain depletion on the gas physics and chemistry, focusing on the impact on photoelectric heating and H2 formation and, therefore, on the H2 gas lines. We find that nano-grain depletion in the Horsehead strongly affects gas heating through the photoelectric effect and thus the gas temperature and the H2 formation, hence the H -> H2 position. Consequently, the first four pure rotational lines of H2 (e.g. 0-0 S(0), S(1), S(2), and S(3)) vary by a factor of 2 to 14. The 0-0 S(3) line that is often underestimated in models is underestimated even more when taking nano-grain depletion into account due to the decrease in gas heating through the photoelectric effect. This strongly suggests that our understanding of the excitation of H2 and/or of heating processes in the Horsehead, and more generally in PDRs, is still incomplete. Nano-grain depletion in the outer part of the Horsehead has a strong influence on several gas tracers that will be prominent in JWST observations of irradiated clouds. We therefore need to take this depletion into account in order to improve our understanding of the Horsehead, and more generally PDRs, and to contribute to the optimal scientific return of the mission.


title: Thinking Through and Writing About Research Ethics Beyond "Broader Impact"

abstract: In March 2021, we held the first instalment of the tutorial on thinking through and writing about research ethics beyond 'Broader Impact' in conjunction with the ACM Conference on Fairness, Accountability, and Transparency (FAccT '21). The goal of this tutorial was to offer a conceptual and practical starting point for engineers and social scientists interested in thinking more expansively, holistically, and critically about research ethics. This report provides an outline of the tutorial, and contains our 'lifecourse checklist'. This was presented as part of the tutorial, and provides a practical starting point for researchers when thinking about research ethics before a project's start. We provide this to the research community, with the hope that researchers use it when considering the ethics of their research.


title: Finite-difference modeling of 2-D wave propagation in the vicinity of dipping interfaces: a comparison of anti-aliasing and equivalent medium approaches

abstract: Finite-difference (FD) modeling of seismic waves in the vicinity of dipping interfaces gives rise to artifacts. Examples are phase and amplitude errors, as well as staircase diffractions. Such errors can be reduced in two general ways. In the first approach, the interface can be anti-aliased (i.e., with an anti-aliased step-function, or a lowpass filter). Alternatively, the interface may be replaced with an equivalent medium (i.e., using Schoenberg \& Muir (SM) calculus or orthorhombic averaging). We test these strategies in acoustic, elastic isotropic, and elastic anisotropic settings. Computed FD solutions are compared to analytical solutions. We find that in acoustic media, anti-aliasing methods lead to the smallest errors. Conversely, in elastic media, the SM calculus provides the best accuracy. The downside of the SM calculus is that it requires an anisotropic FD solver even to model an interface between two isotropic materials. As a result, the computational cost increases compared to when using isotropic FD solvers. However, since coarser grid spacings can be used to represent the dipping interfaces, the two effects (an expensive FD solver on a coarser FD grid) equal out. Hence, the SM calculus can provide an efficient means to reduce errors, also in elastic isotropic media.


title: Katu: a fast open-source full lepto-hadronic kinetic code suitable for Bayesian inference modelling of blazars

abstract: In the modelling of blazars and other radiating plasma flows, correctly evolving in time a series of kinetic equation coupled for different particle species is a computationally challenging problem. In this paper we introduce the code Katu, capable of simultaneously evolving a large number of particle species including photons, leptons and hadrons and their interactions. For each particle, the numerical expressions for the kinetic equations are optimized for efficiency and the code is written to easily allow for extensions and modifications. Additionally, we tie Katu to two pieces of statistical software, emcee and pymultinest, which makes a suite ready to apply to blazars and extract relevant statistical information from their electromagnetic (and neutrino, if applicable) flux. As an example, we apply Katu to Mrk 421 and compare a leptonic and a leptohadronic model. In this first ever direct Bayesian comparison between full kinetic simulations of these models, we find substantial evidence (Bayes factor $\sim7$) for the leptohadronic model purely from the electromagnetic spectrum. The code is available online at https://github.com/hveerten/katu under the LGPL license.


title: Affine representability of quadrics revisited

abstract: The quadric $\operatorname{Q}_{2n}$ is the ${\mathbb Z}$-scheme defined by the equation $\sum_{i=1}^n x_i y_i = z(1-z)$. We show that $\operatorname{Q}_{2n}$ is a homogeneous space for the split reductive group scheme $\operatorname{SO}_{2n+1}$ over ${\mathbb Z}$. The quadric $\operatorname{Q}_{2n}$ is known to have the ${\mathbb A}^1$-homotopy type of a motivic sphere and the identification as a homogeneous space allows us to give a characteristic independent affine representability statement for motivic spheres. This last observation allows us to give characteristic independent comparison results between Chow--Witt groups, motivic stable cohomotopy groups and Euler class groups.


title: Rotation symmetry breaking in the normal state of a kagome superconductor KV3Sb5

abstract: Recently discovered kagome superconductors AV3Sb5 (A=K, Rb, Cs) provide a fresh opportunity to realize and study correlation-driven electronic phenomena on a kagome lattice. The observation of a 2a0 by 2a0 charge density wave (CDW) in the normal state of all members of AV3Sb5 kagome family has generated an enormous amount of interest, in an effort to uncover the nature of this CDW state, and identify any "hidden" broken symmetries. We use spectroscopic-imaging scanning tunneling microscopy to reveal a pronounced intensity anisotropy between different 2a0 CDW directions in KV3Sb5. In particular, by examining the strength of ordering wave vectors as a function of energy in Fourier transforms of differential conductance maps, we find that one of the CDW directions is distinctly different compared to the other two. This observation points towards an intrinsic rotation symmetry broken electronic ground state, where the symmetry is reduced from C6 to C2. Furthermore, in contrast to previous reports, we find that the CDW phase is insensitive to magnetic field direction, regardless of the presence or absence of atomic defects. Our experiments, combined with earlier observations of a stripe 4a0 charge ordering in CsV3Sb5, establish correlation-driven rotation symmetry breaking as a unifying feature of AV3Sb5 kagome superconductors.


title: The scaling limit of the longest increasing subsequence

abstract: We provide a framework for proving convergence to the directed landscape, the central object in the Kardar-Parisi-Zhang universality class. For last passage models, we show that compact convergence to the Airy line ensemble implies convergence to the Airy sheet. In i.i.d. environments, we show that Airy sheet convergence implies convergence of distances and geodesics to their counterparts in the directed landscape. Our results imply convergence of classical last passage models and interacting particle systems. Our framework is built on the notion of a directed metric, a generalization of metrics which behaves better under limits. As a consequence of our results, we present a solution to an old problem: the scaled longest increasing subsequence in a uniform permutation converges to the directed geodesic.


title: Robust Open-Vocabulary Translation from Visual Text Representations

abstract: Machine translation models have discrete vocabularies and commonly use subword segmentation techniques to achieve an 'open vocabulary.' This approach relies on consistent and correct underlying unicode sequences, and makes models susceptible to degradation from common types of noise and variation. Motivated by the robustness of human language processing, we propose the use of visual text representations, which dispense with a finite set of text embeddings in favor of continuous vocabularies created by processing visually rendered text with sliding windows. We show that models using visual text representations approach or match performance of traditional text models on small and larger datasets. More importantly, models with visual embeddings demonstrate significant robustness to varied types of noise, achieving e.g., 25.9 BLEU on a character permuted German-English task where subword models degrade to 1.9.


title: MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scale

abstract: General-purpose robotic systems must master a large repertoire of diverse skills to be useful in a range of daily tasks. While reinforcement learning provides a powerful framework for acquiring individual behaviors, the time needed to acquire each skill makes the prospect of a generalist robot trained with RL daunting. In this paper, we study how a large-scale collective robotic learning system can acquire a repertoire of behaviors simultaneously, sharing exploration, experience, and representations across tasks. In this framework new tasks can be continuously instantiated from previously learned tasks improving overall performance and capabilities of the system. To instantiate this system, we develop a scalable and intuitive framework for specifying new tasks through user-provided examples of desired outcomes, devise a multi-robot collective learning system for data collection that simultaneously collects experience for multiple tasks, and develop a scalable and generalizable multi-task deep reinforcement learning method, which we call MT-Opt. We demonstrate how MT-Opt can learn a wide range of skills, including semantic picking (i.e., picking an object from a particular category), placing into various fixtures (e.g., placing a food item onto a plate), covering, aligning, and rearranging. We train and evaluate our system on a set of 12 real-world tasks with data collected from 7 robots, and demonstrate the performance of our system both in terms of its ability to generalize to structurally similar new tasks, and acquire distinct new tasks more quickly by leveraging past experience. We recommend viewing the videos at https://karolhausman.github.io/mt-opt/


title: The spatial dissemination of COVID-19 and associated socio-economic consequences

abstract: The ongoing coronavirus disease 2019 (COVID-19) pandemic has wreaked havoc worldwide with millions of lives claimed, human travel restricted and economic development halted. Leveraging city-level mobility and case data, our analysis shows that the spatial dissemination of COVID-19 can be well explained by a local diffusion process in the mobility network rather than a global diffusion process, indicating the effectiveness of the implemented disease prevention and control measures. Based on the constructed case prediction model, it is estimated that there could be distinct social consequences if the COVID-19 outbreak happened in different areas. During the epidemic control period, human mobility experienced substantial reductions and the mobility network underwent remarkable local and global structural changes toward containing the spread of COVID-19. Our work has important implications for the mitigation of disease and the evaluation of the socio-economic consequences of COVID-19 on society.


title: Electronic and magnetic properties of VOCl/FeOCl antiferromagnetic heterobilayers

abstract: We study the electronic properties of the heterobilayer of vanadium and iron oxychlorides, VOCl and FeOCl, two layered air stable van der Waals insulating oxides with different types of antiferromagnetic order in bulk: VOCl monolayers are ferromagnetic (FM) whereas the FeOCl monolayers are antiferromagnetic (AF). We use density functional theory (DFT) calculations, with Hubbard correction that is found to be needed to describe correctly the insulating nature of these compounds. We compute the magnetic anisotropy and propose a spin model Hamiltonian. Our calculations show that interlayer coupling in weak and ferromagnetic so that magnetic order of the monolayers is preserved in the heterobilayers providing thereby a van der Waals heterostructure that combines two monolayers with different magnetic order. Interlayer exchange should lead both to exchange bias and to the emergence of hybrid collective modes that that combine FM and AF magnons. The energy band of the heterobilayer show a type II band alignment, and feature spin-splitting of the states of the AF layer due to the breaking of the inversion symmetry.


title: "BNN - BN = ?": Training Binary Neural Networks without Batch Normalization

abstract: Batch normalization (BN) is a key facilitator and considered essential for state-of-the-art binary neural networks (BNN). However, the BN layer is costly to calculate and is typically implemented with non-binary parameters, leaving a hurdle for the efficient implementation of BNN training. It also introduces undesirable dependence between samples within each batch. Inspired by the latest advance on Batch Normalization Free (BN-Free) training, we extend their framework to training BNNs, and for the first time demonstrate that BNs can be completed removed from BNN training and inference regimes. By plugging in and customizing techniques including adaptive gradient clipping, scale weight standardization, and specialized bottleneck block, a BN-free BNN is capable of maintaining competitive accuracy compared to its BN-based counterpart. Extensive experiments validate the effectiveness of our proposal across diverse BNN backbones and datasets. For example, after removing BNs from the state-of-the-art ReActNets, it can still be trained with our proposed methodology to achieve 92.08%, 68.34%, and 68.0% accuracy on CIFAR-10, CIFAR-100, and ImageNet respectively, with marginal performance drop (0.23%~0.44% on CIFAR and 1.40% on ImageNet). Codes and pre-trained models are available at: https://github.com/VITA-Group/BNN_NoBN.


title: Local and scalable detection of genuine multipartite single-photon path entanglement

abstract: How can a multipartite single-photon path-entangled state be certified efficiently by means of local measurements? We address this question by constructing an entanglement witness based on local photon detections preceded by displacement operations to reveal genuine multipartite entanglement. Our witness is defined as a sum of three observables that can be measured locally and assessed with two measurement settings for any number of parties $N$. For any bipartition, the maximum mean value of the witness observable over biseparable states is bounded by the maximum eigenvalue of an $N\times N$ matrix, which can be computed efficiently. We demonstrate the applicability of our scheme by experimentally testing the witness for heralded 4- and 8-partite single-photon path-entangled states. Our implementation shows the scalability of our witness and opens the door for distributing photonic multipartite entanglement in quantum networks at high rates.


title: Collisional Evolution of the Inner Zodiacal Cloud

abstract: The zodiacal cloud is one of the largest structures in the solar system and strongly governed by meteoroid collisions near the Sun. Collisional erosion occurs throughout the zodiacal cloud, yet it is historically difficult to directly measure and has never been observed for discrete meteoroid streams. After six orbits with Parker Solar Probe (PSP), its dust impact rates are consistent with at least three distinct populations: bound zodiacal dust grains on elliptic orbits ($\alpha$-meteoroids), unbound $\beta$-meteoroids on hyperbolic orbits, and a third population of impactors that may either be direct observations of discrete meteoroid streams, or their collisional byproducts ("$\beta$-streams"). $\beta$-streams of varying intensities are expected to be produced by all meteoroid streams, particularly in the inner solar system, and are a universal phenomenon in all exozodiacal disks. We find the majority of collisional erosion of the zodiacal cloud occurs in the range of $10-20$ solar radii and expect this region to also produce the majority of pick-up ions due to dust in the inner solar system. A zodiacal erosion rate of at least $\sim$100 kg s$^{-1}$ and flux of $\beta$-meteoroids at 1 au of $0.4-0.8 \times 10^{-4}$ m$^{-2}$ s$^{-1}$ is found to be consistent with the observed impact rates. The $\beta$-meteoroids investigated here are not found to be primarily responsible for the inner source of pick-up ions, suggesting nanograins susceptible to electromagnetic forces with radii below $\sim$50 nm are the inner source of pick-up ions. We expect the peak deposited energy flux to PSP due to dust to increase in subsequent orbits, up to 7 times that experienced during its sixth orbit.


title: Rebound and scattering of motile Chlamydomonas algae in confined chambers

abstract: Motivated by recent experiments demonstrating that motile algae get trapped in draining foams, we study the trajectories of microorganisms confined in model foam channels (section of a Plateau border). We track single Chlamydomonas reinhardtii cells confined in a thin three-circle microfluidic chamber and show that their spatial distribution exhibits strong corner accumulation. Using empirical scattering laws observed in previous experiments (scattering with a constant scattering angle), we next develop a two-dimension geometrical model and compute the phase space of trapped and periodic trajectories of swimmers inside a three-circles billiard. We find that the majority of cell trajectories end up in a corner, providing a geometrical mechanism for corner accumulation. Incorporating the distribution of scattering angles observed in our experiments and including hydrodynamic interactions between the cells and the surfaces into the geometrical model enables us to reproduce the experimental probability density function of micro-swimmers in microfluidic chambers. Both our experiments and models demonstrate therefore that motility leads generically to trapping in complex geometries.


title: Flexible Instance-Specific Rationalization of NLP Models

abstract: Recent research on model interpretability in natural language processing extensively uses feature scoring methods for identifying which parts of the input are the most important for a model to make a prediction (i.e. explanation or rationale). However, previous research has shown that there is no clear best scoring method across various text classification tasks while practitioners typically have to make several other ad-hoc choices regarding the length and the type of the rationale (e.g. short or long, contiguous or not). Inspired by this, we propose a simple yet effective and flexible method that allows selecting optimally for each data instance: (1) a feature scoring method; (2) the length; and (3) the type of the rationale. Our method is inspired by input erasure approaches to interpretability which assume that the most faithful rationale for a prediction should be the one with the highest difference between the model's output distribution using the full text and the text after removing the rationale as input respectively. Evaluation on four standard text classification datasets shows that our proposed method provides more faithful, comprehensive and highly sufficient explanations compared to using a fixed feature scoring method, rationale length and type. More importantly, we demonstrate that a practitioner is not required to make any ad-hoc choices in order to extract faithful rationales using our approach.


title: Origin of the dome-shaped superconducting phase diagram in $\mathrm{SrTiO}_3$-based interfaces

abstract: A dome-shaped phase diagram of superconducting critical temperature upon doping is often considered as a hallmark of unconventional superconductors. This behavior, observed in two-dimensional electron gases in $\mathrm{SrTiO}_3$-based interfaces whose electronic density is controlled by field effect, has not been explained unambiguously yet. Here, we elaborate a generic scenario for the superconducting phase diagram of these oxide interfaces based on Schr\"odinger-Poisson numerical simulations of the quantum well and transport experiments on a double-gate field-effect device. We propose that the optimal doping point of maximum $T_c$ marks the transition between a single-band and a fragile two-gap s$\pm$-wave superconducting state involving $t_{2g}$ bands of different orbital character. At the optimal doping point, we predict and observe experimentally a bifurcation in the dependence of $T_c$ on the carrier density, which is controlled by the details of the doping execution. Where applying a back-gate voltage triggers the filling of a high-energy $d_\mathrm{xy}$ subband and initiates the overdoped regime, doping with a top-gate delays the filling of the subband and maintains the 2-DEG in the single-band superconducting state of higher $T_c$.


title: Regular black holes and gravitational particle-like solutions in generic DHOST theories

abstract: We construct regular, asymptotically flat black holes of higher order scalar tensor (DHOST) theories, which are obtained by making use of a generalized Kerr-Schild solution generating method. The solutions depend on a mass integration constant, admit a smooth core of chosen regularity, and generically have an inner and outer event horizon. In particular, below a certain mass threshold, we find massive, horizonless, particle-like solutions. We scan through possible observational signatures ranging from weak to strong gravity and study the thermodynamics of our regular solutions, comparing them, when possible, to General Relativity black holes and their thermodynamic laws.


title: The non-linear stability of the Schwarzschild family of black holes

abstract: We prove the non-linear asymptotic stability of the Schwarzschild family as solutions to the Einstein vacuum equations in the exterior of the black hole region: general vacuum initial data, with no symmetry assumed, sufficiently close to Schwarzschild data evolve to a vacuum spacetime which (i) possesses a complete future null infinity $\mathcal{I}^+$ (whose past $J^-(\mathcal{I}^+)$ is moreover bounded by a regular future complete event horizon $\mathcal{H}^+$), (ii) remains close to Schwarzschild in its exterior, and (iii) asymptotes back to a member of the Schwarzschild family as an appropriate notion of time goes to infinity, provided that the data are themselves constrained to lie on a teleologically constructed codimension-$3$ "submanifold" of moduli space. This is the full nonlinear asymptotic stability of Schwarzschild since solutions not arising from data lying on this submanifold should by dimensional considerations approach a Kerr spacetime with rotation parameter $a\neq 0$, i.e. such solutions cannot satisfy (iii). The proof employs teleologically normalised double null gauges, is expressed entirely in physical space and makes essential use of the analysis in our previous study of the linear stability of the Kerr family around Schwarzschild [DHR], as well as techniques developed over the years to control the non-linearities of the Einstein equations. The present work, however, is entirely self-contained. In view of the recent [DHR19, TdCSR20] our approach can be applied to the full non-linear asymptotic stability of the subextremal Kerr family.


title: MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement

abstract: This paper presents a generic method for generating full facial 3D animation from speech. Existing approaches to audio-driven facial animation exhibit uncanny or static upper face animation, fail to produce accurate and plausible co-articulation or rely on person-specific models that limit their scalability. To improve upon existing models, we propose a generic audio-driven facial animation approach that achieves highly realistic motion synthesis results for the entire face. At the core of our approach is a categorical latent space for facial animation that disentangles audio-correlated and audio-uncorrelated information based on a novel cross-modality loss. Our approach ensures highly accurate lip motion, while also synthesizing plausible animation of the parts of the face that are uncorrelated to the audio signal, such as eye blinks and eye brow motion. We demonstrate that our approach outperforms several baselines and obtains state-of-the-art quality both qualitatively and quantitatively. A perceptual user study demonstrates that our approach is deemed more realistic than the current state-of-the-art in over 75% of cases. We recommend watching the supplemental video before reading the paper: https://github.com/facebookresearch/meshtalk


title: Observed CN and HCN intensity ratios exhibit subtle variations in extreme galaxy environments

abstract: We use both new and archival ALMA data of three energy lines each of CN and HCN to explore intensity ratios in dense gas in NGC 3256, NGC 7469, and IRAS 13120-5453. The HCN (3-2)/HCN (1-0) intensity ratio varies in NGC 3256 and NGC 7469, with superlinear trends of 1.53$\pm$0.07 and 1.55$\pm$0.05, respectively. We find an offset to higher HCN (3-2)/HCN (1-0) intensity ratios (~0.8) in IRAS 13120-5453 compared to NGC 3256 (~0.3-0.4) and NGC 7469 (~0.3-0.5). The HCN (4-3)/HCN (3-2) intensity ratio in NGC 7469 has a slope of 1.34$\pm$0.05. We attribute the variation within NGC 3256 to excitation associated with the northern and southern nuclei. In NGC 7469, the variations are localized to the region surrounding the active galactic nucleus. At our resolution (~700 pc), IRAS 13120-5453 shows little variation in the HCN intensity ratios. Individual galaxies show nearly constant CN (2-1)/CN (1-0) intensity ratios. We find an offset to lower CN (2-1)/CN (1-0) intensity ratios (~0.5) in NGC 3256 compared to the other two galaxies (~0.8). For the CN (3-2)/CN (2-1) intensity ratio, NGC 7469 has a superlinear trend of 1.55$\pm$0.04, with the peak localized toward the active galactic nucleus. We find high (~1.7) CN (1-0)/HCN (1-0) intensity ratios in IRAS 13120-5453 and in the northern nucleus of NGC 3256, compared to a more constant ratio (~1.1) in NGC 7469 and non-starbursting regions of NGC 3256.


title: Distantly Supervised Relation Extraction with Sentence Reconstruction and Knowledge Base Priors

abstract: We propose a multi-task, probabilistic approach to facilitate distantly supervised relation extraction by bringing closer the representations of sentences that contain the same Knowledge Base pairs. To achieve this, we bias the latent space of sentences via a Variational Autoencoder (VAE) that is trained jointly with a relation classifier. The latent code guides the pair representations and influences sentence reconstruction. Experimental results on two datasets created via distant supervision indicate that multi-task learning results in performance benefits. Additional exploration of employing Knowledge Base priors into the VAE reveals that the sentence space can be shifted towards that of the Knowledge Base, offering interpretability and further improving results.


title: A condensed-matter analogue of the false vacuum

abstract: Through experimental investigation into the behaviour of a polar dielectric working fluid, an ideal quasi-thermodynamic cycle has been established. Particular stages of this cycle are described in terms of a condensed-matter analogue of the false vacuum, when operating under negative-pressure. The cycle is established between 37 degC and 15 degC under isochoric conditions. Phase-change work is created in two-directions, positive expansion-work and negative contraction-work. A large proportion of the expansion-work derives from a cooling process where the fluid exhibits negative heat capacity. When heat flux ceases, the fluid becomes unstable and heat capacity switches from negative to positive, displaying a non-equivalence of ensembles phase-change. Whilst elements of the fluid behaviour can only be described by the statistical mechanics of non-equilibrium systems, the calculated equations of state for classical thermodynamics are confirmed to be accurate from the experimental investigation. However, the classical thermodynamic calculations for cycle-efficiency do not produce a symmetry of energy conservation. This suggests that an additional form of energy, having long-range interaction and distinct from heat and work input, is involved in the performance of the quasi-thermodynamic cycle. The expansion of a negative-pressure fluid that contains inclusion compounds appears responsible for this potential energy interaction as an analogue of the false vacuum potential that can be explained by application of the virial theorem.


title: Performance study of a $3\times1\times1\mbox{ m}^3$ dual phase liquid Argon Time Projection Chamber exposed to cosmic rays

abstract: We report the results of the analyses of the cosmic ray data collected with a 4 tonne (3$\times$1$\times$1~m$^3$) active mass (volume) Liquid Argon Time-Projection Chamber (TPC) operated in a dual-phase mode. We present a detailed study of the TPC's response, its main detector parameters and performance. The results are important for the understanding and further developments of the dual-phase technology, thanks to the verification of key aspects, such as the extraction of electrons from liquid to gas and their amplification through the entire one square metre readout plain, gain stability, purity and charge sharing between readout views.


title: Algorithm-driven Advances for Scientific CT Instruments: From Model-based to Deep Learning-based Approaches

abstract: Multi-scale 3D characterization is widely used by materials scientists to further their understanding of the relationships between microscopic structure and macroscopic function. Scientific computed tomography (CT) instruments are one of the most popular choices for 3D non-destructive characterization of materials at length scales ranging from the angstrom-scale to the micron-scale. These instruments typically have a source of radiation that interacts with the sample to be studied and a detector assembly to capture the result of this interaction. A collection of such high-resolution measurements are made by re-orienting the sample which is mounted on a specially designed stage/holder after which reconstruction algorithms are used to produce the final 3D volume of interest. The end goal of scientific CT scans include determining the morphology,chemical composition or dynamic behavior of materials when subjected to external stimuli. In this article, we will present an overview of recent advances in reconstruction algorithms that have enabled significant improvements in the performance of scientific CT instruments - enabling faster, more accurate and novel imaging capabilities. In the first part, we will focus on model-based image reconstruction algorithms that formulate the inversion as solving a high-dimensional optimization problem involving a data-fidelity term and a regularization term. In the last part of the article, we will present an overview of recent approaches using deep-learning based algorithms for improving scientific CT instruments.


title: An information-based metric for observing strategy optimization, demonstrated in the context of photometric redshifts with applications to cosmology

abstract: The observing strategy of a galaxy survey influences the degree to which its resulting data can be used to accomplish any science goal. LSST is thus seeking metrics of observing strategies for multiple science cases in order to optimally choose a cadence. Photometric redshifts are essential for many extragalactic science applications of LSST's data, including but not limited to cosmology, but there are few metrics available, and they are not straightforwardly integrated with metrics of other cadence-dependent quantities that may influence any given use case. We propose a metric for observing strategy optimization based on the potentially recoverable mutual information about redshift from a photometric sample under the constraints of a realistic observing strategy. We demonstrate a tractable estimation of a variational lower bound of this mutual information implemented in a public code using conditional normalizing flows. By comparing the recoverable redshift information across observing strategies, we can distinguish between those that preclude robust redshift constraints and those whose data will preserve more redshift information, to be generically utilized in a downstream analysis. We recommend the use of this versatile metric to observing strategy optimization for redshift-dependent extragalactic use cases, including but not limited to cosmology, as well as any other science applications for which photometry may be modeled from true parameter values beyond redshift.


title: Point-Based Modeling of Human Clothing

abstract: We propose a new approach to human clothing modeling based on point clouds. Within this approach, we learn a deep model that can predict point clouds of various outfits, for various human poses, and for various human body shapes. Notably, outfits of various types and topologies can be handled by the same model. Using the learned model, we can infer the geometry of new outfits from as little as a single image, and perform outfit retargeting to new bodies in new poses. We complement our geometric model with appearance modeling that uses the point cloud geometry as a geometric scaffolding and employs neural point-based graphics to capture outfit appearance from videos and to re-render the captured outfits. We validate both geometric modeling and appearance modeling aspects of the proposed approach against recently proposed methods and establish the viability of point-based clothing modeling.


title: An Adversarially-Learned Turing Test for Dialog Generation Models

abstract: The design of better automated dialogue evaluation metrics offers the potential of accelerate evaluation research on conversational AI. However, existing trainable dialogue evaluation models are generally restricted to classifiers trained in a purely supervised manner, which suffer a significant risk from adversarial attacking (e.g., a nonsensical response that enjoys a high classification score). To alleviate this risk, we propose an adversarial training approach to learn a robust model, ATT (Adversarial Turing Test), that discriminates machine-generated responses from human-written replies. In contrast to previous perturbation-based methods, our discriminator is trained by iteratively generating unrestricted and diverse adversarial examples using reinforcement learning. The key benefit of this unrestricted adversarial training approach is allowing the discriminator to improve robustness in an iterative attack-defense game. Our discriminator shows high accuracy on strong attackers including DialoGPT and GPT-3.


title: Valley splittings in Si/SiGe quantum dots with a germanium spike in the silicon well

abstract: Silicon-germanium heterostructures have successfully hosted quantum dot qubits, but the intrinsic near-degeneracy of the two lowest valley states poses an obstacle to high fidelity quantum computing. We present a modification to the Si/SiGe heterostructure by the inclusion of a spike in germanium concentration within the quantum well in order to increase the valley splitting. The heterostructure is grown by chemical vapor deposition and magnetospectroscopy is performed on gate-defined quantum dots to measure the excited state spectrum. We demonstrate a large and widely tunable valley splitting as a function of applied vertical electric field and lateral dot confinement. We further investigate the role of the germanium spike by means of tight-binding simulations in single-electron dots and show a robust doubling of the valley splitting when the spike is present, as compared to a standard (spike-free) heterostructure. This doubling effect is nearly independent of the electric field, germanium content of the spike, and spike location. This experimental evidence of a stable, tunable quantum dot, despite a drastic change to the heterostructure, provides a foundation for future heterostructure modifications.


title: Critical processing temperature for high performance protected silver thin film mirrors

abstract: Silver (Ag) mirrors for astronomical telescopes consist of multiple metallic and dielectric thin films. Furthermore, the topmost surface of such Ag mirrors needs to be covered by a protection coating. While the protection coating is often deposited at room temperature and the entire mirrors are also handled at room temperature, various thin film deposition techniques offer protection coatings with improved characteristics when carried out at elevated temperatures. Thus, in this work, high-performance Ag mirrors were designed and fabricated with a new benchmark. The resulting Ag mirrors were annealed (i.e., post-fabrication annealing) at various temperatures to investigate the viability of introducing thermal processes during and/or after fabrication in improving overall optical performance and durability of protected silver mirrors. In our experiments, Ag mirror samples were deposited by electron-beam evaporation and subsequently annealed at various temperatures in the range from 60 {\deg}C to 300 {\deg}C, and then the mirror samples underwent an environmental stress test at 80 {\deg}C and 80% humidity for 10 days. While all the mirror samples annealed below 200 {\deg}C showed negligible corrosion after undergoing the stress testing, those annealed below 160 {\deg}C presented spectral reflectivity comparable to or higher than that of as-deposited reference samples. In contrast, the mirror samples annealed above 200 {\deg}C exhibited significant degradation after the stress testing. The comprehensive analysis indicated that delamination and voids caused by the growth of Ag grains during the annealing are the primary mechanisms of the degradation.


title: The KPZ equation in a half space with flat initial condition and the unbinding of a directed polymer from an attractive wall

abstract: We present an exact solution for the height distribution of the KPZ equation at any time $t$ in a half space with flat initial condition. This is equivalent to obtaining the free energy distribution of a polymer of length $t$ pinned at a wall at a single point. In the large $t$ limit a binding transition takes place upon increasing the attractiveness of the wall. Around the critical point we find the same statistics as in the Baik-Ben--Arous-P\'ech\'e transition for outlier eigenvalues in random matrix theory. In the bound phase, we obtain the exact measure for the endpoint and the midpoint of the polymer at large time. We also unveil curious identities in distribution between partition functions in half-space and certain partition functions in full space for Brownian type initial condition.

categories: cond-mat.stat-mech cond-mat.dis-nn math-ph math.MP math.PR


title: Characterizing the Zeeman slowing force for $^{40}$Ca$^{19}$F molecules

abstract: In this paper we investigate the feasibility of Zeeman slowing calcium monofluoride (CaF) molecules originating from a cryogenic buffer gas cell. We measure the $A^2\Pi_{1/2} (v=0, J=\frac{1}{2}) - X^2\Sigma_{1/2} (v=0, N=1)$ hyperfine spectrum of CaF in the Paschen-Back regime and find excellent agreement with theory. We then investigate the scattering rate of the molecules in a molecular Zeeman slower by illuminating them with light from a 10mW broad repumper and a 10mW multi-frequency slowing laser. By comparing our results to theory we can calculate the photon scattering rate at higher powers, leading to a force profile for Zeeman slowing. We show results from a simple 1D simulation demonstrating that this force is both strong and narrow enough to lead to significant compression, and slowing of the molecules to trappable velocities.


title: Controlled abstention neural networks for identifying skillful predictions for regression problems

abstract: The earth system is exceedingly complex and often chaotic in nature, making prediction incredibly challenging: we cannot expect to make perfect predictions all of the time. Instead, we look for specific states of the system that lead to more predictable behavior than others, often termed "forecasts of opportunity". When these opportunities are not present, scientists need prediction systems that are capable of saying "I don't know." We introduce a novel loss function, termed "abstention loss", that allows neural networks to identify forecasts of opportunity for regression problems. The abstention loss works by incorporating uncertainty in the network's prediction to identify the more confident samples and abstain (say "I don't know") on the less confident samples. The abstention loss is designed to determine the optimal abstention fraction, or abstain on a user-defined fraction via a PID controller. Unlike many methods for attaching uncertainty to neural network predictions post-training, the abstention loss is applied during training to preferentially learn from the more confident samples. The abstention loss is built upon a standard computer science method. While the standard approach is itself a simple yet powerful tool for incorporating uncertainty in regression problems, we demonstrate that the abstention loss outperforms this more standard method for the synthetic climate use cases explored here. The implementation of proposed loss function is straightforward in most network architectures designed for regression, as it only requires modification of the output layer and loss function.


title: Predicting the Binding of SARS-CoV-2 Peptides to the Major Histocompatibility Complex with Recurrent Neural Networks

abstract: Predicting the binding of viral peptides to the major histocompatibility complex with machine learning can potentially extend the computational immunology toolkit for vaccine development, and serve as a key component in the fight against a pandemic. In this work, we adapt and extend USMPep, a recently proposed, conceptually simple prediction algorithm based on recurrent neural networks. Most notably, we combine regressors (binding affinity data) and classifiers (mass spectrometry data) from qualitatively different data sources to obtain a more comprehensive prediction tool. We evaluate the performance on a recently released SARS-CoV-2 dataset with binding stability measurements. USMPep not only sets new benchmarks on selected single alleles, but consistently turns out to be among the best-performing methods or, for some metrics, to be even the overall best-performing method for this task.


title: Are local ULIRGs powered by AGN? The sub-kpc view of the 220 GHz continuum. PUMA II

abstract: We analyze high-resolution (400pc) 220GHz continuum and CO(2-1) ALMA observations of a representative sample of 23 local (z<0.165) ULIRG systems (34 individual nuclei) as part of the "Physics of ULIRGs with MUSE and ALMA" (PUMA) project. The deconvolved half-light radii of the 220GHz continuum sources are between <60-350 pc (median 90pc). We associate these regions with the regions emitting the bulk of the infrared luminosity. The good agreement, within a factor of 2, between the 220GHz fluxes and the extrapolation of the infrared gray-body, and the small synchrotron and free-free contributions support this assumption. The cold molecular gas emission sizes, r_CO, are 60-700 pc and are similar in advanced mergers and early interacting systems. On average, r_CO are 2.5 times larger than the continuum. We derive L_IR and cold molecular gas surface densities: log Sigma(L_IR)=11.5-14.3 Lsun/kpc^2 and log Sigma(H2)=2.9-4.2 Msun/pc^2. Assuming that the L_IR is produced by star-formation, this corresponds to median Sigma(SFR)=2500 Msun/yr/kpc^2 which would imply extremely short depletion times, <1-15 Myr, and unphysical SF efficiencies >1 for 70% of the sample. Therefore, this favors the presence of obscured AGN that could dominate the L_IR. We also classify the ULIRG nuclei in two groups: (a) compact nuclei (r<130 pc) with high mid-IR excess emission found in optically classified AGN; and (b) nuclei following a relation with decreasing mid-IR excess for decreasing r. 60% of the interacting nuclei lie in the low end (<130 pc) of this relation, while only 30% of the advanced mergers do so, suggesting that in the early interaction phases the activity occurs in more compact and obscured regions. About two thirds of the nuclei are above the Eddington limit which is consistent with the detection of massive outflows in local ULIRGs and the potential role of radiation pressure in the launching process.


title: An exploration of asocial and social learning in the evolution of variable-length structures

abstract: We wish to explore the contribution that asocial and social learning might play as a mechanism for self-adaptation in the search for variable-length structures by an evolutionary algorithm. An extremely challenging, yet simple to understand problem landscape is adopted where the probability of randomly finding a solution is approximately one in a trillion. A number of learning mechanisms operating on variable-length structures are implemented and their performance analysed. The social learning setup, which combines forms of both social and asocial learning in combination with evolution is found to be most performant, while the setups exclusively adopting evolution are incapable of finding solutions.


title: Nonseparable CCR algebras

abstract: Extending a result of the first author and Katsura, we prove that for every UHF algebra $A$ of infinite type, in every uncountable cardinality $\kappa$ there are $2^\kappa$ nonisomorphic approximately matricial C*-algebras with the same $K_0$ group as $A$. These algebras are group \cstar-algebras `twisted' by prescribed canonical commutation relations (CCR), and they can also be considered as nonseparable generalizations of noncommutative tori.


title: Spatial-Temporal Correlation and Topology Learning for Person Re-Identification in Videos

abstract: Video-based person re-identification aims to match pedestrians from video sequences across non-overlapping camera views. The key factor for video person re-identification is to effectively exploit both spatial and temporal clues from video sequences. In this work, we propose a novel Spatial-Temporal Correlation and Topology Learning framework (CTL) to pursue discriminative and robust representation by modeling cross-scale spatial-temporal correlation. Specifically, CTL utilizes a CNN backbone and a key-points estimator to extract semantic local features from human body at multiple granularities as graph nodes. It explores a context-reinforced topology to construct multi-scale graphs by considering both global contextual information and physical connections of human body. Moreover, a 3D graph convolution and a cross-scale graph convolution are designed, which facilitate direct cross-spacetime and cross-scale information propagation for capturing hierarchical spatial-temporal dependencies and structural information. By jointly performing the two convolutions, CTL effectively mines comprehensive clues that are complementary with appearance information to enhance representational capacity. Extensive experiments on two video benchmarks have demonstrated the effectiveness of the proposed method and the state-of-the-art performance.


title: A note on the Markovian SIR epidemic on a random graph with given degrees

abstract: This paper provides an additional probabilistic interpretation of the limiting functions for the SIR epidemic on the configuration model derived in the paper by Janson, Luczak and Windridge (2014).


title: Attenuating surface gravity waves with mechanical metamaterials

abstract: Metamaterials and photonic/phononic crystals have been successfully developed in recent years to achieve advanced wave manipulation and control, both in electromagnetism and mechanics. However, the underlying concepts are yet to be fully applied to the field of fluid dynamics and water waves. Here, we present an example of the interaction of surface gravity waves with a mechanical metamaterial, i.e. periodic underwater oscillating resonators. In particular, we study a device composed by an array of periodic submerged harmonic oscillators whose objective is to absorb wave energy and dissipate it inside the fluid in the form of heat. The study is performed using a state of the art direct numerical simulation of the Navier-Stokes equation in its two-dimensional form with free boundary and moving bodies. We use a Volume of Fluid interface technique for tracking the surface and an Immersed Boundary method for the fluid-structure interaction. We first study the interaction of a monochromatic wave with a single oscillator and then add up to four resonators coupled only fluid-mechanically. We study the efficiency of the device in terms of the total energy dissipation and find that by adding resonators, the dissipation increases in a non trivial way. As expected, a large energy attenuation is achieved when the wave and resonators are characterised by similar frequencies. As the number of resonators is increased, the range of attenuated frequencies also increases. The concept and results presented herein are of relevance for applications in coastal protection.


title: Open data for Moroccan license plates for OCR applications : data collection, labeling, and model construction

abstract: Significant number of researches have been developed recently around intelligent system for traffic management, especially, OCR based license plate recognition, as it is considered as a main step for any automatic traffic management system. Good quality data sets are increasingly needed and produced by the research community to improve the performance of those algorithms. Furthermore, a special need of data is noted for countries having special characters on their licence plates, like Morocco, where Arabic Alphabet is used. In this work, we present a labeled open data set of circulation plates taken in Morocco, for different type of vehicles, namely cars, trucks and motorcycles. This data was collected manually and consists of 705 unique and different images. Furthermore this data was labeled for plate segmentation and for matriculation number OCR. Also, As we show in this paper, the data can be enriched using data augmentation techniques to create training sets with few thousands of images for different machine leaning and AI applications. We present and compare a set of models built on this data. Also, we publish this data as an open access data to encourage innovation and applications in the field of OCR and image processing for traffic control and other applications for transportation and heterogeneous vehicle management.


title: Towards Electronic Structure-Based Ab-Initio Molecular Dynamics Simulations with Hundreds of Millions of Atoms

abstract: We push the boundaries of electronic structure-based \textit{ab-initio} molecular dynamics (AIMD) beyond 100 million atoms. This scale is otherwise barely reachable with classical force-field methods or novel neural network and machine learning potentials. We achieve this breakthrough by combining innovations in linear-scaling AIMD, efficient and approximate sparse linear algebra, low and mixed-precision floating-point computation on GPUs, and a compensation scheme for the errors introduced by numerical approximations. The core of our work is the non-orthogonalized local submatrix method (NOLSM), which scales very favorably to massively parallel computing systems and translates large sparse matrix operations into highly parallel, dense matrix operations that are ideally suited to hardware accelerators. We demonstrate that the NOLSM method, which is at the center point of each AIMD step, is able to achieve a sustained performance of 324 PFLOP/s in mixed FP16/FP32 precision corresponding to an efficiency of 67.7% when running on 1536 NVIDIA A100 GPUs.


title: Magnetic field amplification by a nonlinear electron streaming instability

abstract: Magnetic field amplification by relativistic streaming plasma instabilities is central to a wide variety of high-energy astrophysical environments as well as to laboratory scenarios associated with intense lasers and electron beams. We report on a new secondary nonlinear instability which arises for relativistic dilute electron beams after the saturation of the linear Weibel instability. This instability grows due to the transverse magnetic pressure associated with the beam current filaments, which cannot be quickly neutralized due to the inertia of background ions. We show that it can amplify the magnetic field strength and spatial scale by orders of magnitude, leading to large-scale plasma cavities with strong magnetic field and to very efficient conversion of the beam kinetic energy into magnetic energy. The instability growth rate, saturation level, and scale length are derived analytically and shown to be in good agreement with fully-kinetic simulations.


title: What to Pre-Train on? Efficient Intermediate Task Selection

abstract: Intermediate task fine-tuning has been shown to culminate in large transfer gains across many NLP tasks. With an abundance of candidate datasets as well as pre-trained language models, it has become infeasible to run the cross-product of all combinations to find the best transfer setting. In this work we first establish that similar sequential fine-tuning gains can be achieved in adapter settings, and subsequently consolidate previously proposed methods that efficiently identify beneficial tasks for intermediate transfer learning. We experiment with a diverse set of 42 intermediate and 11 target English classification, multiple choice, question answering, and sequence tagging tasks. Our results show that efficient embedding based methods that rely solely on the respective datasets outperform computational expensive few-shot fine-tuning approaches. Our best methods achieve an average Regret@3 of less than 1% across all target tasks, demonstrating that we are able to efficiently identify the best datasets for intermediate training.


title: Neutrino masses in the Standard Model effective field theory

abstract: We compute the leading-logarithmic correction to the neutrino mass matrix in the Standard Model effective field theory (SMEFT) to dimension seven. In the limit of negligible lepton and down-type quark Yukawa couplings, it receives contributions from the Weinberg dimension-five operator as well as from 11 dimension-six and five dimension-seven independent interactions. Two of the main implications we derive from this result are the following. First, we find dimension-seven operators which, despite violating lepton number, do not renormalise neutrino masses at one loop. And second, we demonstrate that the presence of dimension-six operators around the TeV scale can modify the Standard Model prediction by up to $\mathcal{O}(50\,\%)$. Our result comprises also one step forward towards the renormalisation of the SMEFT to order $v^3/\Lambda^3$.


title: Uncovering near-wall blood flow from sparse data with physics-informed neural networks

abstract: Near-wall blood flow and wall shear stress (WSS) regulate major forms of cardiovascular disease, yet they are challenging to quantify with high fidelity. Patient-specific computational and experimental measurement of WSS suffers from uncertainty, low resolution, and noise issues. Physics-informed neural networks (PINN) provide a flexible deep learning framework to integrate mathematical equations governing blood flow with measurement data. By leveraging knowledge about the governing equations (herein, Navier-Stokes), PINN overcomes the large data requirement in deep learning. In this study, it was shown how PINN could be used to improve WSS quantification in diseased arterial flows. Specifically, blood flow problems where the inlet and outlet boundary conditions were not known were solved by assimilating very few measurement points. Uncertainty in boundary conditions is a common feature in patient-specific computational fluid dynamics models. It was shown that PINN could use sparse velocity measurements away from the wall to quantify WSS with very high accuracy even without full knowledge of the boundary conditions. Examples in idealized stenosis and aneurysm models were considered demonstrating how partial knowledge about the flow physics could be combined with partial measurements to obtain accurate near-wall blood flow data. The proposed hybrid data-driven and physics-based deep learning framework has high potential in transforming high-fidelity near-wall hemodynamics modeling in cardiovascular disease.


title: Estimation of nuclear matrix elements of double-$\beta$ decay from shell model and quasiparticle random-phase approximation

abstract: The nuclear matrix element (NME) of the neutrinoless double-$\beta$ ($0\nu\beta\beta$) decay is an essential input for determining the neutrino effective mass, if the half-life of this decay is measured. The reliable calculation of this NME has been a long-standing problem because of the diversity of the predicted values of the NME depending on the calculation method. In this paper, we focus on the shell model and the QRPA. The shell model have a rich amount of the many-particle many-hole correlations, and the QRPA can obtain the convergence of the result of calculation with respect to the extension of the single-particle space. It is difficult for the shell model to obtain the convergence of the $0\nu\beta\beta$ NME with respect to the valence single-particle space. The many-body correlations of the QRPA are insufficient depending on nuclei. We propose a new method to modify phenomenologically the results of the shell model and the QRPA compensating the insufficient point of each method by using the information of other method complementarily. Extrapolations of the components of the $0\nu\beta\beta$ NME of the shell model are made toward a very large valence single-particle space. We introduce a modification factor to the components of the $0\nu\beta\beta$ NME of the QRPA. Our modification method gives similar values of the $0\nu\beta\beta$ NME of the two methods for $^{48}$Ca. The NME of the two-neutrino double-$\beta$ decay is also modified in a similar but simpler manner, and the consistency of the two methods is improved.


title: proScript: Partially Ordered Scripts Generation via Pre-trained Language Models

abstract: Scripts - standardized event sequences describing typical everyday activities - have been shown to help understand narratives by providing expectations, resolving ambiguity, and filling in unstated information. However, to date they have proved hard to author or extract from text. In this work, we demonstrate for the first time that pre-trained neural language models (LMs) can be be finetuned to generate high-quality scripts, at varying levels of granularity, for a wide range of everyday scenarios (e.g., bake a cake). To do this, we collected a large (6.4k), crowdsourced partially ordered scripts (named proScript), which is substantially larger than prior datasets, and developed models that generate scripts with combining language generation and structure prediction. We define two complementary tasks: (i) edge prediction: given a scenario and unordered events, organize the events into a valid (possibly partial-order) script, and (ii) script generation: given only a scenario, generate events and organize them into a (possibly partial-order) script. Our experiments show that our models perform well (e.g., F1=75.7 in task (i)), illustrating a new approach to overcoming previous barriers to script collection. We also show that there is still significant room for improvement toward human level performance. Together, our tasks, dataset, and models offer a new research direction for learning script knowledge.


title: ALF -- A Fitness-Based Artificial Life Form for Evolving Large-Scale Neural Networks

abstract: Machine Learning (ML) is becoming increasingly important in daily life. In this context, Artificial Neural Networks (ANNs) are a popular approach within ML methods to realize an artificial intelligence. Usually, the topology of ANNs is predetermined. However, there are problems where it is difficult to find a suitable topology. Therefore, Topology and Weight Evolving Artificial Neural Network (TWEANN) algorithms have been developed that can find ANN topologies and weights using genetic algorithms. A well-known downside for large-scale problems is that TWEANN algorithms often evolve inefficient ANNs and require long runtimes. To address this issue, we propose a new TWEANN algorithm called Artificial Life Form (ALF) with the following technical advancements: (1) speciation via structural and semantic similarity to form better candidate solutions, (2) dynamic adaptation of the observed candidate solutions for better convergence properties, and (3) integration of solution quality into genetic reproduction to increase the probability of optimization success. Experiments on large-scale ML problems confirm that these approaches allow the fast solving of these problems and lead to efficient evolved ANNs.


title: Condenser: a Pre-training Architecture for Dense Retrieval

abstract: Pre-trained Transformer language models (LM) have become go-to text representation encoders. Prior research fine-tunes deep LMs to encode text sequences such as sentences and passages into single dense vector representations for efficient text comparison and retrieval. However, dense encoders require a lot of data and sophisticated techniques to effectively train and suffer in low data situations. This paper finds a key reason is that standard LMs' internal attention structure is not ready-to-use for dense encoders, which needs to aggregate text information into the dense representation. We propose to pre-train towards dense encoder with a novel Transformer architecture, Condenser, where LM prediction CONditions on DENSE Representation. Our experiments show Condenser improves over standard LM by large margins on various text retrieval and similarity tasks.


title: The m=2 amplituhedron and the hypersimplex: signs, clusters, triangulations, Eulerian numbers

abstract: The hypersimplex $\Delta_{k+1,n}$ is the image of the positive Grassmannian $Gr^{\geq 0}_{k+1,n}$ under the moment map. It is a polytope of dimension $n-1$ in $\mathbb{R}^n$. Meanwhile, the amplituhedron $\mathcal{A}_{n,k,2}(Z)$ is the projection of the positive Grassmannian $Gr^{\geq 0}_{k,n}$ into $Gr_{k,k+2}$ under a map $\tilde{Z}$ induced by a matrix $Z\in \text{Mat}_{n,k+2}^{>0}$. Introduced in the context of scattering amplitudes, it is not a polytope, and has dimension $2k$. Nevertheless, there seem to be remarkable connections between these two objects via T-duality, as was first noted by Lukowski--Parisi--Williams (LPW). In this paper we use ideas from oriented matroid theory, total positivity, and the geometry of the hypersimplex and positroid polytopes to obtain a deeper understanding of the amplituhedron. We show that the inequalities cutting out positroid polytopes -- images of positroid cells of $Gr^{\geq 0}_{k+1,n}$ under the moment map -- translate into sign conditions characterizing the T-dual Grasstopes -- images of positroid cells of $Gr^{\geq 0}_{k,n}$ under $\tilde{Z}$. Moreover, we subdivide the amplituhedron into chambers, just as the hypersimplex can be subdivided into simplices, with both chambers and simplices enumerated by the Eulerian numbers. We prove the main conjecture of (LPW): a collection of positroid polytopes is a triangulation of $\Delta_{k+1, n}$ if and only if the collection of T-dual Grasstopes is a triangulation of $\mathcal{A}_{n,k,2}(Z)$ for all $Z$. Moreover, we prove Arkani-Hamed--Thomas--Trnka's conjectural sign-flip characterization of $\mathcal{A}_{n,k,2}(Z)$, and Lukowski--Parisi--Spradlin--Volovich's conjectures on $m=2$ cluster adjacency and on generalized triangles (images of $2k$-dimensional positroid cells which map injectively into $\mathcal{A}_{n,k,2}(Z)$). Finally, we introduce new cluster structures in the amplituhedron.


title: Solution of universal nonrelativistic nuclear DFT equations in the Cartesian deformed harmonic-oscillator basis. (IX) HFODD (v3.06h): a new version of the program

abstract: We describe the new version (v3.06h) of the code HFODD that solves the universal nonrelativistic nuclear DFT Hartree-Fock or Hartree-Fock-Bogolyubov problem by using the Cartesian deformed harmonic-oscillator basis. In the new version, we implemented the following new features: (i) zero-range three- and four-body central terms, (ii) zero-range three-body gradient terms, (iii) zero-range tensor terms, (iv) zero-range isospin-breaking terms, (v) finite-range higher-order regularized terms, (vi) finite-range separable terms, (vii) zero-range two-body pairing terms, (viii) multi-quasiparticle blocking, (ix) Pfaffian overlaps, (x) particle-number and parity symmetry restoration, (xi) axialization, (xii) Wigner functions, (xiii) choice of the harmonic-oscillator basis, (xiv) fixed Omega partitions, (xv) consistency formula between energy and fields, and we corrected several errors of the previous versions.


title: Predicting synchronized gene coexpression patterns from fibration symmetries in gene regulatory networks in bacteria

abstract: Background: Gene regulatory networks coordinate the expression of genes across physiological states and ensure a synchronized expression of genes in cellular subsystems, critical for the coherent functioning of cells. Here we address the questions whether it is possible to predict gene synchronization from network structure alone. We have recently shown that synchronized gene expression may be predicted from symmetries in the gene regulatory networks (GRN) and described by the concept of symmetry fibrations. We showed that symmetry fibrations partition the genes into groups called fibers based on the symmetries of their 'input trees', the set of paths in the network through which signals can reach a gene. In idealized dynamic gene expression models, all genes in a fiber are perfectly synchronized, while less idealized models - with gene input functions differencing between genes - predict symmetry breaking and desynchronization. Results: To study the functional role of gene fibers and to test whether some of the fiber-induced coexpression remains in reality, we analyze gene fibrations for the gene regulatory networks of E. coli and B. subtilis and confront them with expression data. We find approximate gene coexpression patterns consistent with symmetry fibrations with idealized gene expression dynamics. This shows that network structure alone provides useful information about gene synchronization, and suggest that gene input functions within fibers may be further streamlined by evolutionary pressures to realize a coexpression of genes. Conclusions: Thus, gene fibrations provides a sound conceptual tool to describe tunable coexpression induced by network topology and shaped by mechanistic details of gene expression.

categories: q-bio.MN physics.bio-ph physics.data-an q-bio.GN


title: A new matroid lift construction and an application to group-labeled graphs

abstract: A well-known result of Brylawski constructs an elementary lift of a matroid $M$ from a linear class of circuits of $M$. We generalize this result by showing how to construct a rank-$k$ lift of $M$ from a rank-$k$ matroid on the set of circuits of $M$. We conjecture that every lift of $M$ arises via this construction. We then apply this result to group-labeled graphs, generalizing a construction of Zaslavsky. Given a graph $G$ with edges labeled by a group, Zaslavsky's lift matroid $K$ is an elementary lift of the graphic matroid $M(G)$ that respects the group-labeling; specifically, the cycles of $G$ that are circuits of $K$ coincide with the cycles that are balanced with respect to the group-labeling. For $k \ge 2$, when does there exist a rank-$k$ lift of $M(G)$ that respects the group-labeling in this same sense? For abelian groups, we show that such a matroid exists if and only if the group is isomorphic to the additive group of a non-prime finite field.


title: Modeling Fuzzy Cluster Transitions for Topic Tracing

abstract: Twitter can be viewed as a data source for Natural Language Processing (NLP) tasks. The continuously updating data streams on Twitter make it challenging to trace real-time topic evolution. In this paper, we propose a framework for modeling fuzzy transitions of topic clusters. We extend our previous work on crisp cluster transitions by incorporating fuzzy logic in order to enrich the underlying structures identified by the framework. We apply the methodology to both computer generated clusters of nouns from tweets and human tweet annotations. The obtained fuzzy transitions are compared with the crisp transitions, on both computer generated clusters and human labeled topic sets.


title: Context-Adaptive Document-Level Neural Machine Translation

abstract: Most existing document-level neural machine translation (NMT) models leverage a fixed number of the previous or all global source sentences to handle the context-independent problem in standard NMT. However, the translating of each source sentence benefits from various sizes of context, and inappropriate context may harm the translation performance. In this work, we introduce a data-adaptive method that enables the model to adopt the necessary and useful context. Specifically, we introduce a light predictor into two document-level translation models to select the explicit context. Experiments demonstrate the proposed approach can significantly improve the performance over the previous methods with a gain up to 1.99 BLEU points.


title: Coupling of complex function theory and finite element method for crack propagation through energetic formulation: conformal mapping approach and reduction to a Riemann-Hilbert problem

abstract: In this paper we present a theoretical background of a coupled analytical-numerical approach to model a crack propagation process in two-dimensional bounded domains. The goal of the coupled analytical-numerical approach is to obtain the correct solution behaviour near the crack tip by help of the analytical solution constructed by using tools of the complex function theory and couple it continuously with the finite element solution in the region far from singularity. In this way, crack propagation could be modelled without using remeshing. Possible directions of crack growth can be calculated through the minimization of the total energy composed of the potential energy and the dissipated energy based on the energy release rate. Within this setting, an analytical solution of a mixed boundary value problem based on complex analysis and conformal mapping techniques is presented in a circular region containing an arbitrary crack path. More precisely, the linear elastic problem is transformed into a Riemann-Hilbert problem in the unit disk for holomorphic functions. Utilising advantages of the analytical solution in the region near the crack tip, the total energy could be evaluated within short computation times for various crack kink angles and lengths leading to a potentially efficient way of computing the minimization procedure. To this end, the paper presents a general strategy of the new coupled approach for crack propagation modelling. Additionally, we also discuss obstacles on the way of practical realisation of this strategy.


title: Adaptive Robust Model Predictive Control with Matched and Unmatched Uncertainty

abstract: We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems commonly model the nonlinear effects of an unknown environment on a nominal system. We optimize over a class of nonlinear feedback policies inspired by certainty equivalent "estimate-and-cancel" control laws pioneered in classical adaptive control to achieve significant performance improvements in the presence of uncertainties of large magnitude, a setting in which existing learning-based predictive control algorithms often struggle to guarantee safety. In contrast to previous work in robust adaptive MPC, our approach allows us to take advantage of structure (i.e., the numerical predictions) in the a priori unknown dynamics learned online through function approximation. Our approach also extends typical nonlinear adaptive control methods to systems with state and input constraints even when we cannot directly cancel the additive uncertain function from the dynamics. Moreover, we apply contemporary statistical estimation techniques to certify the system's safety through persistent constraint satisfaction with high probability. Finally, we show in simulation that our method can accommodate more significant unknown dynamics terms than existing methods.


title: Intense optical parametric amplification in dispersion engineered nanophotonic lithium niobate waveguides

abstract: Strong amplification in integrated photonics is one of the most desired optical functionalities for computing, communications, sensing, and quantum information processing. Semiconductor gain and cubic nonlinearities, such as four-wave mixing and stimulated Raman and Brillouin scattering, have been among the most studied amplification mechanisms on chip. Alternatively, material platforms with strong quadratic nonlinearities promise numerous advantages with respect to gain and bandwidth, among which nanophotonic lithium niobate is one of the most promising candidates. Here, we combine quasi-phase matching with dispersion engineering in nanophotonic lithium niobate waveguides and achieve intense optical parametric amplification. We measure a broadband phase-sensitive on-chip amplification larger than 45 dB/cm in a 2.5-mm-long waveguide. We further confirm high gain operation in the degenerate and non-degenerate regimes by amplifying vacuum fluctuations to macroscopic levels in a 6-mm-long waveguide, with on-chip gains exceeding 100 dB/cm over 600 nm of bandwidth around 2 $\mu$m. Our results unlock new possibilities for on-chip few-cycle nonlinear optics, mid-infrared photonics, and quantum photonics.


title: The String Dual to Free ${\cal N}=4$ Super Yang-Mills

abstract: We propose a worldsheet description for the ${\rm AdS}_5\times {\rm S}^5$ string theory dual to large $N$, free ${\cal N}=4$ super Yang-Mills in four dimensions. The worldsheet theory is a natural generalisation of the recently investigated tensionless string on ${\rm AdS}_3\times {\rm S}^3\times \mathbb{T}^4$. As in the case of ${\rm AdS}_3$ it has a free field description, with spectrally flowed sectors, and is closely related to an (ambi-)twistor string theory. Here, however, we view it as a critical $N=4$ (closed) string background. We argue that the corresponding worldsheet gauge constraints reduce the degrees of freedom to a finite number of oscillators (string bits) in each spectrally flowed sector. Imposing a set of residual gauge constraints on this reduced oscillator Fock space then determines the physical spectrum of the string theory. Quite remarkably, we find compelling evidence that this prescription reproduces precisely the entire planar spectrum - of single trace operators - of the free super Yang-Mills theory.


title: Symmetry reduction to optimize a graph-based polynomial from queueing theory

abstract: For given integers $n$ and $d$, both at least 2, we consider a homogeneous multivariate polynomial $f_d$ of degree $d$ in variables indexed by the edges of the complete graph on $n$ vertices and coefficients depending on cardinalities of certain unions of edges. Cardinaels, Borst and Van Leeuwaarden (arXiv:2111.05777, 2021) asked whether $f_d$, which arises in a model of job-occupancy in redundancy scheduling, attains its minimum over the standard simplex at the uniform probability vector. Brosch, Laurent and Steenkamp [SIAM J. Optim. 31 (2021), 2227--2254] proved that $f_d$ is convex over the standard simplex if $d=2$ and $d=3$, implying the desired result for these $d$. We give a symmetry reduction to show that for fixed $d$, the polynomial is convex over the standard simplex (for all $n\geq 2$) if a constant number of constant matrices (with size and coefficients independent of $n$) are positive semidefinite. This result is then used in combination with a computer-assisted verification to show that the polynomial $f_d$ is convex for $d\leq 9$.


title: Evaluation of Portable Acceleration Solutions for LArTPC Simulation Using Wire-Cell Toolkit

abstract: The Liquid Argon Time Projection Chamber (LArTPC) technology plays an essential role in many current and future neutrino experiments. Accurate and fast simulation is critical to developing efficient analysis algorithms and precise physics model projections. The speed of simulation becomes more important as Deep Learning algorithms are getting more widely used in LArTPC analysis and their training requires a large simulated dataset. Heterogeneous computing is an efficient way to delegate computing-heavy tasks to specialized hardware. However, as the landscape of the compute accelerators is evolving fast, it becomes more and more difficult to manually adapt the code constantly to the latest hardware or software environments. A solution which is portable to multiple hardware architectures while not substantially compromising performance would be very beneficial, especially for long-term projects such as the LArTPC simulations. In search of a portable, scalable and maintainable software solution for LArTPC simulations, we have started to explore high-level portable programming frameworks that support several hardware backends. In this paper, we will present our experience porting the LArTPC simulation code in the Wire-Cell toolkit to NVIDIA GPUs, first with the CUDA programming model and then with a portable library called Kokkos. Preliminary performance results on NVIDIA V100 GPUs and multi-core CPUs will be presented, followed by a discussion of the factors affecting the performance and plans for future improvements.


title: Unified Analysis of Discontinuous Galerkin Methods for Frictional Contact Problem with normal compliance

abstract: In this article, a reliable and efficient a posteriori error estimator of residual type is derived for a class of discontinuous Galerkin methods for the frictional contact problem with reduced normal compliance which is modeled as a quasi-variational inequality. We further derive a priori error estimates in the energy norm under the minimal regularity assumption on the exact solution. The convergence behavior of error over uniform mesh and the performance of error estimator are illustrated by the numerical results.


title: Iterative Model Predictive Control for Piecewise Systems

abstract: In this paper, we present an iterative Model Predictive Control (MPC) design for piecewise nonlinear systems. We consider finite time control tasks where the goal of the controller is to steer the system from a starting configuration to a goal state while minimizing a cost function. First, we present an algorithm that leverages a feasible trajectory that completes the task to construct a control policy which guarantees that state and input constraints are recursively satisfied and that the closed-loop system reaches the goal state in finite time. Utilizing this construction, we present a policy iteration scheme that iteratively generates safe trajectories which have non-decreasing performance. Finally, we test the proposed strategy on a discretized Spring Loaded Inverted Pendulum (SLIP) model with massless legs. We show that our methodology is robust to changes in initial conditions and disturbances acting on the system. Furthermore, we demonstrate the effectiveness of our policy iteration algorithm in a minimum time control task.


title: Data Augmentation for Voice-Assistant NLU using BERT-based Interchangeable Rephrase

abstract: We introduce a data augmentation technique based on byte pair encoding and a BERT-like self-attention model to boost performance on spoken language understanding tasks. We compare and evaluate this method with a range of augmentation techniques encompassing generative models such as VAEs and performance-boosting techniques such as synonym replacement and back-translation. We show our method performs strongly on domain and intent classification tasks for a voice assistant and in a user-study focused on utterance naturalness and semantic similarity.


title: Floquet-Mode Traveling-Wave Parametric Amplifiers

abstract: Simultaneous ideal quantum measurements of multiple single-photon-level signals would advance applications in quantum information processing, metrology, and astronomy, but require the first amplifier to be simultaneously broadband, quantum limited, and directional. However, conventional traveling-wave parametric amplifiers support broadband amplification at the cost of increased added noise and are not genuinely directional due to non-negligible nonlinear backward wave generation. In this work, we introduce a new class of amplifiers which encode the information in the Floquet modes of the system. Such Floquet mode amplifiers prevent information leakage and overcome the trade-off between quantum efficiency (QE) and bandwidth. Crucially, Floquet mode amplifiers strongly suppress the nonlinear forward-backward wave coupling and are therefore genuinely directional and readily integrable with qubits, clearing another major obstacle towards broadband ideal quantum measurements. Furthermore, Floquet mode amplifiers are insensitive to out-of-band impedance mismatch, which otherwise may lead to gain ripples, parametric oscillations, and instability in conventional traveling-wave parametric amplifiers. Finally, we show that a Floquet mode Josephson traveling-wave parametric amplifier implementation can simultaneously achieve $>\!20\,$dB gain and a QE of $\eta/\eta_{\mathrm{ideal}}\!> 99.9\%$ of the quantum limit over more than an octave of bandwidth. The proposed Floquet scheme is also widely applicable to other platforms, such as kinetic inductance traveling-wave amplifiers and optical parametric amplifiers.