title: Measuring the Electron Temperature and Identifying Plasma Detachment using Machine Learning and Spectroscopy

abstract: A machine learning approach has been implemented to measure the electron temperature directly from the emission spectra of a tokamak plasma. This approach utilized a neural network (NN) trained on a dataset of 1865 time slices from operation of the DIII-D tokamak using extreme ultraviolet / vacuum ultraviolet (EUV/VUV) emission spectroscopy matched with high-accuracy divertor Thomson scattering measurements of the electron temperature, $T_e$. This NN is shown to be particularly good at predicting $T_e$ at low temperatures ($T_e < 10$ eV) where the NN demonstrated a mean average error of less than 1 eV. Trained to detect plasma detachment in the tokamak divertor, a NN classifier was able to correctly identify detached states ($T_e<5$ eV) with a 99% accuracy (F$_1$ score of 0.96) at an acquisition rate $10\times$ faster than the Thomson scattering measurement. The performance of the model is understood by examining a set of 4800 theoretical spectra generated using collisional radiative modeling that was also used to predict the performance of a low-cost spectrometer viewing nitrogen emission in the visible wavelengths. These results provide a proof-of-principle that low-cost spectrometers leveraged with machine learning can be used both to boost the performance of more expensive diagnostics on fusion devices, and be used independently as a fast and accurate $T_e$ measurement and detachment classifier.


title: Sub-femtometer scale color charge fluctuations in a proton made of three quarks and a gluon

abstract: The light-front wave function of a proton composed of three quarks and a perturbative gluon is computed. This is then used to derive expressions for the color charge density correlator $\langle\rho^a(\vec q_1)\, \rho^b(\vec q_2)\rangle$ at ${\cal O}(g^4)$ due to the emission of a gluon by one of the quarks in light-cone gauge. The correlator exhibits the soft and collinear singularities. Albeit, we employ exact gluon emission and absorption vertices, and hence the gluon is not required to carry very small light-cone momentum, or to be collinear to the emitting quark. We verify that the correlator satisfies the Ward identity and that it is independent of the renormalization scale, i.e. that ultraviolet divergences cancel. Our expressions provide x-dependent initial conditions for Balitsky-Kovchegov evolution of the C-even part of the dipole scattering matrix to higher energies. That is, we determine the first non-trivial moment of the color charge fluctuations which act as sources for soft color fields in the proton with wavelengths greater than approximately $1/x \sim 10 - 100$.


title: On the Potential of Lexico-logical Alignments for Semantic Parsing to SQL Queries

abstract: Large-scale semantic parsing datasets annotated with logical forms have enabled major advances in supervised approaches. But can richer supervision help even more? To explore the utility of fine-grained, lexical-level supervision, we introduce Squall, a dataset that enriches 11,276 WikiTableQuestions English-language questions with manually created SQL equivalents plus alignments between SQL and question fragments. Our annotation enables new training possibilities for encoder-decoder models, including approaches from machine translation previously precluded by the absence of alignments. We propose and test two methods: (1) supervised attention; (2) adopting an auxiliary objective of disambiguating references in the input queries to table columns. In 5-fold cross validation, these strategies improve over strong baselines by 4.4% execution accuracy. Oracle experiments suggest that annotated alignments can support further accuracy gains of up to 23.9%.


title: Improving Simultaneous Translation by Incorporating Pseudo-References with Fewer Reorderings

abstract: Simultaneous translation is vastly different from full-sentence translation, in the sense that it starts translation before the source sentence ends, with only a few words delay. However, due to the lack of large-scale, high-quality simultaneous translation datasets, most such systems are still trained on conventional full-sentence bitexts. This is far from ideal for the simultaneous scenario due to the abundance of unnecessary long-distance reorderings in those bitexts. We propose a novel method that rewrites the target side of existing full-sentence corpora into simultaneous-style translation. Experiments on Zh->En and Ja->En simultaneous translation show substantial improvements (up to +2.7 BLEU) with the addition of these generated pseudo-references.


title: Neural Star Domain as Primitive Representation

abstract: Reconstructing 3D objects from 2D images is a fundamental task in computer vision. Accurate structured reconstruction by parsimonious and semantic primitive representation further broadens its application. When reconstructing a target shape with multiple primitives, it is preferable that one can instantly access the union of basic properties of the shape such as collective volume and surface, treating the primitives as if they are one single shape. This becomes possible by primitive representation with unified implicit and explicit representations. However, primitive representations in current approaches do not satisfy all of the above requirements at the same time. To solve this problem, we propose a novel primitive representation named neural star domain (NSD) that learns primitive shapes in the star domain. We show that NSD is a universal approximator of the star domain and is not only parsimonious and semantic but also an implicit and explicit shape representation. We demonstrate that our approach outperforms existing methods in image reconstruction tasks, semantic capabilities, and speed and quality of sampling high-resolution meshes.


title: STARFORGE: The effects of protostellar outflows on the IMF

abstract: The initial mass function (IMF) of stars is a key quantity affecting almost every field of astrophysics, yet it remains unclear what physical mechanisms determine it. We present the first runs of the STARFORGE project, using a new numerical framework to follow the formation of individual stars in giant molecular clouds (GMCs) using the GIZMO code. Our suite include runs with increasingly complex physics, starting with isothermal ideal magnetohydrodynamic (MHD) and then adding non-isothermal thermodynamics and protostellar outflows. We show that without protostellar outflows the resulting stellar masses are an order of magnitude too high, similar to the result in the base isothermal MHD run. Outflows disrupt the accretion flow around the protostar, allowing gas to fragment and additional stars to form, thereby lowering the mean stellar mass to a value similar to that observed. The effect of jets upon global cloud evolution is most pronounced for lower-mass GMCs and dense clumps, so while jets can disrupt low-mass clouds, they are unable to regulate star formation in massive GMCs, as they would turn an order unity fraction of the mass into stars before unbinding the cloud. Jets are also unable to stop the runaway accretion of massive stars, which could ultimately lead to the formation of stars with masses $\mathrm{>500\,M_\odot}$. Although we find that the mass scale set by jets is insensitive to most cloud parameters (i.e., surface density, virial parameter), it is strongly dependent on the momentum loading of the jets (which is poorly constrained by observations) as well the the temperature of the parent cloud, which predicts slightly larger IMF variations than observed. We conclude that protostellar jets play a vital role in setting the mass scale of stars, but additional physics are necessary to reproduce the observed IMF.


title: Geometric Optimization of a Neutron Detector for In-Flight Measurement of the Neutron Lifetime

abstract: The recent measurement of the lifetime of the free neutron using the beam method has an 8.7 s (4$\sigma$) discrepancy with UCN measurements. The goal of the BL3 experiment is to improve the statistical error of this measurement and help rule out systematic uncertainties as an explanation for the discrepancy. A well-characterized neutron flux detector with flat response is essential, since the neutron flux enters linearly into the neutron lifetime. I will present a new detector geometry optimization with uniform acceptance up to sixth order in neutron position.


title: Learning Quadrupedal Locomotion over Challenging Terrain

abstract: Some of the most challenging environments on our planet are accessible to quadrupedal animals but remain out of reach for autonomous machines. Legged locomotion can dramatically expand the operational domains of robotics. However, conventional controllers for legged locomotion are based on elaborate state machines that explicitly trigger the execution of motion primitives and reflexes. These designs have escalated in complexity while falling short of the generality and robustness of animal locomotion. Here we present a radically robust controller for legged locomotion in challenging natural environments. We present a novel solution to incorporating proprioceptive feedback in locomotion control and demonstrate remarkable zero-shot generalization from simulation to natural environments. The controller is trained by reinforcement learning in simulation. It is based on a neural network that acts on a stream of proprioceptive signals. The trained controller has taken two generations of quadrupedal ANYmal robots to a variety of natural environments that are beyond the reach of prior published work in legged locomotion. The controller retains its robustness under conditions that have never been encountered during training: deformable terrain such as mud and snow, dynamic footholds such as rubble, and overground impediments such as thick vegetation and gushing water. The presented work opens new frontiers for robotics and indicates that radical robustness in natural environments can be achieved by training in much simpler domains.


title: On Adaptive Distance Estimation

abstract: We provide a static data structure for distance estimation which supports {\it adaptive} queries. Concretely, given a dataset $X = \{x_i\}_{i = 1}^n$ of $n$ points in $\mathbb{R}^d$ and $0 < p \leq 2$, we construct a randomized data structure with low memory consumption and query time which, when later given any query point $q \in \mathbb{R}^d$, outputs a $(1+\epsilon)$-approximation of $\lVert q - x_i \rVert_p$ with high probability for all $i\in[n]$. The main novelty is our data structure's correctness guarantee holds even when the sequence of queries can be chosen adaptively: an adversary is allowed to choose the $j$th query point $q_j$ in a way that depends on the answers reported by the data structure for $q_1,\ldots,q_{j-1}$. Previous randomized Monte Carlo methods do not provide error guarantees in the setting of adaptively chosen queries. Our memory consumption is $\tilde O((n+d)d/\epsilon^2)$, slightly more than the $O(nd)$ required to store $X$ in memory explicitly, but with the benefit that our time to answer queries is only $\tilde O(\epsilon^{-2}(n + d))$, much faster than the naive $\Theta(nd)$ time obtained from a linear scan in the case of $n$ and $d$ very large. Here $\tilde O$ hides $\log(nd/\epsilon)$ factors. We discuss applications to nearest neighbor search and nonparametric estimation. Our method is simple and likely to be applicable to other domains: we describe a generic approach for transforming randomized Monte Carlo data structures which do not support adaptive queries to ones that do, and show that for the problem at hand, it can be applied to standard nonadaptive solutions to $\ell_p$ norm estimation with negligible overhead in query time and a factor $d$ overhead in memory.


title: Clustering-based Inference for Biomedical Entity Linking

abstract: Due to large number of entities in biomedical knowledge bases, only a small fraction of entities have corresponding labelled training data. This necessitates entity linking models which are able to link mentions of unseen entities using learned representations of entities. Previous approaches link each mention independently, ignoring the relationships within and across documents between the entity mentions. These relations can be very useful for linking mentions in biomedical text where linking decisions are often difficult due mentions having a generic or a highly specialized form. In this paper, we introduce a model in which linking decisions can be made not merely by linking to a knowledge base entity but also by grouping multiple mentions together via clustering and jointly making linking predictions. In experiments on the largest publicly available biomedical dataset, we improve the best independent prediction for entity linking by 3.0 points of accuracy, and our clustering-based inference model further improves entity linking by 2.3 points.


title: STARFORGE: Toward a comprehensive numerical model of star cluster formation and feedback

abstract: We present STARFORGE (STAR FORmation in Gaseous Environments): a new numerical framework for 3D radiation MHD simulations of star formation that simultaneously follow the formation, accretion, evolution, and dynamics of individual stars in massive giant molecular clouds (GMCs) while accounting for stellar feedback, including jets, radiative heating and momentum, stellar winds, and supernovae. We use the GIZMO code with the MFM mesh-free Lagrangian MHD method, augmented with new algorithms for gravity, timestepping, sink particle formation and accretion, stellar dynamics, and feedback coupling. We survey a wide range of numerical parameters/prescriptions for sink formation and accretion and find very small variations in star formation history and the IMF (except for intentionally-unphysical variations). Modules for mass-injecting feedback (winds, SNe, and jets) inject new gas elements on-the-fly, eliminating the lack of resolution in diffuse feedback cavities otherwise inherent in Lagrangian methods. The treatment of radiation uses GIZMO's radiative transfer solver to track 5 frequency bands (IR, optical, NUV, FUV, ionizing), coupling direct stellar emission and dust emission with gas heating and radiation pressure terms. We demonstrate accurate solutions for SNe, winds, and radiation in problems with known similarity solutions, and show that our jet module is robust to resolution and numerical details, and agrees well with previous AMR simulations. STARFORGE can scale up to massive ($>10^5 M_\odot $) GMCs on current supercomputers while predicting the stellar ($\gtrsim 0.1 M_\odot$) range of the IMF, permitting simulations of both high- and low-mass cluster formation in a wide range of conditions.


title: The IDLAB VoxSRC-20 Submission: Large Margin Fine-Tuning and Quality-Aware Score Calibration in DNN Based Speaker Verification

abstract: In this paper we propose and analyse a large margin fine-tuning strategy and a quality-aware score calibration in text-independent speaker verification. Large margin fine-tuning is a secondary training stage for DNN based speaker verification systems trained with margin-based loss functions. It enables the network to create more robust speaker embeddings by enabling the use of longer training utterances in combination with a more aggressive margin penalty. Score calibration is a common practice in speaker verification systems to map output scores to well-calibrated log-likelihood-ratios, which can be converted to interpretable probabilities. By including quality features in the calibration system, the decision thresholds of the evaluation metrics become quality-dependent and more consistent across varying trial conditions. Applying both enhancements on the ECAPA-TDNN architecture leads to state-of-the-art results on all publicly available VoxCeleb1 test sets and contributed to our winning submissions in the supervised verification tracks of the VoxCeleb Speaker Recognition Challenge 2020.


title: David extension of circle homeomorphisms, welding, mating, and removability

abstract: We provide a David extension result for circle homeomorphisms conjugating two dynamical systems such that parabolic periodic points go to parabolic periodic points, but hyperbolic points can go to parabolics as well. We use this result, in particular, to prove the existence of a new class of welding homeomorphisms, to establish an explicit dynamical connection between critically fixed anti-rational maps and kissing reflection groups, to show conformal removability of the Julia sets of geometrically finite polynomials and of the limit sets of necklace reflection groups, to produce matings of anti-polynomials and necklace reflection groups, and to give a new proof of the existence of Suffridge polynomials (extremal points in certain spaces of univalent maps).


title: Nanoscale Dynamic Readout of a Chemical Redox Process Using Radicals Coupled with Nitrogen-Vacancy Centers in Nanodiamonds

abstract: Biocompatible nanoscale probes for sensitive detection of paramagnetic species and molecules associated with their (bio)chemical transformations would provide a desirable tool for a better understanding of cellular redox processes. Here, we describe an analytical tool based on quantum sensing techniques. We magnetically coupled negatively charged nitrogen-vacancy (NV) centers in nanodiamonds (NDs) with nitroxide radicals present in a bioinert polymer coating of the NDs. We demonstrated that the T1 spin relaxation time of NV centers is very sensitive to the number of nitroxide radicals, with a resolution down to ~10 spins per ND (detection of approximately $ 10^-23 $ mol in a localized volume). The detection is based on T1 shortening upon the radical attachment and we propose a theoretical model describing this phenomenon. We further show this colloidally stable, water-soluble system can be used dynamically for spatiotemporal readout of a redox chemical process (oxidation of ascorbic acid) occurring near the ND surface in an aqueous environment under ambient conditions.


title: Development of a $^{83\mathrm{m}}$Kr source for the calibration of the CENNS-10 Liquid Argon Detector

abstract: We report on the preparation of and calibration measurements with a $^{83\mathrm{m}}$Kr source for the CENNS-10 liquid argon detector. $^{83\mathrm{m}}$Kr atoms generated in the decay of a $^{83}$Rb source were introduced into the detector via injection into the Ar circulation loop. Scintillation light arising from the 9.4 keV and 32.1 keV conversion electrons in the decay of $^{83\mathrm{m}}$Kr in the detector volume were then observed. This calibration source allows the characterization of the low-energy response of the CENNS-10 detector and is applicable to other low-energy-threshold detectors. The energy resolution of the detector was measured to be 9$\%$ at the total $^{83\mathrm{m}}$Kr decay energy of 41.5 keV. We performed an analysis to separately calibrate the detector using the two conversion electrons at 9.4 keV and 32.1 keV


title: Electromagnetic Emission from a Binary Black Hole Merger Remnant in Plasma: Field Alignment and Plasma Temperature

abstract: Comparable-mass black-hole mergers generically result in moderate to highly spinning holes, whose spacetime curvature will significantly affect nearby matter in observable ways. We investigate how the moderate spin of a post-merger Kerr black hole immersed in a plasma with initially uniform density and uniform magnetic field affects potentially observable accretion rates and energy fluxes. Varying the initial specific internal energy of the plasma over two decades, we find very little change in steady-state mass accretion rate or Poynting luminosity, except at the lowest internal energies, where fluxes do not exhibit steady-state behavior during the simulation timescale. Fixing the internal energy and varying the initial fixed magnetic-field amplitude and orientation, we find that the steady-state Poynting luminosity depends strongly on the initial field angle with respect to the black hole spin axis, while the matter accretion rate is more stable until the field angle exceeds $\sim 45\degree$. The proto-jet formed along the black hole spin-axis conforms to a thin, elongated cylinder near the hole, while aligning with the asymptotic magnetic field at large distances.


title: Geodesic networks in Liouville quantum gravity surfaces

abstract: Recent work has shown that for $\gamma \in (0,2)$, a Liouville quantum gravity (LQG) surface can be endowed with a canonical metric. We prove several results concerning geodesics for this metric. In particular, we completely classify the possible networks of geodesics from a typical point on the surface to an arbitrary point on the surface, as well as the types of networks of geodesics joining two points which occur for a dense set of pairs of points on the surface. This latter result is the $\gamma$-LQG analog of the classification of geodesic networks in the Brownian map due to Angel, Kolesnik, and Miermont (2017). We also show that there is a deterministic $m\in\mathbb N$ such that almost surely any two points are joined by at most $m$ distinct LQG geodesics.


title: Quantifying Uncertainties in Estimates of Income and Wealth Inequality

abstract: I measure the uncertainty affecting estimates of economic inequality in the US and investigate how accounting for properly estimated standard errors can affect the results of empirical and structural macroeconomic studies. In my analysis, I rely upon two data sets: the Survey of Consumer Finances (SCF), which is a triennial survey of household financial condition, and the Individual Tax Model Public Use File (PUF), an annual sample of individual income tax returns. While focusing on the six income and wealth shares of the top 10 to the top 0.01 percent between 1988 and 2018, my results suggest that ignoring uncertainties in estimated wealth and income shares can lead to erroneous conclusions about the current state of the economy and, therefore, lead to inaccurate predictions and ineffective policy recommendations. My analysis suggests that for the six top-decile income shares under consideration, the PUF estimates are considerably better than those constructed using the SCF; for wealth shares of the top 10 to the top 0.5 percent, the SCF estimates appear to be more reliable than the PUF estimates; finally, for the two most granular wealth shares, the top 0.1 and 0.01 percent, both data sets present non-trivial challenges that cannot be readily addressed.


title: On the numerical solution to an inverse medium problem

abstract: This paper is concerned with the inverse medium problem of determining the location and shape of penetrable scattering objects from measurements of the scattered field. We study a sampling indicator function for recovering the scattering object in a fast and robust way. A flexibility of this indicator function is that it is applicable to data measured in near-field regime or far-field regime. The implementation of the function is simple and does not involve solving any ill-posed problems. The resolution analysis and stability estimate of the indicator function are investigated using the factorization analysis of the far-field operator along with the Funk-Hecke formula. The performance of the method is verified on both simulated and experimental data.


title: A P4 Data Plane for the Quantum Internet

abstract: The quantum technology revolution brings with it the promise of a quantum internet. A new -- quantum -- network stack will be needed to account for the fundamentally new properties of quantum entanglement. The first realisations of quantum networks are imminent and research interest in quantum network protocols has started growing. In the non-quantum world, programmable data planes have broken the pattern of ossification of the protocol stack and enabled a new -- software-defined -- network software architecture. Similarly, a programmable quantum data plane could pave the way for a software-defined quantum network architecture. In this paper, we demonstrate how we use P4$_{16}$ to explore abstractions and device architectures for quantum networks.


title: An Efficient Real-Time NMPC for Quadrotor Position Control under Communication Time-Delay

abstract: The advances in computer processor technology have enabled the application of nonlinear model predictive control (NMPC) to agile systems, such as quadrotors. These systems are characterized by their underactuation, nonlinearities, bounded inputs, and time-delays. Classical control solutions fall short in overcoming these difficulties and fully exploiting the capabilities offered by such platforms. This paper presents the design and implementation of an efficient position controller for quadrotors based on real-time NMPC with time-delay compensation and bounds enforcement on the actuators. To deal with the limited computational resources onboard, an offboard control architecture is proposed. It is implemented using the high-performance software package acados, which solves optimal control problems and implements a real-time iteration (RTI) variant of a sequential quadratic programming (SQP) scheme with Gauss-Newton Hessian approximation. The quadratic subproblems (QP) in the SQP scheme are solved with HPIPM, an interior-point method solver, built on top of the linear algebra library BLASFEO, finely tuned for multiple CPU architectures. Solution times are further reduced by reformulating the QPs using the efficient partial condensing algorithm implemented in HPIPM. We demonstrate the capabilities of our architecture using the Crazyflie 2.1 nano-quadrotor.


title: Sobolev training of thermodynamic-informed neural networks for smoothed elasto-plasticity models with level set hardening

abstract: We introduce a deep learning framework designed to train smoothed elastoplasticity models with interpretable components, such as a smoothed stored elastic energy function, a yield surface, and a plastic flow that are evolved based on a set of deep neural network predictions. By recasting the yield function as an evolving level set, we introduce a machine learning approach to predict the solutions of the Hamilton-Jacobi equation that governs the hardening mechanism. This machine learning hardening law may recover classical hardening models and discover new mechanisms that are otherwise very difficult to anticipate and hand-craft. This treatment enables us to use supervised machine learning to generate models that are thermodynamically consistent, interpretable, but also exhibit excellent learning capacity. Using a 3D FFT solver to create a polycrystal database, numerical experiments are conducted and the implementations of each component of the models are individually verified. Our numerical experiments reveal that this new approach provides more robust and accurate forward predictions of cyclic stress paths than these obtained from black-box deep neural network models such as a recurrent GRU neural network, a 1D convolutional neural network, and a multi-step feedforward model.


title: Convex Polytope Trees

abstract: A decision tree is commonly restricted to use a single hyperplane to split the covariate space at each of its internal nodes. It often requires a large number of nodes to achieve high accuracy, hurting its interpretability. In this paper, we propose convex polytope trees (CPT) to expand the family of decision trees by an interpretable generalization of their decision boundary. The splitting function at each node of CPT is based on the logical disjunction of a community of differently weighted probabilistic linear decision-makers, which also geometrically corresponds to a convex polytope in the covariate space. We use a nonparametric Bayesian prior at each node to infer the community's size, encouraging simpler decision boundaries by shrinking the number of polytope facets. We develop a greedy method to efficiently construct CPT and scalable end-to-end training algorithms for the tree parameters when the tree structure is given. We empirically demonstrate the efficiency of CPT over existing state-of-the-art decision trees in several real-world classification and regression tasks from diverse domains.


title: MicroNets: Neural Network Architectures for Deploying TinyML Applications on Commodity Microcontrollers

abstract: Executing machine learning workloads locally on resource constrained microcontrollers (MCUs) promises to drastically expand the application space of IoT. However, so-called TinyML presents severe technical challenges, as deep neural network inference demands a large compute and memory budget. To address this challenge, neural architecture search (NAS) promises to help design accurate ML models that meet the tight MCU memory, latency and energy constraints. A key component of NAS algorithms is their latency/energy model, i.e., the mapping from a given neural network architecture to its inference latency/energy on an MCU. In this paper, we observe an intriguing property of NAS search spaces for MCU model design: on average, model latency varies linearly with model operation (op) count under a uniform prior over models in the search space. Exploiting this insight, we employ differentiable NAS (DNAS) to search for models with low memory usage and low op count, where op count is treated as a viable proxy to latency. Experimental results validate our methodology, yielding our MicroNet models, which we deploy on MCUs using Tensorflow Lite Micro, a standard open-source NN inference runtime widely used in the TinyML community. MicroNets demonstrate state-of-the-art results for all three TinyMLperf industry-standard benchmark tasks: visual wake words, audio keyword spotting, and anomaly detection. Models and training scripts can be found at github.com/ARM-software/ML-zoo.


title: Geometric approach to inhomogeneous Floquet systems

abstract: We present a new geometric approach to Floquet many-body systems described by inhomogeneous conformal field theory in 1+1 dimensions. It is based on an exact correspondence with dynamical systems on the circle that we establish and use to prove existence of (non)heating phases characterized by the (absence) presence of fixed or higher-periodic points of coordinate transformations encoding the time evolution: Heating corresponds to energy and excitations concentrating exponentially fast at unstable such points while nonheating to pseudoperiodic motion. We show that the heating rate (serving as the order parameter for transitions between these two) can have cusps, even within the overall heating phase, and that there is a rich structure of phase diagrams with different heating phases distinguishable through kinks in the entanglement entropy, reminiscent of Lifshitz phase transitions. Our geometric approach generalizes previous results for a subfamily of similar systems that used only the $\mathfrak{sl}(2)$ algebra to general smooth deformations that require the full infinite-dimensional Virasoro algebra, and we argue that it has wider applicability, even beyond conformal field theory.

categories: cond-mat.stat-mech cond-mat.quant-gas hep-th math-ph math.MP


title: Deep-Reinforcement-Learning-Based Scheduling with Contiguous Resource Allocation for Next-Generation Cellular Systems

abstract: Scheduling plays a pivotal role in multi-user wireless communications, since the quality of service of various users largely depends upon the allocated radio resources. In this paper, we propose a novel scheduling algorithm with contiguous frequency-domain resource allocation (FDRA) based on deep reinforcement learning (DRL) that jointly selects users and allocates resource blocks (RBs). The scheduling problem is modeled as a Markov decision process, and a DRL agent determines which user and how many consecutive RBs for that user should be scheduled at each RB allocation step. The state space, action space, and reward function are delicately designed to train the DRL network. More specifically, the originally quasi-continuous action space, which is inherent to contiguous FDRA, is refined into a finite and discrete action space to obtain a trade-off between the inference latency and system performance. Simulation results show that the proposed DRL-based scheduling algorithm outperforms other representative baseline schemes while having lower online computational complexity.


title: Learning second order coupled differential equations that are subject to non-conservative forces

abstract: In this article we address the question whether it is possible to learn the differential equations describing the physical properties of a dynamical system, subject to non-conservative forces, from observations of its realspace trajectory(ies) only. We introduce a network that incorporates a difference approximation for the second order derivative in terms of residual connections between convolutional blocks, whose shared weights represent the coefficients of a second order ordinary differential equation. We further combine this solver-like architecture with a convolutional network, capable of learning the relation between trajectories of coupled oscillators and therefore allows us to make a stable forecast even if the system is only partially observed. We optimize this map together with the solver network, while sharing their weights, to form a powerful framework capable of learning the complex physical properties of a dissipative dynamical system.


title: Robustness-aware 2-bit quantization with real-time performance for neural network

abstract: Quantized neural network (NN) with a reduced bit precision is an effective solution to reduces the computational and memory resource requirements and plays a vital role in machine learning. However, it is still challenging to avoid the significant accuracy degradation due to its numerical approximation and lower redundancy. In this paper, a novel robustness-aware 2-bit quantization scheme is proposed for NN base on binary NN and generative adversarial network(GAN), witch improves the performance by enriching the information of binary NN, efficiently extract the structural information and considering the robustness of the quantized NN. Specifically, using shift addition operation to replace the multiply-accumulate in the quantization process witch can effectively speed the NN. Meanwhile, a structural loss between the original NN and quantized NN is proposed to such that the structural information of data is preserved after quantization. The structural information learned from NN not only plays an important role in improving the performance but also allows for further fine tuning of the quantization network by applying the Lipschitz constraint to the structural loss. In addition, we also for the first time take the robustness of the quantized NN into consideration and propose a non-sensitive perturbation loss function by introducing an extraneous term of spectral norm. The experiments are conducted on CIFAR-10 and ImageNet datasets with popular NN( such as MoblieNetV2, SqueezeNet, ResNet20, etc). The experimental results show that the proposed algorithm is more competitive under 2-bit-precision than the state-of-the-art quantization methods. Meanwhile, the experimental results also demonstrate that the proposed method is robust under the FGSM adversarial samples attack.


title: Predicting Chemical Properties using Self-Attention Multi-task Learning based on SMILES Representation

abstract: In the computational prediction of chemical compound properties, molecular descriptors and fingerprints encoded to low dimensional vectors are used. The selection of proper molecular descriptors and fingerprints is both important and challenging as the performance of such models is highly dependent on descriptors. To overcome this challenge, natural language processing models that utilize simplified molecular input line-entry system as input were studied, and several transformer-variant models achieved superior results when compared with conventional methods. In this study, we explored the structural differences of the transformer-variant model and proposed a new self-attention based model. The representation learning performance of the self-attention module was evaluated in a multi-task learning environment using imbalanced chemical datasets. The experiment results showed that our model achieved competitive outcomes on several benchmark datasets. The source code of our experiment is available at https://github.com/arwhirang/sa-mtl and the dataset is available from the same URL.


title: The Need for Standardized Explainability

abstract: Explainable AI (XAI) is paramount in industry-grade AI; however existing methods fail to address this necessity, in part due to a lack of standardisation of explainability methods. The purpose of this paper is to offer a perspective on the current state of the area of explainability, and to provide novel definitions for Explainability and Interpretability to begin standardising this area of research. To do so, we provide an overview of the literature on explainability, and of the existing methods that are already implemented. Finally, we offer a tentative taxonomy of the different explainability methods, opening the door to future research.


title: A novel method of fuzzy time series forecasting based on interval index number and membership value using support vector machine

abstract: Fuzzy time series forecasting methods are very popular among researchers for predicting future values as they are not based on the strict assumptions of traditional time series forecasting methods. Non-stochastic methods of fuzzy time series forecasting are preferred by the researchers as they provide more significant forecasting results. There are generally, four factors that determine the performance of the forecasting method (1) number of intervals (NOIs) and length of intervals to partition universe of discourse (UOD) (2) fuzzification rules or feature representation of crisp time series (3) method of establishing fuzzy logic rule (FLRs) between input and target values (4) defuzzification rule to get crisp forecasted value. Considering the first two factors to improve the forecasting accuracy, we proposed a novel non-stochastic method fuzzy time series forecasting in which interval index number and membership value are used as input features to predict future value. We suggested a simple rounding-off range and suitable step size method to find the optimal number of intervals (NOIs) and used fuzzy c-means clustering process to divide UOD into intervals of unequal length. We implement support vector machine (SVM) to establish FLRs. To test our proposed method we conduct a simulated study on five widely used real time series and compare the performance with some recently developed models. We also examine the performance of the proposed model by using multi-layer perceptron (MLP) instead of SVM. Two performance measures RSME and SMAPE are used for performance analysis and observed better forecasting accuracy by the proposed model.


title: Determinant of $\mathbb F_p$-hypergeometric solutions under ample reduction

abstract: We consider the KZ differential equations over $\mathbb C$ in the case, when the hypergeometric solutions are one-dimensional integrals. We also consider the same differential equations over a finite field $\mathbb F_p$. We study the polynomial solutions of these differential equations over $\mathbb F_p$, constructed in a previous work joint with V.\,Schechtman and called the $\mathbb F_p$-hypergeometric solutions. The dimension of the space of $\mathbb F_p$-hypergeometric solutions depends on the prime number $p$. We say that the KZ equations have ample reduction for a prime $p$, if the dimension of the space of $\mathbb F_p$-hypergeometric solutions is maximal possible, that is, equal to the dimension of the space of solutions of the corresponding KZ equations over $\mathbb C$. Under the assumption of ample reduction, we prove a determinant formula for the matrix of coordinates of basis $\mathbb F_p$-hypergeometric solutions. The formula is analogous to the corresponding formula for the determinant of the matrix of coordinates of basis complex hypergeometric solutions, in which binomials $(z_i-z_j)^{M_i+M_j}$ are replaced with $(z_i-z_j)^{M_i+M_j-p}$ and the Euler gamma function $\Gamma(x)$ is replaced with a suitable $\mathbb F_p$-analog $\Gamma_{\mathbb F_p}(x)$ defined on $\mathbb F_p$.


title: Invertibility in Category Representations

abstract: Inverse categories are categories in which every morphism x has a unique pseudo-inverse y in the sense that xyx=x and yxy=y. Persistence modules from topological data analysis and similarly decomposable category representations factor through inverse categories. This paper gives a numerical condition, decidable when the indexing category is finite, characterizing when a representation of a small category factors through an inverse category.


title: An infinite-rank summand from iterated Mazur pattern satellite knots

abstract: We show there exists a topologically slice knot $K$ such that the knots $\{M^n(K)\}_{n=0}^\infty$ obtained by iterated satellite operations by the Mazur pattern span an infinite-rank summand of the smooth knot concordance group. This answers a question raised by Feller-Park-Ray.


title: Deep Surrogate Q-Learning for Autonomous Driving

abstract: Challenging problems of deep reinforcement learning systems with regard to the application on real systems are their adaptivity to changing environments and their efficiency w.r.t. computational resources and data. In the application of learning lane-change behavior for autonomous driving, agents have to deal with a varying number of surrounding vehicles. Furthermore, the number of required transitions imposes a bottleneck, since test drivers cannot perform an arbitrary amount of lane changes in the real world. In the off-policy setting, additional information on solving the task can be gained by observing actions from others. While in the classical RL setup this knowledge remains unused, we use other drivers as surrogates to learn the agent's value function more efficiently. We propose Surrogate Q-learning that deals with the aforementioned problems and reduces the required driving time drastically. We further propose an efficient implementation based on a permutation-equivariant deep neural network architecture of the Q-function to estimate action-values for a variable number of vehicles in sensor range. We show that the architecture leads to a novel replay sampling technique we call Scene-centric Experience Replay and evaluate the performance of Surrogate Q-learning and Scene-centric Experience Replay in the open traffic simulator SUMO. Additionally, we show that our methods enhance real-world applicability of RL systems by learning policies on the real highD dataset.


title: Non-existence of bi-infinite polymer Gibbs measures

abstract: We show that nontrivial bi-infinite polymer Gibbs measures do not exist in typical environments in the inverse-gamma (or log-gamma) directed polymer model on the planar square lattice. The precise technical result is that, except for measures supported on straight-line paths, such Gibbs measures do not exist in almost every environment when the weights are independent and identically distributed inverse-gamma random variables. The proof proceeds by showing that when two endpoints of a point-to-point polymer distribution are taken to infinity in opposite directions but not parallel to lattice directions, the midpoint of the polymer path escapes. The proof is based on couplings, planar comparison arguments, and a recently discovered joint distribution of Busemann functions.


title: Preliminary Target Selection for the DESI Quasar (QSO) Sample

abstract: The DESI survey will measure large-scale structure using quasars as direct tracers of dark matter in the redshift range $0.9<z<2.1$ and using quasar Ly-$\alpha$ forests at $z>2.1$. We present two methods to select candidate quasars for DESI based on imaging in three optical ($g, r, z$) and two infrared ($W1, W2$) bands. The first method uses traditional color cuts and the second utilizes a machine-learning algorithm.


title: Preliminary Target Selection for the DESI Emission Line Galaxy (ELG) Sample

abstract: DESI will precisely constrain cosmic expansion and the growth of structure by collecting $\sim$35 million redshifts across $\sim$80% of cosmic history and one third of the sky to study Baryon Acoustic Oscillations (BAO) and Redshift Space Distortions (RSD). We present a preliminary target selection for an Emission Line Galaxy (ELG) sample, which will comprise about half of all DESI tracers. The selection consists of a $g$-band magnitude cut and a $(g-r)$ vs. $(r-z)$ color box, which we validate using HSC/PDR2 photometric redshifts and DEEP2 spectroscopy. The ELG target density should be $\sim$2400 deg$^{-2}$, with $\sim$65% of ELG redshifts reliably within a redshift range of $0.6<z<1.6$. ELG targeting for DESI will be finalized during a `Survey Validation' phase.


title: Preliminary Target Selection for the DESI Luminous Red Galaxy (LRG) Sample

abstract: The DESI survey will observe more than 8 million candidate luminous red galaxies (LRGs) in the redshift range $0.3<z<1.0$. Here we present a preliminary version of the DESI LRG target selection developed using Legacy Surveys Data Release 8 $g$, $r$, $z$ and $W1$ photometry. This selection yields a sample with a uniform surface density of ${\sim}\,600$ deg$^{-2}$and very low predicted stellar contamination and redshift failure rates. During DESI Survey Validation, updated versions of this selection will be tested and optimized.


title: Preliminary Target Selection for the DESI Bright Galaxy Survey (BGS)

abstract: The Dark Energy Spectroscopic Instrument (DESI) will execute a nearly magnitude-limited survey of low redshift galaxies ($0.05 \leq z \leq 0.4$, median $z \approx 0.2$). Clustering analyses of this Bright Galaxy Survey (BGS) will yield the most precise measurements to date of baryon acoustic oscillations and redshift-space distortions at low redshift. DESI BGS will comprise two target classes: (i) BRIGHT ($r<19.5$~mag), and (ii) FAINT ($19.5<r<20$~mag). Here we present a summary of the star-galaxy separation, and different photometric and geometrical masks, used in BGS to reduce the number of spurious targets. The selection results in a total density of $\sim 800$ objects/deg$^2$ for the BRIGHT and $\sim 600$ objects/deg$^2$ for the FAINT selections.A full characterization of the BGS selection can be found in Ruiz-Macias et al. (2020).


title: Preliminary Target Selection for the DESI Milky Way Survey (MWS)

abstract: The DESI Milky Way Survey (MWS) will observe $\ge$8 million stars between $16 < r < 19$ mag, supplemented by observations of brighter targets under poor observing conditions. The survey will permit an accurate determination of stellar kinematics and population gradients; characterize diffuse substructure in the thick disk and stellar halo; enable the discovery of extremely metal-poor stars and other rare stellar types; and improve constraints on the Galaxy's 3D dark matter distribution from halo star kinematics. MWS will also enable a detailed characterization of the stellar populations within 100 pc of the Sun, including a complete census of white dwarfs. The target catalog from the preliminary selection described here is public.


title: Sequential Change Detection by Optimal Weighted $\ell_2$ Divergence

abstract: We present a new non-parametric statistic, called the weighed $\ell_2$ divergence, based on empirical distributions for sequential change detection. We start by constructing the weighed $\ell_2$ divergence as a fundamental building block for two-sample tests and change detection. The proposed statistic is proved to attain the optimal sample complexity in the offline setting. We then study the sequential change detection using the weighed $\ell_2$ divergence and characterize the fundamental performance metrics, including the average run length (ARL) and the expected detection delay (EDD). We also present practical algorithms to find the optimal projection to handle high-dimensional data and the optimal weights, which is critical to quick detection since, in such settings, there are not many post-change samples. Simulation results and real data examples are provided to validate the good performance of the proposed method.


title: Improving Audio Anomalies Recognition Using Temporal Convolutional Attention Network

abstract: Anomalous audio in speech recordings is often caused by speaker voice distortion, external noise, or even electric interferences. These obstacles have become a serious problem in some fields, such as high-quality music mixing and speech processing. In this paper, a novel approach using a temporal convolutional attention network (TCAN) is proposed to tackle this problem. The use of temporal conventional network (TCN) can capture long range patterns using a hierarchy of temporal convolutional filters. To enhance the ability to tackle audio anomalies in different acoustic conditions, an attention mechanism is used in TCN, where a self-attention block is added after each temporal convolutional layer. This aims to highlight the target related features and mitigate the interferences from irrelevant information. To evaluate the performance of the proposed model, audio recordings are collected from the TIMIT dataset, and are then changed by adding five different types of audio distortions: gaussian noise, magnitude drift, random dropout, reduction of temporal resolution, and time warping. Distortions are mixed at different signal-to-noise ratios (SNRs) (5dB, 10dB, 15dB, 20dB, 25dB, 30dB). The experimental results show that the use of proposed model can yield better classification performances than some strong baseline methods, such as the LSTM and TCN based models, by approximate 3$\sim$ 10\% relative improvements.


title: Balmer spectra and Drinfeld centers

abstract: The Balmer spectrum of a monoidal triangulated category is an important geometric construction which is closely related to the problem of classifying thick tensor ideals. We prove that the forgetful functor from the Drinfeld center of a finite tensor category ${\mathbf{C}}$ to ${\mathbf{C}}$ extends to a monoidal triangulated functor between their corresponding stable categories, and induces a continuous map between their Balmer spectra. We give conditions under which it is injective, surjective, or a homeomorphism. We apply this general theory to prove that Balmer spectra associated to finite-dimensional cosemisimple quasitriangular Hopf algebras (in particular, group algebras in characteristic dividing the order of the group) coincide with the Balmer spectra associated to their Drinfeld doubles, and that the thick ideals of both categories are in bijection. An analogous theorem is proven for certain Benson--Witherspoon smash coproduct Hopf algebras, which are not quasitriangular in general.


title: Euclid preparation: IX. EuclidEmulator2 -- Power spectrum emulation with massive neutrinos and self-consistent dark energy perturbations

abstract: We present a new, updated version of the EuclidEmulator (called EuclidEmulator2), a fast and accurate predictor for the nonlinear correction of the matter power spectrum. Percent-level accurate emulation is now supported in the eight-dimensional parameter space of $w_0w_a$CDM$+\sum m_\nu$models between redshift $z=0$ and $z=3$ for spatial scales within the range 0.01 $h$/Mpc $\leq k \leq$ 10 $h$/Mpc. In order to achieve this level of accuracy, we have had to improve the quality of the underlying N-body simulations used as training data: (1) we use self-consistent linear evolution of non-dark matter species such as massive neutrinos, photons, dark energy and the metric field, (2) we perform the simulations in the so-called N-body gauge, which allows one to interpret the results in the framework of general relativity, (3) we run over 250 high-resolution simulations with $3000^3$ particles in boxes of 1 (Gpc/$h$)${}^3$ volumes based on paired-and-fixed initial conditions and (4) we provide a resolution correction that can be applied to emulated results as a post-processing step in order to drastically reduce systematic biases on small scales due to residual resolution effects in the simulations. We find that the inclusion of the dynamical dark energy parameter $w_a$ significantly increases the complexity and expense of creating the emulator. The high fidelity of EuclidEmulator2 is tested in various comparisons against N-body simulations as well as alternative fast predictors like Halofit, HMCode and CosmicEmu. A blind test is successfully performed against the Euclid Flagship v2.0 simulation. Nonlinear correction factors emulated with EuclidEmulator2 are accurate at the level of 1% or better for 0.01 $h$/Mpc $\leq k \leq$ 10 $h$/Mpc and $z\leq3$ compared to high-resolution dark matter only simulations. EuclidEmulator2 is publicly available at https://github.com/miknab/EuclidEmulator2 .


title: Shedding Light on Blind Spots: Developing a Reference Architecture to Leverage Video Data for Process Mining

abstract: Process mining is one of the most active research streams in business process management. In recent years, numerous methods have been proposed for analyzing structured process data. Yet, in many cases, it is only the digitized parts of processes that are directly captured from process-aware information systems, and manual activities often result in blind spots. While the use of video cameras to observe these activities could help to fill this gap, a standardized approach to extracting event logs from unstructured video data remains lacking. Here, we propose a reference architecture to bridge the gap between computer vision and process mining. Various evaluation activities (i.e., competing artifact analysis, prototyping, and real-world application) ensured that the proposed reference architecture allows flexible, use-case-driven, and context-specific instantiations. Our results also show that an exemplary software prototype instantiation of the proposed reference architecture is capable of automatically extracting most of the process-relevant events from unstructured video data.


title: Unrolling of Deep Graph Total Variation for Image Denoising

abstract: While deep learning (DL) architectures like convolutional neural networks (CNNs) have enabled effective solutions in image denoising, in general their implementations overly rely on training data, lack interpretability, and require tuning of a large parameter set. In this paper, we combine classical graph signal filtering with deep feature learning into a competitive hybrid design -- one that utilizes interpretable analytical low-pass graph filters and employs 80% fewer network parameters than state-of-the-art DL denoising scheme DnCNN. Specifically, to construct a suitable similarity graph for graph spectral filtering, we first adopt a CNN to learn feature representations per pixel, and then compute feature distances to establish edge weights. Given a constructed graph, we next formulate a convex optimization problem for denoising using a graph total variation (GTV) prior. Via a $l_1$ graph Laplacian reformulation, we interpret its solution in an iterative procedure as a graph low-pass filter and derive its frequency response. For fast filter implementation, we realize this response using a Lanczos approximation. Experimental results show that in the case of statistical mistmatch, our algorithm outperformed DnCNN by up to 3dB in PSNR.


title: Chiral switching and dynamic barrier reductions in artificial square ice

abstract: Collective dynamics in lithographically-defined artificial spin ices offer profound insights into emergent correlations and phase transitions of geometrically-frustrated Ising spin systems. Their temporal and spatial evolution are often simulated using kinetic Monte Carlo simulations, which rely on the precise knowledge of the switching barriers to obtain predictive results in agreement with experimental observations. In many cases, however, the barriers are derived from simplified assumptions only, and do not take into account the full physical picture of nanomagnetic switching. Here we describe how the immediate magnetic environment of a nanomagnet reversing via quasi-coherent rotation can induce clockwise and counter-clockwise switching channels with different barrier energies. This barrier splitting for chiral reversal channels can be sizeable and, as string-method micromagnetic simulations show, is relevant for artificial spin ice systems made of both exchange -- as well as magnetostatically --dominated units. Due to the barrier splitting (and further reductions due to non-uniform reversal) transition rates can be exponentially enhanced by several orders of magnitude compared to mean-field predictions, especially in the limit of rare switching events where thermal excitation is less likely. This leads to significantly faster relaxation time scales and modified spatial correlations. Our findings are thus of integral importance to achieve realistic kinetic Monte Carlo simulations of emergent correlations in artificial spin systems, magnonic crystals, or the evolution of nanomagnetic logic circuits.


title: Decentralized optimization over noisy, rate-constrained networks: Achieving consensus by communicating differences

abstract: In decentralized optimization, multiple nodes in a network collaborate to minimize the sum of their local loss functions. The information exchange between nodes required for this task, is often limited by network connectivity. We consider a setting in which communication between nodes is hindered by both (i) a finite rate-constraint on the signal transmitted by any node, and (ii) additive noise corrupting the signal received by any node. We propose a novel algorithm for this scenario: Decentralized Lazy Mirror Descent with Differential Exchanges (DLMD-DiffEx), which guarantees convergence of the local estimates to the optimal solution under the given communication constraints. A salient feature of DLMD-DiffEx is the introduction of additional proxy variables that are maintained by the nodes to account for the disagreement in their estimates due to channel noise and rate-constraints. Convergence to the optimal solution is attained by having nodes iteratively exchange these disagreement terms until consensus is achieved. In order to prevent noise accumulation during this exchange, DLMD-DiffEx relies on two sequences; one controlling the power of the transmitted signal, and the other determining the consensus rate. We provide clear insights on the design of these two sequences which highlights the interplay between consensus rate and noise amplification. We investigate the performance of DLMD-DiffEx both from a theoretical perspective as well as through numerical evaluations.


title: On the obscure axiom for one-sided exact categories

abstract: One-sided exact categories are obtained via a weakening of a Quillen exact category. Such one-sided exact categories are homologically similar to Quillen exact categories: a one-sided exact category $\mathcal{E}$ can be (essentially uniquely) embedded into its exact hull ${\mathcal{E}}^{\textrm{ex}}$; this embedding induces a derived equivalence $\textbf{D}^b(\mathcal{E}) \to \textbf{D}^b({\mathcal{E}}^{\textrm{ex}})$. Whereas it is well known that Quillen's obscure axioms are redundant for exact categories, some one-sided exact categories are known to not satisfy the corresponding obscure axiom. In fact, we show that the failure of the obscure axiom is controlled by the embedding of $\mathcal{E}$ into its exact hull ${\mathcal{E}}^{\textrm{ex}}.$ In this paper, we introduce three versions of the obscure axiom (these versions coincide when the category is weakly idempotent complete) and establish equivalent homological properties, such as the snake lemma and the nine lemma. We show that a one-sided exact category admits a closure under each of these obscure axioms, each of which preserves the bounded derived category up to triangle equivalence.


title: SiO Outflows as Tracers of Massive Star Formation in Infrared Dark Clouds

abstract: To study the early phases of massive star formation, we present ALMA observations of SiO(5-4) emission and VLA observations of 6 cm continuum emission towards 32 Infrared Dark Cloud (IRDC) clumps, spatially resolved down to $\lesssim 0.05$ pc. Out of the 32 clumps, we detect SiO emission in 20 clumps, and in 11 of them the SiO emission is relatively strong and likely tracing protostellar outflows. Some SiO outflows are collimated, while others are less ordered. For the six strongest SiO outflows, we estimate basic outflow properties. In our entire sample, where there is SiO emission, we find 1.3 mm continuum and infrared emission nearby, but not vice versa. We build the spectral energy distributions (SEDs) of cores with 1.3 mm continuum emission and fit them with radiative transfer (RT) models. The low luminosities and stellar masses returned by SED fitting suggest these are early stage protostars. We see a slight trend of increasing SiO line luminosity with bolometric luminosity, which suggests more powerful shocks in the vicinity of more massive YSOs. We do not see a clear relation between the SiO luminosity and the evolutionary stage indicated by $L/M$. We conclude that as a protostar approaches a bolometric luminosity of $\sim 10^2 \: L_{\odot}$, the shocks in the outflow are generally strong enough to form SiO emission. The VLA 6 cm observations toward the 15 clumps with the strongest SiO emission detect emission in four clumps, which is likely shock ionized jets associated with the more massive ones of these protostellar cores.


title: Bidirectional Microrocker Bots Controlled via Neutral Position Offset

abstract: The recent advancements in nanoscale 3D printing and microfabrication techniques have reinvigorated research on microrobots. However, precise motion control of the microrobots on biological environments using compact actuation setups remains challenging to date. This work presents a novel control mechanism and contact design that enables bidirectional steering via biasing the neutral position of the microrobot. Equipped with rockers to contact the substrate, the microrobot, hence microrocker bot, is capable of well-controlled forward and backward movement on flat and non-flat biological surfaces. The 100um by 113um by 36um robots were 3D printed via two-photon lithography and subsequently deposited with nickel thin films. Under a relatively small static magnetic field, the microrocker bot tilts either forward or backward to align the thin film magnetization direction with the magnetic field lines. When combined with an oscillating magnetic field, the robot undergoes stick-slip motion in the predisposed direction, dictated by the neutral position tilt. The microrocker bots are further equipped with sharp mechanical tips that can be selectively engaged. When the frequency and offset of the actuation sawtooth waveform are optimized, the robot travels up to 100um/s (1 body length per second) forward and backward showing very linear trajectories. Finally, to prove the functionality of the microrocker bots in direct contact with biological surfaces, we demonstrate the robot's ability to traverse forward and backward on the surface of a Dracaena Fragrans leaf, and upend/engage on its mechanical tip.


title: System Design and Control of an Apple Harvesting Robot

abstract: There is a growing need for robotic apple harvesting due to decreasing availability and rising cost in labor. Towards the goal of developing a viable robotic system for apple harvesting, this paper presents synergistic mechatronic design and motion control of a robotic apple harvesting prototype, which lays a critical foundation for future advancements. Specifically, we develop a deep learning-based fruit detection and localization system using an RGB-D camera. A three degree-of-freedom manipulator is then designed with a hybrid pneumatic/motor actuation mechanism to achieve fast and dexterous movements. A vacuum-based end-effector is used for apple detaching. These three components are integrated into a robotic apple harvesting prototype with simplicity, compactness, and robustness. Moreover, a nonlinear velocity-based control scheme is developed for the manipulator to achieve accurate and agile motion control. Test experiments are conducted to demonstrate the performance of the developed apple harvesting robot.


title: Performance Prediction for Convolutional Neural Networks in Edge Devices

abstract: Running Convolutional Neural Network (CNN) based applications on edge devices near the source of data can meet the latency and privacy challenges. However due to their reduced computing resources and their energy constraints, these edge devices can hardly satisfy CNN needs in processing and data storage. For these platforms, choosing the CNN with the best trade-off between accuracy and execution time while respecting Hardware constraints is crucial. In this paper, we present and compare five (5) of the widely used Machine Learning based methods for execution time prediction of CNNs on two (2) edge GPU platforms. For these 5 methods, we also explore the time needed for their training and tuning their corresponding hyperparameters. Finally, we compare times to run the prediction models on different platforms. The utilization of these methods will highly facilitate design space exploration by providing quickly the best CNN on a target edge GPU. Experimental results show that eXtreme Gradient Boosting (XGBoost) provides a less than 14.73% average prediction error even for unexplored and unseen CNN models' architectures. Random Forest (RF) depicts comparable accuracy but needs more effort and time to be trained. The other 3 approaches (OLS, MLP and SVR) are less accurate for CNN performances estimation.


title: Impact of Size and Thermal Gradient on Supercooling of Phase Change Materials for Thermal Energy Storage

abstract: Phase change material based thermal energy storage has many current and potential applications in the heating and cooling of buildings, battery and electronics thermal management, thermal textiles, and dry cooling of power plants. However, connecting lab scale thermal data obtained on DSC to the performance of large-scale practical systems has been a major challenge primarily due to the dependence of supercooling on the size and temperature gradient of the system. In this work we show how a phase change material's supercooling behavior can be characterized experimentally using common lab scale thermal analysis techniques. We then develop a statistics based theoretical model that uses the lab scale data on small samples to quantitatively predict the supercooling performance for a general thermal energy storage application of any size with temperature gradients. Finally, we validate the modeling methodology by comparing to experimental results for solid-solid phase change in neopentyl glycol, which shows how the model successfully predicts the changes in supercooling temperature across a large range of cooling rates (2 orders of magnitude) and volumes (3 orders of magnitude). By accounting for thermal gradients, the model avoids ~2x error incurred by lumped approximations.


title: Searching signature of neutrino-nucleus coherent scattering with M\"ossbauer Spectroscopy

abstract: The M\"ossbauer spectroscopy is presented as an alternative experimental technique to be pursued in the detec-tion of Coherent Elastic{\nu}-Nucleus Scattering (CENNS). The neutrino transferred energy in the neutrino-nucleusinteraction causes a perturbation at the nuclear levels which are responsible for gamma radiation in M\"ossbauerresonance. The main characteristic of M\"ossbauer spectroscopy is the recoil less condition imposed on the nucleiimposed by quantum restrictions of the crystalline array potential. Coherent neutrino scattering is expected tooccurs low energy regime of the beam, typically below 30 MeV, at higher neutrino energies small incoherencecomponent appears in the scattering[30] as disturbances within the internal nuclear degrees of freedom. Inthis work we have shown that using anti neutrino reactor beam, with the accuracy of M\"ossbauer technique itspossible to obtain a measurable signature of the Coherent neutrino Scattering.


title: How Do Fair Decisions Fare in Long-term Qualification?

abstract: Although many fairness criteria have been proposed for decision making, their long-term impact on the well-being of a population remains unclear. In this work, we study the dynamics of population qualification and algorithmic decisions under a partially observed Markov decision problem setting. By characterizing the equilibrium of such dynamics, we analyze the long-term impact of static fairness constraints on the equality and improvement of group well-being. Our results show that static fairness constraints can either promote equality or exacerbate disparity depending on the driving factor of qualification transitions and the effect of sensitive attributes on feature distributions. We also consider possible interventions that can effectively improve group qualification or promote equality of group qualification. Our theoretical results and experiments on static real-world datasets with simulated dynamics show that our framework can be used to facilitate social science studies.


title: Clustered families and applications to Lang-type conjectures

abstract: We introduce and classify 1-clustered families of linear spaces in the Grassmannian $\mathbb{G}(k-1,n)$ and give applications to Lang-type conjectures. Let $X \subset \mathbb{P}^n$ be a very general hypersurface of degree $d$. Let $Z_L$ be the locus of points contained in a line of $X$. Let $Z_2$ be the locus of points on $X$ that are swept out by lines that meet $X$ in at most $2$ points. We prove that 1) If $d \geq \frac{3n+2}{2}$, then $X$ is algebraically hyperbolic outside $Z_L$. 2) If $d \geq \frac{3n}{2}$, $X$ contains lines but no other rational curves 3) If $d \geq \frac{3n+3}{2}$, then the only points on $X$ that are rationally Chow zero equivalent to points other than themselves are contained in $Z_2$. 4) If $d \geq \frac{3n+2}{2}$ and a relative Green-Griffiths-Lang Conjecture holds, then the exceptional locus for $X$ is contained in $Z_2$.


title: Frequency Response Study on the ERCOT under High Photovoltaic (PV) Penetration Conditions

abstract: Solar photovoltaic (PV) generation is growing rapidly around the world. However, PV generation, based on inverter, is fundamentally different from conventional synchronous generators. It is of vital importance to understand the impacts of increased penetration of PV generation on power system dynamic performance. This paper investigates frequency response of the Electric Reliability Council of Texas (ERCOT) with high PV penetration in the future year. In this work, a realistic baseline dynamic model is validated using synchrophasor measurements. Then, dynamic simulation is performed to evaluate the impacts of high PV generation on frequency response.


title: Reconciling EHT and Gas Dynamics Measurements in M87: Is the Jet Misaligned at Parsec Scales?

abstract: The Event Horizon Telescope mass estimate for M87* is consistent with the stellar dynamics mass estimate, and inconsistent with the gas dynamics mass estimates by up to $2\sigma$. We have previously explored a new gas dynamics model that incorporated sub-Keplerian gas velocities that could in principle explain the discrepancy in the stellar and gas dynamics mass estimate. In this paper, we extend this gas dynamical model to also include non-trivial disk heights, which may also resolve the mass discrepancy independent of sub-Keplerian velocity components. By combining the existing velocity measurements and the EHT mass estimate, we place constraints on the gas disk inclination and sub-Kelplerian fraction. These constraints require the parsec-scale ionized gas disk be misaligned with the milli-arcsecond radio jet by at least $11^{\circ}$, and more typically $27^{\circ}$. Modifications to the gas dynamics model either by introducing sub-Keplerian velocities or thick disks produces further misalignment with the radio jet. If the jet is produced in a Blandford-Znajek-type process, the angular momentum of the black hole is decoupled with the angular momentum of the large scale gas feeding M87*.


title: Document-Level Relation Extraction with Adaptive Thresholding and Localized Context Pooling

abstract: Document-level relation extraction (RE) poses new challenges compared to its sentence-level counterpart. One document commonly contains multiple entity pairs, and one entity pair occurs multiple times in the document associated with multiple possible relations. In this paper, we propose two novel techniques, adaptive thresholding and localized context pooling, to solve the multi-label and multi-entity problems. The adaptive thresholding replaces the global threshold for multi-label classification in the prior work with a learnable entities-dependent threshold. The localized context pooling directly transfers attention from pre-trained language models to locate relevant context that is useful to decide the relation. We experiment on three document-level RE benchmark datasets: DocRED, a recently released large-scale RE dataset, and two datasets CDRand GDA in the biomedical domain. Our ATLOP (Adaptive Thresholding and Localized cOntext Pooling) model achieves an F1 score of 63.4, and also significantly outperforms existing models on both CDR and GDA.


title: Mixed-Precision Embedding Using a Cache

abstract: In recommendation systems, practitioners observed that increase in the number of embedding tables and their sizes often leads to significant improvement in model performances. Given this and the business importance of these models to major internet companies, embedding tables for personalization tasks have grown to terabyte scale and continue to grow at a significant rate. Meanwhile, these large-scale models are often trained with GPUs where high-performance memory is a scarce resource, thus motivating numerous work on embedding table compression during training. We propose a novel change to embedding tables using a cache memory architecture, where the majority of rows in an embedding is trained in low precision, and the most frequently or recently accessed rows cached and trained in full precision. The proposed architectural change works in conjunction with standard precision reduction and computer arithmetic techniques such as quantization and stochastic rounding. For an open source deep learning recommendation model (DLRM) running with Criteo-Kaggle dataset, we achieve 3x memory reduction with INT8 precision embedding tables and full-precision cache whose size are 5% of the embedding tables, while maintaining accuracy. For an industrial scale model and dataset, we achieve even higher >7x memory reduction with INT4 precision and cache size 1% of embedding tables, while maintaining accuracy, and 16% end-to-end training speedup by reducing GPU-to-host data transfers.


title: Comprehensive Performance Analysis of Objective Quality Metrics for Digital Holography

abstract: Objective quality assessment of digital holograms has proven to be a challenging task. While prediction of perceptual quality of the recorded 3D content from the holographic wavefield is an open problem; perceptual quality assessment from content after rendering, requires a time-consuming rendering step and a multitude of possible viewports. In this research, we use 96 Fourier holograms of the recently released HoloDB database to evaluate the performance of well-known and state-of-the-art image quality metrics on digital holograms. We compare the reference holograms with their distorted versions: (i) before rendering on the real and imaginary parts of the quantized complex-wavefield, (ii) after converting Fourier to Fresnel holograms, (iii) after rendering, on the quantized amplitude of the reconstructed data, and (iv) after subsequently removing speckle noise using a Wiener filter. For every experimental track, the quality metric predictions are compared to the Mean Opinion Scores (MOS) gathered on a 2D screen, light field display and a holographic display. Additionally, a statistical analysis of the results and a discussion on the performance of the metrics are presented. The tests demonstrate that while for each test track a few quality metrics present a highly correlated performance compared to the multiple sets of available MOS, none of them demonstrates a consistently high-performance across all four test-tracks.


title: Speculative Container Scheduling for Deep Learning Applications in a Kubernetes Cluster

abstract: In the past decade, we have witnessed a dramatically increasing volume of data collected from varied sources. The explosion of data has transformed the world as more information is available for collection and analysis than ever before. To maximize the utilization, various machine and deep learning models have been developed, e.g. CNN [1] and RNN [2], to study data and extract valuable information from different perspectives. While data-driven applications improve countless products, training models for hyperparameter tuning is still a time-consuming and resource-intensive process. Cloud computing provides infrastructure support for the training of deep learning applications. The cloud service providers, such as Amazon Web Services [3], create an isolated virtual environment (virtual machines and containers) for clients, who share physical resources, e.g., CPU and memory. On the cloud, resource management schemes are implemented to enable better sharing among users and boost the system-wide performance. However, general scheduling approaches, such as spread priority and balanced resource schedulers, do not work well with deep learning workloads. In this project, we propose SpeCon, a novel container scheduler that is optimized for shortlived deep learning applications. Based on virtualized containers, such as Kubernetes [4] and Docker [5], SpeCon analyzes the common characteristics of training processes. We design a suite of algorithms to monitor the progress of the training and speculatively migrate the slow-growing models to release resources for fast-growing ones. Specifically, the extensive experiments demonstrate that SpeCon improves the completion time of an individual job by up to 41.5%, 14.8% system-wide and 24.7% in terms of makespan.


title: Three-dimensional non-Abelian generalizations of the Hofstadter model: spin-orbit-coupled butterfly trios

abstract: We theoretically introduce and study a three-dimensional Hofstadter model with linearly varying non-Abelian gauge potentials along all three dimensions. The model can be interpreted as spin-orbit coupling among a trio of Hofstadter butterfly pairs since each Cartesian surface ($xy$, $yz$, or $zx$) of the model reduces to a two-dimensional non-Abelian Hofstadter problem. By evaluating the commutativity among arbitrary loop operators around all axes, we derive its genuine (necessary and sufficient) non-Abelian condition, namely, at least two out of the three hopping phases should be neither 0 nor $\pi$. Under different choices of gauge fields in either the Abelian or the non-Abelian regime, both weak and strong topological insulating phases are identified in the model.


title: Conversion Gain Enhancement in Standard CMOS Image Sensors

abstract: This paper focuses on the conversion gain (CG) of pixels implementing pinned photo-diodes (PPD) and in-pixel voltage follower in standard CMOS image sensor (CIS) process. An overview of the CG expression and its impact on the noise performance of the CIS readout chain is presented. CG enhancement techniques involving process refinements and pure circuit design and pixel scheme optimization are introduced. The implementation of these techniques in a 180 nm CIS process demonstrates a progressive enhancement of the CG by more than a factor 3 with respect to a standard reference pixel from the same foundry, allowing a better understanding of the different parasitic elements on the sense node capacitance and CG.


title: Uncertainty-Aware Deep Ensembles for Reliable and Explainable Predictions of Clinical Time Series

abstract: Deep learning-based support systems have demonstrated encouraging results in numerous clinical applications involving the processing of time series data. While such systems often are very accurate, they have no inherent mechanism for explaining what influenced the predictions, which is critical for clinical tasks. However, existing explainability techniques lack an important component for trustworthy and reliable decision support, namely a notion of uncertainty. In this paper, we address this lack of uncertainty by proposing a deep ensemble approach where a collection of DNNs are trained independently. A measure of uncertainty in the relevance scores is computed by taking the standard deviation across the relevance scores produced by each model in the ensemble, which in turn is used to make the explanations more reliable. The class activation mapping method is used to assign a relevance score for each time step in the time series. Results demonstrate that the proposed ensemble is more accurate in locating relevant time steps and is more consistent across random initializations, thus making the model more trustworthy. The proposed methodology paves the way for constructing trustworthy and dependable support systems for processing clinical time series for healthcare related tasks.


title: Sums of Squares and Sparse Semidefinite Programming

abstract: We consider two seemingly unrelated questions: the relationship between nonnegative polynomials and sums of squares on real varieties, and sparse semidefinite programming. This connection is natural when a real variety $X$ is defined by a quadratic square-free monomial ideal. In this case nonnegative polynomials and sums of squares on $X$ are also natural objects in positive semidefinite matrix completion. Nonnegative quadratic forms over $X$ naturally correspond to partially specified matrices where all of the fully specified square blocks are PSD, and sums of squares quadratic forms naturally correspond to partially specified matrices which can be completed to a PSD matrix. We show quantitative results on approximation of nonnegative polynomials by sums of squares, which leads to applications in sparse semidefinite programming.


title: Oscillations of 2D ESTER models. I. The adiabatic case

abstract: Recent numerical and theoretical considerations have shown that low-degree acoustic modes in rapidly rotating stars follow an asymptotic formula and recent observations of pulsations in rapidly rotating delta Scuti stars seem to match these expectations. However, a key question is whether strong gradients or discontinuities can adversely affect this pattern to the point of hindering its identification. Other important questions are how rotational splittings are affected by the 2D rotation profiles expected from baroclinic effects and whether it is possible to probe the rotation profile using these splittings. Accordingly, we numerically calculate pulsation modes in continuous and discontinuous rapidly rotating models produced by the 2D ESTER (Evolution STEllaire en Rotation) code. This spectral multi-domain code self-consistently calculates the rotation profile based on baroclinic effects and allows us to introduce discontinuities without loss of numerical accuracy. Pulsations are calculated using an adiabatic version of the Two-dimensional Oscillation Program (TOP) code. The variational principle is used to confirm the high accuracy of the pulsation frequencies and to derive an integral formula that closely matches the generalised rotational splittings, except when modes are involved in avoided crossings. This potentially allows us to probe the the rotation profile using inverse theory. Acoustic glitch theory, applied along the island mode orbit deduced from ray dynamics, can correctly predict the periodicity of the glitch frequency pattern produced by a discontinuity or the Gamma1 dip related to the He II ionisation zone in some of the models. The asymptotic frequency pattern remains sufficiently well preserved to potentially allow its detection in observed stars.


title: The CHAOS-7 geomagnetic field model and observed changes in the South Atlantic Anomaly

abstract: We present the CHAOS-7 model of the time-dependent near-Earth geomagnetic field between 1999 and 2020 based on magnetic field observations collected by the low-Earth orbit satellites {\it Swarm}, CryoSat-2, CHAMP, SAC-C and {\O}rsted, and on annual differences of monthly means of ground observatory measurements. The CHAOS-7 model consists of a time-dependent internal field up to spherical harmonic degree 20, a static internal field which merges to the LCS-1 lithospheric field model above degree 25, a model of the magnetospheric field and its induced counterpart, estimates of Euler angles describing the alignment of satellite vector magnetometers, and magnetometer calibration parameters for CryoSat-2. Only data from dark regions satisfying strict geomagnetic quiet-time criteria (including conditions on IMF $B_z$ and $B_y$ at all latitudes) were used in the field estimation. Model parameters were estimated using an iteratively-reweighted regularized least-squares procedure; regularization of the time-dependent internal field was relaxed at high spherical harmonic degree compared with previous versions of the CHAOS model. We use CHAOS-7 to investigate recent changes in the geomagnetic field, studying the evolution of the South Atlantic weak field anomaly and rapid field changes in the Pacific region since 2014. At Earth's surface a secondary minimum of the South Atlantic Anomaly is now evident to the south west of Africa. Green's functions relating the core-mantle boundary radial field to the surface intensity show this feature is connected with the movement and evolution of a reversed flux feature under South Africa. The continuing growth in size and weakening of the main anomaly is linked to the westward motion and gathering of reversed flux under South America.


title: General Procedure of Gauge Fixings and Ghosts

abstract: We revisit the general procedure of gauge fixings and ghosts based on BRST invariance principle. It is shown that when this is applied to the higher-derivative gauge fixings, it gives the correct structure of gauge fixings and ghosts including "third ghost", previously derived at one-loop level. This procedure is solely based on the symmetry principle and is valid at full order.


title: Collecting data with a mobile phone: Studies of mechanical laws such as energy and momentum conservation

abstract: We use videos taken with a mobile phone to study conservation of energy, conservation of momentum, and the work-energy theorem by analyzing the collision of a cue ball and the eight ball. A video of the full time sequence, starting from before the cue ball is struck until well after the collision, is recorded with a mobile phone. The video is imported into Origin (free to teachers and students taking a class) [OriginLab Corporation, Origin, Version 2020 (OriginLab Corporation, Northampton, MA, USA, 2020)], where the coordinates of the balls are digitized frame-by-frame using the free Video Extractor app. From these data, the velocities are determined as a function of time and used to determine the energy and momentum of each ball. The data suggest that the balls slip through part of their motion when rotating at an angular velocity different than the rolling angular velocity, so angular momentum and frictional torque must be considered. Such experiments require no specialized equipment other than a device to take a video, and the act of digitizing the data provides the student with visual reinforcement of the physics. Experimentation by students outside of campus can be fun for them and provides a useful alternative to classes when in-lab experiments are not practical. Use of a mobile phone in this way is generally applicable to any other mechanical phenomena that involve motion.


title: Automorphic Lie algebras and corresponding integrable systems

abstract: We study automorphic Lie algebras and their applications to integrable systems. Automorphic Lie algebras are a natural generalisation of celebrated Kac-Moody algebras to the case when the group of automorphisms is not cyclic. They are infinite dimensional and almost graded. We formulate the concept of a graded isomorphism and classify $sl(2,C)$ based automorphic Lie algebras corresponding to all finite reduction groups. We show that hierarchies of integrable systems, their Lax representations and master symmetries can be naturally formulated in terms of automorphic Lie algebras.


title: Full-Duplex and Dynamic-TDD: Pushing the Limits of Spectrum Reuse in Multi-Cell Communications

abstract: Although in cellular networks full-duplex and dynamic time-division duplexing promise increased spectrum efficiency, their potential is so far challenged by increased interference. While previous studies have shown that self-interference can be suppressed to a sufficient level, we show that the cross-link interference for both duplexing modes, especially from base station to base station, is the remaining challenge in multi-cell networks, restricting the uplink performance. Using beamforming techniques of low-complexity, we show that this interference can be mitigated, and that full-duplex and dynamic time-division duplexing can substantially increase the capacity of multi-cell networks. Our results suggest that if we can control the cross link interference in full-duplex, then we can almost double the multi cell network capacity as well as user throughput. Therefore, the techniques in this paper have the potentiality to enable a smooth introduction of full-duplex into cellular systems.


title: The Selberg Trace Formula IX: Contribution from the Conjugacy Classes (The Regular Case)

abstract: This paper initiates a study into the contribution to the trace provided by the conjugacy classes.


title: Impartial Achievement Games on Convex Geometries

abstract: We study a game where two players take turns selecting points of a convex geometry until the convex closure of the jointly selected points contains all the points of a given winning set. The winner of the game is the last player able to move. We develop a structure theory for these games and use it to determine the nim number for several classes of convex geometries, including one-dimensional affine geometries, vertex geometries of trees, and games with a winning set consisting of extreme points.


title: Serverless Containers -- rising viable approach to Scientific Workflows

abstract: Increasing popularity of the serverless computing approach has led to the emergence of new cloud infrastructures working in Container-as-a-Service (CaaS) model like AWS Fargate, Google Cloud Run, or Azure Container Instances. They introduce an innovative approach to running cloud containers where developers are freed from managing underlying resources. In this paper, we focus on evaluating capabilities of elastic containers and their usefulness for scientific computing in the scientific workflow paradigm using AWS Fargate and Google Cloud Run infrastructures. For experimental evaluation of our approach, we extended HyperFlow engine to support these CaaS platform, together with adapting four real-world scientific workflows composed of several dozen to over a hundred of tasks organized into a dependency graph. We used these workflows to create cost-performance benchmarks and flow execution plots, measuring delays, elasticity, and scalability. The experiments proved that serverless containers can be successfully applied for scientific workflows. Also, the results allow us to gain insights on specific advantages and limits of such platforms.


title: MRI Image Recovery using Damped Denoising Vector AMP

abstract: Motivated by image recovery in magnetic resonance imaging (MRI), we propose a new approach to solving linear inverse problems based on iteratively calling a deep neural-network, sometimes referred to as plug-and-play recovery. Our approach is based on the vector approximate message passing (VAMP) algorithm, which is known for mean-squared error (MSE)-optimal recovery under certain conditions. The forward operator in MRI, however, does not satisfy these conditions, and thus we design new damping and initialization schemes to help VAMP. The resulting DD-VAMP++ algorithm is shown to outperform existing algorithms in convergence speed and accuracy when recovering images from the fastMRI database for the practical case of Cartesian sampling.


title: Learning to Summarize Long Texts with Memory Compression and Transfer

abstract: We introduce Mem2Mem, a memory-to-memory mechanism for hierarchical recurrent neural network based encoder decoder architectures and we explore its use for abstractive document summarization. Mem2Mem transfers "memories" via readable/writable external memory modules that augment both the encoder and decoder. Our memory regularization compresses an encoded input article into a more compact set of sentence representations. Most importantly, the memory compression step performs implicit extraction without labels, sidestepping issues with suboptimal ground-truth data and exposure bias of hybrid extractive-abstractive summarization techniques. By allowing the decoder to read/write over the encoded input memory, the model learns to read salient information about the input article while keeping track of what has been generated. Our Mem2Mem approach yields results that are competitive with state of the art transformer based summarization methods, but with 16 times fewer parameters


title: Learning to Plan Optimally with Flow-based Motion Planner

abstract: Sampling-based motion planning is the predominant paradigm in many real-world robotic applications, but its performance is immensely dependent on the quality of the samples. The majority of traditional planners are inefficient as they use uninformative sampling distributions as opposed to exploiting structures and patterns in the problem to guide better sampling strategies. Moreover, most current learning-based planners are susceptible to posterior collapse or mode collapse due to the sparsity and highly varying nature of C-Space and motion plan configurations. In this work, we introduce a conditional normalising flow based distribution learned through previous experiences to improve sampling of these methods. Our distribution can be conditioned on the current problem instance to provide an informative prior for sampling configurations within promising regions. When we train our sampler with an expert planner, the resulting distribution is often near-optimal, and the planner can find a solution faster, with less invalid samples, and less initial cost. The normalising flow based distribution uses simple invertible transformations that are very computationally efficient, and our optimisation formulation explicitly avoids mode collapse in contrast to other existing learning-based planners. Finally, we provide a formulation and theoretical foundation to efficiently sample from the distribution; and demonstrate experimentally that, by using our normalising flow based distribution, a solution can be found faster, with less samples and better overall runtime performance.


title: Measuring Cosmological Distances Using Cluster Edges as a Standard Ruler

abstract: The line-of-sight velocity dispersion profile of galaxy clusters exhibits a "kink" corresponding to the spatial extent of orbiting galaxies. Because the spatial extent of a cluster is correlated with the amplitude of the velocity dispersion profile, we can utilise this feature as a gravity-calibrated standard ruler. Specifically, the amplitude of the velocity dispersion data allows us to infer the physical cluster size. Consequently, observations of the angular scale of the "kink" in the profile can be translated into a distance measurement to the cluster. Assuming the relation between cluster radius and cluster velocity dispersion can be calibrated from simulations, we forecast that with existing data from the Sloan Digital Sky Survey (SDSS) we will be able to measure the Hubble constant with $3\%$ precision. Implementing our method with data from the Dark Energy Spectroscopic Instrument (DESI) will result in a $1.3\%$ measurement of the Hubble constant. Adding cosmological supernova data improves the uncertainty of the DESI measurement to $0.7\%$.


title: Probing and Fine-tuning Reading Comprehension Models for Few-shot Event Extraction

abstract: We study the problem of event extraction from text data, which requires both detecting target event types and their arguments. Typically, both the event detection and argument detection subtasks are formulated as supervised sequence labeling problems. We argue that the event extraction models so trained are inherently label-hungry, and can generalize poorly across domains and text genres.We propose a reading comprehension framework for event extraction.Specifically, we formulate event detection as a textual entailment prediction problem, and argument detection as a question answer-ing problem. By constructing proper query templates, our approach can effectively distill rich knowledge about tasks and label semantics from pretrained reading comprehension models. Moreover, our model can be fine-tuned with a small amount of data to boost its performance. Our experiment results show that our method performs strongly for zero-shot and few-shot event extraction, and it achieves state-of-the-art performance on the ACE 2005 benchmark when trained with full supervision.