title: A Neural Acoustic Echo Canceller Optimized Using An Automatic Speech Recognizer And Large Scale Synthetic Data

abstract: We consider the problem of recognizing speech utterances spoken to a device which is generating a known sound waveform; for example, recognizing queries issued to a digital assistant which is generating responses to previous user inputs. Previous work has proposed building acoustic echo cancellation (AEC) models for this task that optimize speech enhancement metrics using both neural network as well as signal processing approaches. Since our goal is to recognize the input speech, we consider enhancements which improve word error rates (WERs) when the predicted speech signal is passed to an automatic speech recognition (ASR) model. First, we augment the loss function with a term that produces outputs useful to a pre-trained ASR model and show that this augmented loss function improves WER metrics. Second, we demonstrate that augmenting our training dataset of real world examples with a large synthetic dataset improves performance. Crucially, applying SpecAugment style masks to the reference channel during training aids the model in adapting from synthetic to real domains. In experimental evaluations, we find the proposed approaches improve performance, on average, by 57% over a signal processing baseline and 45% over the neural AEC model without the proposed changes.


title: Fine-grained Finger Gesture Recognition Using WiFi Signals

abstract: Gesture recognition has become increasingly important in human-computer interaction and can support different applications such as smart home, VR, and gaming. Traditional approaches usually rely on dedicated sensors that are worn by the user or cameras that require line of sight. In this paper, we present fine-grained finger gesture recognition by using commodity WiFi without requiring user to wear any sensors. Our system takes advantages of the fine-grained Channel State Information available from commodity WiFi devices and the prevalence of WiFi network infrastructures. It senses and identifies subtle movements of finger gestures by examining the unique patterns exhibited in the detailed CSI. We devise environmental noise removal mechanism to mitigate the effect of signal dynamic due to the environment changes. Moreover, we propose to capture the intrinsic gesture behavior to deal with individual diversity and gesture inconsistency. Lastly, we utilize multiple WiFi links and larger bandwidth at 5GHz to achieve finger gesture recognition under multi-user scenario. Our experimental evaluation in different environments demonstrates that our system can achieve over 90% recognition accuracy and is robust to both environment changes and individual diversity. Results also show that our system can provide accurate gesture recognition under different scenarios.


title: Uncertainty Characteristics Curves: A Systematic Assessment of Prediction Intervals

abstract: Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI. In regression tasks, uncertainty is typically quantified using prediction intervals calibrated to a specific operating point, making evaluation and comparison across different studies difficult. Our work leverages: (1) the concept of operating characteristics curves and (2) the notion of a gain over a simple reference, to derive a novel operating point agnostic assessment methodology for prediction intervals. The paper describes the corresponding algorithm, provides a theoretical analysis, and demonstrates its utility in multiple scenarios. We argue that the proposed method addresses the current need for comprehensive assessment of prediction intervals and thus represents a valuable addition to the uncertainty quantification toolbox.


title: A Continuous Liveness Detection for Voice Authentication on Smart Devices

abstract: Voice biometrics is drawing increasing attention as it is a promising alternative to legacy passwords for user authentication. Recently, a growing body of work shows that voice biometrics is vulnerable to spoofing through replay attacks, where an adversary tries to spoof voice authentication systems by using a pre-recorded voice sample collected from a genuine user. To this end, we propose VoiceGesture, a liveness detection solution for voice authentication on smart devices such as smartphones and smart speakers. VoiceGesture detects a live user by leveraging both the unique articulatory gesture of the user when speaking a passphrase and the audio hardware advances on these smart devices. Specifically, our system re-uses a pair of built-in speaker and microphone on a smart device as a Doppler radar, which transmits a high-frequency acoustic sound from the speaker and listens to the reflections at the microphone when a user speaks a passphrase. Then we extract Doppler shifts resulted from the user's articulatory gestures for liveness detection. VoiceGesture is practical as it requires neither cumbersome operations nor additional hardware but a speaker and a microphone commonly available on smart devices that support voice input. Our experimental evaluation with 21 participants and different smart devices shows that VoiceGesture achieves over 99% and around 98% detection accuracy for text-dependent and text-independent liveness detection, respectively. Results also show that VoiceGesture is robust to different device placements, low audio sampling frequency, and supports medium range liveness detection on smart speakers in various use scenarios like smart homes and smart vehicles.


title: Object Sensing for Fruit Ripeness Detection Using WiFi Signals

abstract: This paper presents FruitSense, a novel fruit ripeness sensing system that leverages wireless signals to enable non-destructive and low-cost detection of fruit ripeness. Such a system can reuse existing WiFi devices in homes without the need for additional sensors. It uses WiFi signals to sense the physiological changes associated with fruit ripening for detecting the ripeness of fruit. FruitSense leverages the larger bandwidth at 5GHz (i.e., over 600MHz) to extract the multipath-independent signal components to characterize the physiological compounds of the fruit. It then measures the similarity between the extracted features and the ones in ripeness profiles for identifying the ripeness level. We evaluate FruitSense in different multipath environments with two types of fruits (i.e, kiwi and avocado) under four levels of ripeness. Experimental results show that FruitSense can detect the ripeness levels of fruits with an accuracy of over 90%.


title: Necessary and Sufficient Girth Conditions for LDPC Tanner Graphs with Denser Protographs

abstract: This paper gives necessary and sufficient conditions for the Tanner graph of a quasi-cyclic (QC) low-density parity-check (LDPC) code based on the all-one protograph to have girth 6, 8, 10, and 12, respectively, in the case of parity-check matrices with column weight 4. These results are a natural extension of the girth results of the already-studied cases of column weight 2 and 3, and it is based on the connection between the girth of a Tanner graph given by a parity-check matrix and the properties of powers of the product between the matrix and its transpose. The girth conditions can be easily incorporated into fast algorithms that construct codes of desired girth between 6 and 12; our own algorithms are presented for each girth, together with constructions obtained from them and corresponding computer simulations. More importantly, this paper emphasizes how the girth conditions of the Tanner graph corresponding to a parity-check matrix composed of circulants relate to the matrix obtained by adding (over the integers) the circulant columns of the parity-check matrix. In particular, we show that imposing girth conditions on a parity-check matrix is equivalent to imposing conditions on a square circulant submatrix of size 4 obtained from it.


title: The Standard Model of particle physics as a conspiracy theory and the possible role of the Higgs boson in the evolution of the early universe

abstract: I am considering Veltman's "The Infrared - Ultraviolet Connection" addressing the issue of quadratic divergences and the related huge radiative correction predicted by the electroweak Standard Model (SM) in the relationship between the bare and the renormalized theory, commonly called "the hierarchy problem" which usually is claimed that this has to be cured. After the discovery of the Higgs particle at CERN, which essentially completed the SM, an amazing interrelation of the leading interaction strengths of the gauge bosons, the top-quark and the Higgs boson showed up amounting that the SM allows for a perturbative extrapolation of the running couplings up to the Planck scale. The central question concerns the stability of the electroweak vacuum, which requires that the running Higgs self-coupling stays positive. Although several evaluations seem to favor the meta-stability within the experimental and theoretical parameter-uncertainties, one should not exclude the possibility that other experiments and improved matching conditions will be able to establish the absolute stability of the SM vacuum in the future. I will discuss the stable vacuum scenario and its impact on early cosmology, revealing the Higgs boson as the inflaton. It turns out that the Standard Model's presumed "hierarchy problem" and similarly the "cosmological constant problem" resolve themselves when we understand the SM as a low energy effective tail that is emergent from a cutoff-medium at the Planck scale. "The Infrared - Ultraviolet Connection" conveyed by the Higgs boson mass renormalization appears in a new light when the energy dependence of the SM couplings is taken into account. The bare Higgs boson mass square then changes sign below the Planck scale where it is activating the Higgs mechanism.


title: Bose-Einstein Condensation for Lattice Bosons

abstract: We present a class of models of interacting lattice bosons which show complete Bose-Einstein condensation for the ground state.


title: A new broadening technique of numerically unresolved solar transition region and its effect on the spectroscopic synthesis using coronal approximation

abstract: The transition region is a thin layer of the solar atmosphere that controls the energy loss from the solar corona. Large numbers of grid points are required to resolve this thin transition region fully in numerical modeling. In this study, we propose a new numerical treatment, called LTRAC, which can be easily extended to the multi-dimensional domains. We have tested the proposed method using a one-dimensional hydrodynamic model of a coronal loop in an active region. The LTRAC method enables modeling of the transition region with the numerical grid size of 50--100 km, which is about 1000 times larger than the physically required value. We used the velocity differential emission measure to evaluate the possible effects on the optically thin emission. Lower temperature emissions were better reproduced by the LTRAC method than by previous methods. Doppler shift and non-thermal width of the synthesized line emission agree with those from a high-resolution reference simulation within an error of several km/s above the formation temperature of $10^5$ K.


title: Multi-User Activity Recognition and Tracking Using Commodity WiFi

abstract: This paper presents MultiTrack, a commodity WiFi-based human sensing system that can track multiple users and recognize the activities of multiple users performing them simultaneously. Such a system can enable easy and large-scale deployment for multi-user tracking and sensing without the need for additional sensors through the use of existing WiFi devices (e.g., desktops, laptops, and smart appliances). The basic idea is to identify and extract the signal reflection corresponding to each individual user with the help of multiple WiFi links and all the available WiFi channels at 5GHz. Given the extracted signal reflection of each user, MultiTrack examines the path of the reflected signals at multiple links to simultaneously track multiple users. It further reconstructs the signal profile of each user as if only a single user has performed activity in the environment to facilitate multi-user activity recognition. We evaluate MultiTrack in different multipath environments with up to 4 users for multi-user tracking and up to 3 users for activity recognition. Experimental results show that our system can achieve decimeter localization accuracy and over 92% activity recognition accuracy under multi-user scenarios.


title: The axial charges of proton within an extended chiral constituent quark model

abstract: We have performed a study of the isovector, octet and singlet axial charges of the proton in an extended chiral constituent quark model, where all the possible $uudq\bar{q}$~($q=u,d,s$) five-quark Fock components in the proton wave function are taken into account. The $^3P_0$ quark-antiquark creation mechanism is assumed to account for the transition coupling between three- and five-quark components in proton, and the corresponding transition coupling strength is fixed by fitting the intrinsic sea flavor asymmetry $\bar{d}-\bar{u}$ data for proton. Accordingly, with all the parameters fixed by empirical values, the probabilities of the intrinsic five-quark Fock components in proton wave function should be $\sim30 - 50\%$, which lead to the numerical results for quark spin $\Delta u$, $\Delta d$ and $\Delta s$, as well the axial charges of proton consistent with the experimental data and predictions by other theoretical approaches.


title: Nonlocal Phonon Heat Transport Seen in 1-d Pulses

abstract: Phonons are the main heat carriers in semiconductor devices. In small devices, heat is not driven by a local temperature gradient, but by local points of heat input and removal. This complicates theoretical modeling. Study of the propagation of vibrational energy from an initial localized pulse provides insight into nonlocal phonon heat transport. We report simulations of pulse propagation in one dimension. The 1d case has tricky anomalies, but provides the simplest pictures of the evolution from initially ballistic toward longer time diffusive propagation. Our results show surprising details, such as diverse results from different definitions of atomistic local energy, and failure to exhibit pure diffusion at long times. Boltzmann phonon gas theory, including external energy insertion, is applied to this inherentlytime-dependent and nonlocal problem. The solution, using relaxation time approximation for impurity scattering, does not closely agree with the simulated results.


title: High Entropy Oxide Relaxor Ferroelectrics

abstract: Relaxor ferrolectrics are important in technological applications due to a strong electromechanical response, energy storage capacity, electrocaloric effect, and pyroelectric energy conversion properties. Current efforts to discover and design new materials in this class generally rely on substitutional doping of known ferroelectrics, as slight changes to local compositional order can significantly affect the Curie temperature, morphotropic phase boundary, and electromechanical responses. In this work, we demonstrate that moving to the strong limit of compositional complexity in an ABO3 perovskite allows stabilization of novel relaxor responses that do not rely on a single narrow phase transition region. Entropy-assisted synthesis approaches are used to create single crystal Ba(Ti0.2Sn0.2Zr0.2Hf0.2Nb0.2)O3 [Ba(5B)O] films. The high levels of configurational disorder present in this system is found to influence dielectric relaxation, phase transitions, nano-polar domain formation, and Curie temperature. Temperature-dependent dielectric, Raman spectroscopy and second-harmonic generation measurements reveal multiple phase transitions, a high Curie temperature of 570 K, and the relaxor ferroelectric nature of Ba(5B)O films. The first principles theory calculations are used to predict possible combinations of cations to quantify the relative feasibility of formation of highly disordered single-phase perovskite systems. The ability to stabilize single-phase perovskites with such a large number of different cations on the B-sites offers new possibilities for designing high-performance materials for piezoelectric, pyroelectric and tunable dielectric applications.


title: Quadrature protection of squeezed states in a one-dimensional photonic topological insulator

abstract: What is the role of topology in the propagation of quantum light in photonic lattices? We address this question by studying the propagation of squeezed states in a topological one-dimensional waveguide array, benchmarking our results with those for a topologically trivial localized state, and studying their robustness against disorder. Specifically, we study photon statistics, one-mode and two-mode squeezing, and entanglement generation when the localized state is excited with squeezed light. These quantum properties inherit the shape of the localized state but, more interestingly, and unlike in the topologically trivial case, we find that propagation of squeezed light in a topologically protected state robustly preserves the phase of the squeezed quadrature as the system evolves. We show how this latter topological advantage can be harnessed for quantum information protocols.


title: Corona-Enabled Electrostatic Printing for Ultra-Fast R2R Manufacturing of Binder-Free Multifunctional E-Skins

abstract: As essential components in intelligent systems, printed soft electronics (PSEs) are playing crucial roles in public health, national security, and economics. Innovations in printing technologies are required to promote the broad application of high-performance PSEs at a low cost. However, current printing techniques are still facing long-lasting challenges in addressing the conflict between printing speed and performance. To overcome this challenge, we developed a new corona-enabled electrostatic printing (CEP) technique for ultra-fast (milliseconds) roll-to-roll (R2R) manufacturing of binder-free multifunctional e-skins. The printing capability and controllability of CEP were investigated through parametric studies and microstructure observation. The electric field generation, material transfer, and particle amount and size selecting mechanisms were numerically and experimentally studied. CEP printed graphene e-skins were demonstrated to possess outstanding strain sensing performance. The binder-free feature of the CEP-assembled networks enables them to provide pressure sensitivity as low as 2.5 Pa, and capability to detect acoustic signals of hundreds of hertz in frequency. Furthermore, the CEP technique was utilized to pattern different types of functional materials (e.g., graphene and thermochromic polymers) onto different substrates (e.g., tape and textile). Overall, this study demonstrated that CEP can be a novel contactless and ultrafast manufacturing platform compatible with R2R process for fabricating high-performance, scalable, and low-cost soft electronics.


title: A Short and Elementary Proof of the Central Limit Theorem by Individual Swapping

abstract: We present a short proof of the central limit theorem which is elementary in the sense that no knowledge of characteristic functions, linear operators, or other advanced results are needed. Our proof is based on Lindeberg's trick of swapping a term for a normal random variable in turn. The modifications needed to prove the stronger Lindeberg-Feller central limit theorem are addressed at the end.


title: On the Efficacy of Adversarial Data Collection for Question Answering: Results from a Large-Scale Randomized Study

abstract: In adversarial data collection (ADC), a human workforce interacts with a model in real time, attempting to produce examples that elicit incorrect predictions. Researchers hope that models trained on these more challenging datasets will rely less on superficial patterns, and thus be less brittle. However, despite ADC's intuitive appeal, it remains unclear when training on adversarial datasets produces more robust models. In this paper, we conduct a large-scale controlled study focused on question answering, assigning workers at random to compose questions either (i) adversarially (with a model in the loop); or (ii) in the standard fashion (without a model). Across a variety of models and datasets, we find that models trained on adversarial data usually perform better on other adversarial datasets but worse on a diverse collection of out-of-domain evaluation sets. Finally, we provide a qualitative analysis of adversarial (vs standard) data, identifying key differences and offering guidance for future research.


title: Coverage-based Scene Fuzzing for Virtual Autonomous Driving Testing

abstract: Simulation-based virtual testing has become an essential step to ensure the safety of autonomous driving systems. Testers need to handcraft the virtual driving scenes and configure various environmental settings like surrounding traffic, weather conditions, etc. Due to the huge amount of configuration possibilities, the human efforts are subject to the inefficiency in detecting flaws in industry-class autonomous driving system. This paper proposes a coverage-driven fuzzing technique to automatically generate diverse configuration parameters to form new driving scenes. Experimental results show that our fuzzing method can significantly reduce the cost in deriving new risky scenes from the initial setup designed by testers. We expect automated fuzzing will become a common practice in virtual testing for autonomous driving systems.


title: Conversational Question Answering: A Survey

abstract: Question answering (QA) systems provide a way of querying the information available in various formats including, but not limited to, unstructured and structured data in natural languages. It constitutes a considerable part of conversational artificial intelligence (AI) which has led to the introduction of a special research topic on Conversational Question Answering (CQA), wherein a system is required to understand the given context and then engages in multi-turn QA to satisfy the user's information needs. Whilst the focus of most of the existing research work is subjected to single-turn QA, the field of multi-turn QA has recently grasped attention and prominence owing to the availability of large-scale, multi-turn QA datasets and the development of pre-trained language models. With a good amount of models and research papers adding to the literature every year recently, there is a dire need of arranging and presenting the related work in a unified manner to streamline future research. This survey, therefore, is an effort to present a comprehensive review of the state-of-the-art research trends of CQA primarily based on reviewed papers from 2016-2021. Our findings show that there has been a trend shift from single-turn to multi-turn QA which empowers the field of Conversational AI from different perspectives. This survey is intended to provide an epitome for the research community with the hope of laying a strong foundation for the field of CQA.


title: The Hardest Explicit Construction

abstract: We investigate the complexity of explicit construction problems, where the goal is to produce a particular object of size $n$ possessing some pseudorandom property in time polynomial in $n$. We give overwhelming evidence that $\bf{APEPP}$, defined originally by Kleinberg et al., is the natural complexity class associated with explicit constructions of objects whose existence follows from the probabilistic method, by placing a variety of such construction problems in this class. We then demonstrate that a result of Je\v{r}\'{a}bek on provability in Bounded Arithmetic, when reinterpreted as a reduction between search problems, shows that constructing a truth table of high circuit complexity is complete for $\bf{APEPP}$ under $\bf{P}^{\bf{NP}}$ reductions. This illustrates that Shannon's classical proof of the existence of hard boolean functions is in fact a $\textit{universal}$ probabilistic existence argument: derandomizing his proof implies a generic derandomization of the probabilistic method. As a corollary, we prove that $\bf{EXP}^{\bf{NP}}$ contains a language of circuit complexity $2^{n^{\Omega(1)}}$ if and only if it contains a language of circuit complexity $\frac{2^n}{2n}$. Finally, for several of the problems shown to lie in $\bf{APEPP}$, we demonstrate direct polynomial time reductions to the explicit construction of hard truth tables.


title: Modeling Buried Object Brightness and Visibility for Ground Penetrating Radar

abstract: Comparing the observed brightness of various buried objects is a straightforward way to characterize the performance of a ground penetrating radar (GPR) system. However, a limitation arises. A simple comparison of buried object brightness values does not disentangle the effects of the GPR system itself from the system's operating environment and the objects being observed. Therefore, with brightness values exhibiting an unknown synthesis of systemic, environmental, and object factors, GPR system analysis becomes a convoluted affair. In this work, we use an experimentally collected dataset of over 25,000 object observations from five different multi-static radar arrays to develop models of buried object brightness and control for these various effects. Our modeling efforts provide a means for quantifying the relative brightness of GPR systems, the objects they detect, and the physical properties of those objects which influence observed brightness. To evaluate the models' performance on new object observations, we repeatedly simulate fitting them to half the dataset and predicting the observed brightness values of the unseen half. Additionally, we introduce a method for estimating the probability that individual observations constitute a visible object, which aids in failure analysis, performance characterization, and dataset cleaning.


title: Evaluating Word Embeddings with Categorical Modularity

abstract: We introduce categorical modularity, a novel low-resource intrinsic metric to evaluate word embedding quality. Categorical modularity is a graph modularity metric based on the $k$-nearest neighbor graph constructed with embedding vectors of words from a fixed set of semantic categories, in which the goal is to measure the proportion of words that have nearest neighbors within the same categories. We use a core set of 500 words belonging to 59 neurobiologically motivated semantic categories in 29 languages and analyze three word embedding models per language (FastText, MUSE, and subs2vec). We find moderate to strong positive correlations between categorical modularity and performance on the monolingual tasks of sentiment analysis and word similarity calculation and on the cross-lingual task of bilingual lexicon induction both to and from English. Overall, we suggest that categorical modularity provides non-trivial predictive information about downstream task performance, with breakdowns of correlations by model suggesting some meta-predictive properties about semantic information loss as well.


title: On the formal degree conjecture for non-singular supercuspidal representations

abstract: We prove the formal degree conjecture for non-singular supercuspidal representations based on Schwein's work proving the formal degree conjecture for regular supercuspidal representations. The main difference between our work and Schwein's work is that in non-singular case, the Deligne--Lusztig representations can be reducible, and the $S$-groups are not necessary abelian. Therefore, we have to compare the dimensions of irreducible constituents of the Deligne--Lusztig representations and the dimensions of irreducible representations of $S$-groups.


title: Estimation of the equilibrium free energy for glasses using the Jarzynski equality

abstract: The free energy of glasses cannot be estimated using thermodynamic integration, as glasses are intrinsically not in equilibrium. We present numerical simulations showing that, in contrast, plausible free-energy estimates of a Kob-Andersen glass can be obtained using the Jarzynski relation. Using the Jarzynski relation, we also compute the chemical potential difference of the two components of this system, and find that, in the glassy regime, the Jarzynski estimate matches well with the extrapolated value of the supercooled liquid. Our findings are of broader interest as they show that the Jarzynski method can be used under conditions where the thermodynamic integration approach, which is normally more accurate, breaks down completely. Systems where such an approach might be useful are gels and jammed, glassy structures formed by compression.


title: Rotation Equivariant Feature Image Pyramid Network for Object Detection in Optical Remote Sensing Imagery

abstract: Detection of objects is extremely important in various aerial vision-based applications. Over the last few years, the methods based on convolution neural networks have made substantial progress. However, because of the large variety of object scales, densities, and arbitrary orientations, the current detectors struggle with the extraction of semantically strong features for small-scale objects by a predefined convolution kernel. To address this problem, we propose the rotation equivariant feature image pyramid network (REFIPN), an image pyramid network based on rotation equivariance convolution. The proposed model adopts single-shot detector in parallel with a lightweight image pyramid module to extract representative features and generate regions of interest in an optimization approach. The proposed network extracts feature in a wide range of scales and orientations by using novel convolution filters. These features are used to generate vector fields and determine the weight and angle of the highest-scoring orientation for all spatial locations on an image. By this approach, the performance for small-sized object detection is enhanced without sacrificing the performance for large-sized object detection. The performance of the proposed model is validated on two commonly used aerial benchmarks and the results show our proposed model can achieve state-of-the-art performance with satisfactory efficiency.


title: Hyperdimensional Computing for Efficient Distributed Classification with Randomized Neural Networks

abstract: In the supervised learning domain, considering the recent prevalence of algorithms with high computational cost, the attention is steering towards simpler, lighter, and less computationally extensive training and inference approaches. In particular, randomized algorithms are currently having a resurgence, given their generalized elementary approach. By using randomized neural networks, we study distributed classification, which can be employed in situations were data cannot be stored at a central location nor shared. We propose a more efficient solution for distributed classification by making use of a lossy compression approach applied when sharing the local classifiers with other agents. This approach originates from the framework of hyperdimensional computing, and is adapted herein. The results of experiments on a collection of datasets demonstrate that the proposed approach has usually higher accuracy than local classifiers and getting close to the benchmark - the centralized classifier. This work can be considered as the first step towards analyzing the variegated horizon of distributed randomized neural networks.


title: Efficient Passage Retrieval with Hashing for Open-domain Question Answering

abstract: Most state-of-the-art open-domain question answering systems use a neural retrieval model to encode passages into continuous vectors and extract them from a knowledge source. However, such retrieval models often require large memory to run because of the massive size of their passage index. In this paper, we introduce Binary Passage Retriever (BPR), a memory-efficient neural retrieval model that integrates a learning-to-hash technique into the state-of-the-art Dense Passage Retriever (DPR) to represent the passage index using compact binary codes rather than continuous vectors. BPR is trained with a multi-task objective over two tasks: efficient candidate generation based on binary codes and accurate reranking based on continuous vectors. Compared with DPR, BPR substantially reduces the memory cost from 65GB to 2GB without a loss of accuracy on two standard open-domain question answering benchmarks: Natural Questions and TriviaQA. Our code and trained models are available at https://github.com/studio-ousia/bpr.


title: Towards proteinoid computers

abstract: Proteinoids -- thermal proteins -- are produced by heating amino acids to their melting point and initiation of polymerisation to produce polymeric chains. Proteinoids swell in aqueous solution into hollow microspheres. The proteinoid microspheres produce endogenous burst of electrical potential spikes and change patterns of their electrical activity in response to illumination. The microspheres can interconnect by pores and tubes and form networks with a programmable growth. We speculate on how ensembles of the proteinoid microspheres can be developed into unconventional computing devices.


title: Deep Personalized Glucose Level Forecasting Using Attention-based Recurrent Neural Networks

abstract: In this paper, we study the problem of blood glucose forecasting and provide a deep personalized solution. Predicting blood glucose level in people with diabetes has significant value because health complications of abnormal glucose level are serious, sometimes even leading to death. Therefore, having a model that can accurately and quickly warn patients of potential problems is essential. To develop a better deep model for blood glucose forecasting, we analyze the data and detect important patterns. These observations helped us to propose a method that has several key advantages over existing methods: 1- it learns a personalized model for each patient as well as a global model; 2- it uses an attention mechanism and extracted time features to better learn long-term dependencies in the data; 3- it introduces a new, robust training procedure for time series data. We empirically show the efficacy of our model on a real dataset.


title: Robustifying Algorithms of Learning Latent Trees with Vector Variables

abstract: We consider learning the structures of Gaussian latent tree models with vector observations when a subset of them are arbitrarily corrupted. First, we present the sample complexities of Recursive Grouping (RG) and Chow-Liu Recursive Grouping (CLRG) without the assumption that the effective depth is bounded in the number of observed nodes, significantly generalizing the results in Choi et al. (2011). We show that Chow-Liu initialization in CLRG greatly reduces the sample complexity of RG from being exponential in the diameter of the tree to only logarithmic in the diameter for the hidden Markov model (HMM). Second, we robustify RG, CLRG, Neighbor Joining (NJ) and Spectral NJ (SNJ) by using the truncated inner product. These robustified algorithms can tolerate a number of corruptions up to the square root of the number of clean samples. Finally, we derive the first known instance-dependent impossibility result for structure learning of latent trees. The optimalities of the robust version of CLRG and NJ are verified by comparing their sample complexities and the impossibility result.


title: Partial Wasserstein Covering

abstract: We consider a general task called partial Wasserstein covering with the goal of providing information on what patterns are not being taken into account in a dataset (e.g., dataset used during development) compared with another dataset(e.g., dataset obtained from actual applications). We model this task as a discrete optimization problem with partial Wasserstein divergence as an objective function. Although this problem is NP-hard, we prove that it satisfies the submodular property, allowing us to use a greedy algorithm with a 0.63 approximation. However, the greedy algorithm is still inefficient because it requires solving linear programming for each objective function evaluation. To overcome this inefficiency, we propose quasi-greedy algorithms that consist of a series of acceleration techniques, such as sensitivity analysis based on strong duality and the so-called C-transform in the optimal transport field. Experimentally, we demonstrate that we can efficiently fill in the gaps between the two datasets and find missing scene in real driving scenes datasets.


title: Exploiting Global Contextual Information for Document-level Named Entity Recognition

abstract: Most existing named entity recognition (NER) approaches are based on sequence labeling models, which focus on capturing the local context dependencies. However, the way of taking one sentence as input prevents the modeling of non-sequential global context, which is useful especially when local context information is limited or ambiguous. To this end, we propose a model called Global Context enhanced Document-level NER (GCDoc) to leverage global contextual information from two levels, i.e., both word and sentence. At word-level, a document graph is constructed to model a wider range of dependencies between words, then obtain an enriched contextual representation for each word via graph neural networks (GNN). To avoid the interference of noise information, we further propose two strategies. First we apply the epistemic uncertainty theory to find out tokens whose representations are less reliable, thereby helping prune the document graph. Then a selective auxiliary classifier is proposed to effectively learn the weight of edges in document graph and reduce the importance of noisy neighbour nodes. At sentence-level, for appropriately modeling wider context beyond single sentence, we employ a cross-sentence module which encodes adjacent sentences and fuses it with the current sentence representation via attention and gating mechanisms. Extensive experiments on two benchmark NER datasets (CoNLL 2003 and Ontonotes 5.0 English dataset) demonstrate the effectiveness of our proposed model. Our model reaches F1 score of 92.22 (93.40 with BERT) on CoNLL 2003 dataset and 88.32 (90.49 with BERT) on Ontonotes 5.0 dataset, achieving new state-of-the-art performance.


title: Quantifying out-of-station waiting time in oversaturated urban metro systems

abstract: Metro systems in megacities such as Beijing, Shenzhen and Guangzhou are under great passenger demand pressure. During peak hours, it is common to see oversaturated conditions (i.e., passenger demand exceeds network capacity), which bring significant operational risks and safety issues. A popular control intervention is to restrict the entering rate during peak hours by setting up out-of-station queueing with crowd control barriers. The \textit{out-of-station waiting} can make up a substantial proportion of total travel time but is not well-studied in the literature. Accurate quantification of out-of-station waiting time is important to evaluating the social benefit and cost of service scheduling/optimization plans; however, out-of-station waiting time is difficult to estimate because it is not a part of smart card transactions. In this study, we propose an innovative method to estimate the out-of-station waiting time by leveraging the information from a small group of transfer passengers -- those who transfer from nearby bus routes to the metro station. Based on the estimated transfer time for this small group, we first infer the out-of-station waiting time for all passengers by developing a Gaussian Process regression with a Student-$t$ likelihood and then use the estimated out-of-station waiting time to build queueing diagrams. We apply our method to the Tiantongyuan North station of Beijing metro as a case study; our results show that the maximum out-of-station waiting time can reach 15 minutes, and the maximum queue length can be over 3000 passengers. Our results suggest that out-of-station waiting can cause significant travel costs and thus should be considered in analyzing transit performance, mode choice, and social benefits. To the best of our knowledge, this paper is the first quantitative study for out-of-station waiting time.


title: High-Order Large-Eddy Simulations of a Ducted Wind Turbine

abstract: A high-order flux reconstruction method coupled with a high-order sliding mesh method is applied to analyze the performance of a ducted wind turbine at a Reynolds number of $1.25\times 10^6$. To investigate the impacts of the duct, axial flow simulations are also performed for the corresponding open-rotor turbine. It is shown that the ducted turbine has higher thrust and power outputs than the open rotor. Vorticity and velocity fields of two configurations are also visualized and analyzed to show the differences. To evaluate the effects of yawed flows, simulations are carried out for both turbines under five different yaw angles $\gamma=0^{\circ}, \pm15^{\circ}, \pm 30^{\circ}$. The results reveal that the ducted wind turbine has higher power outputs than the open counterpart at all tested yaw angles.


title: Passive Beamforming Design for Intelligent Reflecting Surface Assisted MIMO Systems

abstract: Intelligent reflecting surfaces (IRSs) constitute passive devices, which are capable of adjusting the phase shifts of their reflected signals, and hence they are suitable for passive beamforming. In this paper, we conceive their design with the active beamforming action of multiple-input multipleoutput (MIMO) systems used at the access points (APs) for improving the beamforming gain, where both the APs and users are equipped with multiple antennas. Firstly, we decouple the optimization problem and design the active beamforming for a given IRS configuration. Then we transform the optimization problem of the IRS-based passive beamforming design into a tractable non-convex quadratically constrained quadratic program (QCQP). For solving the transformed problem, we give an approximate solution based on the technique of widely used semidefinite relaxation (SDR). We also propose a low-complexity iterative solution. We further prove that it can converge to a locally optimal value. Finally, considering the practical scenario of discrete phase shifts at the IRS, we give the quantization design for IRS elements on basis of the two solutions. Our simulation results demonstrate the superiority of the proposed solutions over the relevant benchmarks.


title: High-Quality Diversification for Task-Oriented Dialogue Systems

abstract: Many task-oriented dialogue systems use deep reinforcement learning (DRL) to learn policies that respond to the user appropriately and complete the tasks successfully. Training DRL agents with diverse dialogue trajectories prepare them well for rare user requests and unseen situations. One effective diversification method is to let the agent interact with a diverse set of learned user models. However, trajectories created by these artificial user models may contain generation errors, which can quickly propagate into the agent's policy. It is thus important to control the quality of the diversification and resist the noise. In this paper, we propose a novel dialogue diversification method for task-oriented dialogue systems trained in simulators. Our method, Intermittent Short Extension Ensemble (I-SEE), constrains the intensity to interact with an ensemble of diverse user models and effectively controls the quality of the diversification. Evaluations on the Multiwoz dataset show that I-SEE successfully boosts the performance of several state-of-the-art DRL dialogue agents.


title: Evidence for the decay $\Omega_{c}^{0} \to \pi^+\Omega(2012)^- \to \pi^+ (\bar{K}\Xi)^{-}$

abstract: Using a data sample of 980~fb$^{-1}$ collected with the Belle detector operating at the KEKB asymmetric-energy $e^+e^-$ collider, we present evidence for the $\Omega(2012)^-$ in the resonant substructure of $\Omega_{c}^{0} \to \pi^+ (\bar{K}\Xi)^{-}$ ($(\bar{K}\Xi)^{-}$ = $K^-\Xi^0$ + $\bar{K}^0 \Xi^-$) decays. The significance of the $\Omega(2012)^-$ signal is 4.2$\sigma$ after considering the systematic uncertainties. The ratio of the branching fraction of $\Omega_{c}^{0} \to \pi^{+} \Omega(2012)^- \to \pi^+ (\bar{K}\Xi)^{-}$ relative to that of $\Omega_{c}^{0} \to \pi^{+} \Omega^-$ is calculated to be 0.220 $\pm$ 0.059(stat.) $\pm$ 0.035(syst.). The individual ratios of the branching fractions of the two isospin modes are also determined, and found to be ${\cal B}(\Omega_{c}^0 \to \pi^+ \Omega(2012)^-) \times {\cal B}(\Omega(2012)^- \to K^-\Xi^0)/{\cal B}(\Omega_{c}^0 \to \pi^+ K^- \Xi^0)$ = (9.6 $\pm$ 3.2(stat.) $\pm$ 1.8(syst.))\% and ${\cal B}(\Omega_{c}^0 \to \pi^+ \Omega(2012)^-) \times {\cal B}(\Omega(2012)^- \to \bar{K}^0 \Xi^-)/{\cal B}(\Omega_{c}^0 \to \pi^+ \bar{K}^0 \Xi^-)$ = (5.5 $\pm$ 2.8(stat.) $\pm$ 0.7(syst.))\%.


title: Solving Arithmetic Word Problems with Transformers and Preprocessing of Problem Text

abstract: This paper outlines the use of Transformer networks trained to translate math word problems to equivalent arithmetic expressions in infix, prefix, and postfix notations. We compare results produced by many neural configurations and find that most configurations outperform previously reported approaches on three of four datasets with significant increases in accuracy of over 20 percentage points. The best neural approaches boost accuracy by 30% when compared to the previous state-of-the-art on some datasets.


title: Pressure-constant Monte Carlo simulation of phase I of solid CO2 up to 10 GPa at T = 200 K using Kihara potential model

abstract: This article is a continuation of the past three papers, arXiv:1711.04976 (2017), arXiv:1809.04291 (2018), and arXiv:2006.09673v2 (2020), in which configurations of the molecules around a vacancy in solid CO2 with the Pa3 structure (phase I) were calculated by the Monte Carlo (MC) simulation technique at T < 200 K and at a nominal pressure of P = 1 atm using lattice constants determined in reference to experimental data. For the intermolecular potential, the Kihara model of a rod-shape core with zero diameter was used. For theoretical consistency, however, the lattice constant should be determined by a pressure-constant MC simulation, i.e. by the NPT simulation. It was anticipated that the NPT simulation, successful for monoatomic molecular fluids, might not work straightforwardly for solid CO2 because of the non-spherical molecular shape and interactions. In fact, it was found in the present work that the protocol of the standard NPT simulation had to be modified for solid CO2 to achieve an equilibrium lattice constant, given an external pressure, within practical computer time and capacity. The modified protocol was used to calculate the P-V relation at 1 bar and from 2 to 10 GPa at which a structural phase transition is known to take place. The temperature was fixed at 200 K. As a result, the calculated P-V relation was similar to those in previous theoretical works, the molar volume being roughly 0.5 % smaller than experimental data.


title: Field Estimation using Robotic Swarms through Bayesian Regression and Mean-Field Feedback

abstract: Recent years have seen an increased interest in using mean-field density based modelling and control strategy for deploying robotic swarms. In this paper, we study how to dynamically deploy the robots subject to their physical constraints to efficiently measure and reconstruct certain unknown spatial field (e.g. the air pollution index over a city). Specifically, the evolution of the robots' density is modelled by mean-field partial differential equations (PDEs) which are uniquely determined by the robots' individual dynamics. Bayesian regression models are used to obtain predictions and return a variance function that represents the confidence of the prediction. We formulate a PDE constrained optimization problem based on this variance function to dynamically generate a reference density signal which guides the robots to uncertain areas to collect new data, and design mean-field feedback-based control laws such that the robots' density converges to this reference signal. We also show that the proposed feedback law is robust to density estimation errors in the sense of input-to-state stability. Simulations are included to verify the effectiveness of the algorithms.


title: Asymptotics of Sequential Composite Hypothesis Testing under Probabilistic Constraints

abstract: We consider the sequential composite binary hypothesis testing problem in which one of the hypotheses is governed by a single distribution while the other is governed by a family of distributions whose parameters belong to a known set $\Gamma$. We would like to design a test to decide which hypothesis is in effect. Under the constraints that the probabilities that the length of the test, a stopping time, exceeds $n$ are bounded by a certain threshold $\epsilon$, we obtain certain fundamental limits on the asymptotic behavior of the sequential test as $n$ tends to infinity. Assuming that $\Gamma$ is a convex and compact set, we obtain the set of all first-order error exponents for the problem. We also prove a strong converse. Additionally, we obtain the set of second-order error exponents under the assumption that $\mathcal{X}$ is a finite alphabet. In the proof of second-order asymptotics, a main technical contribution is the derivation of a central limit-type result for a maximum of an uncountable set of log-likelihood ratios under suitable conditions. This result may be of independent interest. We also show that some important statistical models satisfy the conditions.


title: Solving Large-Scale Extensive-Form Network Security Games via Neural Fictitious Self-Play

abstract: Securing networked infrastructures is important in the real world. The problem of deploying security resources to protect against an attacker in networked domains can be modeled as Network Security Games (NSGs). Unfortunately, existing approaches, including the deep learning-based approaches, are inefficient to solve large-scale extensive-form NSGs. In this paper, we propose a novel learning paradigm, NSG-NFSP, to solve large-scale extensive-form NSGs based on Neural Fictitious Self-Play (NFSP). Our main contributions include: i) reforming the best response (BR) policy network in NFSP to be a mapping from action-state pair to action-value, to make the calculation of BR possible in NSGs; ii) converting the average policy network of an NFSP agent into a metric-based classifier, helping the agent to assign distributions only on legal actions rather than all actions; iii) enabling NFSP with high-level actions, which can benefit training efficiency and stability in NSGs; and iv) leveraging information contained in graphs of NSGs by learning efficient graph node embeddings. Our algorithm significantly outperforms state-of-the-art algorithms in both scalability and solution quality.


title: Trajectory Optimization for Manipulation of Deformable Objects: Assembly of Belt Drive Units

abstract: This paper presents a novel trajectory optimization formulation to solve the robotic assembly of the belt drive unit. Robotic manipulations involving contacts and deformable objects are challenging in both dynamic modeling and trajectory planning. For modeling, variations in the belt tension and contact forces between the belt and the pulley could dramatically change the system dynamics. For trajectory planning, it is computationally expensive to plan trajectories for such hybrid dynamical systems as it usually requires planning for discrete modes separately. In this work, we formulate the belt drive unit assembly task as a trajectory optimization problem with complementarity constraints to avoid explicitly imposing contact mode sequences. The problem is solved as a mathematical program with complementarity constraints (MPCC) to obtain feasible and efficient assembly trajectories. We validate the proposed method both in simulations with a physics engine and in real-world experiments with a robotic manipulator.


title: Feedback Interconnected Mean-Field Density Estimation and Control

abstract: Swarm robotic systems have foreseeable applications in the near future. Recently, there has been an increasing amount of literature that employs mean-field partial differential equations (PDEs) to model the time-evolution of the probability density of swarm robotic systems and uses density feedback to design stabilizing control laws that act on individuals such that their density converges to a target profile. However, it remains largely unexplored considering problems of how to estimate the mean-field density, how the density estimation algorithms affect the control performance, and whether the estimation performance in turn depends on the control algorithms. In this work, we focus on studying the interplay of these algorithms. Specifically, we propose new density control laws which use the mean-field density and its gradient as feedback, and prove that they are globally input-to-state stable (ISS) with respect to estimation errors. Then, we design filtering algorithms to estimate the density and its gradient separately, and prove that these estimates are convergent assuming the control laws are known. Finally, we show that the feedback interconnection of these estimation and control algorithms is still globally ISS, which is attributed to the bilinearity of the PDE system. An agent-based simulation is included to verify the stability of these algorithms and their feedback interconnection.


title: Evolution of spherical overdensity in Chaplygin gas model

abstract: Even though many scalar field models of dark energy have been considered in the literature, there is another interesting class of dark energy models involving a fluid known as a Chaplygin gas. In addition to describing the dark energy, both scalar-tensor model and the Chaplygin gas model are suitable candidates for explaining the spherical cosmological collapse. One of the most well-known scalar field models is the quintessence model, which was first introduced to explain an accelerating expanding universe. Using a special form of the quintessence model that is equivalent to Chaplygin gas, we describe evolution of a spherical collapse. We study the cosmological properties of the quintessence field with a special potential. In addition to the quintessence model, that can be converted into a Chaplygin gas model in a particular case, we claim that the fixed-potential tachyonic model is equivalent to the Chaplygin gas model. In this work, we obtain the spherical collapse parameters: the virialized overdensity parameters, radius, the energy density at the turnaround moment, etc. We compare the results of the proposed model with the standard model of cosmology and the Einstein-de Sitter model. We show that the formation of the large-scale structures within the framework of a Chaplygin gas model happens earlier than predicted in the standard model.


title: A Differentiable Point Process with Its Application to Spiking Neural Networks

abstract: This paper is concerned about a learning algorithm for a probabilistic model of spiking neural networks (SNNs). Jimenez Rezende & Gerstner (2014) proposed a stochastic variational inference algorithm to train SNNs with hidden neurons. The algorithm updates the variational distribution using the score function gradient estimator, whose high variance often impedes the whole learning algorithm. This paper presents an alternative gradient estimator for SNNs based on the path-wise gradient estimator. The main technical difficulty is a lack of a general method to differentiate a realization of an arbitrary point process, which is necessary to derive the path-wise gradient estimator. We develop a differentiable point process, which is the technical highlight of this paper, and apply it to derive the path-wise gradient estimator for SNNs. We investigate the effectiveness of our gradient estimator through numerical simulation.


title: On the necessary and sufficient conditions for Peng's law of large numbers under sublinear expectations

abstract: In this paper, we firstly establish the weak laws of large numbers on the canonical space $(\br^\bn,\cb(\br^\bn))$ by traditional truncation method and Chebyshev's inequality as in the classical probability theory. Then we extend them from the canonical space to the general sublinear expectation space. The necessary and sufficient conditions for Peng's law of large numbers are obtained.


title: Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation

abstract: Knowledge distillation (KD) is commonly used to construct synthetic data for training non-autoregressive translation (NAT) models. However, there exists a discrepancy on low-frequency words between the distilled and the original data, leading to more errors on predicting low-frequency words. To alleviate the problem, we directly expose the raw data into NAT by leveraging pretraining. By analyzing directed alignments, we found that KD makes low-frequency source words aligned with targets more deterministically but fails to align sufficient low-frequency words from target to source. Accordingly, we propose reverse KD to rejuvenate more alignments for low-frequency target words. To make the most of authentic and synthetic data, we combine these complementary approaches as a new training strategy for further boosting NAT performance. We conduct experiments on five translation benchmarks over two advanced architectures. Results demonstrate that the proposed approach can significantly and universally improve translation quality by reducing translation errors on low-frequency words. Encouragingly, our approach achieves 28.2 and 33.9 BLEU points on the WMT14 English-German and WMT16 Romanian-English datasets, respectively. Our code, data, and trained models are available at \url{https://github.com/alphadl/RLFW-NAT}.


title: The maximum size of a nonhamiltonian graph with given order and connectivity

abstract: Motivated by work of Erd\H{o}s, Ota determined the maximum size $g(n,k)$ of a $k$-connected nonhamiltonian graph of order $n$ in 1995. But for some pairs $n,k,$ the maximum size is not attained by a graph of connectivity $k.$ For example, $g(15,3)=77$ is attained by a unique graph of connectivity $7,$ not $3.$ In this paper we obtain more precise information by determining the maximum size of a nonhamiltonian graph of order $n$ and connectivity $k,$ and determining the extremal graphs. Consequently we solve the corresponding problem for nontraceable graphs.


title: Low-cost Stereovision system (disparity map) for few dollars

abstract: The paper presents an analysis of the latest developments in the field of stereo vision in the low-cost segment, both for prototypes and for industrial designs. We described the theory of stereo vision and presented information about cameras and data transfer protocols and their compatibility with various devices. The theory in the field of image processing for stereo vision processes is considered and the calibration process is described in detail. Ultimately, we presented the developed stereo vision system and provided the main points that need to be considered when developing such systems. The final, we presented software for adjusting stereo vision parameters in real-time in the python language in the Windows operating system.


title: Operator Splitting for Learning to Predict Equilibria in Convex Games

abstract: Systems of competing agents can often be modeled as games. Assuming rationality, the most likely outcomes are given by an equilibrium (e.g. a Nash equilibrium). In many practical settings, games are influenced by context, i.e. additional data beyond the control of any agent (e.g. weather for traffic and fiscal policy for market economies). Often the exact game mechanics are unknown, yet vast amounts of historical data consisting of (context, equilibrium) pairs are available, raising the possibility of learning a solver which predicts the equilibria given only the context. We introduce Nash Fixed Point Networks (N-FPNs), a class of neural networks that naturally output equilibria. Crucially, N- FPNs employ a constraint decoupling scheme to handle complicated agent action sets while avoiding expensive projections. Empirically, we find N-FPNs are compatible with the recently developed Jacobian-Free Backpropagation technique for training implicit networks, making them significantly faster and easier to train than prior models. Our experiments show N-FPNs are capable of scaling to problems orders of magnitude larger than existing learned game solvers.


title: Coexistence of intrinsic piezoelectricity, ferromagnetism and nontrivial band topology in Li-decorated Janus monolayer $\mathrm{Fe_2SSe}$ with high Curie temperature

abstract: Recently, the quantum anomalous Hall (QAH) insulators are predicted in Lithium-decorated iron-based superconductor monolayer materials (LiFeX (X=S, Se and Te)) with very high Curie temperature (\textcolor[rgb]{0.00,0.00,1.00}{PRL 125, 086401 (2020)}), which combines the topological and ferromagnetic (FM) orders. It is interesting and useful to achieve coexistence of intrinsic piezoelectricity, ferromagnetism and nontrivial band topology in single two-dimensional (2D) material, namely 2D piezoelectric quantum anomalous hall insulator (PQAHI). In this work, 2D Janus monolayer $\mathrm{Li_2Fe_2SSe}$ is predict to be a room-temperature PQAHI, which possesses dynamic, mechanical and thermal stabilities. It is predicted to be a half Dirac semimetal without spin-orbit coupling (SOC). It is found that the inclusion of SOC opens up a large nontrivial gap, which means the nontrivial bulk topology (QAH insulator), confirmed by the calculation of Berry curvature and the presence of two chiral edge states (Chern number C=2). Calculated results show that monolayer $\mathrm{Li_2Fe_2SSe}$ possesses robust QAH states against biaxial strain and electronic correlations. Compared to LiFeX, the glide mirror $G_z$ of $\mathrm{Li_2Fe_2SSe}$ disappears, which will induce only out-of-plane piezoelectric response. The calculated out-of-plane $d_{31}$ of monolayer $\mathrm{Li_2Fe_2SSe}$ is -0.238 pm/V comparable with ones of other 2D known materials. Moreover, very high Curie temperature (about 1000 K) is predicted by using Monte Carlo (MC) simulations, which means that the QAH effect can be achieved at room temperature in Janus monolayer $\mathrm{Li_2Fe_2SSe}$. Similar to monolayer $\mathrm{Li_2Fe_2SSe}$, the PQAHI can also be realized in the Janus monolayer $\mathrm{Li_2Fe_2SeTe}$.


title: TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification

abstract: Multiple instance learning (MIL) is a powerful tool to solve the weakly supervised classification in whole slide image (WSI) based pathology diagnosis. However, the current MIL methods are usually based on independent and identical distribution hypothesis, thus neglect the correlation among different instances. To address this problem, we proposed a new framework, called correlated MIL, and provided a proof for convergence. Based on this framework, we devised a Transformer based MIL (TransMIL), which explored both morphological and spatial information. The proposed TransMIL can effectively deal with unbalanced/balanced and binary/multiple classification with great visualization and interpretability. We conducted various experiments for three different computational pathology problems and achieved better performance and faster convergence compared with state-of-the-art methods. The test AUC for the binary tumor classification can be up to 93.09% over CAMELYON16 dataset. And the AUC over the cancer subtypes classification can be up to 96.03% and 98.82% over TCGA-NSCLC dataset and TCGA-RCC dataset, respectively. Implementation is available at: https://github.com/szc19990412/TransMIL.


title: The Generalized Mean Densest Subgraph Problem

abstract: Finding dense subgraphs of a large graph is a standard problem in graph mining that has been studied extensively both for its theoretical richness and its many practical applications. In this paper we introduce a new family of dense subgraph objectives, parameterized by a single parameter $p$, based on computing generalized means of degree sequences of a subgraph. Our objective captures both the standard densest subgraph problem and the maximum $k$-core as special cases, and provides a way to interpolate between and extrapolate beyond these two objectives when searching for other notions of dense subgraphs. In terms of algorithmic contributions, we first show that our objective can be minimized in polynomial time for all $p \geq 1$ using repeated submodular minimization. A major contribution of our work is analyzing the performance of different types of peeling algorithms for dense subgraphs both in theory and practice. We prove that the standard peeling algorithm can perform arbitrarily poorly on our generalized objective, but we then design a more sophisticated peeling method which for $p \geq 1$ has an approximation guarantee that is always at least $1/2$ and converges to 1 as $p \rightarrow \infty$. In practice, we show that this algorithm obtains extremely good approximations to the optimal solution, scales to large graphs, and highlights a range of different meaningful notions of density on graphs coming from numerous domains. Furthermore, it is typically able to approximate the densest subgraph problem better than the standard peeling algorithm, by better accounting for how the removal of one node affects other nodes in its neighborhood.


title: Concurrent Learning Based Tracking Control of Nonlinear Systems using Gaussian Process

abstract: This paper demonstrates the applicability of the combination of concurrent learning as a tool for parameter estimation and non-parametric Gaussian Process for online disturbance learning. A control law is developed by using both techniques sequentially in the context of feedback linearization. The concurrent learning algorithm estimates the system parameters of structured uncertainty without requiring persistent excitation, which are used in the design of the feedback linearization law. Then, a non-parametric Gaussian Process learns unstructured uncertainty. The closed-loop system stability for the nth-order system is proven using the Lyapunov stability theorem. The simulation results show that the tracking error is minimized (i) when true values of model parameters have not been provided, (ii) in the presence of disturbances introduced once the parameters have converged to their true values and (iii) when system parameters have not converged to their true values in the presence of disturbances.


title: Optimal relativities in a modified Bonus-Malus system with long memory transition rules and frequency-severity dependence

abstract: In the classical Bonus-Malus System (BMS) in automobile insurance, the premium for the next year is adjusted according to the policyholder's claim history (particularly frequency) in the previous year. Some variations of the classical BMS have been considered by taking more of driver's claim experience into account to better assess individual's risk. Nevertheless, we note that in practice it is common for a BMS to adopt transition rules according to the claim history for the past multiple years in countries such as Belgium, Italy, Korea, and Singapore. In this paper, we revisit a modified BMS which was briefly introduced in Lemaire (1995) and Pitrebois et al. (2003a). Specifically, such a BMS extends the number of Bonus-Malus (BM) levels due to an additional component in the transition rules representing the number of consecutive claim-free years. With the extended BM levels granting more reasonable bonus to careful drivers, this paper investigates the transition rules in a more rigorous manner, and provides the optimal BM relativities under various statistical model assumptions including the frequency random effect model and the dependent collective risk model. Also, numerical analysis of a real data set is provided to compare the classical BMS and our proposed BMS.


title: Translational Symmetry-Aware Facade Parsing for 3D Building Reconstruction

abstract: Effectively parsing the facade is essential to 3D building reconstruction, which is an important computer vision problem with a large amount of applications in high precision map for navigation, computer aided design, and city generation for digital entertainments. To this end, the key is how to obtain the shape grammars from 2D images accurately and efficiently. Although enjoying the merits of promising results on the semantic parsing, deep learning methods cannot directly make use of the architectural rules, which play an important role for man-made structures. In this paper, we present a novel translational symmetry-based approach to improving the deep neural networks. Our method employs deep learning models as the base parser, and a module taking advantage of translational symmetry is used to refine the initial parsing results. In contrast to conventional semantic segmentation or bounding box prediction, we propose a novel scheme to fuse segmentation with anchor-free detection in a single stage network, which enables the efficient training and better convergence. After parsing the facades into shape grammars, we employ an off-the-shelf rendering engine like Blender to reconstruct the realistic high-quality 3D models using procedural modeling. We conduct experiments on three public datasets, where our proposed approach outperforms the state-of-the-art methods. In addition, we have illustrated the 3D building models built from 2D facade images.


title: Analytical and computational properties of the variable symmetric division deg index

abstract: The aim of this work is to obtain new inequalities for the variable symmetric division deg index $SDD_\alpha(G) = \sum_{uv \in E(G)} (d_u^\alpha/d_v^\alpha+d_v^\alpha/d_u^\alpha)$, and to characterize graphs extremal with respect to them. Here, $uv$ denotes the edge of the graph $G$ connecting the vertices $u$ and $v$, $d_u$ is the degree of the vertex $u$, and $\alpha \in \mathbb{R}$. Some of these inequalities generalize and improve previous results for the symmetric division deg index. In addition, we computationally apply the $SDD_\alpha(G)$ index on random graphs and show that the ratio $\left\langle SDD_\alpha(G) \right\rangle/n$ ($n$ being the order of the graph) depends only on the average degree $\left\langle d \right\rangle$.


title: On Selection of Semiparametric Spatial Regression Models

abstract: In this paper, we focus on the variable selection techniques for a class of semiparametric spatial regression models which allow one to study the effects of explanatory variables in the presence of the spatial information. The spatial smoothing problem in the nonparametric part is tackled by means of bivariate splines over triangulation, which is able to deal efficiently with data distributed over irregularly shaped regions. In addition, we develop a unified procedure for variable selection to identify significant covariates under a double penalization framework, and we show that the penalized estimators enjoy the "oracle" property. The proposed method can simultaneously identify non-zero spatially distributed covariates and solve the problem of "leakage" across complex domains of the functional spatial component. To estimate the standard deviations of the proposed estimators for the coefficients, a sandwich formula is developed as well. In the end, Monte Carlo simulation examples and a real data example are provided to illustrate the proposed methodology. All technical proofs are given in the supplementary materials.


title: Non-equilibrium thermodynamics and Phase transition of Ehrenfest urns with interactions

abstract: Ehrenfest urns with interaction that are connected in a ring is considered as a paradigm model for non-equilibrium thermodynamics and is shown to exhibit two distinct non-equilibrium steady states (NESS) of uniform and non-uniform particle distributions. As the inter-particle attraction varies, a first order non-equilibrium phase transition occurs between these two NESSs characterized by a coexistence regime. The phase boundaries, the NESS particle distributions near saddle points and the associated particle fluxes, average urn population fractions, and the relaxational dynamics to the NESSs are obtained analytically and verified numerically. A generalized non-equilibrium thermodynamics law is also obtained, which explicitly identifies the heat, work, energy and entropy of the system.


title: Grothendieck rings of definable subassignments and equivariant motivic measures

abstract: The paper studies categories of definable subassignments with some category equivalences to semi-algebraic and constructible subsets of arc spaces of algebraic varieties. These materials allow us to compare the motivic measure of Cluckers-Loeser and the one of Denef-Loeser in certain classes of definable subassignments.


title: An inverse random source problem for the time-space fractional diffusion equation driven by fractional Brownian motion

abstract: We study the inverse random source problem for the time-space fractional diffusion equation driven by fractional Brownian motion with Hurst index $H\in(0,1)$. With the aid of a novel estimate, by using the operator approach we propose regularity analyses for the direct problem. Then we provide a reconstruction scheme for the source terms $f$ and $g$ up to the sign. Next, combining the properties of Mittag-Leffler function, the complete uniqueness and instability analyses are provided. It's worth mentioning that all the analyses are unified for $H\in(0,1)$.


title: Consumer Image Quality Prediction using Recurrent Neural Networks for Spatial Pooling

abstract: Promising results for subjective image quality prediction have been achieved during the past few years by using convolutional neural networks (CNN). However, the use of CNNs for high resolution image quality assessment remains a challenge, since typical CNN architectures have been designed for small resolution input images. In this study, we propose an image quality model that attempts to mimic the attention mechanism of human visual system (HVS) by using a recurrent neural network (RNN) for spatial pooling of the features extracted from different spatial areas (patches) by a deep CNN-based feature extractor. The experimental study, conducted by using images with different resolutions from two recently published image quality datasets, indicates that the quality prediction accuracy of the proposed method is competitive against benchmark models representing the state-of-the-art, and the proposed method also performs consistently on different resolution versions of the same dataset.


title: Self-supervised Lesion Change Detection and Localisation in Longitudinal Multiple Sclerosis Brain Imaging

abstract: Longitudinal imaging forms an essential component in the management and follow-up of many medical conditions. The presence of lesion changes on serial imaging can have significant impact on clinical decision making, highlighting the important role for automated change detection. Lesion changes can represent anomalies in serial imaging, which implies a limited availability of annotations and a wide variety of possible changes that need to be considered. Hence, we introduce a new unsupervised anomaly detection and localisation method trained exclusively with serial images that do not contain any lesion changes. Our training automatically synthesises lesion changes in serial images, introducing detection and localisation pseudo-labels that are used to self-supervise the training of our model. Given the rarity of these lesion changes in the synthesised images, we train the model with the imbalance robust focal Tversky loss. When compared to supervised models trained on different datasets, our method shows competitive performance in the detection and localisation of new demyelinating lesions on longitudinal magnetic resonance imaging in multiple sclerosis patients. Code for the models will be made available on GitHub.


title: DialoGraph: Incorporating Interpretable Strategy-Graph Networks into Negotiation Dialogues

abstract: To successfully negotiate a deal, it is not enough to communicate fluently: pragmatic planning of persuasive negotiation strategies is essential. While modern dialogue agents excel at generating fluent sentences, they still lack pragmatic grounding and cannot reason strategically. We present DialoGraph, a negotiation system that incorporates pragmatic strategies in a negotiation dialogue using graph neural networks. DialoGraph explicitly incorporates dependencies between sequences of strategies to enable improved and interpretable prediction of next optimal strategies, given the dialogue context. Our graph-based method outperforms prior state-of-the-art negotiation models both in the accuracy of strategy/dialogue act prediction and in the quality of downstream dialogue response generation. We qualitatively show further benefits of learned strategy-graphs in providing explicit associations between effective negotiation strategies over the course of the dialogue, leading to interpretable and strategic dialogues.


title: Anomalous diamagnetism of electride electrons in transition metal silicides

abstract: Intermetallic silicide compounds, LaScSi and Y$_5$Si$_3$, known for being hydrogen (H) storage materials, are drawing attention as candidates for electrides in which anions are substituted by unbound electrons. It is inferred from a muon spin rotation experiment that the local field at the muon site (which is the same site as that for H) in these compounds exhibits a large negative shift under an external magnetic field, which is mostly independent of temperature. Such anomalous diamagnetism signals a unique property of electride electrons associated with transition metals. Moreover, the diamagnetic shift decreases with increasing H content, suggesting that the electride electrons existing coherently in the hollow interstitial positions are adsorbed by H to form hydride ions (H$^-$)


title: An Empirical Comparison of Off-policy Prediction Learning Algorithms on the Collision Task

abstract: Off-policy prediction -- learning the value function for one policy from data generated while following another policy -- is one of the most challenging subproblems in reinforcement learning. This paper presents empirical results with eleven prominent off-policy learning algorithms that use linear function approximation: five Gradient-TD methods, two Emphatic-TD methods, Off-policy TD($\lambda$), Vtrace, and versions of Tree Backup and ABQ modified to apply to a prediction setting. Our experiments used the Collision task, a small idealized off-policy problem analogous to that of an autonomous car trying to predict whether it will collide with an obstacle. We assessed the performance of the algorithms according to their learning rate, asymptotic error level, and sensitivity to step-size and bootstrapping parameters. By these measures, the eleven algorithms can be partially ordered on the Collision task. In the top tier, the two Emphatic-TD algorithms learned the fastest, reached the lowest errors, and were robust to parameter settings. In the middle tier, the five Gradient-TD algorithms and Off-policy TD($\lambda$) were more sensitive to the bootstrapping parameter. The bottom tier comprised Vtrace, Tree Backup, and ABQ; these algorithms were no faster and had higher asymptotic error than the others. Our results are definitive for this task, though of course experiments with more tasks are needed before an overall assessment of the algorithms' merits can be made.


title: Posted Price versus Auction Mechanisms in Freight Transportation Marketplaces

abstract: We consider a freight platform that serves as an intermediary between shippers and carriers in a truckload transportation network. The platform's objective is to design a mechanism that determines prices for shippers and payments to carriers, as well as how carriers are matched to loads to be transported, to maximize its long-run average profit. We analyze three types of carrier-side mechanisms commonly used by freight platforms: posted price, auction, and a hybrid mechanism where carriers can either book loads at posted prices or submit their bids. The proposed mechanisms are constructed using a fluid approximation model to incorporate carrier interactions in the freight network. We show that the auction mechanism has higher expected profits than the hybrid mechanism, which in turn has higher profits than the posted price mechanism. Thus, the hybrid mechanism achieves a trade-off between platform profit and carrier waiting time. We prove tight bounds between these mechanisms for varying market sizes. The findings are validated through a numerical simulation using industry data from the U.S. freight market.


title: Dynamics of quasi de Sitter and linear combination of exponential models in extended gravity

abstract: In this paper, we have studied the dynamical aspects of some cosmological models in an isotropic space-time within the framework of an extended gravity theory. Two accelerating cosmological models are presented with quasi-de Sitter (QDS) and linear combination of exponential (LCE) scale factors. The geometrical testing mechanism has been performed and analysed. While the results of the QDS model show a departure from the concordant $\Lambda$CDM model, the resulting behavior of the LCE model seems to be compatible with the $\Lambda$CDM model only at the present epoch and is incompatible in the near past.


title: Contrastive ACE: Domain Generalization Through Alignment of Causal Mechanisms

abstract: Domain generalization aims to learn knowledge invariant across different distributions while semantically meaningful for downstream tasks from multiple source domains, to improve the model's generalization ability on unseen target domains. The fundamental objective is to understand the underlying "invariance" behind these observational distributions and such invariance has been shown to have a close connection to causality. While many existing approaches make use of the property that causal features are invariant across domains, we consider the causal invariance of the average causal effect of the features to the labels. This invariance regularizes our training approach in which interventions are performed on features to enforce stability of the causal prediction by the classifier across domains. Our work thus sheds some light on the domain generalization problem by introducing invariance of the mechanisms into the learning process. Experiments on several benchmark datasets demonstrate the performance of the proposed method against SOTAs.


title: A systematic mapping on quantum software development in the context of software engineering

abstract: Quantum Computing is a new paradigm that enables several advances which are impossible using classical technology. With the rise of quantum computers, the software is also invited to change so that it can better fit this new computation way. However, although a lot of research is being conducted in the quantum computing field, it is still scarce studies about the differences of the software and software engineering in this new context. Therefore, this article presents a systematic mapping study to present a wide review on the particularities and characteristics of software that are developed for quantum computers. A total of 24 papers were selected using digital libraries with the objective of answering three research questions elaborated in the conduct of this research.


title: An Extendible, Graph-Neural-Network-Based Approach for Accurate Force Field Development of Large Flexible Organic Molecules

abstract: An accurate force field is the key to the success of all molecular mechanics simulations on organic polymers and biomolecules. Accuracy beyond density functional theory is often needed to describe the intermolecular interactions, while most correlated wavefunction (CW) methods are prohibitively expensive for large molecules. Therefore, it posts a great challenge to develop an extendible ab initio force field for large flexible organic molecules at CW level of accuracy. In this work, we face this challenge by combining the physics-driven nonbonding potential with a data-driven subgraph neural network bonding model (named sGNN). Tests on polyethylene glycol polymer chains show that our strategy is highly accurate and robust for molecules of different sizes. Therefore, we can develop the force field from small molecular fragments (with sizes easily accessible to CW methods) and safely transfer it to large polymers, thus opening a new path to the next-generation organic force fields.

categories: physics.chem-ph cond-mat.soft cs.CE cs.LG physics.comp-ph


title: Simulated quantum annealing as a simulator of non-equilibrium quantum dynamics

abstract: Simulated quantum annealing based on the path-integral Monte Carlo is one of the most common tools to simulate quantum annealing on classical hardware. Nevertheless, it is in principle highly non-trivial whether or not this classical algorithm can correctly reproduce the quantum dynamics of quantum annealing, particularly in the diabatic regime. We study this problem numerically through the generalized Kibble-Zurek mechanism of defect distribution in the simplest ferromagnetic one-dimensional transverse-field Ising model with and without coupling to the environment. We find that,in the absence of coupling to the environment, simulated quantum annealing correctly describes the annealing-time dependence of the average number of defects, but a detailed analysis of the defect distribution shows clear deviations from the theoretical prediction. When the system is open (coupled to the environment), the average number of defects does not follow the theoretical prediction but is qualitatively compatible with the numerical result by the infinite time-evolving block decimation combined with the quasi-adiabatic propagator path integral, which is valid in a very short time region. The distribution of defects in the open system turns out to be not far from the theoretical prediction. It is surprising that the classical stochastic dynamics of simulated quantum annealing ostensibly reproduce some aspects of the quantum dynamics. However, a serious problem is that it is hard to predict for which physical quantities in which system it is reliable. Those results suggest the necessity to exert a good amount of caution in using simulated quantum annealing to study the detailed quantitative aspects of the dynamics of quantum annealing.


title: Effect of the pion field on the distributions of pressure and shear in the proton

abstract: In light of recent experimental progress in determining the pressure and shear distributions in the proton, these quantities are calculated in a model with confined quarks supplemented by the pion field required by chiral symmetry. The incorporation of the pion contributions is shown to account for the long-range distributions, in general agreement with the experimentally extracted quark contributions. The results of the model are also compared with lattice QCD results at unphysically large quark mass.


title: Shell effect in $A=$116--124 Tin isotopes investigated using isotopic analysis of proton scattering at 295 MeV

abstract: Proton elastic scattering off Sn isotopes at $E_p=295$ MeV in the mass number range of $A=$116--124 was investigated using calculation employing relativistic impulse approximation (RIA) with theoretical densities obtained for the Sn isotopes from relativistic Hartree-Bogoliubov (RHB) and nonrelativistic Skyrme Hartree-Fock-Bogoliubov (SHFB) calculations of spherical nuclei. In the RIA calculations, a modified version of the Murdock and Horowitz model that includes a density dependence in the effective nucleon-nucleon ($NN$) interaction was used. A calculation using the theoretical density obtained from a relativistic calculation employing the DD-ME2 interaction successfully reproduced the experimental data for $^{122}$Sn$(p,p)$, but it overestimated the $^{116}$Sn$(p,p)$ and $^{118}$Sn$(p,p)$ cross sections at backward angles. Isotopic analyses of the $(p,p)$ reactions combined with nuclear structure properties were performed based on reaction calculations that used a model density modified from the DD-ME2 density to optimize the neutron density of the Sn isotopes by fitting the isotopic cross section ratios. The resulting optimized density reproduced the experimental $(p,p)$ data for the series of Sn isotopes from $^{116}$Sn to $^{124}$Sn. The neutron root-mean-square(rms) radii and the skin thickness of the Sn isotopes obtained in the present analysis exhibited smooth $A$ dependences in the range of $A=$116--124, which are consistent with the theoretical predictions obtained using the DD-ME2 interaction but seem to contradict the experimental results determined from the $(p,p)$ data. In a detailed analysis of the surface neutron density probed by proton elastic scattering, a signal of the shell effect at $N=66$ in Sn isotopes was found.


title: Understanding the Design Space of Mouth Microgestures

abstract: As wearable devices move toward the face (i.e. smart earbuds, glasses), there is an increasing need to facilitate intuitive interactions with these devices. Current sensing techniques can already detect many mouth-based gestures; however, users' preferences of these gestures are not fully understood. In this paper, we investigate the design space and usability of mouth-based microgestures. We first conducted brainstorming sessions (N=16) and compiled an extensive set of 86 user-defined gestures. Then, with an online survey (N=50), we assessed the physical and mental demand of our gesture set and identified a subset of 14 gestures that can be performed easily and naturally. Finally, we conducted a remote Wizard-of-Oz usability study (N=11) mapping gestures to various daily smartphone operations under a sitting and walking context. From these studies, we develop a taxonomy for mouth gestures, finalize a practical gesture set for common applications, and provide design guidelines for future mouth-based gesture interactions.


title: Proposed DBMS for OTT platforms in line with new age requirements

abstract: Database management has become an enormous tool for on-demand content distribution services, proffering required information and providing custom services to the user. Also plays a major role for the platforms to manage their data in such a way that data redundancy is minimized. This paper emphasizes improving the user experience for the platform by efficiently managing data. Keeping in mind all the new age requirements, especially after COVID-19 the sudden surge in subscription has led the stakeholders to try new things to lead the OTT market. Collection of shows being the root of the tree here, this paper improvises the currently existing branches via various tables and suggests some new features on how the data collected can be utilized for introducing new and much-required query results for the consumer.


title: OntoGUM: Evaluating Contextualized SOTA Coreference Resolution on 12 More Genres

abstract: SOTA coreference resolution produces increasingly impressive scores on the OntoNotes benchmark. However lack of comparable data following the same scheme for more genres makes it difficult to evaluate generalizability to open domain data. This paper provides a dataset and comprehensive evaluation showing that the latest neural LM based end-to-end systems degrade very substantially out of domain. We make an OntoNotes-like coreference dataset called OntoGUM publicly available, converted from GUM, an English corpus covering 12 genres, using deterministic rules, which we evaluate. Thanks to the rich syntactic and discourse annotations in GUM, we are able to create the largest human-annotated coreference corpus following the OntoNotes guidelines, and the first to be evaluated for consistency with the OntoNotes scheme. Out-of-domain evaluation across 12 genres shows nearly 15-20% degradation for both deterministic and deep learning systems, indicating a lack of generalizability or covert overfitting in existing coreference resolution models.


title: Discrete Cosine Transform as Universal Sentence Encoder

abstract: Modern sentence encoders are used to generate dense vector representations that capture the underlying linguistic characteristics for a sequence of words, including phrases, sentences, or paragraphs. These kinds of representations are ideal for training a classifier for an end task such as sentiment analysis, question answering and text classification. Different models have been proposed to efficiently generate general purpose sentence representations to be used in pretraining protocols. While averaging is the most commonly used efficient sentence encoder, Discrete Cosine Transform (DCT) was recently proposed as an alternative that captures the underlying syntactic characteristics of a given text without compromising practical efficiency compared to averaging. However, as with most other sentence encoders, the DCT sentence encoder was only evaluated in English. To this end, we utilize DCT encoder to generate universal sentence representation for different languages such as German, French, Spanish and Russian. The experimental results clearly show the superior effectiveness of DCT encoding in which consistent performance improvements are achieved over strong baselines on multiple standardized datasets.


title: Strain-induced time reversal breaking and half quantum vortices near a putative superconducting tetra-critical point in Sr$_2$RuO$_4$

abstract: It has been shown [1] that many seemingly contradictory experimental findings concerning the superconducting state in Sr$_2$RuO$_4$ can be accounted for as resulting from the existence of an assumed tetra-critical point at near ambient pressure at which $d_{x^2-y^2}$ and $g_{xy(x^2-y^2)}$ superconducting states are degenerate. We perform both a Landau-Ginzburg and a microscopic mean-field analysis of the effect of spatially varying strain on such a state. In the presence of finite $xy$ shear strain, the superconducting state consists of two possible symmetry-related time-reversal symmetry (TRS) preserving states: $d \pm g$. However, at domain walls between two such regions, TRS can be broken, resulting in a $d+ig$ state. More generally, we find that various natural patterns of spatially varying strain induce a rich variety of superconducting textures, including half-quantum fluxoids. These results may resolve some of the apparent inconsistencies between the theoretical proposal and various experimental observations, including the suggestive evidence of half-quantum vortices [2]. [1] Steven A Kivelson, Andrew C Yuan, BJ Ramshaw, and Ronny Thomale, "A proposal for reconciling diverse experiments on the superconducting state in Sr$_2$RuO$_4$," npj Quantum Mater 5 (2020). [2] J Jang, DG Ferguson, V Vakaryuk, Raffi Budakian, SB Chung, PM Goldbart, and Y Maeno, "Observation of half-height magnetization steps in Sr$_2$RuO$_4$," Science 331, 186-188 (2011).


title: Least-Restrictive Multi-Agent Collision Avoidance via Deep Meta Reinforcement Learning and Optimal Control

abstract: Multi-agent collision-free trajectory planning and control subject to different goal requirements and system dynamics has been extensively studied, and is gaining recent attention in the realm of machine and reinforcement learning. However, in particular when using a large number of agents, constructing a least-restrictive collision avoidance policy is of utmost importance for both classical and learning-based methods. In this paper, we propose a Least-Restrictive Collision Avoidance Module (LR-CAM) that evaluates the safety of multi-agent systems and takes over control only when needed to prevent collisions. The LR-CAM is a single policy that can be wrapped around policies of all agents in a multi-agent system. It allows each agent to pursue any objective as long as it is safe to do so. The benefit of the proposed least-restrictive policy is to only interrupt and overrule the default controller in case of an upcoming inevitable danger. We use a Long Short-Term Memory (LSTM) based Variational Auto-Encoder (VAE) to enable the LR-CAM to account for a varying number of agents in the environment. Moreover, we propose an off-policy meta-reinforcement learning framework with a novel reward function based on a Hamilton-Jacobi value function to train the LR-CAM. The proposed method is fully meta-trained through a ROS based simulation and tested on real multi-agent system. Our results show that LR-CAM outperforms the classical least-restrictive baseline by 30 percent. In addition, we show that even if a subset of agents in a multi-agent system use LR-CAM, the success rate of all agents will increase significantly.


title: Putting the Squeeze on Array Programs: Loop Verification via Inductive Rank Reduction

abstract: Automatic verification of array manipulating programs is a challenging problem because it often amounts to the inference of in ductive quantified loop invariants which, in some cases, may not even be firstorder expressible. In this paper, we suggest a novel verification tech nique that is based on induction on userdefined rank of program states as an alternative to loopinvariants. Our technique, dubbed inductive rank reduction, works in two steps. Firstly, we simplify the verification problem and prove that the program is correct when the input state con tains an input array of length B or less, using the length of the array as the rank of the state. Secondly, we employ a squeezing function g which converts a program state sigma with an array of length > B to a state g(sigma) containing an array of length minus 1 or less. We prove that when g satisfies certain natural conditions then if the program violates its specification on sigma then it does so also on g(sigma). The correctness of the program on inputs with arrays of arbitrary lengths follows by induction. We make our technique automatic for array programs whose length of execution is proportional to the length of the input arrays by (i) perform ing the first step using symbolic execution, (ii) verifying the conditions required of g using Z3, and (iii) providing a heuristic procedure for syn thesizing g. We implemented our technique and applied it successfully to several interesting arraymanipulating programs, including a bidirec tional summation program whose loop invariant cannot be expressed in firstorder logic while its specification is quantifier free.