title: On the Bieri-Neumann-Strebel-Renz $\Sigma$-invariants of the Bestvina-Brady groups

abstract: We study the Bieri-Neumann-Strebel-Renz invariants and we prove the following criterion: for groups $H$ and $K$ of type $FP_n$ such that $[H,H] \subseteq K \subseteq H$ and a character $\chi : K \to \mathbb{R}$ with $\chi([H,H]) = 0$ we have $[\chi] \in \Sigma^n(K, \mathbb{Z})$ if and only if $[\mu] \in \Sigma^n(H, \mathbb{Z})$ for every character $\mu : H \to \mathbb{R}$ that extends $\chi$. The same holds for the homotopical invariants $\Sigma^n(-)$ when $K$ and $H$ are groups of type $F_n$. We use these criteria to complete the description of the $\Sigma$-invariants of the Bieri-Stallings groups $G_m$ and more generally to describe the $\Sigma$-invariants of the Bestvina-Brady groups. We also show that the "only if" direction of such criterion holds if we assume only that $K$ is a subnormal subgroup of $H$, where both groups are of type $FP_n$. We apply this last result to wreath products.


title: Array Resource Allocation for Radar and Communication Integration Network

abstract: A radar and communication integration (RCI) system has great flexibility in allocating antenna resources to guarantee both radar and communication performance. This paper considers the array allocation problems for multiple target localization and multiple platforms communication in an RCI network. The objective of array allocation is to maximize the communication capacity for each channel and to minimize the localization error for each target. In this paper, we firstly build a localization and communication model for array allocation in an RCI network. Minorization maximization (MM) is then applied to create surrogate functions for multiple objective optimization problems. The projected gradient descent (PGD) method is further employed to solve two array allocation problems with and without a certain communication capacity constraint. Computer simulations are conducted to evaluate the performance of the proposed algorithms. The results show that the proposed algorithms have improved localization and communication performance after efficiently allocating the array resource in the RCI network.


title: Regularized Inverse Reinforcement Learning

abstract: Inverse Reinforcement Learning (IRL) aims to facilitate a learner's ability to imitate expert behavior by acquiring reward functions that explain the expert's decisions. Regularized IRL applies strongly convex regularizers to the learner's policy in order to avoid the expert's behavior being rationalized by arbitrary constant rewards, also known as degenerate solutions. We propose tractable solutions, and practical methods to obtain them, for regularized IRL. Current methods are restricted to the maximum-entropy IRL framework, limiting them to Shannon-entropy regularizers, as well as proposing the solutions that are intractable in practice. We present theoretical backing for our proposed IRL method's applicability for both discrete and continuous controls, empirically validating our performance on a variety of tasks.


title: An Audio-Video Deep and Transfer Learning Framework for Multimodal Emotion Recognition in the wild

abstract: In this paper, we present our contribution to ABAW facial expression challenge. We report the proposed system and the official challenge results adhering to the challenge protocol. Using end-to-end deep learning and benefiting from transfer learning approaches, we reached a test set challenge performance measure of 42.10%.


title: Five New Post-Main-Sequence Debris Disks with Gaseous Emission

abstract: Observations of debris disks, the products of the collisional evolution of rocky planetesimals, can be used to trace planetary activity across a wide range of stellar types. The most common end points of stellar evolution are no exception as debris disks have been observed around several dozen white dwarf stars. But instead of planetary formation, post-main-sequence debris disks are a signpost of planetary destruction, resulting in compact debris disks from the tidal disruption of remnant planetesimals. In this work, we present the discovery of five new debris disks around white dwarf stars with gaseous debris in emission. All five systems exhibit excess infrared radiation from dusty debris, emission lines from gaseous debris, and atmospheric absorption features indicating on-going accretion of metal-rich debris. In four of the systems, we detect multiple metal species in emission, some of which occur at strengths and transitions previously unseen in debris disks around white dwarf stars. Our first year of spectroscopic follow-up hints at strong variability in the emission lines that can be studied in the future, expanding the range of phenomena these post-main-sequence debris disks exhibit.


title: Learning Intrinsic Symbolic Rewards in Reinforcement Learning

abstract: Learning effective policies for sparse objectives is a key challenge in Deep Reinforcement Learning (RL). A common approach is to design task-related dense rewards to improve task learnability. While such rewards are easily interpreted, they rely on heuristics and domain expertise. Alternate approaches that train neural networks to discover dense surrogate rewards avoid heuristics, but are high-dimensional, black-box solutions offering little interpretability. In this paper, we present a method that discovers dense rewards in the form of low-dimensional symbolic trees - thus making them more tractable for analysis. The trees use simple functional operators to map an agent's observations to a scalar reward, which then supervises the policy gradient learning of a neural network policy. We test our method on continuous action spaces in Mujoco and discrete action spaces in Atari and Pygame environments. We show that the discovered dense rewards are an effective signal for an RL policy to solve the benchmark tasks. Notably, we significantly outperform a widely used, contemporary neural-network based reward-discovery algorithm in all environments considered.


title: Serendipitous Discovery of Nine White Dwarfs With Gaseous Debris Disks

abstract: Optical spectroscopic observations of white dwarf stars selected from catalogs based on the Gaia DR2 database reveal nine new gaseous debris disks that orbit single white dwarf stars, about a factor of two increase over the previously known sample. For each source we present gas emission lines identified and basic stellar parameters, including abundances for lines seen with low-resolution spectroscopy. Principle discoveries include: (1) the coolest white dwarf (Teff~12,720 K) with a gas disk; this star, WD0145+234, has been reported to have undergone a recent infrared outburst; (2) co-location in velocity space of gaseous emission from multiple elements, suggesting that different elements are well-mixed; (3) highly asymmetric emission structures toward SDSSJ0006+2858, and possibly asymmetric structures for two other systems; (4) an overall sample composed of approximately 25% DB and 75% DA white dwarfs, consistent with the overall distribution of primary atmospheric types found in the field population; and (5) never-before-seen emission lines from Na in the spectra of GaiaJ0611-6931, semi-forbidden Mg, Ca, and Fe lines toward WD0842+572, and Si in both stars. The currently known sample of gaseous debris disk systems is significantly skewed towards northern hemisphere stars, suggesting a dozen or so emission line stars are waiting to be found in the southern hemisphere.


title: Moments of the distribution of $k$-free numbers in short intervals and arithmetic progressions

abstract: We show estimates for the distribution of $k$-free numbers in short intervals and arithmetic progressions. We argue that, at least in certain ranges, these estimates agree with a conjecture by H. L. Montgomery.


title: A Critique of Self-Expressive Deep Subspace Clustering

abstract: Subspace clustering is an unsupervised clustering technique designed to cluster data that is supported on a union of linear subspaces, with each subspace defining a cluster with dimension lower than the ambient space. Many existing formulations for this problem are based on exploiting the self-expressive property of linear subspaces, where any point within a subspace can be represented as linear combination of other points within the subspace. To extend this approach to data supported on a union of non-linear manifolds, numerous studies have proposed learning an embedding of the original data using a neural network which is regularized by a self-expressive loss function on the data in the embedded space to encourage a union of linear subspaces prior on the data in the embedded space. Here we show that there are a number of potential flaws with this approach which have not been adequately addressed in prior work. In particular, we show the model formulation is often ill-posed in that it can lead to a degenerate embedding of the data, which need not correspond to a union of subspaces at all and is poorly suited for clustering. We validate our theoretical results experimentally and also repeat prior experiments reported in the literature, where we conclude that a significant portion of the previously claimed performance benefits can be attributed to an ad-hoc post processing step rather than the deep subspace clustering model.


title: The colored Jones polynomial of a cable of the figure-eight knot

abstract: We study the asymptotic behavior of the $N$-dimensional colored Jones polynomial of a cable of the figure-eight knot, evaluated at $\exp(\xi/N)$ for a real number $\xi$. We show that if $\xi$ is sufficiently large, the colored Jones polynomial grows exponentially when $N$ goes to the infinity. Moreover the growth rate is related to the Chern-Simons invariant of the knot exterior associated with an $\mathrm{SL}(2;\mathbb{R})$ representation.


title: On thermal correlators and bosonization duality in Chern-Simons theories with massive fundamental matter

abstract: We consider Chern-Simons theory coupled to massive fundamental matter in three spacetime dimensions at finite temperature, in the large $N$ limit. We compute several thermal correlators in this theory for both fermionic and bosonic matter separately. The results are computed in the large $N$ 't Hooft limit but for arbitrary values of the 't Hooft coupling. Furthermore, we generalize the computations of the four-point function of fundamental scalars in the bosonic theory to finite temperature. As a consistency check, we see that the results obtained here agree with the existing previous results in different limiting cases. Moreover, we check that the results are consistent with the conjectured bosonization duality, providing an additional evidence of it.


title: Multivariate functional responses low rank regression with an application to brain imaging data

abstract: We propose a multivariate functional responses low rank regression model with possible high dimensional functional responses and scalar covariates. By expanding the slope functions on a set of sieve basis, we reconstruct the basis coefficients as a matrix. To estimate these coefficients, we propose an efficient procedure using nuclear norm regularization. We also derive error bounds for our estimates and evaluate our method using simulations. We further apply our method to the Human Connectome Project neuroimaging data to predict cortical surface motor task-evoked functional magnetic resonance imaging signals using various clinical covariates to illustrate the usefulness of our results.


title: Differentially Private Deep Learning with Direct Feedback Alignment

abstract: Standard methods for differentially private training of deep neural networks replace back-propagated mini-batch gradients with biased and noisy approximations to the gradient. These modifications to training often result in a privacy-preserving model that is significantly less accurate than its non-private counterpart. We hypothesize that alternative training algorithms may be more amenable to differential privacy. Specifically, we examine the suitability of direct feedback alignment (DFA). We propose the first differentially private method for training deep neural networks with DFA and show that it achieves significant gains in accuracy (often by 10-20%) compared to backprop-based differentially private training on a variety of architectures (fully connected, convolutional) and datasets.


title: Quantitative predictions of photo-emission dynamics in metal halide perovskites via machine learning

abstract: Metal halide perovskite (MHP) optoelectronics may become a viable alternative to standard Si-based technologies, but the current lack of long-term stability precludes their commercial adoption. Exposure to standard operational stressors (light, temperature, bias, oxygen, and water) often instigate optical and electronic dynamics, calling for a systematic investigation into MHP photophysical processes and the development of quantitative models for their prediction. We resolve the moisture-driven light emission dynamics for both methylammonium lead tribromide and triiodide thin films as a function of relative humidity (rH). With the humidity and photoluminescence time series, we train recurrent neural networks and establish their ability to quantitatively predict the path of future light emission with <11% error over 12 hours. Together, our in situ rH-PL measurements and machine learning forecasting models provide a framework for the rational design of future stable perovskite devices and, thus, a faster transition towards commercial applications.


title: Optoelectronic Analysis of Spectrally Selective Nanophotonic Metafilm Cell for Thermophotovoltaic Energy Conversion

abstract: This work theoretically explores a spectrally selective TPV cell based on an asymmetric Fabry-Perot resonance cavity structure with sub-100-nm GaSb layer. The simulated spectral property of the ultrathin nanophotonic cell structure exhibits a high absorption peak above the bandgap due to the interference effect with electromagnetic field enhanced inside the GaSb layer between top and bottom silver electrodes, while the sub-bandgap absorption is as low as a few percent because of high reflectivity of the metal. An absorption enhancement nearly 20 times at particular frequency above bandgap is achieved within the sub-100-nm GaSb layer with the nanophotonic cell structure compared to the free-standing one. Besides, a thin layer of MoOx is incorporated into the metafilm cell structure as a hole transport layer to consider the charge collection in practice. With rigorous optoelectronic analysis by considering both radiative and nonradiative recombinations (Shockley-Reed-Hall and Auger), the nanophotonic cell is predicted to achieve a TPV efficiency of 22.8% and output power of 0.62 W/cm2 with a black emitter at 1500 K due to spectrally enhanced in-band absorption and low sub-bandgap absorption. With an ideal selective emitter which is hard to achieve in practice along with thermal stability concerns, the efficiency can be further improved to 28% by eliminating sub-bandgap photons. The proposed spectrally selective nanophotonic metafilm cell could be a viable route to achieve high-efficiency and low-cost TPV energy conversion.


title: Microelectromechanical deformable mirror development for high-contrast imaging, part 2: the impact of quantization errors on coronagraph image contrast

abstract: Stellar coronagraphs rely on deformable mirrors (DMs) to correct wavefront errors and create high contrast images. Imperfect control of the DM limits the achievable contrast and, therefore, the DM control electronics must provide fine surface height resolution and low noise. Here, we study the impact of quantization errors due to the DM electronics on the image contrast using experimental data from the High Contrast Imaging Testbed (HCIT) facility at NASA's Jet Propulsion Laboratory (JPL). We find that the simplest analytical model gives optimistic predictions compared to real cases, with contrast up to 3 times better, which leads to DM surface height resolution requirements that are incorrectly relaxed by 70%. We show that taking into account the DM actuator shape, or influence function, improves the analytical predictions. However, we also find that end-to-end numerical simulations of the wavefront sensing and control process provide the most accurate predictions and recommend such an approach for setting robust requirements on the DM control electronics. From our experimental and numerical results, we conclude that a surface height resolution of approximately 6pm is required for imaging temperate terrestrial exoplanets around Solar-type stars at wavelengths as small as 450nm with coronagraph instruments on future space telescopes. Finally, we list the recognizable characteristics of quantization errors that may help determine if they are a limiting factor.


title: The drag of photons by electric current in quantum wells

abstract: The flow of electric current in quantum well breaks the space inversion symmetry, which leads to the dependence of the radiation transmission on the relative orientation of current and photon wave vector, this phenomenon can be named current drag of photons. We have developed a microscopic theory of such an effect for intersubband transitions in quantum wells taking into account both depolarization and exchange-correlation effects. It is shown that the effect of the current drag of photons originates from the asymmetry of intersubband optical transitions due to the redistribution of electrons in momentum space. We show that the presence of dc electric current leads to the shift of intersubband resonance position and affects both transmission coefficient and absorbance in quantum wells.


title: Learning to Recombine and Resample Data for Compositional Generalization

abstract: Flexible neural sequence models outperform grammar- and automaton-based counterparts on a variety of tasks. However, neural models perform poorly in settings requiring compositional generalization beyond the training data -- particularly to rare or unseen subsequences. Past work has found symbolic scaffolding (e.g. grammars or automata) essential in these settings. We describe R&R, a learned data augmentation scheme that enables a large category of compositional generalizations without appeal to latent symbolic structure. R&R has two components: recombination of original training examples via a prototype-based generative model and resampling of generated examples to encourage extrapolation. Training an ordinary neural sequence model on a dataset augmented with recombined and resampled examples significantly improves generalization in two language processing problems -- instruction following (SCAN) and morphological analysis (SIGMORPHON 2018) -- where R&R enables learning of new constructions and tenses from as few as eight initial examples.


title: Spatial-temporal Analysis of COVID-19's Impact on Human Mobility: the Case of the United States

abstract: COVID-19 has been affecting every aspect of societal life including human mobility since December, 2019. In this paper, we study the impact of COVID-19 on human mobility patterns at the state level within the United States. From the temporal perspective, we find that the change of mobility patterns does not necessarily correlate with government policies and guidelines, but is more related to people's awareness of the pandemic, which is reflected by the search data from Google Trends. Our results show that it takes on average 14 days for the mobility patterns to adjust to the new situation. From the spatial perspective, we conduct a state-level network analysis and clustering using the mobility data from Multiscale Dynamic Human Mobility Flow Dataset. As a result, we find that 1) states in the same cluster have shorter geographical distances; 2) a 14-day delay again is found between the time when the largest number of clusters appears and the peak of Coronavirus-related search queries on Google Trends; and 3) a major reduction in other network flow properties, namely degree, closeness, and betweenness, of all states from the week of March 2 to the week of April 6 (the week of the largest number of clusters).


title: Analytic solutions of the Teukolsky equation for massless perturbations of any spin in de Sitter background

abstract: We present analytic solutions to the Teukolsky equation for massless perturbations of any spin in the 4-dimensional de Sitter background. The angular part of the equation fixes the separation constant to a discrete set and its solution is given by hypergeometric polynomials. For the radial part, we derive analytic power series solution which is regular at the poles and determine a transcendental function whose zeros give the characteristic values of the wave frequency. We study the existence of explicit polynomial solutions to the radial equation and obtain two classes of singular closed-form solutions, one with discrete wave frequencies and the other with continuous frequency spectra.


title: Asymptotic and Assouad-Nagata dimension of finitely generated groups and their subgroups

abstract: We prove that for all $k,m,n \in \mathbb N \cup \{\infty\}$ with $4 \leq k \leq m \leq n$, there exists a finitely generated group $G$ with a finitely generated subgroup $H$ such that the asymptotic dimension of $G$ is $k$, the Assouad-Nagata dimension of $G$ is $m$, and the Assouad-Nagata dimension of $H$ is $n$. This simultaneously answers two open questions in asymptotic dimension theory.


title: Topic Diffusion Discovery Based on Deep Non-negative Autoencoder

abstract: Researchers have been overwhelmed by the explosion of research articles published by various research communities. Many research scholarly websites, search engines, and digital libraries have been created to help researchers identify potential research topics and keep up with recent progress on research of interests. However, it is still difficult for researchers to keep track of the research topic diffusion and evolution without spending a large amount of time reviewing numerous relevant and irrelevant articles. In this paper, we consider a novel topic diffusion discovery technique. Specifically, we propose using a Deep Non-negative Autoencoder with information divergence measurement that monitors evolutionary distance of the topic diffusion to understand how research topics change with time. The experimental results show that the proposed approach is able to identify the evolution of research topics as well as to discover topic diffusions in online fashions.


title: $\beta$ Cephei Pulsations in the High-mass Eclipsing System CW Cephei

abstract: CW Cep is an early B-type eclipsing binary with mass measurement precisions better than 1 \%. We report the discovery of pulsation signatures in the TESS time-series data of the system observed during Sectors 17 and 18. Our binary modeling indicates that the target star is a partially-eclipsing detached system with masses of 12.95 $M_\odot$ and 11.88 $M_\odot$ and radii of 5.52 $R_\odot$ and 5.09 $R_\odot$ in an eccentric orbit of $e$ = 0.0305. The distance to the eclipsing system, 928 $\pm$ 36 pc, is much more precise than the Gaia distance of 962 $\pm$ 453 pc. Applying multifrequency analyses to the residual light curve in the outside-eclipse part, we detected 13 significant signals in two frequency regions. Six frequencies below 1 day$^{-1}$ appeared to be mostly orbital harmonic and combination terms, or sidelobes due to insufficient removal of the binary effects. In contrast, seven frequencies clustered around 2.73 day$^{-1}$ and 5.34 day$^{-1}$ could be considered $\beta$ Cep-type pulsations. Our results represent the second discovery of $\beta$ Cep pulsations present in double-lined eclipsing binaries with precise masses and, hence, CW Cep serves as an important test-bed for the asteroseismic modeling of high-mass stars.


title: Deep Tiered Image Segmentation For Detecting Internal Ice Layers in Radar Imagery

abstract: Understanding the structure of Earth's polar ice sheets is important for modeling how global warming will impact polar ice and, in turn, the Earth's climate. Ground-penetrating radar is able to collect observations of the internal structure of snow and ice, but the process of manually labeling these observations is slow and laborious. Recent work has developed automatic techniques for finding the boundaries between the ice and the bedrock, but finding internal layers - the subtle boundaries that indicate where one year's ice accumulation ended and the next began - is much more challenging because the number of layers varies and the boundaries often merge and split. In this paper, we propose a novel deep neural network for solving a general class of tiered segmentation problems. We then apply it to detecting internal layers in polar ice, evaluating on a large-scale dataset of polar ice radar data with human-labeled annotations as ground truth.


title: Moving Target Defense for Robust Monitoring of Electric Grid Transformers in Adversarial Environments

abstract: Electric power grid components, such as high voltage transformers (HVTs), generating stations, substations, etc. are expensive to maintain and, in the event of failure, replace. Thus, regularly monitoring the behavior of such components is of utmost importance. Furthermore, the recent increase in the number of cyberattacks on such systems demands that such monitoring strategies should be robust. In this paper, we draw inspiration from work in Moving Target Defense (MTD) and consider a dynamic monitoring strategy that makes it difficult for an attacker to prevent unique identification of behavioral signals that indicate the status of HVTs. We first formulate the problem of finding a differentially immune configuration set for an MTD in the context of power grids and then propose algorithms to compute it. To find the optimal movement strategy, we model the MTD as a two-player game and consider the Stackelberg strategy. With the help of IEEE test cases, we show the efficacy and scalability of our proposed approaches.


title: Don't Parse, Insert: Multilingual Semantic Parsing with Insertion Based Decoding

abstract: Semantic parsing is one of the key components of natural language understanding systems. A successful parse transforms an input utterance to an action that is easily understood by the system. Many algorithms have been proposed to solve this problem, from conventional rulebased or statistical slot-filling systems to shiftreduce based neural parsers. For complex parsing tasks, the state-of-the-art method is based on autoregressive sequence to sequence models to generate the parse directly. This model is slow at inference time, generating parses in O(n) decoding steps (n is the length of the target sequence). In addition, we demonstrate that this method performs poorly in zero-shot cross-lingual transfer learning settings. In this paper, we propose a non-autoregressive parser which is based on the insertion transformer to overcome these two issues. Our approach 1) speeds up decoding by 3x while outperforming the autoregressive model and 2) significantly improves cross-lingual transfer in the low-resource setting by 37% compared to autoregressive baseline. We test our approach on three well-known monolingual datasets: ATIS, SNIPS and TOP. For cross lingual semantic parsing, we use the MultiATIS++ and the multilingual TOP datasets.


title: Light fragment and neutron emission in high-energy proton induced spallation reactions

abstract: The dynamics of high-energy proton-induced spallation reactions on target nuclides of $^{136}$Xe, $^{59}$Ni, $^{56}$Fe, $^{208}$Pb, $^{184}$W, $^{181}$Ta, $^{197}$Au and $^{112}$Cd, are investigated with the quantum molecular dynamics transport model. The production mechanism of light nuclides and fission fragments is thoroughly analyzed. The statistical code GEMINI is employed in conjunction to the model for managing the decay of primary fragments. For the treatment of cluster emission during the preequilibrium stage, a surface coalescence model is implemented into the model. It is found that the available data of total cross sections are well reproduced with the combined approach for the spallation reactions on both the heavy and light targets, i.e., $^{56}$Fe and $^{208}$Pb, while it is underestimated in the intermediate-mass-fragment region for the medium-mass target $^{136}$Xe. The energetic clusters are mainly contributed from the preequilibrium recognition, in which the quantum tunneling is taken into account. On the other hand, a fairly well overall description of light cluster and neutron emission is obtained and detailed discrepancies with respect to the experimental results are discussed. Possible modifications on the description of spallation reactions are stressed and compared with both recent experimental and theoretical results in the literature.


title: On the size of planar graphs with positive Lin-Lu-Yau Ricci curvature

abstract: We show that if a planar graph $G$ with minimum degree at least $3$ has positive Lin-Lu-Yau Ricci curvature on every edge, then $\Delta(G)\leq 17$, which then implies that $G$ is finite. This is an analogue of a result of DeVos and Mohar [{\em Trans. Amer. Math. Soc., 2007}] on the size of planar graphs with positive combinatorial curvature.


title: Latent linguistic embedding for cross-lingual text-to-speech and voice conversion

abstract: As the recently proposed voice cloning system, NAUTILUS, is capable of cloning unseen voices using untranscribed speech, we investigate the feasibility of using it to develop a unified cross-lingual TTS/VC system. Cross-lingual speech generation is the scenario in which speech utterances are generated with the voices of target speakers in a language not spoken by them originally. This type of system is not simply cloning the voice of the target speaker, but essentially creating a new voice that can be considered better than the original under a specific framing. By using a well-trained English latent linguistic embedding to create a cross-lingual TTS and VC system for several German, Finnish, and Mandarin speakers included in the Voice Conversion Challenge 2020, we show that our method not only creates cross-lingual VC with high speaker similarity but also can be seamlessly used for cross-lingual TTS without having to perform any extra steps. However, the subjective evaluations of perceived naturalness seemed to vary between target speakers, which is one aspect for future improvement.


title: Correlation of the renormalized Hilbert length for convex projective surfaces

abstract: In this paper we focus on dynamical properties of (real) convex projective surfaces. Our main theorem provides an asymptotic formula for the number of free homotopy classes with roughly the same renormalized Hilbert length for two distinct convex real projective structures. The correlation number in this asymptotic formula is characterized in terms of their Manhattan curve. We show that the correlation number is not uniformly bounded away from zero on the space of pairs of hyperbolic surfaces, answering a question of Schwartz and Sharp. In contrast, we provide examples of diverging sequences, defined via cubic rays, along which the correlation number stays larger than a uniform strictly positive constant. In the last section, we extend the correlation theorem to Hitchin representations.


title: Metallic islands in the Kondo insulator SmB$_{6}$

abstract: The predicted interplay between Kondo physics and non-trivial topology in SmB$_{6}$ has stimulated many experimental reports, some of which are in apparent contradiction. The origin of the dispute may lie on the fragility of the Kondo insulating phase in the presence of Sm vacancies (Kondo holes) and/or natural impurities, such as Gd$^{3+}$. In this work, we locally investigated this fragility for Al-flux grown Sm$_{1-x}$Gd$_{x}$B$_{6}$ single crystals (0 $\leq$ $x$ $\leq$ 0.02) by combining electron spin resonance (ESR) and complementary bulk measurements. The Gd$^{3+}$ ESR spectra in a highly dilute regime ($x$ $\sim 0.0004$) display the features of an insulating cubic environment. Remarkably, a metallic ESR lineshape is observed for more concentrated samples ($x$ $\geq$ 0.004), even though these systems are still in a reasonably dilute regime and show insulating $dc$ electrical resistivity. Our data indicate that the Kondo insulating state is destroyed locally around impurities before a global percolation occurs. This result not only explains the discrepancy between $dc$ and $ac$ conductivity, but also provides a scenario to explain the presence of quantum oscillations in magnetization in the absence of quantum oscillations in electrical resistivity.


title: HI Deficiencies and Asymmetries in HIPASS Galaxies

abstract: We present an analysis of the sky distribution of neutral hydrogen (HI) deficiency and spectral asymmetry for galaxies detected by the HI Parkes All-Sky Survey (HIPASS) as a function of projected environment density. Previous studies of galaxy HI deficiency using HIPASS were sensitive to galaxies that are extremely HI rich or poor. We use an updated binning statistic for measuring the global sky distribution of HI deficiency that is sensitive to the average deficiencies. Our analysis confirms the result from previous studies that galaxies residing in denser environments, such as Virgo, are on average more HI deficient than galaxies at lower densities. However, many other individual groups and clusters are not found to be on average significantly HI poor, in contradiction to previous work. In terms of HI spectral asymmetries, we do not recover any significant trend of increasing asymmetry with environment density as found for other galaxy samples. We also investigate the correlation between HI asymmetry and deficiency, but find no variation in the mean asymmetry of galaxies that are HI rich, normal or poor. This indicates that there is either no dependence of asymmetry on HI deficiency, or a galaxy's HI deficiency only has a small influence on the measured HI asymmetry that we are unable to observe using only integrated spectra.


title: On-chip erbium-doped lithium niobate microdisk lasers

abstract: Erbium-doped lithium niobate high-Q microdisk cavities were fabricated in batches by UV exposure, inductively coupled plasma reactive ion etching and chemo-mechanical polishing. The stimulated emission at 1531.6 nm was observed under the pump of a narrow-band laser working at 974 nm in erbium-doped lithium niobate microdisk cavity with threshold down to 400 {\mu}W and a conversion efficiency of 3.1{\times}10^{-4} %, laying the foundation for the LNOI integrated light source research.


title: A Cascade Approach to Neural Abstractive Summarization with Content Selection and Fusion

abstract: We present an empirical study in favor of a cascade architecture to neural text summarization. Summarization practices vary widely but few other than news summarization can provide a sufficient amount of training data enough to meet the requirement of end-to-end neural abstractive systems which perform content selection and surface realization jointly to generate abstracts. Such systems also pose a challenge to summarization evaluation, as they force content selection to be evaluated along with text generation, yet evaluation of the latter remains an unsolved problem. In this paper, we present empirical results showing that the performance of a cascaded pipeline that separately identifies important content pieces and stitches them together into a coherent text is comparable to or outranks that of end-to-end systems, whereas a pipeline architecture allows for flexible content selection. We finally discuss how we can take advantage of a cascaded pipeline in neural text summarization and shed light on important directions for future research.


title: Structural relaxation in quantum supercooled liquids: A mode-coupling approach

abstract: We study supercooled dynamics in quantum hard-sphere liquid using quantum mode-coupling formulation. In the moderate quantum regime, classical cage effects lead to slower dynamics compared to strongly quantum regime, where tunneling overcomes classical caging, leading to faster relaxation. As a result, the glass transition critical density can become significantly higher than for the classical liquids. Perturbative approach is used to solve time dependent quantum mode-coupling equations to study in detail the dynamics of the supercooled liquid in moderate quantum regime. Similar to the classical case, relaxation time shows power-law increase with increasing density in the supercooled regime. However, the power-law exponent is found to be dependent on the quantumness; it increases linearly as the quantumness is increased in the moderate quantum regime.


title: Simplifying the explanation of deep neural networks with sufficient and necessary feature-sets: case of text classification

abstract: During the last decade, deep neural networks (DNN) have demonstrated impressive performances solving a wide range of problems in various domains such as medicine, finance, law, etc. Despite their great performances, they have long been considered as black-box systems, providing good results without being able to explain them. However, the inability to explain a system decision presents a serious risk in critical domains such as medicine where people's lives are at stake. Several works have been done to uncover the inner reasoning of deep neural networks. Saliency methods explain model decisions by assigning weights to input features that reflect their contribution to the classifier decision. However, not all features are necessary to explain a model decision. In practice, classifiers might strongly rely on a subset of features that might be sufficient to explain a particular decision. The aim of this article is to propose a method to simplify the prediction explanation of One-Dimensional (1D) Convolutional Neural Networks (CNN) by identifying sufficient and necessary features-sets. We also propose an adaptation of Layer-wise Relevance Propagation for 1D-CNN. Experiments carried out on multiple datasets show that the distribution of relevance among features is similar to that obtained with a well known state of the art model. Moreover, the sufficient and necessary features extracted perceptually appear convincing to humans.


title: PARADE: A New Dataset for Paraphrase Identification Requiring Computer Science Domain Knowledge

abstract: We present a new benchmark dataset called PARADE for paraphrase identification that requires specialized domain knowledge. PARADE contains paraphrases that overlap very little at the lexical and syntactic level but are semantically equivalent based on computer science domain knowledge, as well as non-paraphrases that overlap greatly at the lexical and syntactic level but are not semantically equivalent based on this domain knowledge. Experiments show that both state-of-the-art neural models and non-expert human annotators have poor performance on PARADE. For example, BERT after fine-tuning achieves an F1 score of 0.709, which is much lower than its performance on other paraphrase identification datasets. PARADE can serve as a resource for researchers interested in testing models that incorporate domain knowledge. We make our data and code freely available.


title: Learning to Fuse Sentences with Transformers for Summarization

abstract: The ability to fuse sentences is highly attractive for summarization systems because it is an essential step to produce succinct abstracts. However, to date, summarizers can fail on fusing sentences. They tend to produce few summary sentences by fusion or generate incorrect fusions that lead the summary to fail to retain the original meaning. In this paper, we explore the ability of Transformers to fuse sentences and propose novel algorithms to enhance their ability to perform sentence fusion by leveraging the knowledge of points of correspondence between sentences. Through extensive experiments, we investigate the effects of different design choices on Transformer's performance. Our findings highlight the importance of modeling points of correspondence between sentences for effective sentence fusion.


title: Distribution evaluation of hypergeometric series

abstract: We evaluate several classes of high weight hypergeometric series via Gamma, polylogarithm and elliptic integrals, mainly through distribution relations.


title: Robust Multi-class Feature Selection via $l_{2,0}$-Norm Regularization Minimization

abstract: Feature selection is an important data pre-processing in data mining and machine learning, which can reduce feature size without deteriorating model's performance. Recently, sparse regression based feature selection methods have received considerable attention due to their good performance. However, because the $l_{2,0}$-norm regularization term is non-convex, this problem is very hard to solve. In this paper, unlike most of the other methods which only solve the approximate problem, a novel method based on homotopy iterative hard threshold (HIHT) is proposed to solve the $l_{2,0}$-norm regularization least square problem directly for multi-class feature selection, which can produce exact row-sparsity solution for the weights matrix. What'more, in order to reduce the computational time of HIHT, an acceleration version of HIHT (AHIHT) is derived. Extensive experiments on eight biological datasets show that the proposed method can achieve higher classification accuracy (ACC) with fewest number of selected features (No.fea) comparing with the approximate convex counterparts and state-of-the-art feature selection methods. The robustness of classification accuracy to the regularization parameter and the number of selected feature are also exhibited.


title: Learning Theory for Inferring Interaction Kernels in Second-Order Interacting Agent Systems

abstract: Modeling the complex interactions of systems of particles or agents is a fundamental scientific and mathematical problem that is studied in diverse fields, ranging from physics and biology, to economics and machine learning. In this work, we describe a very general second-order, heterogeneous, multivariable, interacting agent model, with an environment, that encompasses a wide variety of known systems. We describe an inference framework that uses nonparametric regression and approximation theory based techniques to efficiently derive estimators of the interaction kernels which drive these dynamical systems. We develop a complete learning theory which establishes strong consistency and optimal nonparametric min-max rates of convergence for the estimators, as well as provably accurate predicted trajectories. The estimators exploit the structure of the equations in order to overcome the curse of dimensionality and we describe a fundamental coercivity condition on the inverse problem which ensures that the kernels can be learned and relates to the minimal singular value of the learning matrix. The numerical algorithm presented to build the estimators is parallelizable, performs well on high-dimensional problems, and is demonstrated on complex dynamical systems.


title: Dark matter, electroweak phase transition and gravitational wave in the type-II two-Higgs-doublet model with a singlet scalar field

abstract: In the framework of type-II two-Higgs-doublet model with a singlet scalar dark matter $S$, we study the dark matter observables, the electroweak phase transition, and the gravitational wave signals by such strongly first order phase transition after imposing the constraints of the LHC Higgs data. We take the heavy CP-even Higgs $H$ as the only portal between the dark matter and SM sectors, and find the LHC Higgs data and dark matter observables require $m_S$ and $m_H$ to be larger than 130 GeV and 360 GeV for $m_A=600$ GeV in the case of the 125 GeV Higgs with the SM-like coupling. Next, we carve out some parameter space where a strongly first order electroweak phase transition can be achieved, and find benchmark points for which the amplitudes of gravitational wave spectra reach the sensitivities of the future gravitational wave detectors.


title: tqix: A toolbox for Quantum in X: Quantum measurement, quantum tomography, quantum metrology, and others

abstract: We present an open-source computer program written in Python language for quantum measurement and related issues. In our program, quantum states and operators, including quantum gates, can be developed into a quantum-object function represented by a matrix. Build into the program are several measurement schemes, including von Neumann measurement and weak measurement. Various numerical simulation methods are used to mimic the real experiment results. We first provide an overview of the program structure and then discuss the numerical simulation of quantum measurement. We illustrate the program's performance via quantum state tomography and quantum metrology. The program is built in a general language of quantum physics and thus is widely adaptable to various physical platforms, such as quantum optics, ion traps, superconducting circuit devices, and others. It is also ideal to use in classroom guidance with simulation and visualization of various quantum systems.


title: Leveraging Discourse Rewards for Document-Level Neural Machine Translation

abstract: Document-level machine translation focuses on the translation of entire documents from a source to a target language. It is widely regarded as a challenging task since the translation of the individual sentences in the document needs to retain aspects of the discourse at document level. However, document-level translation models are usually not trained to explicitly ensure discourse quality. Therefore, in this paper we propose a training approach that explicitly optimizes two established discourse metrics, lexical cohesion (LC) and coherence (COH), by using a reinforcement learning objective. Experiments over four different language pairs and three translation domains have shown that our training approach has been able to achieve more cohesive and coherent document translations than other competitive approaches, yet without compromising the faithfulness to the reference translation. In the case of the Zh-En language pair, our method has achieved an improvement of 2.46 percentage points (pp) in LC and 1.17 pp in COH over the runner-up, while at the same time improving 0.63 pp in BLEU score and 0.47 pp in F_BERT.


title: Neural Group Actions

abstract: We introduce an algorithm for designing Neural Group Actions, collections of deep neural network architectures which model symmetric transformations satisfying the laws of a given finite group. This generalizes involutive neural networks $\mathcal{N}$, which satisfy $\mathcal{N}(\mathcal{N}(x))=x$ for any data $x$, the group law of $\mathbb{Z}_2$. We show how to optionally enforce an additional constraint that the group action be volume-preserving. We conjecture, by analogy to a universality result for involutive neural networks, that generative models built from Neural Group Actions are universal approximators for collections of probabilistic transitions adhering to the group laws. We demonstrate experimentally that a Neural Group Action for the quaternion group $Q_8$ can learn how a set of nonuniversal quantum gates satisfying the $Q_8$ group laws act on single qubit quantum states.


title: Geodesic analysis and black hole shadows on a general non--extremal rotating black hole in five--dimensional gauged supergravity

abstract: In this work, motivated by the fact that higher-dimensional theories predict the existence of black holes which differ from their four-dimensional counterpart, we analyse the geodesics and black hole shadow cast by a general non-extremal five-dimensional black hole. The system under consideration corresponds to the Chong-Cveti\v{c}-L\"u-Pope (Phys. Rev.Lett.{\bf 95}, 161301 (2005)), which has the Myers--Perry black hole as a limit.


title: Decamouflage: A Framework to Detect Image-Scaling Attacks on Convolutional Neural Networks

abstract: As an essential processing step in computer vision applications, image resizing or scaling, more specifically downsampling, has to be applied before feeding a normally large image into a convolutional neural network (CNN) model because CNN models typically take small fixed-size images as inputs. However, image scaling functions could be adversarially abused to perform a newly revealed attack called image-scaling attack, which can affect a wide range of computer vision applications building upon image-scaling functions. This work presents an image-scaling attack detection framework, termed as Decamouflage. Decamouflage consists of three independent detection methods: (1) rescaling, (2) filtering/pooling, and (3) steganalysis. While each of these three methods is efficient standalone, they can work in an ensemble manner not only to improve the detection accuracy but also to harden potential adaptive attacks. Decamouflage has a pre-determined detection threshold that is generic. More precisely, as we have validated, the threshold determined from one dataset is also applicable to other different datasets. Extensive experiments show that Decamouflage achieves detection accuracy of 99.9\% and 99.8\% in the white-box (with the knowledge of attack algorithms) and the black-box (without the knowledge of attack algorithms) settings, respectively. To corroborate the efficiency of Decamouflage, we have also measured its run-time overhead on a personal PC with an i5 CPU and found that Decamouflage can detect image-scaling attacks in milliseconds. Overall, Decamouflage can accurately detect image scaling attacks in both white-box and black-box settings with acceptable run-time overhead.


title: On the quasi-isometric rigidity of chambers and walls in cusp-decomposable manifolds

abstract: A cusp-decomposable manifold is a manifold constructed from a finite number of complete, negatively curved, finite volume manifolds and identifying the boundaries of truncated cusps by diffeomorphisms. Using properties of the electric space of the universal cover of cusp-decomposable manifolds, we show that the inclusion of walls and pieces induces quasi-isometric embeddings. We also show that isomorphisms between fundamental groups of higher graph manifolds preserve the decomposition into pieces.


title: Shallow-to-Deep Training for Neural Machine Translation

abstract: Deep encoders have been proven to be effective in improving neural machine translation (NMT) systems, but training an extremely deep encoder is time consuming. Moreover, why deep models help NMT is an open question. In this paper, we investigate the behavior of a well-tuned deep Transformer system. We find that stacking layers is helpful in improving the representation ability of NMT models and adjacent layers perform similarly. This inspires us to develop a shallow-to-deep training method that learns deep models by stacking shallow models. In this way, we successfully train a Transformer system with a 54-layer encoder. Experimental results on WMT'16 English-German and WMT'14 English-French translation tasks show that it is $1.4$ $\times$ faster than training from scratch, and achieves a BLEU score of $30.33$ and $43.29$ on two tasks. The code is publicly available at https://github.com/libeineu/SDT-Training/.


title: Multi-hop Inference for Question-driven Summarization

abstract: Question-driven summarization has been recently studied as an effective approach to summarizing the source document to produce concise but informative answers for non-factoid questions. In this work, we propose a novel question-driven abstractive summarization method, Multi-hop Selective Generator (MSG), to incorporate multi-hop reasoning into question-driven summarization and, meanwhile, provide justifications for the generated summaries. Specifically, we jointly model the relevance to the question and the interrelation among different sentences via a human-like multi-hop inference module, which captures important sentences for justifying the summarized answer. A gated selective pointer generator network with a multi-view coverage mechanism is designed to integrate diverse information from different perspectives. Experimental results show that the proposed method consistently outperforms state-of-the-art methods on two non-factoid QA datasets, namely WikiHow and PubMedQA.


title: 3D Convolutional Sequence to Sequence Model for Vertebral Compression Fractures Identification in CT

abstract: An osteoporosis-related fracture occurs every three seconds worldwide, affecting one in three women and one in five men aged over 50. The early detection of at-risk patients facilitates effective and well-evidenced preventative interventions, reducing the incidence of major osteoporotic fractures. In this study, we present an automatic system for identification of vertebral compression fractures on Computed Tomography images, which are often an undiagnosed precursor to major osteoporosis-related fractures. The system integrates a compact 3D representation of the spine, utilizing a Convolutional Neural Network (CNN) for spinal cord detection and a novel end-to-end sequence to sequence 3D architecture. We evaluate several model variants that exploit different representation and classification approaches and present a framework combining an ensemble of models that achieves state of the art results, validated on a large data set, with a patient-level fracture identification of 0.955 Area Under the Curve (AUC). The system proposed has the potential to support osteoporosis clinical management, improve treatment pathways, and to change the course of one of the most burdensome diseases of our generation.


title: Bone Feature Segmentation in Ultrasound Spine Image with Robustness to Speckle and Regular Occlusion Noise

abstract: 3D ultrasound imaging shows great promise for scoliosis diagnosis thanks to its low-costing, radiation-free and real-time characteristics. The key to accessing scoliosis by ultrasound imaging is to accurately segment the bone area and measure the scoliosis degree based on the symmetry of the bone features. The ultrasound images tend to contain many speckles and regular occlusion noise which is difficult, tedious and time-consuming for experts to find out the bony feature. In this paper, we propose a robust bone feature segmentation method based on the U-net structure for ultrasound spine Volume Projection Imaging (VPI) images. The proposed segmentation method introduces a total variance loss to reduce the sensitivity of the model to small-scale and regular occlusion noise. The proposed approach improves 2.3% of Dice score and 1% of AUC score as compared with the u-net model and shows high robustness to speckle and regular occlusion noise.


title: The structure of k_{\omega} spaces and a question of Arhangel'skii's

abstract: In 2010 a question of Arhangel'skii's highlighted a gap in the knowledge of k_{\omega}-spaces. His specific question had in fact been answered by Siwiec in 1976, but the highlighted gap still remains. We introduce the simple idea of pure quotient maps, extend Morita's theorem to these, and use Fell's topology to show that every quotient map onto a k_{\omega}-space can be 'purified'; and thus fill the gap, elucidate the structure of k_{\omega}-spaces, and obtain a fuller answer to Arhangel'skii's question.


title: The role of the elaphrocentre in void galaxy formation

abstract: Voids may affect galaxy formation via weakening mass infall or increasing disk sizes, which could potentially play a role in the formation of giant low surface brightness galaxies (LSBGs). If a dark matter halo forms at the potential hill corresponding to a void of the cosmic web, which we denote the 'elaphrocentre' in contrast to a barycentre, then the elaphrocentre should weaken the infall rate to the halo when compared to infall rates towards barycentres. We investigate this hypothesis numerically. We present a complete software pipeline to simulate galaxy formation, starting from a power spectrum of initial perturbations and an N-body simulation through to merger-history-tree based mass infall histories. The pipeline is built from well-established, free-licensed cosmological software packages, and aims at highly portable long-term reproducibility. We find that the elaphrocentric accelerations tending to oppose mass infall are modest. We do not find evidence of location in a void or elaphrocentric position weakening mass infall towards a galaxy. However, we find indirect evidence of voids influencing galaxy formation: while void galaxies are of lower mass compared to galaxies in high density environments, their spin parameters are typically higher. For a fixed mass, the implied disk scale length would be greater. Tangential accelerations in voids are found to be high and might significantly contribute to the higher spin parameters. We find significantly later formation epochs for void galaxies; this should give lower matter densities and may imply lower surface densities of disk galaxies. Thus, void galaxies have higher spin parameters and later formation epochs; both are factors that may increase the probability of forming LSBGs in voids.


title: Visual News: Benchmark and Challenges in News Image Captioning

abstract: We propose Visual News Captioner, an entity-aware model for the task of news image captioning. We also introduce Visual News, a large-scale benchmark consisting of more than one million news images along with associated news articles, image captions, author information, and other metadata. Unlike the standard image captioning task, news images depict situations where people, locations, and events are of paramount importance. Our proposed method can effectively combine visual and textual features to generate captions with richer information such as events and entities. More specifically, built upon the Transformer architecture, our model is further equipped with novel multi-modal feature fusion techniques and attention mechanisms, which are designed to generate named entities more accurately. Our method utilizes much fewer parameters while achieving slightly better prediction results than competing methods. Our larger and more diverse Visual News dataset further highlights the remaining challenges in captioning news images.


title: Maximum Reward Formulation In Reinforcement Learning

abstract: Reinforcement learning (RL) algorithms typically deal with maximizing the expected cumulative return (discounted or undiscounted, finite or infinite horizon). However, several crucial applications in the real world, such as drug discovery, do not fit within this framework because an RL agent only needs to identify states (molecules) that achieve the highest reward within a trajectory and does not need to optimize for the expected cumulative return. In this work, we formulate an objective function to maximize the expected maximum reward along a trajectory, derive a novel functional form of the Bellman equation, introduce the corresponding Bellman operators, and provide a proof of convergence. Using this formulation, we achieve state-of-the-art results on the task of molecule generation that mimics a real-world drug discovery pipeline.


title: Ultra-wideband free-space optical phase stabilisation

abstract: Free-space optical (FSO) communications has the potential to revolutionize wireless communications due to its advantages of inherent security, high-directionality, high available bandwidth and small physical footprint. The effects of atmospheric turbulence currently limit the performance of FSO communications. In this letter, we demonstrate a system capable of indiscriminately suppressing the atmospheric phase noise encountered by independent optical signals spread over a range of 7.2 THz (encompassing the full optical C-Band), by actively phase stabilizing a primary optical signal at 193.1 THz (1552 nm). We show ~30 dB of indiscriminate phase stabilization over the full range, down to average phase noise at 10 Hz of -39.6 dBc/Hz when using an acousto-optic modulator (AOM) as a Doppler actuator, and -39.9 dBc/Hz when using a fiber-stretcher as group-delay actuator to provide the phase-stabilization system's feedback. We demonstrate that this suppression is limited by the noise of the independent optical signals, and that the expected achievable suppression is more than 40 dB greater, reaching around -90 dB/Hz at 10 Hz. We conclude that 40 Tbps ground-to-space FSO transmission would be made possible with the combination of our stabilization system and other demonstrated technologies.


title: Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition

abstract: Knowledge of a disease includes information of various aspects of the disease, such as signs and symptoms, diagnosis and treatment. This disease knowledge is critical for many health-related and biomedical tasks, including consumer health question answering, medical language inference and disease name recognition. While pre-trained language models like BERT have shown success in capturing syntactic, semantic, and world knowledge from text, we find they can be further complemented by specific information like knowledge of symptoms, diagnoses, treatments, and other disease aspects. Hence, we integrate BERT with disease knowledge for improving these important tasks. Specifically, we propose a new disease knowledge infusion training procedure and evaluate it on a suite of BERT models including BERT, BioBERT, SciBERT, ClinicalBERT, BlueBERT, and ALBERT. Experiments over the three tasks show that these models can be enhanced in nearly all cases, demonstrating the viability of disease knowledge infusion. For example, accuracy of BioBERT on consumer health question answering is improved from 68.29% to 72.09%, while new SOTA results are observed in two datasets. We make our data and code freely available.


title: Surfacing Misconceptions Through Visualization Critique

abstract: Students of visualization come to formal education with an abundance of personal experience. However, one's exposure to graphics through media and education may not be sufficiently diverse to appreciate the nuance and complexity required to design and evaluate effective representations. While many introductory courses in visualization address best practices for visual encoding of data based on perceptual characteristics, as cognitive scientists, we place equal value on representational decisions based on communicative context: how the representation is intended to be used. In this pedagogical activity, we aim to surface learners' preconceived notions about what makes a visualization effective. Here we describe the structure and context of an introductory-level visualization activity, how it might be conducted in individual or group settings, our experience with the common misconceptions the activity can reveal, and conclude with recommendations on how they might be addressed.


title: On the arithmetic-geometric index of graphs

abstract: Very recently, the first geometric-arithmetic index $GA$ and arithmetic-geometric index $AG$ were introduced in mathematical chemistry. In the present paper, we first obtain some lower and upper bounds on $AG$ and characterize the extremal graphs. We also establish various relations between $AG$ and other topological indices, such as the first geometric-arithmetic index $GA$, atom-bond-connectivity index $ABC$, symmetric division deg index $SDD$, chromatic number $\chi$ and so on. Finally, we present some sufficient conditions of $GA(G)>GA(G-e)$ or $AG(G)>AG(G-e)$ for an edge $e$ of a graph $G$. In particular, for the first geometric-arithmetic index, we also give a refinement of Bollob\'{a}s-Erd\H{o}s-type theorem obtained in [3].


title: Tatum-Level Drum Transcription Based on a Convolutional Recurrent Neural Network with Language Model-Based Regularized Training

abstract: This paper describes a neural drum transcription method that detects from music signals the onset times of drums at the $\textit{tatum}$ level, where tatum times are assumed to be estimated in advance. In conventional studies on drum transcription, deep neural networks (DNNs) have often been used to take a music spectrogram as input and estimate the onset times of drums at the $\textit{frame}$ level. The major problem with such frame-to-frame DNNs, however, is that the estimated onset times do not often conform with the typical tatum-level patterns appearing in symbolic drum scores because the long-term musically meaningful structures of those patterns are difficult to learn at the frame level. To solve this problem, we propose a regularized training method for a frame-to-tatum DNN. In the proposed method, a tatum-level probabilistic language model (gated recurrent unit (GRU) network or repetition-aware bi-gram model) is trained from an extensive collection of drum scores. Given that the musical naturalness of tatum-level onset times can be evaluated by the language model, the frame-to-tatum DNN is trained with a regularizer based on the pretrained language model. The experimental results demonstrate the effectiveness of the proposed regularized training method.


title: On Optimal Pointwise in Time Error Bounds and Difference Quotients for the Proper Orthogonal Decomposition

abstract: In this paper, we resolve several long standing issues dealing with optimal pointwise in time error bounds for proper orthogonal decomposition (POD) reduced order modeling of the heat equation. In particular, we study the role played by difference quotients (DQs) in obtaining reduced order model (ROM) error bounds that are optimal with respect to both the time discretization error and the ROM discretization error. When the DQs are not used, we prove that both the ROM projection error and the ROM error are suboptimal. When the DQs are used, we prove that both the ROM projection error and the ROM error are optimal. The numerical results for the heat equation support the theoretical results.


title: Photo-excitation band-structure engineering of 2H-NbSe$_2$ probed by time- and angle-resolved photoemission spectroscopy

abstract: We investigated the nonequilibrium electronic structure of 2H-NbSe$_2$ by time- and angle-resolved photoemission spectroscopy. We find that the band structure is distinctively modulated by strong photo-excitation, as indicated by the unusual increase in the photoelectron intensities around E$_F$. In order to gain insight into the observed photo-induced electronic state, we performed DFT calculations with modulated lattice structures, and found that the variation of the Se height from the Nb layer results in a significant change in the effective mass and band gap energy. We further study the momentum-dependent carrier dynamics. The results suggest that the relaxation is faster at the K-centered Fermi surface than at the $\Gamma$-centered Fermi surface, which can be attributed to the stronger electron-lattice coupling at the K-centered Fermi surface. Our demonstration of band structure engineering suggests a new role for light as a tool for controlling the functionalities of solid-state materials.


title: Easy access to energy fluctuations in non-equilibrium quantum many-body systems

abstract: We combine theoretical and experimental efforts to propose a method for studying energy fluctuations, in particular, to obtain the related bi-stochastic matrix of transition probabilities by means of simple measurements at the end of a protocol that drives a many-body quantum system out-of-equilibrium. This scheme is integrated with numerical optimizations in order to ensure a proper analysis of the experimental data, leading to physical probabilities. The method is experimentally evaluated employing a two interacting spin-1/2 system in a nuclear magnetic resonance setup. We show how to recover the transition probabilities using only local measures which enables an experimental verification of the detailed fluctuation theorem in a many-body system driven out-of-equilibrium.


title: Uncertainty in Neural Processes

abstract: We explore the effects of architecture and training objective choice on amortized posterior predictive inference in probabilistic conditional generative models. We aim this work to be a counterpoint to a recent trend in the literature that stresses achieving good samples when the amount of conditioning data is large. We instead focus our attention on the case where the amount of conditioning data is small. We highlight specific architecture and objective choices that we find lead to qualitative and quantitative improvement to posterior inference in this low data regime. Specifically we explore the effects of choices of pooling operator and variational family on posterior quality in neural processes. Superior posterior predictive samples drawn from our novel neural process architectures are demonstrated via image completion/in-painting experiments.


title: Strongly lensed gravitational waves as the probes to test the cosmic distance duality relation

abstract: The cosmic distance relation (DDR) associates the angular diameters distance ($D_A$) and luminosity distance ($D_L$) by a simple formula, i.e., $D_L=(1+z)^2D_A$. The strongly lensed gravitational waves (GWs) provide a unique way to measure $D_A$ and $D_L$ simultaneously to the GW source, hence can be used as probes to test DDR. In this paper, we prospect the use of strongly lensed GW events from the future Einstein Telescope to test DDR. We write the possible deviation of DDR as $(1+z)^2D_A/D_L=\eta(z)$, and consider two different parametrizations of $\eta(z)$, namely, $\eta_1(z)=1+\eta_0 z$ and $\eta_2(z)=1+\eta_0 z/(1+z)$. Numerical simulations show that, with about 100 strongly lensed GW events observed by ET, the parameter $\eta_0$ can be constrained at $1.3\%$ and $3\%$ levels for the first and second parametrizations, respectively.


title: Generalizable and Explainable Dialogue Generation via Explicit Action Learning

abstract: Response generation for task-oriented dialogues implicitly optimizes two objectives at the same time: task completion and language quality. Conditioned response generation serves as an effective approach to separately and better optimize these two objectives. Such an approach relies on system action annotations which are expensive to obtain. To alleviate the need of action annotations, latent action learning is introduced to map each utterance to a latent representation. However, this approach is prone to over-dependence on the training data, and the generalization capability is thus restricted. To address this issue, we propose to learn natural language actions that represent utterances as a span of words. This explicit action representation promotes generalization via the compositional structure of language. It also enables an explainable generation process. Our proposed unsupervised approach learns a memory component to summarize system utterances into a short span of words. To further promote a compact action representation, we propose an auxiliary task that restores state annotations as the summarized dialogue context using the memory component. Our proposed approach outperforms latent action baselines on MultiWOZ, a benchmark multi-domain dataset.


title: On the physical mechanisms underlying single molecule dynamics in simple liquids

abstract: Physical arguments and comparisons with published experimental data suggest that in simple liquids: i) single-molecule-scale viscous forces are produced by temperature-dependent London dispersion forces, ii) viscosity decay with increasing temperature reflects electron cloud compression and attendant suppression of electron screening, produced by increased nuclear agitation, and iii) temperature-dependent self-diffusion is driven by a narrow band of phonon frequencies lying at the low-frequency end of the solid-state-like phonon spectrum. The results suggest that collision-induced electron cloud distortion plays a decisive role in single molecule dynamics: i) electron cloud compression produces short-lived repulsive states and single molecule, self-diffusive hops, while ii) shear-induced distortion generates viscosity and single-molecule-scale viscous drag. The results provide new insight into nonequilibrium molecular dynamics in nonpolar, nonmetallic liquids.


title: AICov: An Integrative Deep Learning Framework for COVID-19 Forecasting with Population Covariates

abstract: The COVID-19 pandemic has profound global consequences on health, economic, social, political, and almost every major aspect of human life. Therefore, it is of great importance to model COVID-19 and other pandemics in terms of the broader social contexts in which they take place. We present the architecture of AICov, which provides an integrative deep learning framework for COVID-19 forecasting with population covariates, some of which may serve as putative risk factors. We have integrated multiple different strategies into AICov, including the ability to use deep learning strategies based on LSTM and even modeling. To demonstrate our approach, we have conducted a pilot that integrates population covariates from multiple sources. Thus, AICov not only includes data on COVID-19 cases and deaths but, more importantly, the population's socioeconomic, health and behavioral risk factors at a local level. The compiled data are fed into AICov, and thus we obtain improved prediction by integration of the data to our model as compared to one that only uses case and death data.


title: Generative Autoregressive Ensembles for Satellite Imagery Manipulation Detection

abstract: Satellite imagery is becoming increasingly accessible due to the growing number of orbiting commercial satellites. Many applications make use of such images: agricultural management, meteorological prediction, damage assessment from natural disasters, or cartography are some of the examples. Unfortunately, these images can be easily tampered and modified with image manipulation tools damaging downstream applications. Because the nature of the manipulation applied to the image is typically unknown, unsupervised methods that don't require prior knowledge of the tampering techniques used are preferred. In this paper, we use ensembles of generative autoregressive models to model the distribution of the pixels of the image in order to detect potential manipulations. We evaluate the performance of the presented approach obtaining accurate localization results compared to previously presented approaches.


title: Energy-based Out-of-distribution Detection

abstract: Determining whether inputs are out-of-distribution (OOD) is an essential building block for safely deploying machine learning models in the open world. However, previous methods relying on the softmax confidence score suffer from overconfident posterior distributions for OOD data. We propose a unified framework for OOD detection that uses an energy score. We show that energy scores better distinguish in- and out-of-distribution samples than the traditional approach using the softmax scores. Unlike softmax confidence scores, energy scores are theoretically aligned with the probability density of the inputs and are less susceptible to the overconfidence issue. Within this framework, energy can be flexibly used as a scoring function for any pre-trained neural classifier as well as a trainable cost function to shape the energy surface explicitly for OOD detection. On a CIFAR-10 pre-trained WideResNet, using the energy score reduces the average FPR (at TPR 95%) by 18.03% compared to the softmax confidence score. With energy-based training, our method outperforms the state-of-the-art on common benchmarks.


title: Discriminatively-Tuned Generative Classifiers for Robust Natural Language Inference

abstract: While discriminative neural network classifiers are generally preferred, recent work has shown advantages of generative classifiers in term of data efficiency and robustness. In this paper, we focus on natural language inference (NLI). We propose GenNLI, a generative classifier for NLI tasks, and empirically characterize its performance by comparing it to five baselines, including discriminative models and large-scale pretrained language representation models like BERT. We explore training objectives for discriminative fine-tuning of our generative classifiers, showing improvements over log loss fine-tuning from prior work . In particular, we find strong results with a simple unbounded modification to log loss, which we call the "infinilog loss". Our experiments show that GenNLI outperforms both discriminative and pretrained baselines across several challenging NLI experimental settings, including small training sets, imbalanced label distributions, and label noise.


title: Integrity-Based Path Planning Strategy for Urban Autonomous Vehicular Navigation Using GPS and Cellular Signals

abstract: An integrity-based path planning strategy for autonomous ground vehicle (AGV) navigation in urban environments is developed. The vehicle is assumed to navigate by utilizing cellular long-term evolution (LTE) signals in addition to Global Positioning System (GPS) signals. Given a desired destination, an optimal path is calculated, which minimizes a cost function that considers both the horizontal protection level (HPL) and travel distance. The constraints are that (i) the ratio of nodes with faulty signals to the total nodes be lower than a maximum allowable ratio and (ii) the HPLs along each candidate path be lower than the horizontal alert limit (HAL). To predict the faults and HPL before the vehicle is driven, GPS and LTE pseudoranges along the candidate paths are generated utilizing a commercial ray-tracing software and three-dimensional (3D) terrain and building maps. Simulated pseudoranges inform the path planning algorithm about potential biases due to reflections from buildings in urban environments. Simulation results are presented showing that the optimal path produced by the proposed path planning strategy has the minimum average HPL among the candidate paths.


title: Peculiar Velocity Estimation from Kinetic SZ Effect using Deep Neural Networks

abstract: The Sunyaev-Zel'dolvich (SZ) effect is expected to be instrumental in measuring velocities of distant clusters in near future telescope surveys. We simplify the calculation of peculiar velocities of galaxy clusters using deep learning frameworks trained on numerical simulations to avoid the estimation of the optical depth. The image of distorted photon backgrounds are generated for idealized observations using one of the largest cosmological hydrodynamical simulations, the Magneticum simulations. The model is tested to be capable peculiar velocities from future kinetic SZ observations under different noise conditions. The deep learning algorithm displays robustness in estimating peculiar velocities from kinetic SZ effect by an improvement in accuracy of about 17% compared to the analytical approach.


title: Assessing Phrasal Representation and Composition in Transformers

abstract: Deep transformer models have pushed performance on NLP tasks to new limits, suggesting sophisticated treatment of complex linguistic inputs, such as phrases. However, we have limited understanding of how these models handle representation of phrases, and whether this reflects sophisticated composition of phrase meaning like that done by humans. In this paper, we present systematic analysis of phrasal representations in state-of-the-art pre-trained transformers. We use tests leveraging human judgments of phrase similarity and meaning shift, and compare results before and after control of word overlap, to tease apart lexical effects versus composition effects. We find that phrase representation in these models relies heavily on word content, with little evidence of nuanced composition. We also identify variations in phrase representation quality across models, layers, and representation types, and make corresponding recommendations for usage of representations from these models.


title: The total Johnson homomorphism on the homology cylinder and the bracket-quantization HOMFLY-PT skein algebra

abstract: A homology cylinder of a surface induces an automorphism of the completed group ring of the fundamental group of the surface. We introduce a new method of computing the automorphism by using the Goldman Lie algebra of the surface or some skein algebra. In particular, we give a refinement of a formula by Kuno and Massuyeau.


title: Classification of Thompson related groups arising from Jones technology I

abstract: In the quest in constructing conformal field theories (CFT) Jones has discovered a beautiful and deep connection between CFT, Richard Thompson's groups and knot theory. This led to a powerful functorial framework for constructing actions of particular groups arising from categories such as Thompson's groups and braid groups. In particular, given a group and two of its endomorphisms one can construct a semidirect product where the largest Thompson's group $V$ is acting. These semidirect products have remarkable diagrammatic descriptions which were previously used to provide new examples of groups having the Haagerup property. They naturally appear in certain field theories as being generated by local and global symmetries. Moreover, these groups occur in a construction of Tanushevski and can be realised using Brin-Zappa-Szep's products with the technology of cloning systems of Witzel-Zaremsky. We consider in this article the class of groups obtained in that way where one of the endomorphism is trivial leaving the case of two nontrivial endomorphisms to a second article. We provide an explicit description of all these groups as permutational restricted twisted wreath products where $V$ is the group acting and the twist depends on the endomorphism chosen. We classify this class of groups up to isomorphisms and provide a thin description of their automorphism group thanks to an unexpected rigidity phenomena.


title: Improving Attention Mechanism with Query-Value Interaction

abstract: Attention mechanism has played critical roles in various state-of-the-art NLP models such as Transformer and BERT. It can be formulated as a ternary function that maps the input queries, keys and values into an output by using a summation of values weighted by the attention weights derived from the interactions between queries and keys. Similar with query-key interactions, there is also inherent relatedness between queries and values, and incorporating query-value interactions has the potential to enhance the output by learning customized values according to the characteristics of queries. However, the query-value interactions are ignored by existing attention methods, which may be not optimal. In this paper, we propose to improve the existing attention mechanism by incorporating query-value interactions. We propose a query-value interaction function which can learn query-aware attention values, and combine them with the original values and attention weights to form the final output. Extensive experiments on four datasets for different tasks show that our approach can consistently improve the performance of many attention-based models by incorporating query-value interactions.


title: Sparse optimal control of a phase field tumour model with mechanical effects

abstract: In this paper, we study an optimal control problem for a macroscopic mechanical tumour model based on the phase field approach. The model couples a Cahn--Hilliard type equation to a system of linear elasticity and a reaction-diffusion equation for a nutrient concentration. By taking advantage of previous analytical well-posedness results established by the authors, we seek optimal controls in the form of a boundary nutrient supply, as well as concentrations of cytotoxic and antiangiogenic drugs that minimise a cost functional involving mechanical stresses. Special attention is given to sparsity effects, where with the inclusion of convex non-differentiable regularisation terms to the cost functional, we can infer from the first-order optimality conditions that the optimal drug concentrations can vanish on certain time intervals.


title: ALFWorld: Aligning Text and Embodied Environments for Interactive Learning

abstract: Given a simple request like Put a washed apple in the kitchen fridge, humans can reason in purely abstract terms by imagining action sequences and scoring their likelihood of success, prototypicality, and efficiency, all without moving a muscle. Once we see the kitchen in question, we can update our abstract plans to fit the scene. Embodied agents require the same abilities, but existing work does not yet provide the infrastructure necessary for both reasoning abstractly and executing concretely. We address this limitation by introducing ALFWorld, a simulator that enables agents to learn abstract, text based policies in TextWorld (C\^ot\'e et al., 2018) and then execute goals from the ALFRED benchmark (Shridhar et al., 2020) in a rich visual environment. ALFWorld enables the creation of a new BUTLER agent whose abstract knowledge, learned in TextWorld, corresponds directly to concrete, visually grounded actions. In turn, as we demonstrate empirically, this fosters better agent generalization than training only in the visually grounded environment. BUTLER's simple, modular design factors the problem to allow researchers to focus on models for improving every piece of the pipeline (language understanding, planning, navigation, and visual scene understanding).


title: Gate controlled unitary operation on flying spin qubits in quantum Hall edge states

abstract: Spin and orbital freedoms of electrons traveling on spin-resolved quantum Hall edge states (quantum Hall ferromagnets) are maximally entangled. The unitary operations on these two freedoms are hence equivalent, which means one can manipulate the spins with non-magnetic methods through the orbitals. If one takes the quantization axis of spins along the magnetization axis, the zenith angle is determined by the partition rate of spin-separated edges while the azimuth angle is defined as the phase difference between the edges. Utilizing these properties, we have realized electrically controlled unitary operation on the electron spins on the quantum Hall ferromagnets. The zenith angle of the spin was controlled through the radius of gyration at a corner by means of applying voltage to a thin gate placed at one edge. The subsequent rotation in the azimuth angle was controlled via the distance between the edge channels also by a gate voltage. The combination of the two operations constitutes the first systematic electric operation on spins in the quantum Hall edge channels.


title: Shock width measured under liquid and solid conditions in a 2D dusty plasma

abstract: Widths of shocks are compared, under liquid and solid conditions, for a two-dimensional layer of charged microspheres levitated in a plasma. In this strongly coupled dusty plasma, a shock was launched as a blast wave by moving an exciter wire at a supersonic speed and then bringing it to a halt. Runs were repeated with the layer of microspheres prepared two ways: a crystalline-like solid, and a liquid. The liquid was sustained using laser heating, with conditions that were otherwise the same as in the solid. The shock width was found to be less in a liquid than in a solid, where it was 4 to 6 lattice constants. These measurements were based on the high-gradient region of density profiles. The profiles were obtained from particle coordinates, measured by high-speed video imaging. The spatial resolution was improved by combining particle coordinates, in the shock's frame of reference, from a sequence of images.


title: DBLFace: Domain-Based Labels for NIR-VIS Heterogeneous Face Recognition

abstract: Deep learning-based domain-invariant feature learning methods are advancing in near-infrared and visible (NIR-VIS) heterogeneous face recognition. However, these methods are prone to overfitting due to the large intra-class variation and the lack of NIR images for training. In this paper, we introduce Domain-Based Label Face (DBLFace), a learning approach based on the assumption that a subject is not represented by a single label but by a set of labels. Each label represents images of a specific domain. In particular, a set of two labels per subject, one for the NIR images and one for the VIS images, are used for training a NIR-VIS face recognition model. The classification of images into different domains reduces the intra-class variation and lessens the negative impact of data imbalance in training. To train a network with sets of labels, we introduce a domain-based angular margin loss and a maximum angular loss to maintain the inter-class discrepancy and to enforce the close relationship of labels in a set. Quantitative experiments confirm that DBLFace significantly improves the rank-1 identification rate by 6.7% on the EDGE20 dataset and achieves state-of-the-art performance on the CASIA NIR-VIS 2.0 dataset.


title: On optimization of the metal ion production by Electron Cyclotron Resonance Ion Sources

abstract: The three-dimensional NAM-ECRIS model is applied for studying the metal ion production in the DECRIS-PM Electron Cyclotron Resonance Ion Source. Experimentally measured extracted ion currents are accurately reproduced with the model. Parameters of the injection of metal vapors into the source are optimized. It is found that the axial injection of the highly directional fluxes allows increasing the extracted ion currents of the highly charged calcium ions by factor of 1.5. The reason for the gain in the currents is formation of internal barrier for the ions inside the plasma, which increase the ion extraction and production efficiency. Benefits of injecting the singly-charged calcium ions instead of atoms are discussed.


title: Improving Long-Tail Relation Extraction with Collaborating Relation-Augmented Attention

abstract: Wrong labeling problem and long-tail relations are two main challenges caused by distant supervision in relation extraction. Recent works alleviate the wrong labeling by selective attention via multi-instance learning, but cannot well handle long-tail relations even if hierarchies of the relations are introduced to share knowledge. In this work, we propose a novel neural network, Collaborating Relation-augmented Attention (CoRA), to handle both the wrong labeling and long-tail relations. Particularly, we first propose relation-augmented attention network as base model. It operates on sentence bag with a sentence-to-relation attention to minimize the effect of wrong labeling. Then, facilitated by the proposed base model, we introduce collaborating relation features shared among relations in the hierarchies to promote the relation-augmenting process and balance the training data for long-tail relations. Besides the main training objective to predict the relation of a sentence bag, an auxiliary objective is utilized to guide the relation-augmenting process for a more accurate bag-level representation. In the experiments on the popular benchmark dataset NYT, the proposed CoRA improves the prior state-of-the-art performance by a large margin in terms of Precision@N, AUC and Hits@K. Further analyses verify its superior capability in handling long-tail relations in contrast to the competitors.


title: Be It Unresolved: Measuring Time Delays from Lensed Supernovae

abstract: Gravitationally lensed Type Ia supernovae may be the next frontier in cosmic probes, able to deliver independent constraints on dark energy, spatial curvature, and the Hubble constant. Measurements of time delays between the multiple images become more incisive due to the standardized candle nature of the source, monitoring for months rather than years, and partial immunity to microlensing. While currently extremely rare, hundreds of such systems should be detected by upcoming time domain surveys. Even more will have the images spatially unresolved, with the observed lightcurve a superposition of time delayed image fluxes. We investigate whether unresolved images can be recognized as lensed sources given only lightcurve information, and whether time delays can be extracted robustly. We develop a method that successfully identifies such systems, with a false positive rate of $\lesssim 5\%$, and measures the time delays with a completeness of $\gtrsim 93\%$ and with a bias of $\lesssim 0.5\%$ for $\Delta t_{\rm fit} \gtrsim 10$ days.


title: High tunnel magnetoresistance and magnetism in metastable bcc Co$_{1-x}$Mn$_x$-based magnetic tunnel junctions

abstract: Co-rich Co$_{1-x}$Mn$_x$ alloys have hcp or fcc disordered phases and those ferromagnetic orderings are significantly deteriorated with increasing Mn concentration $x$ in bulk. On the other hand, those metastable bcc phases show properties attractive to spintronics, e.g., high tunnel magnetoresistance (TMR) ratio of more than 200% (600%) at 300 K (10 K) in magnetic tunnel junctions (MTJs) with the $x$ = 0.25 bcc alloy electrodes [Kunimatsu et al., Appl. Phys. Express 13, 083007 (2020)]. Here, we report systematic study of structure and magnetism for epitaxial thin films as well as the TMR effect in MgO(001)-barrier MTJs with electrodes comprising those bcc films. The single phase bcc Co$_{1-x}$Mn$_x$(001) films were pseudomorphically grown on Cr(001) for 0.14 < $x$ < 0.50 with a sputtering technique. The magnetization was larger than that of pure Co for $x$ = 0.14-0.25 and deceased with further increasing $x$. This behavior mainly stemmed from the composition dependence of magnetic moment of Mn that exceeded 2 $\mu _B$ at the maximum, unveiled by X-ray magnetic circular dichroism. Correspondingly, within the range of 0.25 < $x$ < 0.37, the TMR ratio decreased from 620% (229%) to 450% (194%) at 10 K (300 K) as $x$ increased. We discussed the relationship between the magnetism and high TMR ratio with different $x$ with the aid of the ab-initio band structure calculations.


title: Detect All Abuse! Toward Universal Abusive Language Detection Models

abstract: Online abusive language detection (ALD) has become a societal issue of increasing importance in recent years. Several previous works in online ALD focused on solving a single abusive language problem in a single domain, like Twitter, and have not been successfully transferable to the general ALD task or domain. In this paper, we introduce a new generic ALD framework, MACAS, which is capable of addressing several types of ALD tasks across different domains. Our generic framework covers multi-aspect abusive language embeddings that represent the target and content aspects of abusive language and applies a textual graph embedding that analyses the user's linguistic behaviour. Then, we propose and use the cross-attention gate flow mechanism to embrace multiple aspects of abusive language. Quantitative and qualitative evaluation results show that our ALD algorithm rivals or exceeds the six state-of-the-art ALD algorithms across seven ALD datasets covering multiple aspects of abusive language and different online community domains.


title: An Empirical Study on Model-agnostic Debiasing Strategies for Robust Natural Language Inference

abstract: The prior work on natural language inference (NLI) debiasing mainly targets at one or few known biases while not necessarily making the models more robust. In this paper, we focus on the model-agnostic debiasing strategies and explore how to (or is it possible to) make the NLI models robust to multiple distinct adversarial attacks while keeping or even strengthening the models' generalization power. We firstly benchmark prevailing neural NLI models including pretrained ones on various adversarial datasets. We then try to combat distinct known biases by modifying a mixture of experts (MoE) ensemble method and show that it's nontrivial to mitigate multiple NLI biases at the same time, and that model-level ensemble method outperforms MoE ensemble method. We also perform data augmentation including text swap, word substitution and paraphrase and prove its efficiency in combating various (though not all) adversarial attacks at the same time. Finally, we investigate several methods to merge heterogeneous training data (1.35M) and perform model ensembling, which are straightforward but effective to strengthen NLI models.


title: A two-stage approach for beam hardening artifact reduction in low-dose dental CBCT

abstract: This paper presents a two-stage method for beam hardening artifact correction of dental cone beam computerized tomography (CBCT). The proposed artifact reduction method is designed to improve the quality of maxillofacial imaging, where soft tissue details are not required. Compared to standard CT, the additional difficulty of dental CBCT comes from the problems caused by offset detector, FOV truncation, and low signal-to-noise ratio due to low X-ray irradiation. To address these problems, the proposed method primarily performs a sinogram adjustment in the direction of enhancing data consistency, considering the situation according to the FOV truncation and offset detector. This sinogram correction algorithm significantly reduces beam hardening artifacts caused by high-density materials such as teeth, bones, and metal implants, while tending to amplify special types of noise. To suppress such noise, a deep convolutional neural network is complementarily used, where CT images adjusted by the sinogram correction are used as the input of the neural network. Numerous experiments validate that the proposed method successfully reduces beam hardening artifacts and, in particular, has the advantage of improving the image quality of teeth, associated with maxillofacial CBCT imaging.


title: Vrengt: A Shared Body-Machine Instrument for Music-Dance Performance

abstract: This paper describes the process of developing a shared instrument for music-dance performance, with a particular focus on exploring the boundaries between standstill vs motion, and silence vs sound. The piece Vrengt grew from the idea of enabling a true partnership between a musician and a dancer, developing an instrument that would allow for active co-performance. Using a participatory design approach, we worked with sonification as a tool for systematically exploring the dancer's bodily expressions. The exploration used a "spatiotemporal matrix", with a particular focus on sonic microinteraction. In the final performance, two Myo armbands were used for capturing muscle activity of the arm and leg of the dancer, together with a wireless headset microphone capturing the sound of breathing. In the paper we reflect on multi-user instrument paradigms, discuss our approach to creating a shared instrument using sonification as a tool for the sound design, and reflect on the performers' subjective evaluation of the instrument.