title: Hi-Fi Multi-Speaker English TTS Dataset

abstract: This paper introduces a new multi-speaker English dataset for training text-to-speech models. The dataset is based on LibriVox audiobooks and Project Gutenberg texts, both in the public domain. The new dataset contains about 292 hours of speech from 10 speakers with at least 17 hours per speaker sampled at 44.1 kHz. To select speech samples with high quality, we considered audio recordings with a signal bandwidth of at least 13 kHz and a signal-to-noise ratio (SNR) of at least 32 dB. The dataset is publicly released at http://www.openslr.org/109/ .


title: Mass, Spin, and Ultralight Boson Constraints from the Intermediate Mass Black Hole in the Tidal Disruption Event 3XMM J215022.4-055108

abstract: We simultaneously and successfully fit the multi-epoch X-ray spectra of the tidal disruption event (TDE) 3XMM J215022.4-055108 using a modified version of our relativistic slim disk model that now accounts for angular momentum losses from radiation. We explore the effects of different disk properties and of uncertainties in the spectral hardening factor fc and redshift z on the estimation of the black hole mass M and spin a. Across all choices of theoretical priors, we constrain M to less than 2.2e4 Ms at 1 sigma confidence. Assuming that the TDE host is a star cluster associated with the adjacent, brighter, barred lenticular galaxy at z=0.055, we constrain M and a to be (1.75+0.45-0.05)e4 Ms and 0.8+0.12-0.02, respectively, at 1 sigma confidence. The high, but sub-extremal, spin suggests that, if this intermediate mass black hole (IMBH) has grown significantly since formation, it has acquired its last e-fold in mass in a way incompatible with both the standard and chaotic limits of gas accretion. Ours is the first clear IMBH with a spin measurement. As such, this object represents a novel laboratory for astro-particle physics; its M and a place tight limits on the existence of ultralight bosons, ruling out those with masses 1.0e-15 to 1.0e-16 eV.


title: On Asymptotic Rigidity and Continuity Problems in Nonlinear Elasticity on Manifolds and Hypersurfaces

abstract: Intrinsic nonlinear elasticity deals with the deformations of elastic bodies as isometric immersions of Riemannian manifolds into the Euclidean spaces (see Ciarlet [9,10]). In this paper, we study the rigidity and continuity properties of elastic bodies for the intrinsic approach to nonlinear elasticity. We first establish a geometric rigidity estimate for mappings from Riemannian manifolds to spheres (in the spirit of Friesecke-James-M\"{u}ller [23]), which is the first result of this type for the non-Euclidean case as far as we know. Then we prove the asymptotic rigidity of elastic membranes under suitable geometric conditions. Finally, we provide a simplified geometric proof of the continuous dependence of deformations of elastic bodies on the Cauchy-Green tensors and second fundamental forms, which extends the Ciarlet-Mardare theorem in [18] to arbitrary dimensions and co-dimensions.


title: On Fundamental Solutions of Higher-Order Space-Fractional Dirac equations

abstract: Starting from the pseudo-differential decomposition $\mathbf{D}=(-\Delta)^{\frac{1}{2}}\mathcal{H}$ of the Dirac operator $\displaystyle \mathbf{D}=\sum_{j=1}^n\mathbf{e}_j\partial_{x_j}$ in terms of the fractional operator $(-\Delta)^{\frac{1}{2}}$ of order $1$ and of the Riesz-Hilbert type operator $\mathcal{H}$ we will investigate the fundamental solutions of the space-fractional Dirac equation of L\'evy-Feller type $$\partial_t\Phi_\alpha(\mathbf{x},t;\theta)=-(-\Delta)^{\frac{\alpha}{2}}\exp\left( \frac{i\pi\theta}{2} \mathcal{H}\right)\Phi_\alpha(\mathbb{x},t;\theta) $$ involving the fractional Laplacian $-(-\Delta)^{\frac{\alpha}{2}}$ of order $\alpha$, with $2m\leq \alpha <2m+2$ ($m\in \mathbb{N}$), and the exponentiation operator $\exp\left( \frac{i\pi\theta}{2} \mathcal{H}\right)$ as the hypercomplex counterpart of the fractional Riesz-Hilbert transform carrying the \textit{skewness parameter} $\theta$, with values in the range $|\theta|\leq \min\{\alpha-2m,2m+2-\alpha\}$. Such model problem permits us to obtain hypercomplex counterparts for the fundamental solutions of higher-order heat-type equations $\partial_t F_M(x,t)=\kappa_M(\partial_x)^M F_M(x,t)$ $(M=2,3,\ldots)$ in case where the even powers resp. odd powers $\mathbf{D}^{2m}=(-\Delta)^{m}$ ($M=\alpha=2m$) resp. $\mathbf{D}^{2m+1}=(-\Delta)^{m+\frac{1}{2}}\mathcal{H}$ ($M=\alpha=2m+1$) of $\mathbf{D}$ are being considered.


title: Characterization of Er$^{3+}$:YVO$_{4}$ for microwave to optical transduction

abstract: Quantum transduction between microwave and optical frequencies is important for connecting superconducting quantum platforms in a quantum network. Ensembles of rare-earth ions are promising candidates to achieve this conversion due to their collective coherent properties at microwave and optical frequencies. Erbium ions are of particular interest because of their telecom wavelength optical transitions that are compatible with fiber communication networks. Here, we report the optical and electron spin properties of erbium doped yttrium orthovanadate (Er$^{3+}$:YVO$_{4}$), including high-resolution optical spectroscopy, electron paramagnetic resonance studies and an initial demonstration of microwave to optical conversion of classical fields. The highly absorptive optical transitions and narrow ensemble linewidths make Er$^{3+}$:YVO$_{4}$ promising for magneto-optic quantum transduction.


title: Finite-Time In-Network Computation of Linear Transforms

abstract: This paper focuses on finite-time in-network computation of linear transforms of distributed graph data. Finite-time transform computation problems are of interest in graph-based computing and signal processing applications in which the objective is to compute, by means of distributed iterative methods, various (linear) transforms of the data distributed at the agents or nodes of the graph. While finite-time computation of consensus-type or more generally rank-one transforms have been studied, systematic approaches toward scalable computing of general linear transforms, specifically in the case of heterogeneous agent objectives in which each agent is interested in obtaining a different linear combination of the network data, are relatively less explored. In this paper, by employing ideas from algebraic geometry, we develop a systematic characterization of linear transforms that are amenable to distributed in-network computation in finite-time using linear iterations. Further, we consider the general case of directed inter-agent communication graphs. Specifically, it is shown that \emph{almost all} linear transformations of data distributed on the nodes of a digraph containing a Hamiltonian cycle may be computed using at most $N$ linear distributed iterations. Finally, by studying an associated matrix factorization based reformulation of the transform computation problem, we obtain, as a by-product, certain results and characterizations on sparsity-constrained matrix factorization that are of independent interest.


title: STL Robustness Risk over Discrete-Time Stochastic Processes

abstract: We present a framework to interpret signal temporal logic (STL) formulas over discrete-time stochastic processes in terms of the induced risk. Each realization of a stochastic process either satisfies or violates an STL formula. In fact, we can assign a robustness value to each realization that indicates how robustly this realization satisfies an STL formula. We then define the risk of a stochastic process not satisfying an STL formula robustly, referred to as the STL robustness risk. In our definition, we permit general classes of risk measures such as, but not limited to, the conditional value-at-risk. While in general hard to compute, we propose an approximation of the STL robustness risk. This approximation has the desirable property of being an upper bound of the STL robustness risk when the chosen risk measure is monotone, a property satisfied by most risk measures. Motivated by the interest in data-driven approaches, we present a sampling-based method for estimating the approximate STL robustness risk from data for the value-at-risk. While we consider the value-at-risk, we highlight that such sampling-based methods are viable for other risk measures.


title: Adaptive Self-Interference Cancellation for Full-Duplex Wireless Communication Systems

abstract: In this letter, we consider single-cell, single-user systems wherein uplink and downlink user equipment communicate with a full-duplex relay. Due to the near-far problem, the self-interference (SI) can be 100-1000x the received signal power. In this context, we consider the adaptive Least Mean Squares (LMS) algorithm to estimate the SI channel and then subtract the SI from the desired received signal before the analog-to-digital converter (ADC). We measure the robustness of this technique in terms of bit error rate (BER) and spectral efficiency.


title: A microstructural analysis of 2D halide perovskites: Stability and functionality

abstract: Recent observations indicated that the photoelectric conversion properties of perovskite materials are intimately related to the presence of superlattice structures and other unusual nanoscale features in them. The low dimensional or mixed dimensional halide perovskite family are found to be more efficient materials for device application compared to 3-dimensional halide perovskites. The emergence of perovskite solar cell has revolutionized the solar cell industry because of their flexible architecture and rapidly increased efficiency. Tuning the dielectric constant, charge separation are the main objective in designing a photovoltaic device that can be explored using 2-dimensional perovskite family. Thus, revisiting the fundamental properties of perovskite crystals could reveal further possibilities for recognizing these improvements towards device functionality. In this context, this review discusses the material properties of 2-dimensional halide perovskite and related optoelectronic devices aiming particularly for solar cell application.


title: Influencing Reinforcement Learning through Natural Language Guidance

abstract: Interactive reinforcement learning agents use human feedback or instruction to help them learn in complex environments. Often, this feedback comes in the form of a discrete signal that is either positive or negative. While informative, this information can be difficult to generalize on its own. In this work, we explore how natural language advice can be used to provide a richer feedback signal to a reinforcement learning agent by extending policy shaping, a well-known Interactive reinforcement learning technique. Usually policy shaping employs a human feedback policy to help an agent to learn more about how to achieve its goal. In our case, we replace this human feedback policy with policy generated based on natural language advice. We aim to inspect if the generated natural language reasoning provides support to a deep reinforcement learning agent to decide its actions successfully in any given environment. So, we design our model with three networks: first one is the experience driven, next is the advice generator and third one is the advice driven. While the experience driven reinforcement learning agent chooses its actions being influenced by the environmental reward, the advice driven neural network with generated feedback by the advice generator for any new state selects its actions to assist the reinforcement learning agent to better policy shaping.


title: The effect of oxygen ions on the stability and polarization of Kinetic Alfv\'en Waves in the Magnetosphere

abstract: One of the most striking properties of Kinetic Alfv\'en Waves (KAW) is that, unlike the also Alfv\'enic Electromagnetic Ion Cyclotron (EMIC) waves, these waves are right-hand polarized in the plasma frame. In particular, this signature property is key for the identification of KAW from in situ measurements of plasma waves. From the theoretical point of view, both the dispersion relation and the polarization of KAW has been mostly studied in proton-electron plasmas. However, most astrophysical and space plasmas are multi-species, and therefore in these systems the dispersion properties of the KAW may not depend only on the macroscopic parameters of proton and electron distributions, but also on the parameters of heavier ions. Here, using Vlasov linear theory we study the dispersion properties of Alfv\'enic modes in multi-species plasmas composed by electrons, protons, and O$^+$ ions, with macroscopic plasma parameters relevant to the inner magnetosphere. In consistency with recent observations, our numerical results show that the presence of O$^+$ ions allows the existence of KAW in a wider wave-number range and at smaller wave-normal angles compared to the electron-proton case, but at the same time isotropic O$^+$ ions tend to reduce (or even inhibiting) the growth rates of unstable KAW triggered by anisotropic protons. These results suggest that magnetospheric ions may play an important role on the energy transfer from large macroscopic scales to sub-ionic and electronic scales, especially during intense geomagnetic storms in which O$^+$ ions can dominate the plasma composition in the inner magnetosphere.


title: Learning Neural Representation of Camera Pose with Matrix Representation of Pose Shift via View Synthesis

abstract: How to effectively represent camera pose is an essential problem in 3D computer vision, especially in tasks such as camera pose regression and novel view synthesis. Traditionally, 3D position of the camera is represented by Cartesian coordinate and the orientation is represented by Euler angle or quaternions. These representations are manually designed, which may not be the most effective representation for downstream tasks. In this work, we propose an approach to learn neural representations of camera poses and 3D scenes, coupled with neural representations of local camera movements. Specifically, the camera pose and 3D scene are represented as vectors and the local camera movement is represented as a matrix operating on the vector of the camera pose. We demonstrate that the camera movement can further be parametrized by a matrix Lie algebra that underlies a rotation system in the neural space. The vector representations are then concatenated and generate the posed 2D image through a decoder network. The model is learned from only posed 2D images and corresponding camera poses, without access to depths or shapes. We conduct extensive experiments on synthetic and real datasets. The results show that compared with other camera pose representations, our learned representation is more robust to noise in novel view synthesis and more effective in camera pose regression.


title: Detection of COVID-19 Disease using Deep Neural Networks with Ultrasound Imaging

abstract: The new coronavirus 2019 (COVID-2019) has rapidly become a pandemic and has had a devastating effect on both everyday life, public health and the global economy. It is critical to detect positive cases as early as possible to prevent the further spread of this epidemic and to treat affected patients quickly. The need for auxiliary diagnostic tools has increased as accurate automated tool kits are not available. This paper presents a work in progress that proposes the analysis of images of lung ultrasound scans using a convolutional neural network. The trained model will be used on a Raspberry Pi to predict on new images.


title: Restricting admissible representations to fixed-point subgroups

abstract: Given a $p$-adic group $G$ equipped with an action of a finite group $\Gamma\subset\mathrm{Aut}_F(\mathbf{G})$, and a reductive fixed-point subgroup $G^\Gamma$, we establish a relationship between constructions of types for these two groups due to Yu, Kim--Yu and Fintzen, and generalizes the relationship between general linear and classical groups observed by Stevens. As an application, given a parabolically induced or supercuspidal representation $\pi$ of $G$, we explicitly identify a number of the inertial equivalence classes occurring in the representation $\pi|_{G^{[\Gamma]}}$.


title: Late fusion of machine learning models using passively captured interpersonal social interactions and motion from smartphones predicts decompensation in heart failure

abstract: Objective: Worldwide, heart failure (HF) is a major cause of morbidity and mortality and one of the leading causes of hospitalization. Early detection of HF symptoms and pro-active management may reduce adverse events. Approach: Twenty-eight participants were monitored using a smartphone app after discharge from hospitals, and each clinical event during the enrollment (N=110 clinical events) was recorded. Motion, social, location, and clinical survey data collected via the smartphone-based monitoring system were used to develop and validate an algorithm for predicting or classifying HF decompensation events (hospitalizations or clinic visit) versus clinic monitoring visits in which they were determined to be compensated or stable. Models based on single modality as well as early and late fusion approaches combining patient-reported outcomes and passive smartphone data were evaluated. Results: The highest AUCPr for classifying decompensation with a late fusion approach was 0.80 using leave one subject out cross-validation. Significance: Passively collected data from smartphones, especially when combined with weekly patient-reported outcomes, may reflect behavioral and physiological changes due to HF and thus could enable prediction of HF decompensation.


title: SimCD: Simultaneous Clustering and Differential expression analysis for single-cell transcriptomic data

abstract: Single-Cell RNA sequencing (scRNA-seq) measurements have facilitated genome-scale transcriptomic profiling of individual cells, with the hope of deconvolving cellular dynamic changes in corresponding cell sub-populations to better understand molecular mechanisms of different development processes. Several scRNA-seq analysis methods have been proposed to first identify cell sub-populations by clustering and then separately perform differential expression analysis to understand gene expression changes. Their corresponding statistical models and inference algorithms are often designed disjointly. We develop a new method -- SimCD -- that explicitly models cell heterogeneity and dynamic differential changes in one unified hierarchical gamma-negative binomial (hGNB) model, allowing simultaneous cell clustering and differential expression analysis for scRNA-seq data. Our method naturally defines cell heterogeneity by dynamic expression changes, which is expected to help achieve better performances on the two tasks compared to the existing methods that perform them separately. In addition, SimCD better models dropout (zero inflation) in scRNA-seq data by both cell- and gene-level factors and obviates the need for sophisticated pre-processing steps such as normalization, thanks to the direct modeling of scRNA-seq count data by the rigorous hGNB model with an efficient Gibbs sampling inference algorithm. Extensive comparisons with the state-of-the-art methods on both simulated and real-world scRNA-seq count data demonstrate the capability of SimCD to discover cell clusters and capture dynamic expression changes. Furthermore, SimCD helps identify several known genes affected by food deprivation in hypothalamic neuron cell subtypes as well as some new potential markers, suggesting the capability of SimCD for bio-marker discovery.


title: Finite time blow-up for the heat flow of H-surface with constant mean curvature

abstract: In this paper, the authors consider an initial boundary value problem for the heat flow of equation of surfaces with constant mean curvatures, which was investigated in [On the heat flow of equation of surfaces of constant mean curvatures, Manuscripta Mathematica, 2011, 134: 259-271] by Huang et al., where global well-posedness and finite time blow-up of regular solutions were obtained. Their results are complemented in this paper in the sense that some new conditions on the initial data are provided for the solutions to develop finite time singularity.


title: Assert Use and Defectiveness in Industrial Code

abstract: The use of asserts in code has received increasing attention in the software engineering community in the past few years, even though it has been a recognized programming construct for many decades. A previous empirical study by Casalnuovo showed that methods containing asserts had fewer defects than those that did not. In this paper, we analyze the test classes of two industrial telecom Java systems to lend support to, or refute that finding. We also analyze the physical position of asserts in methods to determine if there is a relationship between assert placement and method defect-proneness. Finally, we explore the role of test method size and the relationship it has with asserts. In terms of the previous study by Casalnuovo, we found only limited evidence to support the earlier results. We did however find that defective methods with one assert tended to be located at significantly lower levels of the class position-wise than non-defective methods. Finally, method size seemed to correlate strongly with asserts, but surprisingly less so when we excluded methods with just one assert. The work described highlights the need for more studies into this aspect of code, one which has strong links with code comprehension.


title: Lozenge tilings of a hexagon with a horizontal intrusion

abstract: Motivated by a conjecture posed by Fulmek and Krattenthaler, we provide product formulas for the number of lozenge tilings of a semiregular hexagon containing a horizontal intrusion. As a direct corollary, we obtain a product formula for the number of boxed plane partitions with a certain restriction. We also investigate the asymptotic behavior of the ratio between the number of lozenge tilings of a semiregular hexagon containing a horizontal intrusion and that of a semiregular hexagon without an intrusion.


title: Forward-partial inverse-half-forward splitting algorithm for solving monotone inclusions

abstract: In this paper we provide a splitting algorithm for solving coupled monotone inclusions in a real Hilbert space involving the sum of a normal cone to a vector subspace, a maximally monotone, a monotone-Lipschitzian, and a cocoercive operator. The proposed method takes advantage of the intrinsic properties of each operator and generalizes the method of partial inverses and the forward-backward-half forward splitting, among other methods. At each iteration, our algorithm needs two computations of the Lipschitzian operator while the cocoercive operator is activated only once. By using product space techniques, we derive a method for solving a composite monotone primal-dual inclusions including linear operators and we apply it to solve constrained composite convex optimization problems. Finally, we apply our algorithm to a constrained total variation least-squares problem and we compare its performance with efficient methods in the literature.


title: PDWN: Pyramid Deformable Warping Network for Video Interpolation

abstract: Video interpolation aims to generate a non-existent intermediate frame given the past and future frames. Many state-of-the-art methods achieve promising results by estimating the optical flow between the known frames and then generating the backward flows between the middle frame and the known frames. However, these methods usually suffer from the inaccuracy of estimated optical flows and require additional models or information to compensate for flow estimation errors. Following the recent development in using deformable convolution (DConv) for video interpolation, we propose a light but effective model, called Pyramid Deformable Warping Network (PDWN). PDWN uses a pyramid structure to generate DConv offsets of the unknown middle frame with respect to the known frames through coarse-to-fine successive refinements. Cost volumes between warped features are calculated at every pyramid level to help the offset inference. At the finest scale, the two warped frames are adaptively blended to generate the middle frame. Lastly, a context enhancement network further enhances the contextual detail of the final output. Ablation studies demonstrate the effectiveness of the coarse-to-fine offset refinement, cost volumes, and DConv. Our method achieves better or on-par accuracy compared to state-of-the-art models on multiple datasets while the number of model parameters and the inference time are substantially less than previous models. Moreover, we present an extension of the proposed framework to use four input frames, which can achieve significant improvement over using only two input frames, with only a slight increase in the model size and inference time.


title: Program Behavior Analysis and Clustering using Performance Counters

abstract: Understanding the dynamic behavior of computer programs during normal working conditions is an important task, which has multiple security benefits such as the development of behavior-based anomaly detection, vulnerability discovery, and patching. Existing works achieved this goal by collecting and analyzing various data including network traffic, system calls, instruction traces, etc. In this paper, we explore the use of a new type of data, performance counters, to analyze the dynamic behavior of programs. Using existing primitives, we develop a tool named perfextract to capture data from different performance counters for a program during its startup time, thus forming multiple time series to represent the dynamic behavior of the program. We analyze the collected data and develop a semi-supervised clustering algorithm that allows us to classify each program using its performance counter time series into a specific group and to identify the intrinsic behavior of that group. We carry out extensive experiments with 18 real-world programs that belong to 4 groups including web browsers, text editors, image viewers, and audio players. The experimental results show that the examined programs can be accurately differentiated based on their performance counter data regardless of whether programs are run in physical or virtual environments.


title: Hybrid stars can be self-bound

abstract: Based on the properties of uniform nuclear matter at the nuclear saturation density and basic thermodynamic relations, we first re-study the composition of matter on the surface of normal neutron stars and hybrid stars. It is found that the hybrid stars are composed of uniform hadronic matter on the surface rather than heavy nuclei. Then we use the Walceka model and the self-consistent NJL model to describe the equation of state of low-density hadrons and quark matter at high densities respectively, and the P--interpolation method is employed to connect the equation of state at the extreme densities to study hybrid stars. As a result, we find that the obtained hybrid star mass-radius relation and tidal deformability meet the latest astronomical data. More importantly, we find that the hybrid stars we obtained can be self-bound rather than gravitationally bound, which is completely different from previous related studies.


title: Simple Uncoupled No-Regret Learning Dynamics for Extensive-Form Correlated Equilibrium

abstract: The existence of simple uncoupled no-regret learning dynamics that converge to correlated equilibria in normal-form games is a celebrated result in the theory of multi-agent systems. Specifically, it has been known for more than 20 years that when all players seek to minimize their internal regret in a repeated normal-form game, the empirical frequency of play converges to a normal-form correlated equilibrium. Extensive-form games generalize normal-form games by modeling both sequential and simultaneous moves, as well as imperfect information. Because of the sequential nature and presence of private information in the game, correlation in extensive-form games possesses significantly different properties than its counterpart in normal-form games, many of which are still open research directions. Extensive-form correlated equilibrium (EFCE) has been proposed as the natural extensive-form counterpart to the classical notion of correlated equilibrium in normal-form games. Compared to the latter, the constraints that define the set of EFCEs are significantly more complex, as the correlation device must keep into account the evolution of beliefs of each player as they make observations throughout the game. Due to that significant added complexity, the existence of uncoupled learning dynamics leading to an EFCE has remained a challenging open research question for a long time. In this article, we settle that question by giving the first uncoupled no-regret dynamics that converge to the set of EFCEs in n-player general-sum extensive-form games with perfect recall. We show that each iterate can be computed in time polynomial in the size of the game tree, and that, when all players play repeatedly according to our learning dynamics, the empirical frequency of play is proven to be a O(T^-0.5)-approximate EFCE with high probability after T game repetitions, and an EFCE almost surely in the limit.


title: Golden Tortoise Beetle Optimizer: A Novel Nature-Inspired Meta-heuristic Algorithm for Engineering Problems

abstract: This paper proposes a novel nature-inspired meta-heuristic algorithm called the Golden Tortoise Beetle Optimizer (GTBO) to solve optimization problems. It mimics golden tortoise beetle's behavior of changing colors to attract opposite sex for mating and its protective strategy that uses a kind of anal fork to deter predators. The algorithm is modeled based on the beetle's dual attractiveness and survival strategy to generate new solutions for optimization problems. To measure its performance, the proposed GTBO is compared with five other nature-inspired evolutionary algorithms on 24 well-known benchmark functions investigating the trade-off between exploration and exploitation, local optima avoidance, and convergence towards the global optima is statistically significant. We particularly applied GTBO to two well-known engineering problems including the welded beam design problem and the gear train design problem. The results demonstrate that the new algorithm is more efficient than the five baseline algorithms for both problems. A sensitivity analysis is also performed to reveal different impacts of the algorithm's key control parameters and operators on GTBO's performance.


title: TSNAT: Two-Step Non-Autoregressvie Transformer Models for Speech Recognition

abstract: The autoregressive (AR) models, such as attention-based encoder-decoder models and RNN-Transducer, have achieved great success in speech recognition. They predict the output sequence conditioned on the previous tokens and acoustic encoded states, which is inefficient on GPUs. The non-autoregressive (NAR) models can get rid of the temporal dependency between the output tokens and predict the entire output tokens in at least one step. However, the NAR model still faces two major problems. On the one hand, there is still a great gap in performance between the NAR models and the advanced AR models. On the other hand, it's difficult for most of the NAR models to train and converge. To address these two problems, we propose a new model named the two-step non-autoregressive transformer(TSNAT), which improves the performance and accelerating the convergence of the NAR model by learning prior knowledge from a parameters-sharing AR model. Furthermore, we introduce the two-stage method into the inference process, which improves the model performance greatly. All the experiments are conducted on a public Chinese mandarin dataset ASIEHLL-1. The results show that the TSNAT can achieve a competitive performance with the AR model and outperform many complicated NAR models.


title: ASPER: Attention-based Approach to Extract Syntactic Patterns denoting Semantic Relations in Sentential Context

abstract: Semantic relationships, such as hyponym-hypernym, cause-effect, meronym-holonym etc. between a pair of entities in a sentence are usually reflected through syntactic patterns. Automatic extraction of such patterns benefits several downstream tasks, including, entity extraction, ontology building, and question answering. Unfortunately, automatic extraction of such patterns has not yet received much attention from NLP and information retrieval researchers. In this work, we propose an attention-based supervised deep learning model, ASPER, which extracts syntactic patterns between entities exhibiting a given semantic relation in the sentential context. We validate the performance of ASPER on three distinct semantic relations -- hyponym-hypernym, cause-effect, and meronym-holonym on six datasets. Experimental results show that for all these semantic relations, ASPER can automatically identify a collection of syntactic patterns reflecting the existence of such a relation between a pair of entities in a sentence. In comparison to the existing methodologies of syntactic pattern extraction, ASPER's performance is substantially superior.


title: The chiral restored quark stars can exist in the universe

abstract: In this paper, the equation of state (EOS) of deconfined quark stars is studied in the framework of the two-flavor NJL model, and the self-consistent mean field approximation is employed by introducing a parameter $\alpha$ combining the original Lagrangian and the Fierz-transformed Lagrangian, $\mathcal{L}_R= (1-\alpha)\mathcal{L}+\alpha\mathcal{L}_F$, to measure the weights of different interaction channels. It is believed that the deconfinement of phase transition happens along with the chiral phase transition. Thus, due to the lack of description of confinement in the NJL model, the vacuum pressure is set to confine quarks at low densities, which is the pressure corresponding to the critical point of chiral phase transition. We find that deconfined quark stars can reach over two-solar-mass, and the bag constant therefore shifts from $(130 ~\mathrm{MeV})^4$ to $(150 ~\mathrm{MeV})^4$ as $\alpha$ grows. In addition, the tidal deformability $\Lambda$ is yielded ranging from 253 to 482 along with the decrease of $~\alpha$, which satisfies the astronomical constraint of $\Lambda<800$ for 1.4-solar-mass neutron stars.


title: Generative Locally Linear Embedding

abstract: Locally Linear Embedding (LLE) is a nonlinear spectral dimensionality reduction and manifold learning method. It has two main steps which are linear reconstruction and linear embedding of points in the input space and embedding space, respectively. In this work, we propose two novel generative versions of LLE, named Generative LLE (GLLE), whose linear reconstruction steps are stochastic rather than deterministic. GLLE assumes that every data point is caused by its linear reconstruction weights as latent factors. The proposed GLLE algorithms can generate various LLE embeddings stochastically while all the generated embeddings relate to the original LLE embedding. We propose two versions for stochastic linear reconstruction, one using expectation maximization and another with direct sampling from a derived distribution by optimization. The proposed GLLE methods are closely related to and inspired by variational inference, factor analysis, and probabilistic principal component analysis. Our simulations show that the proposed GLLE methods work effectively in unfolding and generating submanifolds of data.


title: Weakly-supervised Instance Segmentation via Class-agnostic Learning with Salient Images

abstract: Humans have a strong class-agnostic object segmentation ability and can outline boundaries of unknown objects precisely, which motivates us to propose a box-supervised class-agnostic object segmentation (BoxCaseg) based solution for weakly-supervised instance segmentation. The BoxCaseg model is jointly trained using box-supervised images and salient images in a multi-task learning manner. The fine-annotated salient images provide class-agnostic and precise object localization guidance for box-supervised images. The object masks predicted by a pretrained BoxCaseg model are refined via a novel merged and dropped strategy as proxy ground truth to train a Mask R-CNN for weakly-supervised instance segmentation. Only using $7991$ salient images, the weakly-supervised Mask R-CNN is on par with fully-supervised Mask R-CNN on PASCAL VOC and significantly outperforms previous state-of-the-art box-supervised instance segmentation methods on COCO. The source code, pretrained models and datasets are available at \url{https://github.com/hustvl/BoxCaseg}.


title: Distributed Reinforcement Learning for Age of Information Minimization in Real-Time IoT Systems

abstract: In this paper, the problem of minimizing the weighted sum of age of information (AoI) and total energy consumption of Internet of Things (IoT) devices is studied. In the considered model, each IoT device monitors a physical process that follows nonlinear dynamics. As the dynamics of the physical process vary over time, each device must find an optimal sampling frequency to sample the real-time dynamics of the physical system and send sampled information to a base station (BS). Due to limited wireless resources, the BS can only select a subset of devices to transmit their sampled information. Thus, edge devices must cooperatively sample their monitored dynamics based on the local observations and the BS must collect the sampled information from the devices immediately, hence avoiding the additional time and energy used for sampling and information transmission. To this end, it is necessary to jointly optimize the sampling policy of each device and the device selection scheme of the BS so as to accurately monitor the dynamics of the physical process using minimum energy. This problem is formulated as an optimization problem whose goal is to minimize the weighted sum of AoI cost and energy consumption. To solve this problem, we propose a novel distributed reinforcement learning (RL) approach for the sampling policy optimization. The proposed algorithm enables edge devices to cooperatively find the global optimal sampling policy using their own local observations. Given the sampling policy, the device selection scheme can be optimized thus minimizing the weighted sum of AoI and energy consumption of all devices. Simulations with real data of PM 2.5 pollution show that the proposed algorithm can reduce the sum of AoI by up to 17.8% and 33.9% and the total energy consumption by up to 13.2% and 35.1%, compared to a conventional deep Q network method and a uniform sampling policy.


title: SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Prediction

abstract: Pedestrian trajectory prediction is a key technology in autopilot, which remains to be very challenging due to complex interactions between pedestrians. However, previous works based on dense undirected interaction suffer from modeling superfluous interactions and neglect of trajectory motion tendency, and thus inevitably result in a considerable deviance from the reality. To cope with these issues, we present a Sparse Graph Convolution Network~(SGCN) for pedestrian trajectory prediction. Specifically, the SGCN explicitly models the sparse directed interaction with a sparse directed spatial graph to capture adaptive interaction pedestrians. Meanwhile, we use a sparse directed temporal graph to model the motion tendency, thus to facilitate the prediction based on the observed direction. Finally, parameters of a bi-Gaussian distribution for trajectory prediction are estimated by fusing the above two sparse graphs. We evaluate our proposed method on the ETH and UCY datasets, and the experimental results show our method outperforms comparative state-of-the-art methods by 9% in Average Displacement Error(ADE) and 13% in Final Displacement Error(FDE). Notably, visualizations indicate that our method can capture adaptive interactions between pedestrians and their effective motion tendencies.


abstract: We construct symmetric self-similar Dirichlet forms on unconstrained Sierpinski carpets, which are natural extension of planar Sierpinski carpets by allowing the small cells to live off the $1/k$ grids. The intersection of two cells can be a line segment of irrational length, and the non-diagonal assumption is dropped in this recurrent setting.


title: High-resolution Depth Maps Imaging via Attention-based Hierarchical Multi-modal Fusion

abstract: Depth map records distance between the viewpoint and objects in the scene, which plays a critical role in many real-world applications. However, depth map captured by consumer-grade RGB-D cameras suffers from low spatial resolution. Guided depth map super-resolution (DSR) is a popular approach to address this problem, which attempts to restore a high-resolution (HR) depth map from the input low-resolution (LR) depth and its coupled HR RGB image that serves as the guidance. The most challenging problems for guided DSR are how to correctly select consistent structures and propagate them, and properly handle inconsistent ones. In this paper, we propose a novel attention-based hierarchical multi-modal fusion (AHMF) network for guided DSR. Specifically, to effectively extract and combine relevant information from LR depth and HR guidance, we propose a multi-modal attention based fusion (MMAF) strategy for hierarchical convolutional layers, including a feature enhance block to select valuable features and a feature recalibration block to unify the similarity metrics of modalities with different appearance characteristics. Furthermore, we propose a bi-directional hierarchical feature collaboration (BHFC) module to fully leverage low-level spatial information and high-level structure information among multi-scale features. Experimental results show that our approach outperforms state-of-the-art methods in terms of reconstruction accuracy, running speed and memory efficiency.


title: On Fractal Features and Fractal Linear Space About Fractal Continuous Functions

abstract: This paper investigates fractal dimension of linear combination of fractal continuous functions with the same or different fractal dimensions. It has been proved that: (1) $BV_{I}$ all fractal continuous functions with bounded variation is fractal linear space; (2) ${}^{1}D_{I}$ all fractal continuous functions with Box dimension one is a fractal linear space; (3) ${}^{s}D_{I}$ all fractal continuous functions with identical Box dimension $s(1<s\leq 2)$ is surprisingly a non-fractal linear space, even non-fractal linear manifold, beyond our initial expectation, because the Box dimension of linear combination of fractal continuous functions can take any real number in $[1,s)$ if it exists, and some different upper and lower Box dimension if it does not exit. This attracts our interests to probe into fractal characteristics of ${}^{s}D_{I}$, and get some suggesting results.


title: Fitting Splines to Axonal Arbors Quantifies Relationship between Branch Order and Geometry

abstract: Neuromorphology is crucial to identifying neuronal subtypes and understanding learning. It is also implicated in neurological disease. However, standard morphological analysis focuses on macroscopic features such as branching frequency and connectivity between regions, and often neglects the internal geometry of neurons. In this work, we treat neuron trace points as a sampling of differentiable curves and fit them with a set of branching B-splines. We designed our representation with the Frenet-Serret formulas from differential geometry in mind. The Frenet-Serret formulas completely characterize smooth curves, and involve two parameters, curvature and torsion. Our representation makes it possible to compute these parameters from neuron traces in closed form. These parameters are defined continuously along the curve, in contrast to other parameters like tortuosity which depend on start and end points. We applied our method to a dataset of cortical projection neurons traced in two mouse brains, and found that the parameters are distributed differently between primary, collateral, and terminal axon branches, thus quantifying geometric differences between different components of an axonal arbor. The results agreed in both brains, further validating our representation. The code used in this work can be readily applied to neuron traces in SWC format and is available in our open-source Python package brainlit: http://brainlit.neurodata.io/.


title: Unexpected novel Merbecovirus discoveries in agricultural sequencing datasets from Wuhan, China

abstract: In this study we document the unexpected discovery of multiple coronaviruses and a BSL-3 pathogen in agricultural cotton and rice sequencing datasets. In particular, we have identified a novel HKU5-related Merbecovirus in a cotton dataset sequenced by the Huazhong Agricultural University in 2017. We have also found an infectious clone sequence containing a novel HKU4-related Merbecovirus related to MERS coronavirus in a rice dataset sequenced by the Huazhong Agricultural University in early 2020. Another HKU5-related Merbecovirus, as well as Japanese encephalitis virus, were identified in a cotton dataset sequenced by the Huazhong Agricultural University in 2018. An HKU3-related Betacoronavirus was found in a Mus musculus sequencing dataset from the Wuhan Institute of Virology in 2017. Finally, a SARS-WIV1-like Betacoronavirus was found in a rice dataset sequenced by the Fujian Agriculture and Forestry University in 2017. Using the contaminating reads we have extracted from the above datasets, we were able to assemble complete genomes of two novel coronaviruses which we disclose herein. In light of our findings, we raise concerns about biosafety protocol breaches, as indicated by our discovery of multiple dangerous human pathogens in agricultural sequencing laboratories in Wuhan and Fouzou City, China.


title: Hierarchical Image Peeling: A Flexible Scale-space Filtering Framework

abstract: The importance of hierarchical image organization has been witnessed by a wide spectrum of applications in computer vision and graphics. Different from image segmentation with the spatial whole-part consideration, this work designs a modern framework for disassembling an image into a family of derived signals from a scale-space perspective. Specifically, we first offer a formal definition of image disassembly. Then, by concerning desired properties, such as peeling hierarchy and structure preservation, we convert the original complex problem into a series of two-component separation sub-problems, significantly reducing the complexity. The proposed framework is flexible to both supervised and unsupervised settings. A compact recurrent network, namely hierarchical image peeling net, is customized to efficiently and effectively fulfill the task, which is about 3.5Mb in size, and can handle 1080p images in more than 60 fps per recurrence on a GTX 2080Ti GPU, making it attractive for practical use. Both theoretical findings and experimental results are provided to demonstrate the efficacy of the proposed framework, reveal its superiority over other state-of-the-art alternatives, and show its potential to various applicable scenarios. Our code is available at \url{https://github.com/ForawardStar/HIPe}.


title: Atomic systems in n-Hilbert spaces and their tensor products

abstract: Concept of a family of local atoms in n-Hilbert space is being studied. K-frame in tensor product of n-Hilbert spaces is described and a characterization is given. Atomic system in tensor product of n-Hilbert spaces is presented and established a relationship between atomic systems in n-Hilbert spaces and their tensor products.


title: Performance analysis of facial recognition: A critical review through glass factor

abstract: COVID-19 pandemic and social distancing urge a reliable human face recognition system in different abnormal situations. However, there is no research which studies the influence of glass factor in facial recognition system. This paper provides a comprehensive review of glass factor. The study contains two steps: data collection and accuracy test. Data collection includes collecting human face images through different situations, such as clear glasses, glass with water and glass with mist. Based on the collected data, an existing state-of-the-art face detection and recognition system built upon MTCNN and Inception V1 deep nets is tested for further analysis. Experimental data supports that 1) the system is robust for classification when comparing real-time images and 2) it fails at determining if two images are of same person by comparing real-time disturbed image with the frontal ones.


title: Code Reviews with Divergent Review Scores: An Empirical Study of the OpenStack and Qt Communities

abstract: Code review is a broadly adopted software quality practice where developers critique each others' patches. In addition to providing constructive feedback, reviewers may provide a score to indicate whether the patch should be integrated. Since reviewer opinions may differ, patches can receive both positive and negative scores. If reviews with divergent scores are not carefully resolved, they may contribute to a tense reviewing culture and may slow down integration. In this paper, we study patches with divergent review scores in the OPENSTACK and QT communities. Quantitative analysis indicates that patches with divergent review scores: (1) account for 15%-37% of patches that receive multiple review scores; (2) are integrated more often than they are abandoned; and (3) receive negative scores after positive ones in 70% of cases. Furthermore, a qualitative analysis indicates that patches with strongly divergent scores that: (4) are abandoned more often suffer from external issues (e.g., integration planning, content duplication) than patches with weakly divergent scores and patches without divergent scores; and (5) are integrated often address reviewer concerns indirectly (i.e., without changing patches). Our results suggest that review tooling should integrate with release schedules and detect concurrent development of similar patches to optimize review discussions with divergent scores. Moreover, patch authors should note that even the most divisive patches are often integrated through discussion, integration timing, and careful revision.


title: Hypercorrelation Squeeze for Few-Shot Segmentation

abstract: Few-shot semantic segmentation aims at learning to segment a target object from a query image using only a few annotated support images of the target class. This challenging task requires to understand diverse levels of visual cues and analyze fine-grained correspondence relations between the query and the support images. To address the problem, we propose Hypercorrelation Squeeze Networks (HSNet) that leverages multi-level feature correlation and efficient 4D convolutions. It extracts diverse features from different levels of intermediate convolutional layers and constructs a collection of 4D correlation tensors, i.e., hypercorrelations. Using efficient center-pivot 4D convolutions in a pyramidal architecture, the method gradually squeezes high-level semantic and low-level geometric cues of the hypercorrelation into precise segmentation masks in coarse-to-fine manner. The significant performance improvements on standard few-shot segmentation benchmarks of PASCAL-5i, COCO-20i, and FSS-1000 verify the efficacy of the proposed method.


title: DINE: Domain Adaptation from Single and Multiple Black-box Predictors

abstract: To ease the burden of labeling, unsupervised domain adaptation (UDA) aims to transfer knowledge in previous and related labeled datasets (sources) to a new unlabeled dataset (target). Despite impressive progress, prior methods always need to access the raw source data and develop data-dependent alignment approaches to recognize the target samples in a transductive learning manner, which may raise privacy concerns from source individuals. Several recent studies resort to an alternative solution by exploiting the well-trained white-box model from the source domain, yet, it may still leak the raw data through generative adversarial learning. This paper studies a practical and interesting setting for UDA, where only black-box source models (i.e., only network predictions are available) are provided during adaptation in the target domain. To solve this problem, we propose a new two-step knowledge adaptation framework called DIstill and fine-tuNE (DINE). Taking into consideration the target data structure, DINE first distills the knowledge from the source predictor to a customized target model, then fine-tunes the distilled model to further fit the target domain. Besides, neural networks are not required to be identical across domains in DINE, even allowing effective adaptation on a low-resource device. Empirical results on three UDA scenarios (i.e., single-source, multi-source, and partial-set) confirm that DINE achieves highly competitive performance compared to state-of-the-art data-dependent approaches. Code is available at \url{https://github.com/tim-learn/DINE/}.


title: Possible nature of Dark Matter

abstract: {We present a study of neutron star models that contain dark matter (DM) in the core. The DM is assumed to have a particle nature and to be self-interacting. Using constraints on the mass and radius of neutron stars, we investigate the allowed properties of either bosonic or fermionic DM particles. We consider cases where it constitutes up to 15\% of the mass of the star, even though conventional mechanisms cannot generate such large fractions. For this purpose three different models of neutron stars are considered, the first involving nucleons only, the second including hyperons, and the last involving strange matter in the core. Different EoSs are constructed for the various cases of fermionic and bosonic DM. These EoSs are solved for selected properties of the DM particles and the results are tested against mass, radius and tidal deformability constraints for neutron stars. The distribution of energy density of DM and ordinary matter inside the neutron stars is also presented. It is found that if the DM is fermionic in nature it does not just sit in the core but it is present everywhere in the star, from the centre to outside the surface and may even envelop it.

categories: hep-ph astro-ph.CO astro-ph.GA astro-ph.HE hep-th


title: Attention Back-end for Automatic Speaker Verification with Multiple Enrollment Utterances

abstract: Probabilistic linear discriminant analysis (PLDA) or cosine similarity have been widely used in traditional speaker verification systems as back-end techniques to measure pairwise similarities. To make better use of multiple enrollment utterances, we propose a novel attention back-end model, which can be used for both text-independent (TI) and text-dependent (TD) speaker verification, and employ scaled-dot self-attention and feed-forward self-attention networks as architectures that learn the intra-relationships of the enrollment utterances. In order to verify the proposed attention back-end, we conduct a series of experiments on CNCeleb and VoxCeleb datasets by combining it with several sate-of-the-art speaker encoders including TDNN and ResNet. Experimental results using multiple enrollment utterances on CNCeleb show that the proposed attention back-end model leads to lower EER and minDCF score than the PLDA and cosine similarity counterparts for each speaker encoder and an experiment on VoxCeleb indicate that our model can be used even for single enrollment case.


title: Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations

abstract: Grasp detection in clutter requires the robot to reason about the 3D scene from incomplete and noisy perception. In this work, we draw insight that 3D reconstruction and grasp learning are two intimately connected tasks, both of which require a fine-grained understanding of local geometry details. We thus propose to utilize the synergies between grasp affordance and 3D reconstruction through multi-task learning of a shared representation. Our model takes advantage of deep implicit functions, a continuous and memory-efficient representation, to enable differentiable training of both tasks. We train the model on self-supervised grasp trials data in simulation. Evaluation is conducted on a clutter removal task, where the robot clears cluttered objects by grasping them one at a time. The experimental results in simulation and on the real robot have demonstrated that the use of implicit neural representations and joint learning of grasp affordance and 3D reconstruction have led to state-of-the-art grasping results. Our method outperforms baselines by over 10% in terms of grasp success rate. Additional results and videos can be found at https://sites.google.com/view/rpl-giga2021


title: A Conversational Agent System for Dietary Supplements Use

abstract: Dietary supplements (DS) have been widely used by consumers, but the information around the efficacy and safety of DS is disparate or incomplete, thus creating barriers for consumers to find information effectively. Conversational agent (CA) systems have been applied to the healthcare domain, but there is no such a system to answer consumers regarding DS use, although widespread use of DS. In this study, we develop the first CA system for DS use


title: Optimal design of a superconducting transmon qubit with tapered wiring

abstract: Analytical formulas are presented for simplified but useful qubit geometries that predict surface dielectric loss when its thickness is much less than the metal thickness, the limiting case needed for real devices. These formulas can thus be used to precisely predict loss and optimize the qubit layout. Surprisingly, a significant fraction of surface loss comes from the small wire that connects the Josephson junction to the qubit capacitor. Tapering this wire is shown to significantly lower its loss. Also predicted are the size and density of the two-level state (TLS) spectrum from individual surface dissipation sites.


title: Active Trajectory Estimation for Partially Observed Markov Decision Processes via Conditional Entropy

abstract: In this paper, we consider the problem of controlling a partially observed Markov decision process (POMDP) in order to actively estimate its state trajectory over a fixed horizon with minimal uncertainty. We pose a novel active smoothing problem in which the objective is to directly minimise the smoother entropy, that is, the conditional entropy of the (joint) state trajectory distribution of concern in fixed-interval Bayesian smoothing. Our formulation contrasts with prior active approaches that minimise the sum of conditional entropies of the (marginal) state estimates provided by Bayesian filters. By establishing a novel form of the smoother entropy in terms of the POMDP belief (or information) state, we show that our active smoothing problem can be reformulated as a (fully observed) Markov decision process with a value function that is concave in the belief state. The concavity of the value function is of particular importance since it enables the approximate solution of our active smoothing problem using piecewise-linear function approximations in conjunction with standard POMDP solvers. We illustrate the approximate solution of our active smoothing problem in simulation and compare its performance to alternative approaches based on minimising marginal state estimate uncertainties.


title: Graph Sampling Based Deep Metric Learning for Generalizable Person Re-Identification

abstract: Recent studies show that, both explicit deep feature matching as well as large-scale and diverse training data can significantly improve the generalization of person re-identification. However, the efficiency of learning deep matchers on large-scale data has not yet been adequately studied. Though learning with classification parameters or class memory is a popular way, it incurs large memory and computational costs. In contrast, pairwise deep metric learning within mini batches would be a better choice. However, the most popular random sampling method, the well-known PK sampler, is not informative and efficient for deep metric learning. Though online hard example mining has improved the learning efficiency to some extent, the mining in mini batches after random sampling is still limited. This inspires us to explore the use of hard example mining earlier, in the data sampling stage. To do so, in this paper, we propose an efficient mini-batch sampling method, called graph sampling (GS), for large-scale deep metric learning. The basic idea is to build a nearest neighbor relationship graph for all classes at the beginning of each epoch. Then, each mini batch is composed of a randomly selected class and its nearest neighboring classes so as to provide informative and challenging examples for learning. Together with an adapted competitive baseline, we improve the state of the art in generalizable person re-identification significantly, by 25.1% in Rank-1 on MSMT17 when trained on RandPerson. Besides, the proposed method also outperforms the competitive baseline, by 6.8% in Rank-1 on CUHK03-NP when trained on MSMT17. Meanwhile, the training time is significantly reduced, from 25.4 hours to 2 hours when trained on RandPerson with 8,000 identities. Code is available at https://github.com/ShengcaiLiao/QAConv.


title: Embedding Gauss-Bonnet scalarization models in higher dimensional topological theories

abstract: In the presence of appropriate non-minimal couplings between a scalar field and the curvature squared Gauss-Bonnet (GB) term, compact objects such as neutron stars and black holes (BHs) can spontaneously scalarize, becoming a preferred vacuum. Such strong gravity phase transitions have attracted considerable attention recently. The non-minimal coupling functions that allow this mechanism are, however, always postulated ad hoc. Here we point out that families of such functions naturally emerge in the context of Higgs--Chern-Simons gravity models, which are found as dimensionally descents of higher dimensional, purely topological, Chern-Pontryagin non-Abelian densities. As a proof of concept, we study spherically symmetric scalarized BH solutions in a particular Einstein-GB-scalar field model, whose coupling is obtained from this construction, pointing out novel features and caveats thereof. The possibility of vectorization is also discussed, since this construction also originates vector fields non-minimally coupled to the GB invariant.


title: Learning Image Aesthetic Assessment from Object-level Visual Components

abstract: As it is said by Van Gogh, great things are done by a series of small things brought together. Aesthetic experience arises from the aggregation of underlying visual components. However, most existing deep image aesthetic assessment (IAA) methods over-simplify the IAA process by failing to model image aesthetics with clearly-defined visual components as building blocks. As a result, the connection between resulting aesthetic predictions and underlying visual components is mostly invisible and hard to be explicitly controlled, which limits the model in both performance and interpretability. This work aims to model image aesthetics from the level of visual components. Specifically, object-level regions detected by a generic object detector are defined as visual components, namely object-level visual components (OVCs). Then generic features representing OVCs are aggregated for the aesthetic prediction based upon proposed object-level and graph attention mechanisms, which dynamically determines the importance of individual OVCs and relevance between OVC pairs, respectively. Experimental results confirm the superiority of our framework over previous relevant methods in terms of SRCC and PLCC on the aesthetic rating distribution prediction. Besides, quantitative analysis is done towards model interpretation by observing how OVCs contribute to aesthetic predictions, whose results are found to be supported by psychology on aesthetics and photography rules. To the best of our knowledge, this is the first attempt at the interpretation of a deep IAA model.


title: A Task-Motion Planning Framework Using Iteratively Deepened AND/OR Graph Networks

abstract: We present an approach for Task-Motion Planning (TMP) using Iterative Deepened AND/OR Graph Networks (TMP-IDAN) that uses an AND/OR graph network based novel abstraction for compactly representing the task-level states and actions. While retrieving a target object from clutter, the number of object re-arrangements required to grasp the target is not known ahead of time. To address this challenge, in contrast to traditional AND/OR graph-based planners, we grow the AND/OR graph online until the target grasp is feasible and thereby obtain a network of AND/OR graphs. The AND/OR graph network allows faster computations than traditional task planners. We validate our approach and evaluate its capabilities using a Baxter robot and a state-of-the-art robotics simulator in several challenging non-trivial cluttered table-top scenarios. The experiments show that our approach is readily scalable to increasing number of objects and different degrees of clutter.


title: The Bohr inequality for the generalized C{\'e}saro averaging operators

abstract: The main aim of this paper is to prove a generalization of the classical Bohr theorem and as an application, we obtain a counterpart of Bohr theorem for the generalized Ces\'aro operator.


title: On the Entanglement Entropy in Gaussian cMERA

abstract: The continuous Multi Scale Entanglement Renormalization Anstaz (cMERA) consists of a variational method which carries out a real space renormalization scheme on the wavefunctionals of quantum field theories. In this work we calculate the entanglement entropy of the half space for a free scalar theory through a Gaussian cMERA circuit. We obtain the correct entropy written in terms of the optimized cMERA variational parameter, the local density of disentanglers. Accordingly, using the entanglement entropy production per unit scale, we study local areas in the bulk of the tensor network in terms of the differential entanglement generated along the cMERA flow. This result spurs us to establish an explicit relation between the cMERA variational parameter and the radial component of a dual AdS geometry through the Ryu-Takayanagi formula. Finally, based on recent formulations of non-Gaussian cMERA circuits, we argue that the entanglement entropy for the half space can be written as an integral along the renormalization scale whose measure is given by the Fisher information metric of the cMERA circuit. Consequently, a straightforward relation between AdS geometry and the Fisher information metric is also established.


title: Scene Text Retrieval via Joint Text Detection and Similarity Learning

abstract: Scene text retrieval aims to localize and search all text instances from an image gallery, which are the same or similar to a given query text. Such a task is usually realized by matching a query text to the recognized words, outputted by an end-to-end scene text spotter. In this paper, we address this problem by directly learning a cross-modal similarity between a query text and each text instance from natural images. Specifically, we establish an end-to-end trainable network, jointly optimizing the procedures of scene text detection and cross-modal similarity learning. In this way, scene text retrieval can be simply performed by ranking the detected text instances with the learned similarity. Experiments on three benchmark datasets demonstrate our method consistently outperforms the state-of-the-art scene text spotting/retrieval approaches. In particular, the proposed framework of joint detection and similarity learning achieves significantly better performance than separated methods. Code is available at: https://github.com/lanfeng4659/STR-TDSL.


title: Difference of facial achromatic numbers between two triangular embeddings of a graph

abstract: A facial $3$-complete $k$-coloring of a triangulation $G$ on a surface is a vertex $k$-coloring such that every triple of $k$-colors appears on the boundary of some face of $G$. The facial $3$-achromatic number $\psi_3(G)$ of $G$ is the maximum integer $k$ such that $G$ has a facial $3$-complete $k$-coloring. This notion is an expansion of the complete coloring, that is, a proper vertex coloring of a graph such that every pair of colors appears on the ends of some edge. For two triangulations $G$ and $G'$ on a surface, $\psi_3(G)$ may not be equal to $\psi_3(G')$ even if $G$ is isomorphic to $G'$ as graphs. Hence, it would be interesting to see how large the difference between $\psi_3(G)$ and $\psi_3(G')$ can be. We shall show that the upper bound for such difference in terms of the genus of the surface.


title: Finding Nano-\"Otzi: Semi-Supervised Volume Visualization for Cryo-Electron Tomography

abstract: Cryo-Electron Tomography (cryo-ET) is a new 3D imaging technique with unprecedented potential for resolving submicron structural detail. Existing volume visualization methods, however, cannot cope with its very low signal-to-noise ratio. In order to design more powerful transfer functions, we propose to leverage soft segmentation as an explicit component of visualization for noisy volumes. Our technical realization is based on semi-supervised learning where we combine the advantages of two segmentation algorithms. A first weak segmentation algorithm provides good results for propagating sparse user provided labels to other voxels in the same volume. This weak segmentation algorithm is used to generate dense pseudo labels. A second powerful deep-learning based segmentation algorithm can learn from these pseudo labels to generalize the segmentation to other unseen volumes, a task that the weak segmentation algorithm fails at completely. The proposed volume visualization uses the deep-learning based segmentation as a component for segmentation-aware transfer function design. Appropriate ramp parameters can be suggested automatically through histogram analysis. Finally, our visualization uses gradient-free ambient occlusion shading to further suppress visual presence of noise, and to give structural detail desired prominence. The cryo-ET data studied throughout our technical experiments is based on the highest-quality tilted series of intact SARS-CoV-2 virions. Our technique shows the high impact in target sciences for visual data analysis of very noisy volumes that cannot be visualized with existing techniques.


title: Decentralized Statistical Inference with Unrolled Graph Neural Networks

abstract: In this paper, we investigate the decentralized statistical inference problem, where a network of agents cooperatively recover a (structured) vector from private noisy samples without centralized coordination. Existing optimization-based algorithms suffer from issues of model mismatch and poor convergence speed, and thus their performance would be degraded, provided that the number of communication rounds is limited. This motivates us to propose a learning-based framework, which unrolls well-noted decentralized optimization algorithms (e.g., Prox-DGD and PG-EXTRA) into graph neural networks (GNNs). By minimizing the recovery error via end-to-end training, this learning-based framework resolves the model mismatch issue. Our convergence analysis (with PG-EXTRA as the base algorithm) reveals that the learned model parameters may accelerate the convergence and reduce the recovery error to a large extent. The simulation results demonstrate that the proposed GNN-based learning methods prominently outperform several state-of-the-art optimization-based algorithms in convergence speed and recovery error.


title: $L^2$-stableness for solution to linearized KdV equation

abstract: The linearized Korteweg-De Vries equation can be written as a Hamilton-like system. However, the Hamilton energy depends on the time, and is a nonsymmetric operator on $L^2({\bf R})$. By performing suitable unitary transforms on the Hamilton energy, we can reduce this operator into one that is not independent on the time but nonsymmetric. In this study, we consider the $L^2$-stability issues and smoothing estimates for this operator, and prove that it has no eigenvalues.


title: Cylindrical spacetimes due to radial magnetic fields

abstract: We continue our previous study of cylindrically symmetric, static electrovacuum spacetimes generated by a magnetic field, involving optionally the cosmological constant, and investigate several classes of exact solutions. These spacetimes are due to magnetic fields that are perpendicular to the axis of symmetry.


title: Perspective-corrected Spatial Referring Expression Generation for Human-Robot Interaction

abstract: Intelligent robots designed to interact with humans in real scenarios need to be able to refer to entities actively by natural language. In spatial referring expression generation, the ambiguity is unavoidable due to the diversity of reference frames, which will lead to an understanding gap between humans and robots. To narrow this gap, in this paper, we propose a novel perspective-corrected spatial referring expression generation (PcSREG) approach for human-robot interaction by considering the selection of reference frames. The task of referring expression generation is simplified into the process of generating diverse spatial relation units. First, we pick out all landmarks in these spatial relation units according to the entropy of preference and allow its updating through a stack model. Then all possible referring expressions are generated according to different reference frame strategies. Finally, we evaluate every expression using a probabilistic referring expression resolution model and find the best expression that satisfies both of the appropriateness and effectiveness. We implement the proposed approach on a robot system and empirical experiments show that our approach can generate more effective spatial referring expressions for practical applications.


title: Center of Banach algebra valued Beurling algebras

abstract: We prove that for a Banach algebra $A$ having a bounded $\mathcal{Z}(A)$-approximate identity and for every $\bf[IN]$ group $G$ with weight $w$ which is either constant on conjugacy classes or $w \geq 1$, $\mathcal{Z}\big(L^1_w(G) \otimes^\gamma A\big) \cong \mathcal{Z}(L^1_w(G)) \otimes^\gamma \mathcal{Z}(A)$. As an application, we discuss the conditions under which $\mathcal{Z}\big(L^1_w(G,A)\big)$ enjoys certain Banach algebraic properties, for example, weak amenability, semisimplicity etc.


title: Conv1D Energy-Aware Path Planner for Mobile Robots in Unstructured Environments

abstract: Driving energy consumption plays a major role in the navigation of mobile robots in challenging environments, especially if they are left to operate unattended under limited on-board power. This paper reports on first results of an energy-aware path planner, which can provide estimates of the driving energy consumption and energy recovery of a robot traversing complex uneven terrains. Energy is estimated over trajectories making use of a self-supervised learning approach, in which the robot autonomously learns how to correlate perceived terrain point clouds to energy consumption and recovery. A novel feature of the method is the use of 1D convolutional neural network to analyse the terrain sequentially in the same temporal order as it would be experienced by the robot when moving. The performance of the proposed approach is assessed in simulation over several digital terrain models collected from real natural scenarios, and is compared with a heuristic inclination-based energy model. We show evidence of the benefit of our method to increase the overall prediction r2 score by 66.8% and to reduce the driving energy consumption over planned paths by 5.5%.


title: A strongly universal cellular automaton in the dodecagrid with five states

abstract: In this paper, we prove that there is a strongly universal cellular automaton in the dodecagrid, the tessellation {5,3,4} of the hyperbolic 3D-space, with five states which is rotation invariant. This improves a previous paper of the author where the automaton required ten states.


title: Factorization of radiative leptonic D-meson decay with sub-leading power corrections

abstract: In this work, we calculate the sub-leading power contributions to the radiative leptonic $D\to\gamma \,\ell \,\nu$ decay. For the first time, we provide the analytic expressions of next-to-leading power contributions and the error estimation associated with the power expansion of ${\cal O}(\Lambda_{\rm QCD}/m_c)$. In our calculation, we adopt two different models of the $D$-meson distribution amplitudes $\phi_{D,\rm I}^+$ and $\phi_{D,\rm II}^+$. Within the framework of the QCD factorization as well as the dispersion relation, we evaluate the soft contribution up to the next-to-leading logarithmic accuracy, and the higher-twist contribution from the two-particle and three-particle distribution amplitudes is also considered. Finally, we find that all the sub-leading power contributions are significant at $\lambda_D(\mu_0)=354\,\rm MeV$, and the next-to-leading power contributions will lead to $143\%$ in $\phi_{D,\rm I}^+$ and $120\%$ in $\phi_{D,\rm II}^+$ corrections to leading power vector form factors with $E_{\gamma}=0.5\,\rm GeV$. As the corrections from the higher-twist and local sub-leading power contributions will be enhanced with the growing of the inverse moment, it is difficult to extract an appropriate inverse moment of the $D$-meson distribution amplitude. The predicted branching fractions are $(1.88_{-0.29}^{+0.36})\times10^{-5}$ for $\phi_{D,\rm I}^+$ and $(2.31_{-0.54}^{+0.65})\times10^{-5}$ for $\phi_{D,\rm II}^+$, respectively.


title: ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for Abstract Word Prediction

abstract: This paper describes our system for Task 4 of SemEval-2021: Reading Comprehension of Abstract Meaning (ReCAM). We participated in all subtasks where the main goal was to predict an abstract word missing from a statement. We fine-tuned the pre-trained masked language models namely BERT and ALBERT and used an Ensemble of these as our submitted system on Subtask 1 (ReCAM-Imperceptibility) and Subtask 2 (ReCAM-Nonspecificity). For Subtask 3 (ReCAM-Intersection), we submitted the ALBERT model as it gives the best results. We tried multiple approaches and found that Masked Language Modeling(MLM) based approach works the best.


title: Arithmetic Progressions in Sumsets of Sparse Sets

abstract: A set of positive integers $A \subset \mathbb{Z}_{> 0}$ is \emph{log-sparse} if there is an absolute constant $C$ so that for any positive integer $x$ the sequence contains at most $C$ elements in the interval $[x,2x)$. In this note we study arithmetic progressions in sums of log-sparse subsets of $\mathbb{Z}_{> 0}$. We prove that for any log-sparse subsets $S_1, \dots, S_n$ of $\mathbb{Z}_{> 0},$ the sumset $S = S_1 + \cdots + S_n$ cannot contain an arithmetic progression of size greater than $n^{(1+o(1))n}.$ We also show that this is nearly tight by proving that there exist log-sparse sets $S_1, \dots, S_n$ such that $S_1 + \cdots + S_n$ contains an arithmetic progression of size $n^{(1-o(1)) n}.$


title: Field-Induced Superconductivity near the Superconducting Critical Pressure in UTe2

abstract: We report the magnetoresistance in the novel spin-triplet superconductor UTe2 under pressure close to the critical pressure Pc, where the superconducting phase terminates, for field along the three a, b and c-axes in the orthorhombic structure. The superconducting phase for H // a-axis just below Pc shows a field-reentrant behavior due to the competition with the emergence of magnetic order at low fields. The upper critical field Hc2 for H // c-axis shows a quasi-vertical increase in the H-T phase diagram just below Pc, indicating that superconductivity is reinforced by the strong fluctuations which persist even at high fields above 20T. Increasing pressure leads to the disappearance of superconductivity at zero field with the emergence of magnetic order. Surprisingly, field-induced superconductivity is observed at high fields, where a spin-polarized state is realized due to the suppression of the magnetic ordered phases; the spin-polarized state is favorable for superconductivity, whereas the magnetic ordered phase at low field seems to be unfavorable. The huge Hc2 in the spin-polarized state seems to imply a spin-triplet state. Contrary to the a- and c-axes, no field-reinforcement of superconductivity occurs for magnetic field along the b-axis. We compare the results with the field-reentrant superconductivity above the metamagnetic field, Hm for the field direction tilted by about 30 deg. from b to c-axis at ambient pressure as well as the field-reentrant (-reinforced) superconductivity in ferromagnetic superconductors, URhGe and UCoGe.


title: IITK@Detox at SemEval-2021 Task 5: Semi-Supervised Learning and Dice Loss for Toxic Spans Detection

abstract: In this work, we present our approach and findings for SemEval-2021 Task 5 - Toxic Spans Detection. The task's main aim was to identify spans to which a given text's toxicity could be attributed. The task is challenging mainly due to two constraints: the small training dataset and imbalanced class distribution. Our paper investigates two techniques, semi-supervised learning and learning with Self-Adjusting Dice Loss, for tackling these challenges. Our submitted system (ranked ninth on the leader board) consisted of an ensemble of various pre-trained Transformer Language Models trained using either of the above-proposed techniques.


title: MCL@IITK at SemEval-2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation using Augmented Data, Signals, and Transformers

abstract: In this work, we present our approach for solving the SemEval 2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation (MCL-WiC). The task is a sentence pair classification problem where the goal is to detect whether a given word common to both the sentences evokes the same meaning. We submit systems for both the settings - Multilingual (the pair's sentences belong to the same language) and Cross-Lingual (the pair's sentences belong to different languages). The training data is provided only in English. Consequently, we employ cross-lingual transfer techniques. Our approach employs fine-tuning pre-trained transformer-based language models, like ELECTRA and ALBERT, for the English task and XLM-R for all other tasks. To improve these systems' performance, we propose adding a signal to the word to be disambiguated and augmenting our data by sentence pair reversal. We further augment the dataset provided to us with WiC, XL-WiC and SemCor 3.0. Using ensembles, we achieve strong performance in the Multilingual task, placing first in the EN-EN and FR-FR sub-tasks. For the Cross-Lingual setting, we employed translate-test methods and a zero-shot method, using our multilingual models, with the latter performing slightly better.


title: Information-theoretic regularization for Multi-source Domain Adaptation

abstract: Adversarial learning strategy has demonstrated remarkable performance in dealing with single-source Domain Adaptation (DA) problems, and it has recently been applied to Multi-source DA (MDA) problems. Although most existing MDA strategies rely on a multiple domain discriminator setting, its effect on the latent space representations has been poorly understood. Here we adopt an information-theoretic approach to identify and resolve the potential adverse effect of the multiple domain discriminators on MDA: disintegration of domain-discriminative information, limited computational scalability, and a large variance in the gradient of the loss during training. We examine the above issues by situating adversarial DA in the context of information regularization. This also provides a theoretical justification for using a single and unified domain discriminator. Based on this idea, we implement a novel neural architecture called a Multi-source Information-regularized Adaptation Networks (MIAN). Large-scale experiments demonstrate that MIAN, despite its structural simplicity, reliably and significantly outperforms other state-of-the-art methods.


title: Conversational Question Answering over Knowledge Graphs with Transformer and Graph Attention Networks

abstract: This paper addresses the task of (complex) conversational question answering over a knowledge graph. For this task, we propose LASAGNE (muLti-task semAntic parSing with trAnsformer and Graph atteNtion nEtworks). It is the first approach, which employs a transformer architecture extended with Graph Attention Networks for multi-task neural semantic parsing. LASAGNE uses a transformer model for generating the base logical forms, while the Graph Attention model is used to exploit correlations between (entity) types and predicates to produce node representations. LASAGNE also includes a novel entity recognition module which detects, links, and ranks all relevant entities in the question context. We evaluate LASAGNE on a standard dataset for complex sequential question answering, on which it outperforms existing baseline averages on all question types. Specifically, we show that LASAGNE improves the F1-score on eight out of ten question types; in some cases, the increase in F1-score is more than 20% compared to the state of the art.


title: Stacking and gate tunable topological flat bands, gaps and anisotropic strip patterns in twisted trilayer graphene

abstract: Trilayer graphene with a twisted middle layer has recently emerged as a new platform exhibiting correlated phases and superconductivity near its magic angle. A detailed characterization of its electronic structure in the parameter space of twist angle $\theta$, interlayer potential difference $\Delta$, and top-bottom layer stacking $\tau$ reveals that flat bands with large Coulomb energy vs bandwidth $U/W > 1$ are expected within a range of $\pm 0.2^{\circ}$ near $\theta \simeq1.5^{\circ}$ and $\theta \simeq1.2^{\circ}$ for $\tau_{\rm AA}$ top-bottom layer stacking, between a wider $1^{\circ} \sim 1.7^{\circ}$ range for $\tau_{\rm AB}$ stacking, whose bands often have finite valley Chern numbers thanks to the opening of primary and secondary band gaps in the presence of a finite $\Delta$, and below $\theta \lesssim 0.6^{\circ}$ for all $\tau$ considered. The largest $U/W$ ratios are expected at the magic angle $\sim 1.5^{\circ}$ when $|\Delta| \sim 0$~meV for AA, and slightly below near $\sim 1.4^{\circ}$ for finite $|\Delta| \sim 25$~meV for AB stackings, and near $\theta \sim 0.4^{\circ}$ for both stackings. When ${\tau}$ is the saddle point stacking vector between AB and BA we observe pronounced anisotropic local density of states (LDOS) strip patterns with broken triangular rotational symmetry. We present optical conductivity calculations that reflect the changes in the electronic structure introduced by the stacking and gate tunable system parameters.


title: Geometric Brownian Motion under Stochastic Resetting: A Stationary yet Non-ergodic Process

abstract: We study the effects of stochastic resetting on geometric Brownian motion (GBM), a canonical stochastic multiplicative process for non-stationary and non-ergodic dynamics. Resetting is a sudden interruption of a process, which consecutively renews its dynamics. We show that, although resetting renders GBM stationary, the resulting process remains non-ergodic. Quite surprisingly, the effect of resetting is pivotal in manifesting the non-ergodic behavior. In particular, we observe three different long-time regimes: a quenched state, an unstable and a stable annealed state depending on the resetting strength. Notably, in the last regime, the system is self-averaging and thus the sample average will always mimic ergodic behavior establishing a stand alone feature for GBM under resetting. Crucially, the above-mentioned regimes are well separated by a self-averaging time period which can be minimized by an optimal resetting rate. Our results can be useful to interpret data emanating from stock market collapse or reconstitution of investment portfolios.


title: TransfoRNN: Capturing the Sequential Information in Self-Attention Representations for Language Modeling

abstract: In this paper, we describe the use of recurrent neural networks to capture sequential information from the self-attention representations to improve the Transformers. Although self-attention mechanism provides a means to exploit long context, the sequential information, i.e. the arrangement of tokens, is not explicitly captured. We propose to cascade the recurrent neural networks to the Transformers, which referred to as the TransfoRNN model, to capture the sequential information. We found that the TransfoRNN models which consists of only shallow Transformers stack is suffice to give comparable, if not better, performance than a deeper Transformer model. Evaluated on the Penn Treebank and WikiText-2 corpora, the proposed TransfoRNN model has shown lower model perplexities with fewer number of model parameters. On the Penn Treebank corpus, the model perplexities were reduced up to 5.5% with the model size reduced up to 10.5%. On the WikiText-2 corpus, the model perplexity was reduced up to 2.2% with a 27.7% smaller model. Also, the TransfoRNN model was applied on the LibriSpeech speech recognition task and has shown comparable results with the Transformer models.


title: D-optimal designs for the Mitscherlich non-linear regression function

abstract: Mitscherlich's function is a well-known three-parameter non-linear regression function that quantifies the relation between a stimulus or a time variable and a response. Optimal designs for this function have been constructed only for normally distributed responses with homoscedastic variances. In this paper, we construct D-optimal designs for discrete and continuous responses having their distribution function in the exponential family. We also demonstrate the connection with D-optimality for weighted linear regression.


title: Hyperplane families creating envelopes

abstract: A simple geometric mechanism: "the locus of intersections of perpendicular bisectors and normal lines", often arises in many guises in Nonlinear Sciences. In this paper, a new application of this simple geometric mechanism is given. Namely, we show that this mechanism gives answers to all four basic problems on envelopes created by hyperplane families (existence problem, representation problem, equivalence problem of definitions, uniqueness problem) at once.


title: Reliably fast adversarial training via latent adversarial perturbation

abstract: While multi-step adversarial training is widely popular as an effective defense method against strong adversarial attacks, its computational cost is notoriously expensive, compared to standard training. Several single-step adversarial training methods have been proposed to mitigate the above-mentioned overhead cost; however, their performance is not sufficiently reliable depending on the optimization setting. To overcome such limitations, we deviate from the existing input-space-based adversarial training regime and propose a single-step latent adversarial training method (SLAT), which leverages the gradients of latent representation as the latent adversarial perturbation. We demonstrate that the L1 norm of feature gradients is implicitly regularized through the adopted latent perturbation, thereby recovering local linearity and ensuring reliable performance, compared to the existing single-step adversarial training methods. Because latent perturbation is based on the gradients of the latent representations which can be obtained for free in the process of input gradients computation, the proposed method costs roughly the same time as the fast gradient sign method. Experiment results demonstrate that the proposed method, despite its structural simplicity, outperforms state-of-the-art accelerated adversarial training methods.


title: Vector lattice approach to the Riesz and Stone Representation theorems

abstract: We present vector-lattice-theoretic proofs of Riesz Representation Theorem and Stone Representation Theorem.


title: Class-incremental Learning using a Sequence of Partial Implicitly Regularized Classifiers

abstract: In class-incremental learning, the objective is to learn a number of classes sequentially without having access to the whole training data. However, due to a problem known as catastrophic forgetting, neural networks suffer substantial performance drop in such settings. The problem is often approached by experience replay, a method which stores a limited number of samples to be replayed in future steps to reduce forgetting of the learned classes. When using a pretrained network as a feature extractor, we show that instead of training a single classifier incrementally, it is better to train a number of specialized classifiers which do not interfere with each other yet can cooperatively predict a single class. Our experiments on CIFAR100 dataset show that the proposed method improves the performance over SOTA by a large margin.


title: Saved by the rook: a case of matchings and Hamiltonian cycles

abstract: The rook graph is a graph whose edges represent all the possible legal moves of the rook chess piece on a chessboard. The problem we consider is the following. Given any set $M$ containing pairs of cells such that each cell of the $m_1 \times m_2$ chessboard is in exactly one pair, we determine the values of the positive integers $m_1$ and $m_2$ for which it is possible to construct a closed tour of all the cells of the chessboard which uses all the pairs of cells in $M$ and some edges of the rook graph. This is an alternative formulation of a graph-theoretical problem presented in [Electron. J. Combin. 28(1) (2021), #P1.7] involving the Cartesian product $G$ of two complete graphs $K_{m_1}$ and $K_{m_2}$, which is, in fact, isomorphic to the $m_{1}\times m_{2}$ rook graph. The problem revolves around determining the values of the parameters $m_1$ and $m_2$ that would allow any perfect matching of the complete graph on the same vertex set of $G$ to be extended to a Hamiltonian cycle by using only edges in $G$.


title: An expansion formula for Hawkes processes and application to cyber-insurance derivatives

abstract: In this paper we provide an expansion formula for Hawkes processes which involves the addition of jumps at deterministic times to the Hawkes process in the spirit of the well-known integration by parts formula (or more precisely the Mecke formula) for Poisson functional. Our approach allows us to provide an expansion of the premium of a class of cyber insurance derivatives (such as reinsurance contracts including generalized Stop-Loss contracts) or risk management instruments (like Expected Shortfall) in terms of so-called shifted Hawkes processes. From the actuarial point of view, these processes can be seen as "stressed" scenarios. Our expansion formula for Hawkes processes enables us to provide lower and upper bounds on the premium (or the risk evaluation) of such cyber contracts and to quantify the surplus of premium compared to the standard modeling with a homogenous Poisson process.


title: Broadband dielectric behavior of MIL-100 metal-organic framework as a function of structural amorphization

abstract: The performance of modern electronics is associated with the multi-layered interconnects, encouraging the development of a low-k dielectrics. Herein, we studied the effects of phase transition from crystalline to amorphous on dielectric, optical and electrical properties of MIL-100 (Fe) and Basolite F300 metal-organic framework (MOF) obtained using different synthesis techniques in both the radio (4-1.5 MHz) and infrared (1.2-150 THz) frequency regimes, which are important for the microelectronics, infrared optical sensors, and high-frequency telecommunications. The impact of amorphization on broadband dielectric response was established based on: (1) The comparison in the dielectric characteristics of a commercially available amorphous Basolite F300 versus a mechanochemically synthesized crystalline MIL-100 in the MHz region. (2) By tracking the frequency shifts in the vibrational modes of MIL-100 structure in the far-IR (phonons) and mid-IR regions. We showed that various parameters such as pelleting pressure, temperature, frequency, density, and degree of amorphization greatly affect the dielectric properties of the framework. We also investigated the influence of temperature (20-100 {\deg}C) on the electric and dielectric response in the MHz region, crucial for all electronic devices.


title: An Infinite Set of Integral Formulae for Polar, Nematic, and Higher Order Structures at the Interface of Motility-Induced Phase Separation

abstract: Motility-induced phase separation (MIPS) is a purely non-equilibrium phenomenon in which self-propelled particles phase separate without any attractive interactions. One surprising feature of MIPS is the emergence of polar, nematic, and higher order structures at the interfacial region, whose underlying physics remains poorly understood. Starting with a model of MIPS in which all many-body interactions are captured by an effective speed function and an effective pressure function that depend solely on the local particle density, I derive analytically an infinite set of integral formulae (IF) for the ordering structures at the interface. I then demonstrate that half of these IF are in fact exact for a wide class of active Brownian particle systems. Finally, I test the IF by applying them to numerical data from direct particle dynamics simulation and find that all the IF remain valid to a great extent.