title: Fixed-Budget Best-Arm Identification in Structured Bandits

abstract: Best-arm identification (BAI) in a fixed-budget setting is a bandit problem where the learning agent maximizes the probability of identifying the optimal (best) arm after a fixed number of observations. Most works on this topic study unstructured problems with a small number of arms, which limits their applicability. We propose a general tractable algorithm that incorporates the structure, by successively eliminating suboptimal arms based on their mean reward estimates from a joint generalization model. We analyze our algorithm in linear and generalized linear models (GLMs), and propose a practical implementation based on a G-optimal design. In linear models, our algorithm has competitive error guarantees to prior works and performs at least as well empirically. In GLMs, this is the first practical algorithm with analysis for fixed-budget BAI.


title: Semi-Supervised Training with Pseudo-Labeling for End-to-End Neural Diarization

abstract: In this paper, we present a semi-supervised training technique using pseudo-labeling for end-to-end neural diarization (EEND). The EEND system has shown promising performance compared with traditional clustering-based methods, especially in the case of overlapping speech. However, to get a well-tuned model, EEND requires labeled data for all the joint speech activities of every speaker at each time frame in a recording. In this paper, we explore a pseudo-labeling approach that employs unlabeled data. First, we propose an iterative pseudo-label method for EEND, which trains the model using unlabeled data of a target condition. Then, we also propose a committee-based training method to improve the performance of EEND. To evaluate our proposed method, we conduct the experiments of model adaptation using labeled and unlabeled data. Experimental results on the CALLHOME dataset show that our proposed pseudo-label achieved a 37.4% relative diarization error rate reduction compared to a seed model. Moreover, we analyzed the results of semi-supervised adaptation with pseudo-labeling. We also show the effectiveness of our approach on the third DIHARD dataset.


title: Predicting Deep Neural Network Generalization with Perturbation Response Curves

abstract: The field of Deep Learning is rich with empirical evidence of human-like performance on a variety of prediction tasks. However, despite these successes, the recent Predicting Generalization in Deep Learning (PGDL) NeurIPS 2020 competition suggests that there is a need for more robust and efficient measures of network generalization. In this work, we propose a new framework for evaluating the generalization capabilities of trained networks. We use perturbation response (PR) curves that capture the accuracy change of a given network as a function of varying levels of training sample perturbation. From these PR curves, we derive novel statistics that capture generalization capability. Specifically, we introduce two new measures for accurately predicting generalization gaps: the Gi-score and Pal-score, which are inspired by the Gini coefficient and Palma ratio (measures of income inequality), that accurately predict generalization gaps. Using our framework applied to intra and inter-class sample mixup, we attain better predictive scores than the current state-of-the-art measures on a majority of tasks in the PGDL competition. In addition, we show that our framework and the proposed statistics can be used to capture to what extent a trained network is invariant to a given parametric input transformation, such as rotation or translation. Therefore, these generalization gap prediction statistics also provide a useful means for selecting optimal network architectures and hyperparameters that are invariant to a certain perturbation.


title: Fundamental Privacy Limits in Bipartite Networks under Active Attacks

abstract: This work considers active deanonymization of bipartite networks. The scenario arises naturally in evaluating privacy in various applications such as social networks, mobility networks, and medical databases. For instance, in active deanonymization of social networks, an anonymous victim is targeted by an attacker (e.g. the victim visits the attacker's website), and the attacker queries her group memberships (e.g. by querying the browser history) to deanonymize her. In this work, the fundamental limits of privacy, in terms of the minimum number of queries necessary for deanonymization, is investigated. A stochastic model is considered, where i) the bipartite network of group memberships is generated randomly, ii) the attacker has partial prior knowledge of the group memberships, and iii) it receives noisy responses to its real-time queries. The bipartite network is generated based on linear and sublinear preferential attachment, and the stochastic block model. The victim's identity is chosen randomly based on a distribution modeling the users' risk of being the victim (e.g. probability of visiting the website). An attack algorithm is proposed which builds upon techniques from communication with feedback, and its performance, in terms of expected number of queries, is analyzed. Simulation results are provided to verify the theoretical derivations.


title: Ex uno plures: Splitting One Model into an Ensemble of Subnetworks

abstract: Monte Carlo (MC) dropout is a simple and efficient ensembling method that can improve the accuracy and confidence calibration of high-capacity deep neural network models. However, MC dropout is not as effective as more compute-intensive methods such as deep ensembles. This performance gap can be attributed to the relatively poor quality of individual models in the MC dropout ensemble and their lack of diversity. These issues can in turn be traced back to the coupled training and substantial parameter sharing of the dropout models. Motivated by this perspective, we propose a strategy to compute an ensemble of subnetworks, each corresponding to a non-overlapping dropout mask computed via a pruning strategy and trained independently. We show that the proposed subnetwork ensembling method can perform as well as standard deep ensembles in both accuracy and uncertainty estimates, yet with a computational efficiency similar to MC dropout. Lastly, using several computer vision datasets like CIFAR10/100, CUB200, and Tiny-Imagenet, we experimentally demonstrate that subnetwork ensembling also consistently outperforms recently proposed approaches that efficiently ensemble neural networks.


title: Unipotent nearby cycles and the cohomology of shtukas

abstract: We give cases in which nearby cycles commutes with pushforward from sheaves on the moduli stack of shtukas to a product of curves over a finite field. The proof systematically uses the property that taking nearby cycles of Satake sheaves on the Beilinson-Drinfeld Grassmannian with parahoric reduction is a central functor together with a "Zorro's lemma" argument similar to that given by Xue to prove the smoothness of cohomology sheaves at unramified places. As an application, for automorphic forms at the parahoric level, we characterize the image of tame inertia under the Langlands correspondence in terms of two-sided cells.


title: Submodular + Concave

abstract: It has been well established that first order optimization methods can converge to the maximal objective value of concave functions and provide constant factor approximation guarantees for (non-convex/non-concave) continuous submodular functions. In this work, we initiate the study of the maximization of functions of the form $F(x) = G(x) +C(x)$ over a solvable convex body $P$, where $G$ is a smooth DR-submodular function and $C$ is a smooth concave function. This class of functions is a strict extension of both concave and continuous DR-submodular functions for which no theoretical guarantee is known. We provide a suite of Frank-Wolfe style algorithms, which, depending on the nature of the objective function (i.e., if $G$ and $C$ are monotone or not, and non-negative or not) and on the nature of the set $P$ (i.e., whether it is downward closed or not), provide $1-1/e$, $1/e$, or $1/2$ approximation guarantees. We then use our algorithms to get a framework to smoothly interpolate between choosing a diverse set of elements from a given ground set (corresponding to the mode of a determinantal point process) and choosing a clustered set of elements (corresponding to the maxima of a suitable concave function). Additionally, we apply our algorithms to various functions in the above class (DR-submodular + concave) in both constrained and unconstrained settings, and show that our algorithms consistently outperform natural baselines.


title: Ghosts in Neural Networks: Existence, Structure and Role of Infinite-Dimensional Null Space

abstract: Overparametrization has been remarkably successful for deep learning studies. This study investigates an overlooked but important aspect of overparametrized neural networks, that is, the null components in the parameters of neural networks, or the ghosts. Since deep learning is not explicitly regularized, typical deep learning solutions contain null components. In this paper, we present a structure theorem of the null space for a general class of neural networks. Specifically, we show that any null element can be uniquely written by the linear combination of ridgelet transforms. In general, it is quite difficult to fully characterize the null space of an arbitrarily given operator. Therefore, the structure theorem is a great advantage for understanding a complicated landscape of neural network parameters. As applications, we discuss the roles of ghosts on the generalization performance of deep learning.


title: Geospatial Reasoning with Shapefiles for Supporting Policy Decisions

abstract: Policies are authoritative assets that are present in multiple domains to support decision-making. They describe what actions are allowed or recommended when domain entities and their attributes satisfy certain criteria. It is common to find policies that contain geographical rules, including distance and containment relationships among named locations. These locations' polygons can often be found encoded in geospatial datasets. We present an approach to transform data from geospatial datasets into Linked Data using the OWL, PROV-O, and GeoSPARQL standards, and to leverage this representation to support automated ontology-based policy decisions. We applied our approach to location-sensitive radio spectrum policies to identify relationships between radio transmitters coordinates and policy-regulated regions in Census.gov datasets. Using a policy evaluation pipeline that mixes OWL reasoning and GeoSPARQL, our approach implements the relevant geospatial relationships, according to a set of requirements elicited by radio spectrum domain experts.


title: HyCA: A Hybrid Computing Architecture for Fault Tolerant Deep Learning

abstract: Hardware faults on the regular 2-D computing array of a typical deep learning accelerator (DLA) can lead to dramatic prediction accuracy loss. Prior redundancy design approaches typically have each homogeneous redundant processing element (PE) to mitigate faulty PEs for a limited region of the 2-D computing array rather than the entire computing array to avoid the excessive hardware overhead. However, they fail to recover the computing array when the number of faulty PEs in any region exceeds the number of redundant PEs in the same region. The mismatch problem deteriorates when the fault injection rate rises and the faults are unevenly distributed. To address the problem, we propose a hybrid computing architecture (HyCA) for fault-tolerant DLAs. It has a set of dot-production processing units (DPPUs) to recompute all the operations that are mapped to the faulty PEs despite the faulty PE locations. According to our experiments, HyCA shows significantly higher reliability, scalability, and performance with less chip area penalty when compared to the conventional redundancy approaches. Moreover, by taking advantage of the flexible recomputing, HyCA can also be utilized to scan the entire 2-D computing array and detect the faulty PEs effectively at runtime.


title: Virasoro Action on the $Q$-Functions

abstract: A formula for Schur $Q$-functions is presented which describes the action of the Virasoro operators. For a strict partition, we prove a concise formula for $L_{-k}Q_{\lambda}$, where $L_{-k}$ $(k\geq 1)$ is the Virasoro operator.


title: Detection of Flare-associated CME Candidates on Two M-dwarfs by GWAC and Fast, Time-resolved Spectroscopic Follow-ups

abstract: The flare-associated stellar coronal mass ejection (CME) in solar-like and late type stars is quite essential for the habitability of an exoplanet. In this paper, we report detection of flare-associated CMEs in two M-dwarfs, thanks to the high cadence survey carried out by the Ground Wide-angle Camera system and the fast photometric and spectroscopic follow-ups. The flare energy in $R-$band is determined to be $1.6\times10^{35}\ \mathrm{erg}$ and $8.1\times10^{33}\ \mathrm{erg}$ based on the modeling of their light curves. The time-resolved spectroscopyic observations start at about 20 and 40 minutes after the trigger in both cases. The large projected maximum velocity of $\sim500-700\ \mathrm{km\ s^{-1}}$ suggests that the high velocity wing of their H$\alpha$ emission lines are most likely resulted from a CME event in both stars, after excluding the possibility of chromospheric evaporation and coronal rain. The masses of the CMEs are estimated to be $1.5-4.5\times10^{19}\ \mathrm{g}$ and $7.1\times10^{18}\ \mathrm{g}$.


title: A 2020 taxonomy of algorithms inspired on living beings behavior

abstract: Taking the role of a computer naturalist, a journey is taken through bio inspired algorithms taking account on algorithms which are inspired on living being behaviors. A compilation of algorithms is made considering several reviews or surveys of bio-inspired heuristics and swarm intelligence until 2020 year. A classification is made considering kingdoms as used by biologists generating several branches for animalia, bacteria, plants, fungi and protista to develop a taxonomy.


title: Uncovering Closed-form Governing Equations of Nonlinear Dynamics from Videos

abstract: Distilling analytical models from data has the potential to advance our understanding and prediction of nonlinear dynamics. Although discovery of governing equations based on observed system states (e.g., trajectory time series) has revealed success in a wide range of nonlinear dynamics, uncovering the closed-form equations directly from raw videos still remains an open challenge. To this end, we introduce a novel end-to-end unsupervised deep learning framework to uncover the mathematical structure of equations that governs the dynamics of moving objects in videos. Such an architecture consists of (1) an encoder-decoder network that learns low-dimensional spatial/pixel coordinates of the moving object, (2) a learnable Spatial-Physical Transformation component that creates mapping between the extracted spatial/pixel coordinates and the latent physical states of dynamics, and (3) a numerical integrator-based sparse regression module that uncovers the parsimonious closed-form governing equations of learned physical states and, meanwhile, serves as a constraint to the autoencoder. The efficacy of the proposed method is demonstrated by uncovering the governing equations of a variety of nonlinear dynamical systems depicted by moving objects in videos. The resulting computational framework enables discovery of parsimonious interpretable model in a flexible and accessible sensing environment where only videos are available.


title: A reversible system based on hybrid toggle radius-4 cellular automata and its application as a block cipher

abstract: The dynamical system described herein uses a hybrid cellular automata (CA) mechanism to attain reversibility, and this approach is adapted to create a novel block cipher algorithm called HCA. CA are widely used for modeling complex systems and employ an inherently parallel model. Therefore, applications derived from CA have a tendency to fit very well in the current computational paradigm where scalability and multi-threading potential are quite desirable characteristics. HCA model has recently received a patent by the Brazilian agency INPI. Several evaluations and analyses performed on the model are presented here, such as theoretical discussions related to its reversibility and an analysis based on graph theory, which reduces HCA security to the well-known Hamiltonian cycle problem that belongs to the NP-complete class. Finally, the cryptographic robustness of HCA is empirically evaluated through several tests, including avalanche property compliance and the NIST randomness suite.


title: Reconstruction of People in Loose Clothing

abstract: 3D human body reconstruction from monocular images is an interesting and ill-posed problem in computer vision with wider applications in multiple domains. In this paper, we propose SHARP, a novel end-to-end trainable network that accurately recovers the detailed geometry and appearance of 3D people in loose clothing from a monocular image. We propose a sparse and efficient fusion of a parametric body prior with a non-parametric peeled depth map representation of clothed models. The parametric body prior constraints our model in two ways: first, the network retains geometrically consistent body parts that are not occluded by clothing, and second, it provides a body shape context that improves prediction of the peeled depth maps. This enables SHARP to recover fine-grained 3D geometrical details with just L1 losses on the 2D maps, given an input image. We evaluate SHARP on publicly available Cloth3D and THuman datasets and report superior performance to state-of-the-art approaches.


title: Point Cloud Upsampling via Disentangled Refinement

abstract: Point clouds produced by 3D scanning are often sparse, non-uniform, and noisy. Recent upsampling approaches aim to generate a dense point set, while achieving both distribution uniformity and proximity-to-surface, and possibly amending small holes, all in a single network. After revisiting the task, we propose to disentangle the task based on its multi-objective nature and formulate two cascaded sub-networks, a dense generator and a spatial refiner. The dense generator infers a coarse but dense output that roughly describes the underlying surface, while the spatial refiner further fine-tunes the coarse output by adjusting the location of each point. Specifically, we design a pair of local and global refinement units in the spatial refiner to evolve a coarse feature map. Also, in the spatial refiner, we regress a per-point offset vector to further adjust the coarse outputs in fine-scale. Extensive qualitative and quantitative results on both synthetic and real-scanned datasets demonstrate the superiority of our method over the state-of-the-arts.


title: Weak solutions to the stationary Cahn-Hillard/Navier-Stokes equations for compressible fluids

abstract: We are concerned with the Cahn-Hilliard/Navier-Stokes equations for the stationary compressible flows in a three-dimensional bounded domain. The governing equations consist of the stationary Navier-Stokes equations describing the compressible fluid flows and the stationary Cahn-Hilliard type diffuse equation for the mass concentration difference. We prove the existence of weak solutions when the adiabatic exponent $\gamma$ satisfies $\gamma>\frac{4}{3}$. The proof is based on the weighted total energy estimates and the new techniques developed to overcome the difficulties from the capillary stress.


title: Encoding physics to learn reaction-diffusion processes

abstract: Modeling complex spatiotemporal dynamical systems, such as the reaction-diffusion processes, have largely relied on partial differential equations (PDEs). However, due to insufficient prior knowledge on some under-explored dynamical systems, such as those in chemistry, biology, geology, physics and ecology, and the lack of explicit PDE formulation used for describing the nonlinear process of the system variables, to predict the evolution of such a system remains a challenging task. Unifying measurement data and our limited prior physics knowledge via machine learning provides us with a new path to solving this problem. Existing physics-informed learning paradigms impose physics laws through soft penalty constraints, whose solution quality largely depends on a trial-and-error proper setting of hyperparameters. Since the core of such methods is still rooted in black-box neural networks, the resulting model generally lacks interpretability and suffers from critical issues of extrapolation and generalization. To this end, we propose a deep learning framework that forcibly encodes given physics structure to facilitate the learning of the spatiotemporal dynamics in sparse data regimes. We show how the proposed approach can be applied to a variety of problems regarding the PDE system, including forward and inverse analysis, data-driven modeling, and discovery of PDEs. The resultant learning paradigm that encodes physics shows high accuracy, robustness, interpretability and generalizability demonstrated via extensive numerical experiments.


title: Improved bounds for the expected number of $k$-sets

abstract: Given a finite set of points $S\subset\mathbb{R}^d$, a $k$-set of $S$ is a subset $A \subset S$ of size $k$ which can be strictly separated from $S \setminus A $ by a hyperplane. Similarly, a $k$-facet of a point set $S$ in general position is a subset $\Delta\subset S$ of size $d$ such that the hyperplane spanned by $\Delta$ has $k$ points from $S$ on one side. For a probability distribution $P$ on $\mathbb{R}^d$, we study $E_P(k,n)$, the expected number of $k$-facets of a sample of $n$ random points from $P$. When $P$ is a distribution on $\mathbb{R}^2$ such that the measure of every line is 0, we show that $E_P(k,n) = O(n(k+1)^{1/4})$. Our argument is based on a technique by B\'{a}r\'{a}ny and Steiger. We study how it may be possible to improve this bound using the continuous version of the polynomial partitioning theorem. This motivates a question concerning the points of intersection of an algebraic curve and the $k$-edge graph of a set of points. We also study a variation on the $k$-set problem for the set system whose set of ranges consists of all translations of some strictly convex body in the plane. The motivation is to show that the technique by B\'{a}r\'{a}ny and Steiger is tight for a natural family of set systems. For any such set system, we determine bounds for the expected number of $k$-sets which are tight up to logarithmic factors.


title: A Gaia based photometric and kinematic analysis of the old open cluster King 11

abstract: This paper presents an investigation of an old age open cluster King 11 using Gaia's Early Data Release 3 (EDR3) data. Considering the stars with membership probability ($P_{\mu}$) $> 90\%$, we identified 676 most probable cluster members within the cluster's limiting radius. The mean proper motion (PM) for King 11 is determined as: $\mu_{x}=-3.391\pm0.006$ and $\mu_{y}=-0.660\pm0.004$ mas yr$^{-1}$. The blue straggler stars (BSS) of King 11 show a centrally concentrated radial distribution. The values of limiting radius, age, and distance are determined as 18.51 arcmin, 3.63$\pm$0.42 Gyr and $3.33\pm0.15$ kpc, respectively. The cluster's apex coordinates ($A=267.84^{\circ} \pm 1.01^{\circ}$, $D=-27.48^{\circ} \pm 1.03^{\circ}$) are determined using the apex diagram (AD) method and verified using the ($\mu_U$,$\mu_T$) diagram. We also obtained the orbit that the cluster follows in the Galaxy and estimated its tentative birthplace in the disk. The resulting spatial velocity of King 11 is 60.2 $\pm$ 2.16 km s$^{-1}$. A significant oscillation along the $Z$-coordinate up to 0.556$\pm$0.022~kpc is determined.


title: Accelerating Neural Architecture Search via Proxy Data

abstract: Despite the increasing interest in neural architecture search (NAS), the significant computational cost of NAS is a hindrance to researchers. Hence, we propose to reduce the cost of NAS using proxy data, i.e., a representative subset of the target data, without sacrificing search performance. Even though data selection has been used across various fields, our evaluation of existing selection methods for NAS algorithms offered by NAS-Bench-1shot1 reveals that they are not always appropriate for NAS and a new selection method is necessary. By analyzing proxy data constructed using various selection methods through data entropy, we propose a novel proxy data selection method tailored for NAS. To empirically demonstrate the effectiveness, we conduct thorough experiments across diverse datasets, search spaces, and NAS algorithms. Consequently, NAS algorithms with the proposed selection discover architectures that are competitive with those obtained using the entire dataset. It significantly reduces the search cost: executing DARTS with the proposed selection requires only 40 minutes on CIFAR-10 and 7.5 hours on ImageNet with a single GPU. Additionally, when the architecture searched on ImageNet using the proposed selection is inversely transferred to CIFAR-10, a state-of-the-art test error of 2.4\% is yielded. Our code is available at https://github.com/nabk89/NAS-with-Proxy-data.


title: Quantitative results for banded Toeplitz matrices subject to random and deterministic perturbations

abstract: We consider the eigenvalues of a fixed, non-normal matrix subject to a small additive perturbation. In particular, we consider the case when the fixed matrix is a banded Toeplitz matrix, where the bandwidth is allowed to grow slowly with the dimension, and the perturbation matrix is drawn from one of several different random matrix ensembles. We establish a number of non-asymptotic results for the eigenvalues of this model, including a local law and a rate of convergence in Wasserstein distance of the empirical spectral measure to its limiting distribution. In addition, we define the classical locations of the eigenvalues and prove a rigidity result showing that, on average, the eigenvalues concentrate closely around their classical locations. While proving these results we also establish a number of auxiliary results that may be of independent interest, including a quantitative version of the Tao--Vu replacement principle, a general least singular value bound that applies to adversarial models, and a description of the limiting empirical spectral measure for random multiplicative perturbations.


title: On the inexact scaled gradient projection method

abstract: The purpose of this paper is to present an inexact version of the scaled gradient projection method on a convex set, which is inexact in two sense. First, an inexact projection on the feasible set is computed, allowing for an appropriate relative error tolerance. Second, an inexact non-monotone line search scheme is employed to compute a step size which defines the next iteration. It is shown that the proposed method has similar asymptotic convergence properties and iteration-complexity bounds as the usual scaled gradient projection method employing monotone line searches.


title: Scaling of Small-Scale Dynamo Properties in the Rayleigh-Taylor Instability

abstract: We derive scaling relations based on free-fall and isotropy assumptions for the kinematic small-scale dynamo growth rate and amplification factor over the course of the mixing, saturation, and decay phases of the Rayleigh-Taylor instability (RTI) in a fully-ionized plasma. The scaling relations are tested using sets of three dimensional, visco-resistive MHD simulations of the RTI and found to hold in the saturation phase, but exhibit discrepancies during the mixing and decays phases, suggesting a need to relax either the free-fall or isotropy assumptions. Application of the scaling relations allows for quantitative prediction of the net amplification of magnetic energy in the kinematic dynamo phase and therefore a determination of whether the magnetic energy either remains sub-equipartition at all velocity scales or reaches equipartition with at least some scales of the turbulent kinetic energy in laboratory and astrophysical scenarios. As an example, we consider the dynamo in RTI-unstable regions of the outer envelope of a binary neutron star merger and predict that the kinematic regime of the small-scale dynamo ends on the time scale of nanoseconds and then reaches saturation on a timescale of microseconds, which are both fast compared to the millisecond relaxation time of the post-merger.


title: GRB 170817A Afterglow from a Relativistic Electron-Positron Pair Wind Observed Off-axis

abstract: A relativistic electron-positron ($e^{+}e^{-}$) pair wind from a rapidly rotating, strongly magnetized neutron star (NS) would interact with a gamma-ray burst (GRB) external shock and reshapes afterglow emission signatures. Assuming that the merger remnant of GW170817 is a long-lived NS, we show that a relativistic $e^{+}e^{-}$ pair wind model with a simple top-hat jet viewed off-axis can reproduce multi-wavelength afterglow lightcurves and superluminal motion of GRB 170817A. The Markov chain Monte Carlo (MCMC) method is adopted to obtain the best-fitting parameters, which give the jet half-opening angle $\theta_{j}\approx0.11$ rad, and the viewing angle $\theta_{v}\approx0.23$ rad. The best-fitting value of $\theta_{v}$ is close to the lower limit of the prior which is chosen based on the gravitational-wave and electromagnetic observations. In addition, we also derive the initial Lorentz factor $\Gamma_{0}\approx47$ and the isotropic kinetic energy $E_{\rm K,iso}\approx2\times10^{52}\rm\ erg$. A consistence between the corrected on-axis values for GRB 170817A and typical values observed for short GRBs indicates that our model can also reproduce the prompt emission of GRB 170817A. An NS with a magnetic field strength $B_{p}\approx1.6\times10^{13}\rm\ G$ is obtained in our fitting, indicating that a relatively low thermalization efficiency $\eta\lesssim10^{-3}$ is needed to satisfy observational constraints on the kilonova. Furthermore, our model is able to reproduce a late-time shallow decay in the X-ray lightcurve and predicts that the X-ray and radio flux will continue to decline in the coming years.


title: Lagrangian approach to super-sample effects on biased tracers at field level: galaxy density fields and intrinsic alignments

abstract: It has been recognized that the observables of large-scale structure (LSS) is susceptible to long-wavelength density and tidal fluctuations whose wavelengths exceed the accessible scale of a finite-volume observation, referred to as the super-sample modes. The super-sample modes modulate the growth and expansion rate of local structures, thus affecting the cosmological information encoded in the statistics of galaxy clustering data. In this paper, based on the Lagrangian perturbation theory, we develop a new formalism to systematically compute the response of a biased tracer of LSS, which is expressed perturbatively in terms of the matter density field of sub-survey modes, to the super-sample modes at the field level. The formalism presented here reproduces the power spectrum responses that have been previously derived, and provides an alternative way to compute statistical quantities with super-sample modes. As an application, we consider the statistics of the intrinsic alignments of galaxies and halos, and derive the field response of the galaxy/halo shape bias to the super-sample modes. Possible impacts of the long-mode contributions on the covariance of the three-dimensional power spectra of the intrinsic alignment are also discussed, and the signal-to-noise ratios are estimated.


title: Diamagnetic/Paramagnetic Phase Transitions in Non-equilibrium Confined Single-Component Plasmas

abstract: In this letter, a phase transition of a non-equilibrated single component plasma evolving within a uniform constant magnetic field is demonstrated for the first time. We present classical fluid models that capture this phenomenon, confirm with N -particle simulations, derive constraints on parameters necessary to induce this phase transition, and suggest an experiment to test the novel predictions of the theory.


title: Sentence Embeddings using Supervised Contrastive Learning

abstract: Sentence embeddings encode sentences in fixed dense vectors and have played an important role in various NLP tasks and systems. Methods for building sentence embeddings include unsupervised learning such as Quick-Thoughts and supervised learning such as InferSent. With the success of pretrained NLP models, recent research shows that fine-tuning pretrained BERT on SNLI and Multi-NLI data creates state-of-the-art sentence embeddings, outperforming previous sentence embeddings methods on various evaluation benchmarks. In this paper, we propose a new method to build sentence embeddings by doing supervised contrastive learning. Specifically our method fine-tunes pretrained BERT on SNLI data, incorporating both supervised crossentropy loss and supervised contrastive loss. Compared with baseline where fine-tuning is only done with supervised cross-entropy loss similar to current state-of-the-art method SBERT, our supervised contrastive method improves 2.8% in average on Semantic Textual Similarity (STS) benchmarks and 1.05% in average on various sentence transfer tasks.


title: Deep learning based low-dose synchrotron radiation CT reconstruction

abstract: Synchrotron radiation sources are widely used in various fields, among which computed tomography (CT) is one of the most important. The amount of effort expended by the operator varies depending on the subject. If the number of angles needed to be used can be greatly reduced under the condition of similar imaging effects, the working time and workload of the experimentalists will be greatly reduced. However, decreasing the sampling angle can produce serious artifacts and blur the details. We try to use a deep learning model which can build high quality reconstruction sparse data sampling from the angle of the image and ResAttUnet are put forward. ResAttUnet is roughly a symmetrical U-shaped network that incorporates similar mechanisms to ResNet and attention. In addition, the mixed precision is adopted to reduce the demand for video memory of the model and training time.


title: Element-specific electronic and structural dynamics using transient X-ray spectroscopy

abstract: Transient X-ray absorption techniques can measure ultrafast dynamics of the elemental edges in a material or multiple layer junction, giving them immense potential for deconvoluting concurrent processes. However, the interpretation of the photoexcited changes to an X-ray edge is not as simple as directly probing a transition with optical or infrared wavelengths. The core hole left by the core-level transition distorts the measured absorption and reflection spectra, both hiding and revealing different aspects of a photo-induced process. In this perspective, we describe the implementation and interpretation of transient X-ray experiments. This description includes a guide of how to choose the best wavelength and corresponding X-ray sources when designing an experiment. As an example, we focus on the rising use of extreme ultraviolet (XUV) spectroscopy for understanding performance limiting behaviors in solar energy materials, such as measurements of polaron formation, electron and hole kinetics, and charge transport in each layer of a metal-oxide-semiconductor junction. The ability of measuring photoexcited carriers in each layer of a multilayer junction could prove particularly impactful in the study of molecules, materials, and their combinations that lead to functional devices in photochemistry and photoelectrochemistry.


title: Towards the Memorization Effect of Neural Networks in Adversarial Training

abstract: Recent studies suggest that ``memorization'' is one important factor for overparameterized deep neural networks (DNNs) to achieve optimal performance. Specifically, the perfectly fitted DNNs can memorize the labels of many atypical samples, generalize their memorization to correctly classify test atypical samples and enjoy better test performance. While, DNNs which are optimized via adversarial training algorithms can also achieve perfect training performance by memorizing the labels of atypical samples, as well as the adversarially perturbed atypical samples. However, adversarially trained models always suffer from poor generalization, with both relatively low clean accuracy and robustness on the test set. In this work, we study the effect of memorization in adversarial trained DNNs and disclose two important findings: (a) Memorizing atypical samples is only effective to improve DNN's accuracy on clean atypical samples, but hardly improve their adversarial robustness and (b) Memorizing certain atypical samples will even hurt the DNN's performance on typical samples. Based on these two findings, we propose Benign Adversarial Training (BAT) which can facilitate adversarial training to avoid fitting ``harmful'' atypical samples and fit as more ``benign'' atypical samples as possible. In our experiments, we validate the effectiveness of BAT, and show it can achieve better clean accuracy vs. robustness trade-off than baseline methods, in benchmark datasets such as CIFAR100 and Tiny~ImageNet.


title: Nonasymptotic theory for two-layer neural networks: Beyond the bias-variance trade-off

abstract: Large neural networks have proved remarkably effective in modern deep learning practice, even in the overparametrized regime where the number of active parameters is large relative to the sample size. This contradicts the classical perspective that a machine learning model must trade off bias and variance for optimal generalization. To resolve this conflict, we present a nonasymptotic generalization theory for two-layer neural networks with ReLU activation function by incorporating scaled variation regularization. Interestingly, the regularizer is equivalent to ridge regression from the angle of gradient-based optimization, but plays a similar role to the group lasso in controlling the model complexity. By exploiting this "ridge-lasso duality," we obtain new prediction bounds for all network widths, which reproduce the double descent phenomenon. Moreover, the overparametrized minimum risk is lower than its underparametrized counterpart when the signal is strong, and is nearly minimax optimal over a suitable class of functions. By contrast, we show that overparametrized random feature models suffer from the curse of dimensionality and thus are suboptimal.


title: The Hot Mitochondrion Paradox: Reconciling Theory and Experiment

abstract: Experiments by Chretien and co-workers suggest that mitochondria are 10oC hotter than their surroundings. Steady-state theoretical estimates place this difference at a maximum of 10^-5 oC. This million-fold disagreement may be called the hot mitochondrion paradox. It is suggested that every proton translocated via ATP synthase sparks a picosecond temperature-difference spike of the order of magnitude measured by Chretien et al. Time-averaging of these spikes recovers the theoretical value. Further, a temporal and spatial superposition of the fluorescence intensity of a very large number of molecular thermometer molecules in the sample can give the appearance of a steady signal. The inner mitochondrial membrane appears to be flanked by temperature differences fluctuating in time and along the membrane s surface, with hot and cold spots as ultrashort temperature spikes.


title: On Ramanujan's formula for $\zeta(1/2)$ and $\zeta(2m+1)$

abstract: Page 332 of Ramanujan's Lost Notebook contains a compelling identity for $\zeta(1/2)$, which has been studied by many mathematicians over the years. On the same page, Ramanujan also recorded the series, \begin{align*} \frac{1^r}{\exp(1^s x) - 1} + \frac{2^r}{\exp(2^s x) - 1} + \frac{3^r}{\exp(3^s x) - 1} + \cdots, \end{align*} where $s$ is a positive integer and $r-s$ is any even integer. Unfortunately, Ramanujan doesn't give any formula for it. This series was rediscovered by Kanemitsu, Tanigawa, and Yoshimoto, although they studied it only when $r-s$ is a negative even integer. Recently, Dixit and the second author generalized the work of Kanemitsu et al. and obtained a transformation formula for the aforementioned series with $r-s$ is any even integer. While extending the work of Kanemitsu et al., Dixit and the second author obtained a beautiful generalization of Ramanujan's formula for odd zeta values. In the current paper, we investigate transformation formulas for an infinite series, and interestingly, we derive Ramanujan's formula for $\zeta(1/2)$, Wigert's formula for $\zeta(1/k)$ as well as Ramanujan's formula for $\zeta(2m+1)$. Furthermore, we obtain a new identity for $\zeta(-1/2)$ in the spirit of Ramanujan.


title: Biocarbon reinforced polypropylene composite: An investigation of mechanical and filler behavior through advanced dynamic atomic force microscopy and X-ray micro CT

abstract: Polymer composites were manufactured using biocarbon particles as a reinforcing filler to improve the mechanical and thermal properties. However, a detailed examination of dispersion and agglomeration of filler is essential to correlate the filler matrix and the filler and filler interactions with the mechanical properties of the product. We investigated the variations of mechanical, agglomeration behaviour of fillers, and thermal properties of polypropylene coconut shell biocarbon composites. PP CSB composites were prepared by melt mixing process varying the CSB content using a Brabender mixer. The nanomechanical mapping of the composites studied using Atomic Force Microscopy revealed an increase in Youngs modulus from 1.6 to 2.9 GPa when CSB loading increased from 0 to 20 weight percentage. The dispersion and agglomeration of CSB filler in the PP matrix were investigated using 3D reconstructed images with the help of X-ray micro CT, and a dedicated 3D reconstruction software. The thermal stability of the PP CSB composites also improved with an increase in CSB content in PP.


title: Pretraining Representations for Data-Efficient Reinforcement Learning

abstract: Data efficiency is a key challenge for deep reinforcement learning. We address this problem by using unlabeled data to pretrain an encoder which is then finetuned on a small amount of task-specific data. To encourage learning representations which capture diverse aspects of the underlying MDP, we employ a combination of latent dynamics modelling and unsupervised goal-conditioned RL. When limited to 100k steps of interaction on Atari games (equivalent to two hours of human experience), our approach significantly surpasses prior work combining offline representation pretraining with task-specific finetuning, and compares favourably with other pretraining methods that require orders of magnitude more data. Our approach shows particular promise when combined with larger models as well as more diverse, task-aligned observational data -- approaching human-level performance and data-efficiency on Atari in our best setting. We provide code associated with this work at https://github.com/mila-iqia/SGI.


title: Diffusion Source Identification on Networks with Statistical Confidence

abstract: Diffusion source identification on networks is a problem of fundamental importance in a broad class of applications, including rumor controlling and virus identification. Though this problem has received significant recent attention, most studies have focused only on very restrictive settings and lack theoretical guarantees for more realistic networks. We introduce a statistical framework for the study of diffusion source identification and develop a confidence set inference approach inspired by hypothesis testing. Our method efficiently produces a small subset of nodes, which provably covers the source node with any pre-specified confidence level without restrictive assumptions on network structures. Moreover, we propose multiple Monte Carlo strategies for the inference procedure based on network topology and the probabilistic properties that significantly improve the scalability. To our knowledge, this is the first diffusion source identification method with a practically useful theoretical guarantee on general networks. We demonstrate our approach via extensive synthetic experiments on well-known random network models and a mobility network between cities concerning the COVID-19 spreading.


title: Classification of simple strong Harish-Chandra modules over the Lie superalgebra of vector fields on $\C^{m|n}$

abstract: In this paper, we classify simple strong Harish-Chandra modules over the Lie superalgebra $W_{m,n}$ of vector fields on $\C^{m|n}$. Any such module is the unique simple submodule of some tensor module $F(P,V)$ for a simple weight module $P$ over the Weyl superalgebra $\mathcal K_{m,n}$ and a simple weight module $V$ over the general linear superalgebra $\gl_{m,n}$.


title: Probabilistic task modelling for meta-learning

abstract: We propose probabilistic task modelling -- a generative probabilistic model for collections of tasks used in meta-learning. The proposed model combines variational auto-encoding and latent Dirichlet allocation to model each task as a mixture of Gaussian distribution in an embedding space. Such modelling provides an explicit representation of a task through its task-theme mixture. We present an efficient approximation inference technique based on variational inference method for empirical Bayes parameter estimation. We perform empirical evaluations to validate the task uncertainty and task distance produced by the proposed method through correlation diagrams of the prediction accuracy on testing tasks. We also carry out experiments of task selection in meta-learning to demonstrate how the task relatedness inferred from the proposed model help to facilitate meta-learning algorithms.


title: CoAtNet: Marrying Convolution and Attention for All Data Sizes

abstract: Transformers have attracted increasing interests in computer vision, but they still fall behind state-of-the-art convolutional networks. In this work, we show that while Transformers tend to have larger model capacity, their generalization can be worse than convolutional networks due to the lack of the right inductive bias. To effectively combine the strengths from both architectures, we present CoAtNets(pronounced "coat" nets), a family of hybrid models built from two key insights: (1) depthwise Convolution and self-Attention can be naturally unified via simple relative attention; (2) vertically stacking convolution layers and attention layers in a principled way is surprisingly effective in improving generalization, capacity and efficiency. Experiments show that our CoAtNets achieve state-of-the-art performance under different resource constraints across various datasets: Without extra data, CoAtNet achieves 86.0% ImageNet top-1 accuracy; When pre-trained with 13M images from ImageNet-21K, our CoAtNet achieves 88.56% top-1 accuracy, matching ViT-huge pre-trained with 300M images from JFT-300M while using 23x less data; Notably, when we further scale up CoAtNet with JFT-3B, it achieves 90.88% top-1 accuracy on ImageNet, establishing a new state-of-the-art result.


title: EMFlow: Data Imputation in Latent Space via EM and Deep Flow Models

abstract: The presence of missing values within high-dimensional data is an ubiquitous problem for many applied sciences. A serious limitation of many available data mining and machine learning methods is their inability to handle partially missing values and so an integrated approach that combines imputation and model estimation is vital for down-stream analysis. A computationally fast algorithm, called EMFlow, is introduced that performs imputation in a latent space via an online version of Expectation-Maximization (EM) algorithm by using a normalizing flow (NF) model which maps the data space to a latent space. The proposed EMFlow algorithm is iterative, involving updating the parameters of online EM and NF alternatively. Extensive experimental results for high-dimensional multivariate and image datasets are presented to illustrate the superior performance of the EMFlow compared to a couple of recently available methods in terms of both predictive accuracy and speed of algorithmic convergence. We provide code for all our experiments.


title: Streaming Belief Propagation for Community Detection

abstract: The community detection problem requires to cluster the nodes of a network into a small number of well-connected "communities". There has been substantial recent progress in characterizing the fundamental statistical limits of community detection under simple stochastic block models. However, in real-world applications, the network structure is typically dynamic, with nodes that join over time. In this setting, we would like a detection algorithm to perform only a limited number of updates at each node arrival. While standard voting approaches satisfy this constraint, it is unclear whether they exploit the network information optimally. We introduce a simple model for networks growing over time which we refer to as streaming stochastic block model (StSBM). Within this model, we prove that voting algorithms have fundamental limitations. We also develop a streaming belief-propagation (StreamBP) approach, for which we prove optimality in certain regimes. We validate our theoretical findings on synthetic and real data.


title: Khintchine's theorem for affine hyperplanes in positive charateristic

abstract: In this paper we establish the convergence case of Khintchine's theorem for affine hyperplanes in function field of positive characteristic. Along with that, we also prove a quantitative version of the same. The main technique used in the proof is a dynamical result called `Quantitative nondivergence' due to D. Y. Kleinbock and G. A. Margulis [17].


title: Efficient simulation of non-classical liquid-vapour phase-transition flows: a method of fundamental solutions

abstract: Classical continuum-based liquid vapour phase-change models typically assume continuity of temperature at phase interfaces along with a relation which describes the rate of evaporation at the interface (Hertz-Knudsen-Schrage, for example). However, for phase transitions processes at small scales, such as the evaporation of nanodroplets, the assumption that the temperature is continuous across the liquid-vapour interface leads to significant inaccuracies (McGaughey & Ward 2002; Rana et al. 2019), as may the adoption of classical constitutive relations that lead to the Navier-Stokes-Fourier equations (NSF). In this article, to capture the notable effects of rarefaction at small scales, we adopt an extended continuum-based approach utilizing the coupled constitutive relations (CCR). In CCR theory, additional terms are invoked in the constitutive relations of NSF equations originating from the arguments of irreversible thermodynamics as well as consistent with kinetic theory of gases. The modelling approach allows us to derive new fundamental solutions for the linearised CCR model and to develop a numerical framework based upon the method of fundamental solutions (MFS) and enables threedimensional multiphase micro-flow simulations to be performed at remarkably low computational cost. The new framework is benchmarked against classical results and then explored as an efficient tool for solving three-dimensional phase-change events involving droplets.


title: Blockchain for IoT Access Control: Recent Trends and Future Research Directions

abstract: With the rapid development of wireless sensor networks, smart devices, and traditional information and communication technologies, there is tremendous growth in the use of Internet of Things (IoT) applications and services in our everyday life. IoT systems deal with high volumes of data. This data can be particularly sensitive, as it may include health, financial, location, and other highly personal information. Fine-grained security management in IoT demands effective access control. Several proposals discuss access control for the IoT, however, a limited focus is given to the emerging blockchain-based solutions for IoT access control. In this paper, we review the recent trends and critical needs for blockchain-based solutions for IoT access control. We identify several important aspects of blockchain, including decentralised control, secure storage and sharing information in a trustless manner, for IoT access control including their benefits and limitations. Finally, we note some future research directions on how to converge blockchain in IoT access control efficiently and effectively.


title: Fracture Mechanics-Based Quantitative Matching of Forensic Evidence Fragments

abstract: Fractured metal fragments with rough and irregular surfaces are often found at crime scenes. Current forensic practice visually inspects the complex jagged trajectory of fractured surfaces to recognize a ``match'' using comparative microscopy and physical pattern analysis. We developed a novel computational framework, utilizing the basic concepts of fracture mechanics and statistical analysis to provide quantitative match analysis for match probability and error rates. The framework employs the statistics of fracture surfaces to become non-self-affine with unique roughness characteristics at relevant microscopic length scale, dictated by the intrinsic material resistance to fracture and its microstructure. At such a scale, which was found to be greater than two grain-size or micro-feature-size, we establish that the material intrinsic properties, microstructure, and exposure history to external forces on an evidence fragment have the premise of uniqueness, which quantitatively describes the microscopic features on the fracture surface for forensic comparisons. The methodology utilizes 3D spectral analysis of overlapping topological images of the fracture surface and classifies specimens with very high accuracy using statistical learning. Cross correlations of image-pairs in two frequency ranges are used to develop matrix variate statistical models for the distributions among matching and non-matching pairs of images, and provides a decision rule for identifying matches and determining error rates. A set of thirty eight different fracture surfaces of steel articles were correctly classified. The framework lays the foundations for forensic applications with quantitative statistical comparison across a broad range of fractured materials with diverse textures and mechanical properties.


title: Sleeping beauties and temporal evolution of the coronavirus literature

abstract: Temporal evolution of the coronavirus literature over the last thirty years (N=43,769) is analyzed along with its subdomain of SARS-CoV-2 articles (N=27,460) and the subdomain of reviews and meta-analytic studies (N=1,027). (i) The analyses on the subset of SARS-CoV-2 literature identified studies published prior to 2020 that have now proven highly instrumental in the development of various clusters of publications linked to SARS-CoV-2. In particular, the so-called sleeping beauties of the coronavirus literature with an awakening in 2020 were identified, i.e., previously published studies of this literature that had remained relatively unnoticed for several years but gained sudden traction in 2020 in the wake of the SARS-CoV-2 outbreak. (ii) The subset of 2020 SARS-CoV-2 articles is bibliographically distant from the rest of this literature published prior to 2020. Individual articles of the SARS-CoV-2 segment with a bridging role between the two bodies of articles (i.e., before and after 2020) are identifiable. (iii) Furthermore, the degree of bibliographic coupling within the 2020 SARS-CoV-2 cluster is much poorer compared to the cluster of articles published prior to 2020. This could, in part, be explained by the higher diversity of topics that are studied in relation to SARS-CoV-2 compared to the literature of coronaviruses published prior to the SARS-CoV-2 disease. This work demonstrates how scholarly efforts undertaken during peace time or prior to a disease outbreak could suddenly play a critical role in prevention and mitigation of health disasters caused by new diseases.


title: Benchmarking NetBASILISK: a Network Security Project for Science

abstract: Infrastructures supporting distributed scientific collaborations must address competing goals in both providing high-performance access to resources while simultaneously securing the infrastructure against security threats. The NetBASILISK project is attempting to improve the security of such infrastructures while not adversely impacting their performance. This paper will present our work to create a benchmark and monitoring infrastructure that allows us to test for any degradation in transferring data into a NetBASILISK protected site.


title: Phase Retrieval using Single-Instance Deep Generative Prior

abstract: Several deep learning methods for phase retrieval exist, but most of them fail on realistic data without precise support information. We propose a novel method based on single-instance deep generative prior that works well on complex-valued crystal data.


title: Anisotropic Hyperbolic Inflation

abstract: Hyperbolic inflation is an extension of the slow-roll inflation in multi-field models. We extend hyperbolic inflation by adding a gauge field and find four-type attractor solutions: slow-roll inflation, hyperbolic inflation, anisotropic slow roll inflation, and anisotropic hyperbolic inflation. We perform the stability analysis with the dynamical system method. We also study the transition behaviors of solutions between anisotropic slow roll inflation and anisotropic hyperbolic inflation. Our result indicates that destabilization of the standard slow-roll inflation ubiquitously occurs in multi-scalar-gauge field inflationary scenarios.


title: Making Better Use of Bilingual Information for Cross-Lingual AMR Parsing

abstract: Abstract Meaning Representation (AMR) is a rooted, labeled, acyclic graph representing the semantics of natural language. As previous works show, although AMR is designed for English at first, it can also represent semantics in other languages. However, they find that concepts in their predicted AMR graphs are less specific. We argue that the misprediction of concepts is due to the high relevance between English tokens and AMR concepts. In this work, we introduce bilingual input, namely the translated texts as well as non-English texts, in order to enable the model to predict more accurate concepts. Besides, we also introduce an auxiliary task, requiring the decoder to predict the English sequences at the same time. The auxiliary task can help the decoder understand what exactly the corresponding English tokens are. Our proposed cross-lingual AMR parser surpasses previous state-of-the-art parser by 10.6 points on Smatch F1 score. The ablation study also demonstrates the efficacy of our proposed modules.


title: ChaCha for Online AutoML

abstract: We propose the ChaCha (Champion-Challengers) algorithm for making an online choice of hyperparameters in online learning settings. ChaCha handles the process of determining a champion and scheduling a set of `live' challengers over time based on sample complexity bounds. It is guaranteed to have sublinear regret after the optimal configuration is added into consideration by an application-dependent oracle based on the champions. Empirically, we show that ChaCha provides good performance across a wide array of datasets when optimizing over featurization and hyperparameter decisions.


title: Fractional order magnetic resonance fingerprinting in the human cerebral cortex

abstract: Mathematical models are becoming increasingly important in magnetic resonance imaging (MRI), as they provide a mechanistic approach for making a link between tissue microstructure and signals acquired using the medical imaging instrument. The Bloch equations, which describes spin and relaxation in a magnetic field, is a set of integer order differential equations with a solution exhibiting mono-exponential behaviour in time. Parameters of the model may be estimated using a non-linear solver, or by creating a dictionary of model parameters from which MRI signals are simulated and then matched with experiment. We have previously shown the potential efficacy of a magnetic resonance fingerprinting (MRF) approach, i.e. dictionary matching based on the classical Bloch equations, for parcellating the human cerebral cortex. However, this classical model is unable to describe in full the mm-scale MRI signal generated based on an heterogenous and complex tissue micro-environment. The time-fractional order Bloch equations has been shown to provide, as a function of time, a good fit of brain MRI signals. We replaced the integer order Bloch equations with the previously reported time-fractional counterpart within the MRF framework and performed experiments to parcellate human gray matter, which is cortical brain tissue with different cyto-architecture at different spatial locations. Our findings suggest that the time-fractional order parameters, {\alpha} and {\beta}, potentially associate with the effect of interareal architectonic variability, hypothetically leading to more accurate cortical parcellation.


title: Detecting and Correcting IMU Movements During Joint Angle Estimation

abstract: Inertial measurement units (IMUs) increasingly function as a basic component of wearable sensor network (WSN)systems. IMU-based joint angle estimation (JAE) is a relatively typical usage of IMUs, with extensive applications. However, the issue that IMUs move with respect to their original placement during JAE is still a research gap, and limits the robustness of deploying the technique in real-world application scenarios. In this study, we propose to detect and correct the IMU movement online in a relatively computationally lightweight manner. Particularly, we first experimentally investigate the influence of IMU movements. Second, we design the metrics for detecting IMU movements by mathematically formulating how the IMU movement affects the IMU measurements. Third, we determine the optimal thresholds of metrics by synthetic IMU data from a significantly amended simulation model. Finally, a correction method is proposed to correct the effects of IMU movements. We demonstrate our method on both synthetic data and real-user data. The results demonstrate our method is a promising solution to detecting and correcting IMU movements during JAE.


title: Restrictions of characters in p-solvable groups

abstract: Let G be a p-solvable group, P a p-subgroup and chi in Irr(G) such that chi(1)_p \ge |G:P|_p. We prove that the restriction chi_P is a sum of characters induced from subgroups Q\le P such that chi(1)_p=|G:Q|_p. This generalizes previous results by Giannelli--Navarro and Giannelli--Sambale on the number of linear constituents of chi_P. Although this statement does not hold for arbitrary groups, we conjecture a weaker version which can be seen as an extension of Brauer--Nesbitt's theorem on characters of p-defect zero. It also extends a conjecture of Wilde.


title: Contextual Recommendations and Low-Regret Cutting-Plane Algorithms

abstract: We consider the following variant of contextual linear bandits motivated by routing applications in navigational engines and recommendation systems. We wish to learn a hidden $d$-dimensional value $w^*$. Every round, we are presented with a subset $\mathcal{X}_t \subseteq \mathbb{R}^d$ of possible actions. If we choose (i.e. recommend to the user) action $x_t$, we obtain utility $\langle x_t, w^* \rangle$ but only learn the identity of the best action $\arg\max_{x \in \mathcal{X}_t} \langle x, w^* \rangle$. We design algorithms for this problem which achieve regret $O(d\log T)$ and $\exp(O(d \log d))$. To accomplish this, we design novel cutting-plane algorithms with low "regret" -- the total distance between the true point $w^*$ and the hyperplanes the separation oracle returns. We also consider the variant where we are allowed to provide a list of several recommendations. In this variant, we give an algorithm with $O(d^2 \log d)$ regret and list size $\mathrm{poly}(d)$. Finally, we construct nearly tight algorithms for a weaker variant of this problem where the learner only learns the identity of an action that is better than the recommendation. Our results rely on new algorithmic techniques in convex geometry (including a variant of Steiner's formula for the centroid of a convex set) which may be of independent interest.


title: Q-dependent Collective Relaxation Dynamics of Glass-Forming Liquid Ca0.4K0.6(NO3)1.4 Investigated by Wide-Angle Neutron Spin-Echo

abstract: Employing wide-angle neutron spin echo spectroscopy, we measured the Q-dependent coherent intermediate scattering function of the prototypical ionic glass former Ca0.4K0.6(NO3)1.4, in the equilibrium and supercooled liquid states beyond the hydrodynamic regime. The data reveal a clear two-step relaxation: an exponential fast process, and a stretched exponential slow alpha process. de Gennes narrowing is observed in all characteristic variables of the alpha process: the relaxation time, amplitude, and stretching exponent. At all length scales probed, the relative amplitude of the alpha-relaxation decreases with increasing temperature and levels off in the normal liquid state. The temperature dependence of the stretching exponent and the relaxation time at different Q's indicate that modifications of the relaxation mechanisms at the local length scales, manifested as temperature independent dynamic heterogeneity and smaller deviations from Arrhenius behavior, have occurred even above the alpha-beta (Johari-Goldstein) bifurcation temperature.


title: Searching for radio pulsation from SGR 1935+2154 with the Parkes Ultra-Wideband Low receiver

abstract: Magnetars have been proposed to be the origin of FRBs soon after its initial discovery. The detection of the first Galactic FRB 20200428 from SGR 1935+2154 has made this hypothesis more convincing. In October 2020, this source was supposed to be in an extremely active state again. We then carried out a 1.6-hours follow-up observation of SGR 1935+2154 using the new ultra-wideband low (UWL) receiver of the Parkes 64\,m radio telescope covering a frequency range of 704$-$4032 MHz. However, no convincing signal was detected in either of our single pulse or periodicity searches. We obtained a limit on the flux density of periodic signal of $\rm 3.6\,\mu Jy$ using the full 3.3GHz bandwidth data sets, which is the strictest limit for that of SGR 1935+2154. Our full bandwidth limit on the single pulses fluence is 35mJy ms, which is well below the brightest single pulses detected by the FAST radio telescope just two before our observation. Assuming that SGR 1935+2154 is active during our observation, our results suggest that its radio bursts are either intrinsically narrowband or show a steep spectrum.


title: Fast Computational Ghost Imaging using Unpaired Deep Learning and a Constrained Generative Adversarial Network

abstract: The unpaired training can be the only option available for fast deep learning-based ghost imaging, where obtaining a high signal-to-noise ratio (SNR) image copy of each low SNR ghost image could be practically time-consuming and challenging. This paper explores the capabilities of deep learning to leverage computational ghost imaging when there is a lack of paired training images. The deep learning approach proposed here enables fast ghost imaging through reconstruction of high SNR images from faint and hastily shot ghost images using a constrained Wasserstein generative adversarial network. In the proposed approach, the objective function is regularized to enforce the generation of faithful and relevant high SNR images to the ghost copies. This regularization measures the distance between reconstructed images and the faint ghost images in a low-noise manifold generated by a shadow network. The performance of the constrained network is shown to be particularly important for ghost images with low SNR. The proposed pipeline is able to reconstruct high-quality images from the ghost images with SNR values not necessarily equal to the SNR of the training set.


title: Taxonomy of Machine Learning Safety: A Survey and Primer

abstract: The open-world deployment of Machine Learning (ML) algorithms in safety-critical applications such as autonomous vehicles needs to address a variety of ML vulnerabilities such as interpretability, verifiability, and performance limitations. Research explores different approaches to improve ML dependability by proposing new models and training techniques to reduce generalization error, achieve domain adaptation, and detect outlier examples and adversarial attacks. However, there is a missing connection between ongoing ML research and well-established safety principles. In this paper, we present a structured and comprehensive review of ML techniques to improve the dependability of ML algorithms in uncontrolled open-world settings. From this review, we propose the Taxonomy of ML Safety that maps state-of-the-art ML techniques to key engineering safety strategies. Our taxonomy of ML safety presents a safety-oriented categorization of ML techniques to provide guidance for improving dependability of the ML design and development. The proposed taxonomy can serve as a safety checklist to aid designers in improving coverage and diversity of safety strategies employed in any given ML system.


title: Statistical Classification via Robust Hypothesis Testing

abstract: In this letter, we consider multiple statistical classification problem where a sequence of n independent and identically distributed observations, that are generated by one of M discrete sources, need to be classified. The source distributions are not known, however one has access to labeled training sequences, of length N, from each source. We consider the case where the unknown source distributions are estimated from the training sequences, then the estimates are used as nominal distributions in a robust hypothesis test. Specifically, we consider the robust DGL test due to Devroye et al. and provide non-asymptotic exponential bounds, that are functions of N{n, on the error probability of classification.


title: Energy Conservation in the thin layer approximation: V. The surface brightness in supernova remnants

abstract: Two new equations of motion for a supernova remnant (SNR) are derived in the framework of energy conservation for the thin-layer approximation. The first one is based on an inverse square law for the surrounding density and the second one on a non-cubic dependence of the swept mass. Under the assumption that the observed radio-flux scales as the flux of kinetic energy, two scaling laws are derived for the temporal evolution of the surface brightness of SNRs. The astrophysical applications cover two galactic samples of surface brightness and an extragalactic one.


title: Verification of a Merkle Patricia Tree Library Using F*

abstract: A Merkle tree is a data structure for representing a key-value store as a tree. Each node of a Merkle tree is equipped with a hash value computed from those of their descendants. A Merkle tree is often used for representing a state of a blockchain system since it can be used for efficiently auditing the state in a trustless manner. Due to the safety-critical nature of blockchains, ensuring the correctness of their implementation is paramount. We show our formally verified implementation of the core part of Plebeia using F*. Plebeia is a library to manipulate an extension of Merkle trees (called Plebeia trees). It is being implemented as a part of the storage system of the Tezos blockchain system. To this end, we gradually ported Plebeia to F*; the OCaml code extracted from the modules ported to F* is linked with the unverified part of Plebeia. By this gradual porting process, we can obtain a working code from our partially verified implementation of Plebeia; we confirmed that the binary passes all the unit tests of Plebeia. More specifically, we verified the following properties on the implementation of Plebeia: (1) Each tree-manipulating function preserves the invariants on the data structure of a Plebeia tree and satisfies the functional requirements as a nested key-value store; (2) Each function for serializing/deserializing a Plebeia tree to/from the low-level storage is implemented correctly; and (3) The hash function for a Plebeia tree is relatively collision-resistant with respect to the cryptographic safety of the blake2b hash function. During porting Plebeia to F*, we found a bug in an old version of Plebeia, which was overlooked by the tests bundled with the original implementation. To the best of our knowledge, this is the first work that verifies a production-level implementation of a Merkle-tree library by F*.


title: Interlacing Results for Hypergraphs

abstract: Hypergraphs are a generalization of graphs in which edges can connect any number of vertices. They allow the modeling of complex networks with higher-order interactions, and their spectral theory studies the qualitative properties that can be inferred from the spectrum, i.e. the multiset of the eigenvalues, of an operator associated to a hypergraph. It is expected that a small perturbation of a hypergraph, such as the removal of a few vertices or edges, does not lead to a major change of the eigenvalues. In particular, it is expected that the eigenvalues of the original hypergraph interlace the eigenvalues of the perturbed hypergraph. Here we work on hypergraphs where, in addition, each vertex--edge incidence is given a real number, and we prove interlacing results for the adjacency matrix, the Kirchoff Laplacian and the normalized Laplacian. Tightness of the inequalities is also shown.


title: A note on Quebbemann's extremal lattices of rank 64

abstract: By constructing explicit examples, we show that the method of Quebbemann yields many isomorphism classes of extremal lattices of rank 64. Many of these examples have no non-trivial automorphisms.


title: Temporal Averaging LSTM-based Channel Estimation Scheme for IEEE 802.11p Standard

abstract: In vehicular communications, reliable channel estimation is critical for the system performance due to the doubly-dispersive nature of vehicular channels. IEEE 802.11p standard allocates insufficient pilots for accurate channel tracking. Consequently, conventional IEEE 802.11p estimators suffer from a considerable performance degradation, especially in high mobility scenarios. Recently, deep learning (DL) techniques have been employed for IEEE 802.11p channel estimation. Nevertheless, these methods suffer either from performance degradation in very high mobility scenarios or from large computational complexity. In this paper, these limitations are solved using a long short term memory (LSTM)-based estimation. The proposed estimator employs an LSTM unit to estimate the channel, followed by temporal averaging (TA) processing as a noise alleviation technique. Moreover, the noise mitigation ratio is determined analytically, thus validating the TA processing ability in improving the overall performance. Simulation results reveal the performance superiority of the proposed schemes compared to recently proposed DL-based estimators, while recording a significant reduction in the computational complexity.


title: Catchphrase: Automatic Detection of Cultural References

abstract: A snowclone is a customizable phrasal template that can be realized in multiple, instantly recognized variants. For example, ``* is the new *" (Orange is the new black, 40 is the new 30). Snowclones are extensively used in social media. In this paper, we study snowclones originating from pop-culture quotes; our goal is to automatically detect cultural references in text. We introduce a new, publicly available data set of pop-culture quotes and their corresponding snowclone usages and train models on them. We publish code for Catchphrase, an internet browser plugin to automatically detect and mark references in real-time, and examine its performance via a user study. Aside from assisting people to better comprehend cultural references, we hope that detecting snowclones can complement work on paraphrasing and help to tackle long-standing questions in social science about the dynamics of information propagation.


title: MICE: A Crosslinguistic Emotion Corpus in Malay, Indonesian, Chinese and English

abstract: MICE is a corpus of emotion words in four languages which is currently working progress. There are two sections to this study, Part I: Emotion word corpus and Part II: Emotion word survey. In Part 1, the method of how the emotion data is culled for each of the four languages will be described and very preliminary data will be presented. In total, we identified 3,750 emotion expressions in Malay, 6,657 in Indonesian, 3,347 in Mandarin Chinese and 8,683 in English. We are currently evaluating and double checking the corpus and doing further analysis on the distribution of these emotion expressions. Part II Emotion word survey involved an online language survey which collected information on how speakers assigned the emotion words into basic emotion categories, the rating for valence and intensity as well as biographical information of all the respondents.


title: Probing Multilingual Language Models for Discourse

abstract: Pre-trained multilingual language models have become an important building block in multilingual natural language processing. In the present paper, we investigate a range of such models to find out how well they transfer discourse-level knowledge across languages. This is done with a systematic evaluation on a broader set of discourse-level tasks than has been previously been assembled. We find that the XLM-RoBERTa family of models consistently show the best performance, by simultaneously being good monolingual models and degrading relatively little in a zero-shot setting. Our results also indicate that model distillation may hurt the ability of cross-lingual transfer of sentence representations, while language dissimilarity at most has a modest effect. We hope that our test suite, covering 5 tasks with a total of 22 languages in 10 distinct families, will serve as a useful evaluation platform for multilingual performance at and beyond the sentence level.


title: RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformer

abstract: End-to-end simultaneous speech translation (SST), which directly translates speech in one language into text in another language in real-time, is useful in many scenarios but has not been fully investigated. In this work, we propose RealTranS, an end-to-end model for SST. To bridge the modality gap between speech and text, RealTranS gradually downsamples the input speech with interleaved convolution and unidirectional Transformer layers for acoustic modeling, and then maps speech features into text space with a weighted-shrinking operation and a semantic encoder. Besides, to improve the model performance in simultaneous scenarios, we propose a blank penalty to enhance the shrinking quality and a Wait-K-Stride-N strategy to allow local reranking during decoding. Experiments on public and widely-used datasets show that RealTranS with the Wait-K-Stride-N strategy outperforms prior end-to-end models as well as cascaded models in diverse latency settings.


title: Wigner SU(4) symmetry, clustering, and the spectrum of $^{12}$C

abstract: We present lattice calculations of the low-lying spectrum of $^{12}$C using a simple nucleon-nucleon interaction that is independent of spin and isospin and therefore invariant under Wigner's SU(4) symmetry. We find strong signals for all excited states up to $\sim 15$~MeV above the ground state, and explore the structure of each state using a large variety of $\alpha$ cluster and harmonic oscillator trial states, projected onto given irreducible representations of the cubic group. We are able to verify earlier findings for the $\alpha$ clustering in the Hoyle state and the second $2^+$ state of $^{12}$C. The success of these calculations to describe the full low-lying energy spectrum using spin-independent interactions suggest that either the spin-orbit interactions are somewhat weak in the $^{12}$C system, or the effects of $\alpha$ clustering are diminishing their influence. This is in agreement with previous findings from {\it ab initio} shell model calculations.


title: Joint System-Wise Optimization for Pipeline Goal-Oriented Dialog System

abstract: Recent work (Takanobu et al., 2020) proposed the system-wise evaluation on dialog systems and found that improvement on individual components (e.g., NLU, policy) in prior work may not necessarily bring benefit to pipeline systems in system-wise evaluation. To improve the system-wise performance, in this paper, we propose new joint system-wise optimization techniques for the pipeline dialog system. First, we propose a new data augmentation approach which automates the labeling process for NLU training. Second, we propose a novel stochastic policy parameterization with Poisson distribution that enables better exploration and offers a principled way to compute policy gradient. Third, we propose a reward bonus to help policy explore successful dialogs. Our approaches outperform the competitive pipeline systems from Takanobu et al. (2020) by big margins of 12% success rate in automatic system-wise evaluation and of 16% success rate in human evaluation on the standard multi-domain benchmark dataset MultiWOZ 2.1, and also outperform the recent state-of-the-art end-to-end trained model from DSTC9.


title: A black-box, general purpose quadratic self-consistent field code with and without Cholesky Decomposition of the two-electron integrals

abstract: We present the implementation of a quadratically convergent Self-consistent field (QCSCF) algorithm based on an adaptive trust-radius optimization scheme for restricted open-shell Hartree-Fock (ROHF), restricted Hartree-Fock (RHF), and unrestricted Hartree-Fock (UHF) references. The algorithm can exploit Cholesky decomposition (CD) of the two-electron integrals to allow calculations on larger systems. The most important feature of the QCSCF code lies in its black-box nature -- probably the most important quality desired by a generic user. As shown for pilot applications, it does not require one to tune the self-consistent field (SCF) parameters (damping, Pulay's DIIS, and other similar techniques) in difficult-to-converge molecules. Also, it can be used to obtain a very thigh convergence with extended basis set - a situation often needed when computing high-order molecular properties - where the standard SCF algorithm starts to oscillate. Nevertheless, trouble may appear even with a QCSCF solver. In this respect, we discuss what can go wrong, focusing on the multiple UHF solutions of ortho-benzyne


title: A measurement of the Lyman-beta forest power spectrum and its cross with the Lyman-alpha forest in X-Shooter XQ-100

abstract: The Lyman-alpha forest is the large-scale structure probe for which we appear to have modeling control to the highest wavenumbers. This makes the Lyman-alpha forest of great interest for constraining the warmness/fuzziness of dark matter and the timing of reionization processes. However, the standard statistic, the Lyman-alpha forest power spectrum, is unable to strongly constrain the IGM temperature-density relation, and this inability further limits how well other high wavenumber-sensitive parameters can be constrained. With the aim of breaking these degeneracies, we measure the power spectrum of the Lyman-beta forest and its cross correlation with the coeval Lyman-alpha forest using the one hundred spectra of z=3.5-4.5 quasars in the VLT/X-Shooter XQ-100 Legacy Survey, motivated by the Lyman-beta transition's smaller absorption cross section that makes it sensitive to somewhat higher densities relative to the Lyman-alpha transition. Our inferences from this measurement for the IGM temperature-density relation appear to latch consistently onto the recent tight lower-redshift Lyman-alpha forest constraints. The z=3.4-4.7 trends we find using the Lyman-alpha$-$Lyman-beta cross correlation show a flattening of the slope of the temperature-density relation with decreasing redshift. This is the trend anticipated from ongoing HeII reionization and there being sufficient time to reach the asymptotic temperature-density slope after hydrogen reionization completes. Furthermore, our measurements provide a consistency check on IGM models that explain the Lyman-alpha forest, with the cross correlation being immune to systematics that are uncorrelated between the two forests, such as metal line contamination.


title: Existence of a smooth Hamiltonian circle action near parabolic orbits

abstract: We show that every parabolic orbit of a two-degree of freedom integrable system admits a $C^\infty$-smooth Hamiltonian circle action, which is persistent under small integrable $C^\infty$ perturbations. We deduce from this result the structural stability of parabolic orbits and show that they are all smoothly equivalent (in the non-symplectic sense) to a standard model. Our proof is based on showing that every symplectomorphism of a neighbourhood of a parabolic point preserving the integrals of motion is Hamiltonian whose generating function is smooth and constant on the connected components of the common level sets.


title: Geometry of certain Brill-Noether locus on a very general sextic surface and Ulrich bundles

abstract: Let $X \subset \mathbb P^3$ be a very general sextic surface over complex numbers. In this paper we study certain Brill-Noether problems for moduli of rank $2$ stable bundles on $X$ and its relation with rank $2$ weakly Ulrich and Ulrich bundles. In particular, we show the non-emptiness of certain Brill-Noether loci and using the geometry of the moduli and the notion of the Petri map on higher dimensional varieties, we prove the existence of components of expected dimension. We also give sufficient conditions for the existence of rank $2$ weakly Ulrich bundles $\mathcal E$ on $X$ with $c_1(\mathcal E) =5H$ and $c_2 \geq 91$ and partially address the question of whether these conditions really hold. We then study the possible implication of the existence of an weakly Ulrich bundle in terms of non-emptiness of Brill-Noether loci. Finally, using the existence of rank $2$ Ulrich bundles on $X$ we obtain some more non-empty Brill-Noether loci and investigate the possibility of existence of higher rank simple Ulrich bundles on $X$.


title: Tracking by Joint Local and Global Search: A Target-aware Attention based Approach

abstract: Tracking-by-detection is a very popular framework for single object tracking which attempts to search the target object within a local search window for each frame. Although such local search mechanism works well on simple videos, however, it makes the trackers sensitive to extremely challenging scenarios, such as heavy occlusion and fast motion. In this paper, we propose a novel and general target-aware attention mechanism (termed TANet) and integrate it with tracking-by-detection framework to conduct joint local and global search for robust tracking. Specifically, we extract the features of target object patch and continuous video frames, then we concatenate and feed them into a decoder network to generate target-aware global attention maps. More importantly, we resort to adversarial training for better attention prediction. The appearance and motion discriminator networks are designed to ensure its consistency in spatial and temporal views. In the tracking procedure, we integrate the target-aware attention with multiple trackers by exploring candidate search regions for robust tracking. Extensive experiments on both short-term and long-term tracking benchmark datasets all validated the effectiveness of our algorithm. The project page of this paper can be found at \url{https://sites.google.com/view/globalattentiontracking/home/extend}.


title: The Crab Nebula as a Calibrator for wide-beam Cosmic Microwave Background polarization surveys

abstract: We analyze the effect of polarized diffuse emission in the calibration of wide-beam mm-wave polarimeters, when using the Crab Nebula as a reference source for both polarized brightness and polarization angle. We show that, for CMB polarization experiments aiming at detecting B-mode in a scenario with a tensor to scalar ratio $r \sim 0.001$, wide (a few degrees in diameter), precise ($\sigma_Q$ , $\sigma_U$ $\sim$ 20 $\mu$$K_{CMB}$ arcmin), high angular resolution ($< \mathrm{FWHM}$) reference maps are needed to properly take into account the effects of diffuse polarized emission and avoid significant bias in the calibration.


title: J-GEM optical and near-infrared follow-up of gravitational wave events during LIGO's and Virgo's third observing run

abstract: The Laser Interferometer Gravitational-wave Observatory Scientific Collaboration and Virgo Collaboration (LVC) sent out 56 gravitational-wave (GW) notices during the third observing run (O3). Japanese collaboration for Gravitational wave ElectroMagnetic follow-up (J-GEM) performed optical and near-infrared observations to identify and observe an electromagnetic (EM) counterpart. We constructed web-based system which enabled us to obtain and share information of candidate host galaxies for the counterpart, and status of our observations. Candidate host galaxies were selected from the GLADE catalog with a weight based on the three-dimensional GW localization map provided by LVC. We conducted galaxy-targeted and wide-field blind surveys, real-time data analysis, and visual inspection of observed galaxies. We performed galaxy-targeted follow-ups to 23 GW events during O3, and the maximum probability covered by our observations reached to 9.8%. Among them, we successfully started observations for 10 GW events within 0.5 days after the detection. This result demonstrates that our follow-up observation has a potential to constrain EM radiation models for a merger of binary neutron stars at a distance of up to $\sim$100~Mpc with a probability area of $\leq$ 500~deg$^2$.


title: Late levels of nested occupancy scheme in random environment

abstract: Consider a weighted branching process generated by a point process on $[0,1]$, whose atoms sum up to one. Then the weights of all individuals in any given generation sum up to one, as well. We define a nested occupancy scheme in random environment as the sequence of balls-in-boxes schemes (with random probabilities) in which boxes of the $j$th level, $j=1,2,\ldots$ are identified with the $j$th generation individuals and the hitting probabilities of boxes are identified with the corresponding weights. The collection of balls is the same for all generations, and each ball starts at the root and moves along the tree of the weighted branching process according to the following rule: transition from a mother box to a daughter box occurs with probability given by the ratio of the daughter and mother weights. Assuming that there are $n$ balls, we give a full classification of regimes of the a.s.\ convergence for the number of occupied (ever hit) boxes in the $j$th level, properly normalized, as $n$ and $j=j_n$ grow to $\infty$. Here, $(j_n)_{n\in\mathbb N}$ is a sequence of positive numbers growing proportionally to $\log n$. We call such levels late, for the nested occupancy scheme gets extinct in the levels which grow super-logarithmically in $n$ in the sense that each occupied box contains one ball. Also, in some regimes we prove the strong laws of large numbers (a) for the number of the $j$th level boxes which contain at least $k$ balls, $k\geq 2$ and (b) under the assumption that the mean number of the first level boxes is finite, for the number of empty boxes in the $j$th level.


title: Nonlinear Hawkes Processes in Time-Varying System

abstract: Hawkes processes are a class of point processes that have the ability to model the self- and mutual-exciting phenomena. Although the classic Hawkes processes cover a wide range of applications, their expressive ability is limited due to three key hypotheses: parametric, linear and homogeneous. Recent work has attempted to address these limitations separately. This work aims to overcome all three assumptions simultaneously by proposing the flexible state-switching Hawkes processes: a flexible, nonlinear and nonhomogeneous variant where a state process is incorporated to interact with the point processes. The proposed model empowers Hawkes processes to be applied to time-varying systems. For inference, we utilize the latent variable augmentation technique to design two efficient Bayesian inference algorithms: Gibbs sampler and mean-field variational inference, with analytical iterative updates to estimate the posterior. In experiments, our model achieves superior performance compared to the state-of-the-art competitors.


title: Stochastic Models of Neural Plasticity: A Scaling Approach

abstract: In neuroscience, synaptic plasticity refers to the set of mechanisms driving the dynamics of neuronal connections, called synapses and represented by a scalar value, the synaptic weight. A Spike-Timing Dependent Plasticity (STDP) rule is a biologically-based model representing the time evolution of the synaptic weight as a functional of the past spiking activity of adjacent neurons. A general mathematical framework has been introduced in~arXiv:2010.08195. In this paper we develop and investigate a scaling approach of these models based on several biological assumptions. Experiments show that long-term synaptic plasticity evolves on a much slower timescale than the cellular mechanisms driving the activity of neuronal cells, like their spiking activity or the concentration of various chemical components created/suppressed by this spiking activity. For this reason, a scaled version of the stochastic model of~arXiv:2010.08195 is introduced and a limit theorem, an averaging principle, is stated for a large class of plasticity kernels. A companion paper~arXiv:2010.08790 is entirely devoted to the tightness properties used to prove these convergence results. These averaging principles are used to study two important STDP models: pair-based rules and calcium-based rules. Our results are compared with the approximations of neuroscience STDP models. A class of discrete models of STDP rules is also investigated for the analytical tractability of its limiting dynamical system.


title: Hunting isolated neutron stars with proper motions from wide-area optical surveys

abstract: High-velocity neutron stars (HVNSs) that were kicked out from their birth location can be potentially identified with their large proper motions, and possibly with large parallax, when they come across the solar neighborhood. In this paper, we study the feasibility of hunting isolated HVNSs in wide-area optical surveys by modeling the evolution of NS luminosity taking into account spin-down and thermal radiation. Assuming the upcoming 10-year VRO LSST observation, our model calculations predict that about 10 HVNSs mainly consisting of pulsars with ages of $10^4$--$10^5$ yr and thermally emitting NSs with $10^5$--$10^6$ yr are detectable. We find that a few NSs with effective temperature $< 5 \times 10^5$ K, which are likely missed in the current and future X-ray surveys, are also detectable. In addition to the standard neutron star cooling models, we consider a dark matter heating model. If such a strong heating exists we find that the detectable HVNSs would be significantly cooler, i.e., $\lesssim 5\times 10^5$ K. Thus, the future optical observation will give an unique NS sample, which can provide essential constraints on the NS cooling and heating mechanisms. Moreover, we suggest that providing HVNS samples with optical surveys is helpful for understanding the intrinsic kick-velocity distribution of NSs.


title: UniKeyphrase: A Unified Extraction and Generation Framework for Keyphrase Prediction

abstract: Keyphrase Prediction (KP) task aims at predicting several keyphrases that can summarize the main idea of the given document. Mainstream KP methods can be categorized into purely generative approaches and integrated models with extraction and generation. However, these methods either ignore the diversity among keyphrases or only weakly capture the relation across tasks implicitly. In this paper, we propose UniKeyphrase, a novel end-to-end learning framework that jointly learns to extract and generate keyphrases. In UniKeyphrase, stacked relation layer and bag-of-words constraint are proposed to fully exploit the latent semantic relation between extraction and generation in the view of model structure and training process, respectively. Experiments on KP benchmarks demonstrate that our joint approach outperforms mainstream methods by a large margin.


title: Stimulated emission of plasmon-LO mode in narrow gap HgTe/CdHgTe quantum wells

abstract: We calculate the dispersion of the plasmon-LO modes taking into account the spatial dispersion of the electronic polarizability. It is shown that stimulated emission of the plasmon-LO mode is possible in the frequency range corresponding to the Reststrahlen band of GaAs both in a 6 nm wide HgTe/CdTe QW and in a 5 nm wide HgTe/Cd0.7Hg0.3Te QW grown on the (013) plane. Due to the anisotropy of the dispersion law for the plasmon-LO mode, the [03-1] direction appears to be optimal for generation.