title: A consistent and conservative volume distribution algorithm and its applications to multiphase flows using Phase-Field models

abstract: In the present study, the multiphase volume distribution problem, where there can be an arbitrary number of phases, is addressed using a consistent and conservative volume distribution algorithm. The proposed algorithm satisfies the summation constraint, the conservation constraint, and the \textit{consistency of reduction}. The first application of the volume distribution algorithm is to determine the Lagrange multipliers in multiphase Phase-Field models that enforce the mass conservation, and a multiphase conservative Allen-Cahn model that satisfies the \textit{consistency of reduction} is developed. A corresponding consistent and conservative numerical scheme is developed for the model. The multiphase conservative Allen-Cahn model has a better ability than the multiphase Cahn-Hilliard model to preserve under-resolved structures. The second application is to develop a numerical procedure, called the boundedness mapping, to map the order parameters, obtained numerically from a multiphase model, into their physical interval, and at the same time to preserve the physical properties of the order parameters. Along with the consistent and conservative schemes for the multiphase Phase-Field models, the numerical solutions of the order parameters are reduction consistent, conservative, and bounded, which are theoretically analyzed and numerically validated. Then, the multiphase Phase-Field models are coupled with the momentum equation by satisfying the \textit{consistency of mass conservation} and the \textit{consistency of mass and momentum transport}, thanks to the consistent formulation. It is demonstrated that the proposed model and scheme converge to the sharp-interface solution and are capable of capturing the complicated multiphase dynamics even when there is a large density and/or viscosity ratio.


title: Effective Unsupervised Domain Adaptation with Adversarially Trained Language Models

abstract: Recent work has shown the importance of adaptation of broad-coverage contextualised embedding models on the domain of the target task of interest. Current self-supervised adaptation methods are simplistic, as the training signal comes from a small percentage of \emph{randomly} masked-out tokens. In this paper, we show that careful masking strategies can bridge the knowledge gap of masked language models (MLMs) about the domains more effectively by allocating self-supervision where it is needed. Furthermore, we propose an effective training strategy by adversarially masking out those tokens which are harder to reconstruct by the underlying MLM. The adversarial objective leads to a challenging combinatorial optimisation problem over \emph{subsets} of tokens, which we tackle efficiently through relaxation to a variational lowerbound and dynamic programming. On six unsupervised domain adaptation tasks involving named entity recognition, our method strongly outperforms the random masking strategy and achieves up to +1.64 F1 score improvements.


title: On the effect of rotation on the life-span of analytic solutions to the $3D$ inviscid primitive equations

abstract: We study the effect of the rotation on the life-span of solutions to the $3D$ hydrostatic Euler equations with rotation and the inviscid Primitive equations (PEs) on the torus. The space of analytic functions appears to be the natural space to study the initial value problem for the inviscid PEs with general initial data, as they have been recently shown to exhibit Kelvin-Helmholtz type instability. First, for a short interval of time that is independent of the rate of rotation $|\Omega|$, we establish the local well-posedness of the inviscid PEs in the space of analytic functions. In addition, thanks to a fine analysis of the barotropic and baroclinic modes decomposition, we establish two results about the long time existence of solutions. (i) Independently of $|\Omega|$, we show that the life-span of the solution tends to infinity as the analytic norm of the initial baroclinic mode goes to zero. Moreover, we show in this case that the solution of the $3D$ inviscid PEs converges to the solution of the limit system, which is governed by the $2D$ Euler equations. (ii) We show that the life-span of the solution can be prolonged unboundedly with $|\Omega|\rightarrow \infty$, which is the main result of this paper. This is established for "well-prepared" initial data, namely, when only the Sobolev norm (but not the analytic norm) of the baroclinic mode is small enough, depending on $|\Omega|$. Furthermore, for large $|\Omega|$ and "well-prepared" initial data, we show that the solution to the $3D$ inviscid PEs is approximated by the solution to a simple limit resonant system with the same initial data.


title: Learning by Minimizing the Sum of Ranked Range

abstract: In forming learning objectives, one oftentimes needs to aggregate a set of individual values to a single output. Such cases occur in the aggregate loss, which combines individual losses of a learning model over each training sample, and in the individual loss for multi-label learning, which combines prediction scores over all class labels. In this work, we introduce the sum of ranked range (SoRR) as a general approach to form learning objectives. A ranked range is a consecutive sequence of sorted values of a set of real numbers. The minimization of SoRR is solved with the difference of convex algorithm (DCA). We explore two applications in machine learning of the minimization of the SoRR framework, namely the AoRR aggregate loss for binary classification and the TKML individual loss for multi-label/multi-class classification. Our empirical results highlight the effectiveness of the proposed optimization framework and demonstrate the applicability of proposed losses using synthetic and real datasets.


title: A Convex Approach to Data-driven Optimal Control via Perron-Frobenius and Koopman Operators

abstract: The paper is about the data-driven computation of optimal control for a class of control affine deterministic nonlinear systems. We assume that the control dynamical system model is not available, and the only information about the system dynamics is available in the form of time-series data. We provide a convex formulation for the optimal control problem of the nonlinear system. The convex formulation relies on the duality result in the dynamical system's stability theory involving density function and Perron-Frobenius operator. We formulate the optimal control problem as an infinite-dimensional convex optimization program. The finite-dimensional approximation of the optimization problem relies on the recent advances made in the Koopman operator's data-driven computation, which is dual to the Perron-Frobenius operator. Simulation results are presented to demonstrate the application of the developed framework.


title: Directed Graphs from Exact Covering Systems

abstract: Given an exact covering system $S = \{a_i$ (mod $d_i$) $: 1 \leq i \leq r\}$, we introduce the corresponding exact covering system digraph (ECSD) $G_S = G(d_1n+a_1, \ldots, d_rn+a_r)$. The vertices of $G_S$ are the integers and the edges are $(n, d_in+a_i)$ for each $n \in \mathbb{Z}$ and for each congruence in the covering system. We study the structure of these directed graphs, which have finitely many components, one cycle per component, as well as indegree 1 and outdegree $r$ at each vertex. We also explore the link between ECSDs that have a single component and non-standard digital representations of integers.


title: Spherically symmetric linear perturbations of electrically counterpoised dust

abstract: We consider spherically symmetric linear perturbations of static spherically symmetric spacetimes where the matter content is ellectrically counterpoised dust. We show that the evolution equation for the fluid perturbation implies that the fluid elements move with constant velocities. Therefore there are neither oscillations nor exponential departure from the background solution. We present an explicit example that shows that the perturbation could lead to the formation of a black hole.


title: On the Effects of Knowledge-Augmented Data in Word Embeddings

abstract: This paper investigates techniques for knowledge injection into word embeddings learned from large corpora of unannotated data. These representations are trained with word cooccurrence statistics and do not commonly exploit syntactic and semantic information from linguistic knowledge bases, which potentially limits their transferability to domains with differing language distributions or usages. We propose a novel approach for linguistic knowledge injection through data augmentation to learn word embeddings that enforce semantic relationships from the data, and systematically evaluate the impact it has on the resulting representations. We show our knowledge augmentation approach improves the intrinsic characteristics of the learned embeddings while not significantly altering their results on a downstream text classification task.


title: Data-driven Operation of the Resilient Electric Grid: A Case of COVID-19

abstract: Electrical energy is a vital part of modern life, and expectations for grid resilience to allow a continuous and reliable energy supply has tremendously increased even during adverse events (e.g., Ukraine cyber-attack, Hurricane Maria). The global pandemic COVID-19 has raised the electric energy reliability risk due to potential workforce disruptions, supply chain interruptions, and increased possible cybersecurity threats. The pandemic introduces a significant degree of uncertainly to the grid operation in the presence of other extreme events like natural disasters, unprecedented outages, aging power grids, high proliferation of distributed generation, and cyber-attacks. This situation increases the need for measures for the resiliency of power grids to mitigate the impacts of the pandemic as well as simultaneous extreme events. Solutions to manage such an adverse scenario will be multi-fold: a) emergency planning and organizational support, b) following safety protocol, c) utilizing enhanced automation and sensing for situational awareness, and d) integration of advanced technologies and data points for ML-driven enhanced decision support. Enhanced digitalization and automation resulted in better network visibility at various levels, including generation, transmission, and distribution. These data or information can be utilized to take advantage of advanced machine learning techniques for automation and increased power grid resilience. In this paper, a) we review the impact of COVID-19 on power grid operations and actions taken by operators/organizations to minimize the impact of COVID-19, and b) we have presented the recently developed tool and concepts using natural language processing (NLP) in the domain of machine learning and artificial intelligence that can be used for increasing resiliency of power systems in normal and in extreme scenarios such as COVID-19 pandemics.


title: Transversal flexoelectric coefficient for nanostructures at finite deformations from first principles

abstract: We present a novel formulation for calculating the transversal flexoelectric coefficient of nanostructures at finite deformations from first principles. Specifically, we introduce the concept of \emph{radial polarization} to make the coefficient a well-defined quantity for uniform bending deformations. We use the framework to calculate the flexoelectric coefficient for group IV atomic monolayers using density functional theory. We find that graphene's coefficient is significantly larger than previously reported, with a charge transfer mechanism that differs from other members of its group.


title: Policy Learning Using Weak Supervision

abstract: Most existing policy learning solutions require the learning agents to receive high-quality supervision signals such as well-designed rewards in reinforcement learning (RL) or high-quality expert demonstrations in behavioral cloning (BC). These quality supervisions are usually infeasible or prohibitively expensive to obtain in practice. We aim for a unified framework that leverages the available cheap weak supervisions to perform policy learning efficiently. To handle this problem, we treat the "weak supervision" as imperfect information coming from a peer agent, and evaluate the learning agent's policy based on a "correlated agreement" with the peer agent's policy (instead of simple agreements). Our approach explicitly punishes a policy for overfitting to the weak supervision. In addition to theoretical guarantees, extensive evaluations on tasks including RL with noisy rewards, BC with weak demonstrations, and standard policy co-training show that our method leads to substantial performance improvements, especially when the complexity or the noise of the learning environments is high.


title: Quantitative K-theory, positive scalar curvature, and band width

abstract: We develop two connections between the quantitative framework of operator $K$-theory for geometric $C^*$-algebras and the problem of positive scalar curvature. First, we introduce a quantitative notion of higher index and use it to give a refinement of the well-known obstruction of Rosenberg to positive scalar curvature on closed spin manifolds coming from the higher index of the Dirac operator. We show that on a manifold with uniformly positive scalar curvature, the propagation at which the index of the Dirac operator vanishes is related inversely to the curvature lower bound. Second, we give an approach, using related techniques, to Gromov's band width conjecture, which has been the subject of recent work by Zeidler and Cecchini from a different point of view.


title: Quantum dynamics of topological strings in a frustrated Ising antiferromagnet

abstract: We investigate the quantum dynamics of the transverse field Ising model on the triangular lattice through large-scale quantum Monte Carlo simulations and stochastic analytic continuation. At weak transverse field, we capture for the first time the excitations related to topological quantum strings, which exhibits continuum features described by XY chain along the strings and those in accord with "Luttinger string liquid" in the perpendicular direction. The continuum features can be well understood from the perspective of topological strings. Furthermore, we identify the contribution of strings from the excitation spectrum. Our study provides characteristic features for the experimental search for string-related excitations and proposes a new theoretical method to pinpoint topological excitations in the experimental spectra.


title: ALMaQUEST -- IV. The ALMA-MaNGA QUEnching and STar formation (ALMaQUEST) Survey

abstract: The ALMaQUEST (ALMA-MaNGA QUEnching and STar formation) survey is a program with spatially-resolved $^{12}$CO(1-0) measurements obtained with the Atacama Large Millimeter Array (ALMA) for 46 galaxies selected from the Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) DR15 optical integral-field spectroscopic survey. The aim of the ALMaQUEST survey is to investigate the dependence of star formation activity on the cold molecular gas content at kpc scales in nearby galaxies. The sample consists of galaxies spanning a wide range in specific star formation rate (sSFR), including starburst (SB), main-sequence (MS), and green valley (GV) galaxies. In this paper, we present the sample selection and characteristics of the ALMA observations, and showcase some of the key results enabled by the combination of spatially-matched stellar populations and gas measurements. Considering the global (aperture-matched) stellar mass, molecular gas mass, and star formation rate of the sample, we find that the sSFR depends on both the star formation efficiency (SFE) and the molecular gas fraction ($f_{\rm H_{2}}$), although the correlation with the latter is slightly weaker. Furthermore, the dependence of sSFR on the molecular gas content (SFE or $f_{\rm H_{2}}$) is stronger than that on either the atomic gas fraction or the molecular-to-atomic gas fraction, albeit with the small HI sample size. On kpc scales, the variations in both SFE and $f_{\rm H_{2}}$ within individual galaxies can be as large as 1-2 dex thereby demonstrating that the availability of spatially-resolved observations is essential to understand the details of both star formation and quenching processes.


title: Strong antiferromagnetic proximity coupling in a heterostructured superconductor Sr$_2$VO$_3$FeAs

abstract: We report observation of strong magnetic proximity coupling in a heterostructured superconductor Sr$_2$VO$_3$FeAs, determined by the upper critical fields $H_{c2}(T)$ measurements up to 65 T. Using the resistivity and the radio-frequency measurements for both $H \parallel ab$ and $H \parallel c$, we found a strong upward curvature of $H_{c2}^c(T)$, together with a steep increase of $H_{c2}^{ab}(T)$ near $T_c$, yielding the anisotropic factor $\gamma_H=H_{c2}^{ab}/H_{c2}^c$ up to $\sim$ 20, the largest value among iron-based superconductors. These are attributed to the Jaccarino-Peter effect, rather than to the multiband effect, due to strong exchange interaction between itinerant Fe spins of the FeAs layers and localized V spins of Mott-insulating SrVO$_3$ layers. These findings provide evidence for strong antiferromagnetic proximity coupling, comparable with the intralayer superexchange interaction of SrVO$_3$ layer and sufficient to induce magnetic frustration in Sr$_2$VO$_3$FeAs.


title: The act of remembering: a study in partially observable reinforcement learning

abstract: Reinforcement Learning (RL) agents typically learn memoryless policies---policies that only consider the last observation when selecting actions. Learning memoryless policies is efficient and optimal in fully observable environments. However, some form of memory is necessary when RL agents are faced with partial observability. In this paper, we study a lightweight approach to tackle partial observability in RL. We provide the agent with an external memory and additional actions to control what, if anything, is written to the memory. At every step, the current memory state is part of the agent's observation, and the agent selects a tuple of actions: one action that modifies the environment and another that modifies the memory. When the external memory is sufficiently expressive, optimal memoryless policies yield globally optimal solutions. Unfortunately, previous attempts to use external memory in the form of binary memory have produced poor results in practice. Here, we investigate alternative forms of memory in support of learning effective memoryless policies. Our novel forms of memory outperform binary and LSTM-based memory in well-established partially observable domains.


title: Exact Solution to Sodium-Iridate-BCS-Hubbard Model along the Symmetric Line: Non-trivial topology in the ferromagnetic order

abstract: We study the sodium-iridates model on the honeycomb lattice with both BCS pairing potential and Hubbard interaction term. It is shown that this model can be exactly solved with appropriate choices of amplitude of pairing gaps, where the interacting terms are transformed to external field terms. The band structures of these exact solutions on both torus and cylinder geometry are discussed in great details. It is found that the ground state assumes an anti-ferromagnetic configuration, which breaks the time reversal symmetry spontaneously and renders the superconductor topologically trivial. On the other hand, the nontrivial topology is preserved with ferromagnetic configuration and can be characterized by the isospin Chern number.


title: A Distributed Model-Free Ride-Sharing Approach for Joint Matching, Pricing, and Dispatching using Deep Reinforcement Learning

abstract: Significant development of ride-sharing services presents a plethora of opportunities to transform urban mobility by providing personalized and convenient transportation while ensuring efficiency of large-scale ride pooling. However, a core problem for such services is route planning for each driver to fulfill the dynamically arriving requests while satisfying given constraints. Current models are mostly limited to static routes with only two rides per vehicle (optimally) or three (with heuristics). In this paper, we present a dynamic, demand aware, and pricing-based vehicle-passenger matching and route planning framework that (1) dynamically generates optimal routes for each vehicle based on online demand, pricing associated with each ride, vehicle capacities and locations. This matching algorithm starts greedily and optimizes over time using an insertion operation, (2) involves drivers in the decision-making process by allowing them to propose a different price based on the expected reward for a particular ride as well as the destination locations for future rides, which is influenced by supply-and demand computed by the Deep Q-network, (3) allows customers to accept or reject rides based on their set of preferences with respect to pricing and delay windows, vehicle type and carpooling preferences, and (4) based on demand prediction, our approach re-balances idle vehicles by dispatching them to the areas of anticipated high demand using deep Reinforcement Learning (RL). Our framework is validated using the New York City Taxi public dataset; however, we consider different vehicle types and designed customer utility functions to validate the setup and study different settings. Experimental results show the effectiveness of our approach in real-time and large scale settings.


title: Cutoff Phenomenon for Cyclic Dynamics on Hypercube

abstract: The cutoff phenomena for Markovian dynamics have been observed and rigorously verified for a multitude of models, particularly for Glauber-type dynamics on spin systems. However, prior studies have barely considered irreversible chains. In this work, the cutoff phenomenon of certain cyclic dynamics are studied on the hypercube $\Sigma_{n} = Q^{V_{n}}$, where $Q = \{1, 2, 3\}$ and $V_{n} = \{1,...,n\}$. The main feature of these dynamics is the fact that they are represented by an irreversible Markov chain. Based on the coupling modifications suggested in a previous study of the cutoff phenomenon for the Curie-Weiss-Potts model, a comprehensive proof is presented.


title: A Review of Vegetation Encroachment Detection in Power Transmission Lines using Optical Sensing Satellite Imagery

abstract: Vegetation encroachment in power transmission lines can cause outages, which may result in severe impact on economic of power utilities companies as well as the consumer. Vegetation detection and monitoring along the power line corridor right-of-way (ROW) are implemented to protect power transmission lines from vegetation penetration. There were various methods used to monitor the vegetation penetration, however, most of them were too expensive and time consuming. Satellite images can play a major role in vegetation monitoring, because it can cover high spatial area with relatively low cost. In this paper, the current techniques used to detect the vegetation encroachment using satellite images are reviewed and categorized into four sectors; Vegetation Index based method, object-based detection method, stereo matching based and other current techniques. However, the current methods depend usually on setting manually serval threshold values and parameters which make the detection process very static. Machine Learning (ML) and deep learning (DL) algorithms can provide a very high accuracy with flexibility in the detection process. Hence, in addition to review the current technique of vegetation penetration monitoring in power transmission, the potential of using Machine Learning based algorithms are also included.


title: On the Identifiability of Phylogenetic Networks under a Pseudolikelihood model

abstract: The Tree of Life is the graphical structure that represents the evolutionary process from single-cell organisms at the origin of life to the vast biodiversity we see today. Reconstructing this tree from genomic sequences is challenging due to the variety of biological forces that shape the signal in the data, and many of those processes like incomplete lineage sorting and hybridization can produce confounding information. Here, we present the mathematical version of the identifiability proofs of phylogenetic networks under the pseudolikelihood model in SNaQ. We establish that the ability to detect different hybridization events depends on the number of nodes on the hybridization blob, with small blobs (corresponding to closely related species) being the hardest to be detected. Our work focuses on level-1 networks, but raises attention to the importance of identifiability studies on phylogenetic inference methods for broader classes of networks.


title: $K$-theoretic Catalan functions

abstract: We prove that the $K$-$k$-Schur functions are part of a family of inhomogenous symmetric functions whose top homogeneous components are Catalan functions, the Euler characteristics of certain vector bundles on the flag variety. Lam-Schilling-Shimozono identified the $K$-$k$-Schur functions as Schubert representatives for $K$-homology of the affine Grassmannian for SL$_{k+1}$. Our perspective reveals that the $K$-$k$-Schur functions satisfy a shift invariance property, and we deduce positivity of their branching coefficients from a positivity result of Baldwin and Kumar. We further show that a slight adjustment of our formulation for $K$-$k$-Schur functions produces a second shift-invariant basis which conjecturally has both positive branching and a rectangle factorization property. Building on work of Ikeda-Iwao-Maeno, we conjecture that this second basis gives the images of the Lenart-Maeno quantum Grothendieck polynomials under a $K$-theoretic analog of the Peterson isomorphism.


title: Unbounded Slice Sampling

abstract: Slice sampling is an efficient Markov Chain Monte Carlo algorithm to sample from an unnormalized density with acceptance ratio always $1$. However, when the variable to sample is unbounded, its "stepping-out" heuristic works only locally, making it difficult to uniformly explore possible candidates. This paper proposes a simple change-of-variable method to slice sample an unbounded variable equivalently from [0,1).


title: Learning Manifold Implicitly via Explicit Heat-Kernel Learning

abstract: Manifold learning is a fundamental problem in machine learning with numerous applications. Most of the existing methods directly learn the low-dimensional embedding of the data in some high-dimensional space, and usually lack the flexibility of being directly applicable to down-stream applications. In this paper, we propose the concept of implicit manifold learning, where manifold information is implicitly obtained by learning the associated heat kernel. A heat kernel is the solution of the corresponding heat equation, which describes how "heat" transfers on the manifold, thus containing ample geometric information of the manifold. We provide both practical algorithm and theoretical analysis of our framework. The learned heat kernel can be applied to various kernel-based machine learning models, including deep generative models (DGM) for data generation and Stein Variational Gradient Descent for Bayesian inference. Extensive experiments show that our framework can achieve state-of-the-art results compared to existing methods for the two tasks.


title: OLALA: Object-Level Active Learning for Efficient Document Layout Annotation

abstract: Document images often have intricate layout structures, with numerous content regions (e.g. texts, figures, tables) densely arranged on each page. This makes the manual annotation of layout datasets expensive and inefficient. These characteristics also challenge existing active learning methods, as image-level scoring and selection suffer from the overexposure of common objects.Inspired by recent progresses in semi-supervised learning and self-training, we propose an Object-Level Active Learning framework for efficient document layout Annotation, OLALA. In this framework, only regions with the most ambiguous object predictions within an image are selected for annotators to label, optimizing the use of the annotation budget. For unselected predictions, the semi-automatic correction algorithm is proposed to identify certain errors based on prior knowledge of layout structures and rectifies them with minor supervision. Additionally, we carefully design a perturbation-based object scoring function for document images. It governs the object selection process via evaluating prediction ambiguities, and considers both the positions and categories of predicted layout objects. Extensive experiments show that OLALA can significantly boost model performance and improve annotation efficiency, given the same labeling budget. Code for this paper can be accessed via https://github.com/lolipopshock/detectron2_al.


title: Multivariate Lagrange interpolation and polynomials of one quaternionic variable

abstract: This paper considers the extension of classical Lagrange interpolation in one real or complex variable to "polynomials of one quaternionic variable". To do this we develop some aspects of the theory of such polynomials. We then give a number of related multivariate polynomial interpolation schemes for ${\mathbb{R}}^4$ and ${\mathbb{C}}^2$ with good geometric properties, and some aspects of least interpolation and of Kergin interpolation.


title: How Effective is Task-Agnostic Data Augmentation for Pretrained Transformers?

abstract: Task-agnostic forms of data augmentation have proven widely effective in computer vision, even on pretrained models. In NLP similar results are reported most commonly for low data regimes, non-pretrained models, or situationally for pretrained models. In this paper we ask how effective these techniques really are when applied to pretrained transformers. Using two popular varieties of task-agnostic data augmentation (not tailored to any particular task), Easy Data Augmentation (Wei and Zou, 2019) and Back-Translation (Sennrichet al., 2015), we conduct a systematic examination of their effects across 5 classification tasks, 6 datasets, and 3 variants of modern pretrained transformers, including BERT, XLNet, and RoBERTa. We observe a negative result, finding that techniques which previously reported strong improvements for non-pretrained models fail to consistently improve performance for pretrained transformers, even when training data is limited. We hope this empirical analysis helps inform practitioners where data augmentation techniques may confer improvements.


title: Voting Data-Driven Regression Learning for Discovery of Functional Materials and Applications to Two-Dimensional Ferroelectric Materials

abstract: Regression machine learning is widely applied to predict various materials. However, insufficient materials data usually leads to a poor performance. Here, we develop a new voting data-driven method that could generally improve the performance of regression learning model for accurately predicting properties of materials. We apply it to investigate a large family (2135) of two-dimensional hexagonal binary compounds focusing on ferroelectric properties and find that the performance of the model for electric polarization is indeed greatly improved, where 38 stable ferroelectrics with out-of-plane polarization including 31 metals and 7 semiconductors are screened out. By an unsupervised learning, actionable information such as how the number and orbital radius of valence electrons, ionic polarizability, and electronegativity of constituent atoms affect polarization was extracted. Our voting data-driven method not only reduces the size of materials data for constructing a reliable learning model but also enables to make precise predictions for targeted functional materials.


title: DEMI: Discriminative Estimator of Mutual Information

abstract: Estimating mutual information between continuous random variables is often intractable and extremely challenging for high-dimensional data. Recent progress has leveraged neural networks to optimize variational lower bounds on mutual information. Although showing promise for this difficult problem, the variational methods have been theoretically and empirically proven to have serious statistical limitations: 1) many methods struggle to produce accurate estimates when the underlying mutual information is either low or high; 2) the resulting estimators may suffer from high variance. Our approach is based on training a classifier that provides the probability that a data sample pair is drawn from the joint distribution rather than from the product of its marginal distributions. Moreover, we establish a direct connection between mutual information and the average log odds estimate produced by the classifier on a test set, leading to a simple and accurate estimator of mutual information. We show theoretically that our method and other variational approaches are equivalent when they achieve their optimum, while our method sidesteps the variational bound. Empirical results demonstrate high accuracy of our approach and the advantages of our estimator in the context of representation learning. Our demo is available at https://github.com/RayRuizhiLiao/demi_mi_estimator.


title: Resonant Energy Recycling SRAM Architecture

abstract: Although we may be at the end of Moore's law, lowering chip power consumption is still the primary driving force for the designers. To enable low-power operation, we propose a resonant energy recovery static random access memory (SRAM). We propose the first series resonance scheme to reduce the dynamic power consumption of the SRAM operation. Besides, we identified the requirement of supply boosting of the write buffers for proper resonant operation. We evaluated the resonant 144KB SRAM cache through SPICE and test chip using a commercial 28nm CMOS technology. The experimental results show that the resonant SRAM can save up to 30% dynamic power at 1GHz operating frequency compared to the state-of-the-art design.


title: Measuring Association on Topological Spaces Using Kernels and Geometric Graphs

abstract: In this paper we propose and study a class of simple, nonparametric, yet interpretable measures of association between two random variables $X$ and $Y$ taking values in general topological spaces. These nonparametric measures -- defined using the theory of reproducing kernel Hilbert spaces -- capture the strength of dependence between $X$ and $Y$ and have the property that they are 0 if and only if the variables are independent and 1 if and only if one variable is a measurable function of the other. Further, these population measures can be consistently estimated using the general framework of graph functionals which include $k$-nearest neighbor graphs and minimum spanning trees. Moreover, a sub-class of these estimators are also shown to adapt to the intrinsic dimensionality of the underlying distribution. Some of these empirical measures can also be computed in near linear time. Under the hypothesis of independence between $X$ and $Y$, these empirical measures (properly normalized) have a standard normal limiting distribution. Thus, these measures can also be readily used to test the hypothesis of mutual independence between $X$ and $Y$. In fact, as far as we are aware, these are the only procedures that possess all the above mentioned desirable properties. Furthermore, when restricting to Euclidean spaces, we can make these sample measures of association finite-sample distribution-free, under the hypothesis of independence, by using multivariate ranks defined via the theory of optimal transport. The recent correlation coefficient proposed in Dette et al. (2013), Chatterjee (2019), and Azadkia and Chatterjee (2019) can be seen as a special case of this general class of measures.


title: A pilot search for extragalactic OH absorption with FAST

abstract: OH absorption is currently the only viable way to detect OH molecules in non-masing galaxies at cosmological distances. There have been only 6 such detections at z>0.05 to date and so it is hard to put a statistically robust constraint on OH column densities in distant galaxies. We carried out a pilot OH absorption survey towards 8 associated and 1 intervening HI 21-cm absorbers using the Five-hundred-meter Aperture Spherical radio Telescope (FAST). We were able to constrain the OH abundance relative to HI ([OH]/[HI]) to be lower than 10^-6 ~ 10^-8 for redshifts z within [0.1919, 0.2241]. Although no individual detection was made, stacking three associated absorbers free of RFI provides a sensitive OH column density 3-sigma upper-limit ~ 1.57 x 10^14 (Tx/10K)(1/fc) cm^-2, which corresponds to a [OH]/[HI] < 5.45 x 10^-8. Combining with archival data, we show that associated absorbers have a slightly lower OH abundance than intervening absorbers. Our results are consistent with a trend of decreasing OH abundance with decreasing redshift.


title: Second-Order NLP Adversarial Examples

abstract: Adversarial example generation methods in NLP rely on models like language models or sentence encoders to determine if potential adversarial examples are valid. In these methods, a valid adversarial example fools the model being attacked, and is determined to be semantically or syntactically valid by a second model. Research to date has counted all such examples as errors by the attacked model. We contend that these adversarial examples may not be flaws in the attacked model, but flaws in the model that determines validity. We term such invalid inputs second-order adversarial examples. We propose the constraint robustness curve and associated metric ACCS as tools for evaluating the robustness of a constraint to second-order adversarial examples. To generate this curve, we design an adversarial attack to run directly on the semantic similarity models. We test on two constraints, the Universal Sentence Encoder (USE) and BERTScore. Our findings indicate that such second-order examples exist, but are typically less common than first-order adversarial examples in state-of-the-art models. They also indicate that USE is effective as constraint on NLP adversarial examples, while BERTScore is nearly ineffectual. Code for running the experiments in this paper is available at https://github.com/jxmorris12/second-order-adversarial-examples.


title: Improving AMR Parsing with Sequence-to-Sequence Pre-training

abstract: In the literature, the research on abstract meaning representation (AMR) parsing is much restricted by the size of human-curated dataset which is critical to build an AMR parser with good performance. To alleviate such data size restriction, pre-trained models have been drawing more and more attention in AMR parsing. However, previous pre-trained models, like BERT, are implemented for general purpose which may not work as expected for the specific task of AMR parsing. In this paper, we focus on sequence-to-sequence (seq2seq) AMR parsing and propose a seq2seq pre-training approach to build pre-trained models in both single and joint way on three relevant tasks, i.e., machine translation, syntactic parsing, and AMR parsing itself. Moreover, we extend the vanilla fine-tuning method to a multi-task learning fine-tuning method that optimizes for the performance of AMR parsing while endeavors to preserve the response of pre-trained models. Extensive experimental results on two English benchmark datasets show that both the single and joint pre-trained models significantly improve the performance (e.g., from 71.5 to 80.2 on AMR 2.0), which reaches the state of the art. The result is very encouraging since we achieve this with seq2seq models rather than complex models. We make our code and model available at https://github.com/xdqkid/S2S-AMR-Parser.


title: Empirical Likelihood-Based Estimation and Inference in Randomized Controlled Trials with High-Dimensional Covariates

abstract: In this paper, we propose a data-adaptive empirical likelihood-based approach for treatment effect estimation and inference, which overcomes the obstacle of the traditional empirical likelihood-based approaches in the high-dimensional setting by adopting penalized regression and machine learning methods to model the covariate-outcome relationship. In particular, we show that our procedure successfully recovers the true variance of Zhang's treatment effect estimator (Zhang, 2018) by utilizing a data-splitting technique. Our proposed estimator is proved to be asymptotically normal and semiparametric efficient under mild regularity conditions. Simulation studies indicate that our estimator is more efficient than the estimator proposed by Wager et al. (2016) when random forests are employed to model the covariate-outcome relationship. Moreover, when multiple machine learning models are imposed, our estimator is at least as efficient as any regular estimator with a single machine learning model. We compare our method to existing ones using the ACTG175 data and the GSE118657 data, and confirm the outstanding performance of our approach.


title: MetaPhys: Few-Shot Adaptation for Non-Contact Physiological Measurement

abstract: There are large individual differences in physiological processes, making designing personalized health sensing algorithms challenging. Existing machine learning systems struggle to generalize well to unseen subjects or contexts and can often contain problematic biases. Video-based physiological measurement is not an exception. Therefore, learning personalized or customized models from a small number of unlabeled samples is very attractive as it would allow fast calibrations to improve generalization and help correct biases. In this paper, we present a novel meta-learning approach called MetaPhys for personalized video-based cardiac measurement for contactless pulse and heart rate monitoring. Our method uses only 18-seconds of video for customization and works effectively in both supervised and unsupervised manners. We evaluate our proposed approach on two benchmark datasets and demonstrate superior performance in cross-dataset evaluation with substantial reductions (42% to 44%) in errors compared with state-of-the-art approaches. We have also demonstrated our proposed method significantly helps reduce the bias in skin type.


title: Ford Highway Driving RTK Dataset: 30,000 km of North American Highways

abstract: There is a growing need for vehicle positioning information to support Advanced Driver Assistance Systems (ADAS), Connectivity (V2X), and Autonomous Driving (AD) features. These range from a need for road determination ($<$5 meters), lane determination ($<$1.5 meters), and determining where the vehicle is within the lane ($<$0.3 meters). This paper presents the Ford Highway Driving RTK (Ford-HDR) dataset. This dataset includes nearly 30,000 km of data collected primarily on North American highways during a driving campaign designed to validate driver assistance features in 2018. This includes data from a representative automotive production GNSS used primarily for turn-by-turn navigation as well as an Inertial Navigation System (INS) which couples two survey-grade GNSS receivers with a tactical grade Inertial Measurement Unit (IMU) to act as ground truth. The latter utilized networked Real-Time Kinematic (RTK) GNSS corrections delivered over a cellular modem in real-time. This dataset is being released into the public domain to spark further research in the community.


title: Photon-Driven Neural Path Guiding

abstract: Although Monte Carlo path tracing is a simple and effective algorithm to synthesize photo-realistic images, it is often very slow to converge to noise-free results when involving complex global illumination. One of the most successful variance-reduction techniques is path guiding, which can learn better distributions for importance sampling to reduce pixel noise. However, previous methods require a large number of path samples to achieve reliable path guiding. We present a novel neural path guiding approach that can reconstruct high-quality sampling distributions for path guiding from a sparse set of samples, using an offline trained neural network. We leverage photons traced from light sources as the input for sampling density reconstruction, which is highly effective for challenging scenes with strong global illumination. To fully make use of our deep neural network, we partition the scene space into an adaptive hierarchical grid, in which we apply our network to reconstruct high-quality sampling distributions for any local region in the scene. This allows for highly efficient path guiding for any path bounce at any location in path tracing. We demonstrate that our photon-driven neural path guiding method can generalize well on diverse challenging testing scenes that are not seen in training. Our approach achieves significantly better rendering results of testing scenes than previous state-of-the-art path guiding methods.


title: Robust frequency stabilization and linewidth narrowing of a laser with large intermittent frequency jumps using an optical cavity and an atomic beam

abstract: An experimental method is developed for the robust frequency stabilization using a high-finesse cavity when the laser exhibits large intermittent frequency jumps. This is accomplished by applying an additional slow feedback signal from Doppler-free fluorescence spectroscopy in an atomic beam with increased frequency locking range. As a result, a stable and narrow-linewidth 556 nm laser maintains the frequency lock status for more than a week, and contributes to more accurate evaluation of the Yb optical lattice clock. In addition, the reference optical cavity is supported at vibration-insensitive points without any vibration isolation table, making the laser setup more simple and compact.


title: A Unified View on Graph Neural Networks as Graph Signal Denoising

abstract: Graph Neural Networks (GNNs) have risen to prominence in learning representations for graph structured data. A single GNN layer typically consists of a feature transformation and a feature aggregation operation. The former normally uses feed-forward networks to transform features, while the latter aggregates the transformed features over the graph. Numerous recent works have proposed GNN models with different designs in the aggregation operation. In this work, we establish mathematically that the aggregation processes in a group of representative GNN models including GCN, GAT, PPNP, and APPNP can be regarded as (approximately) solving a graph denoising problem with a smoothness assumption. Such a unified view across GNNs not only provides a new perspective to understand a variety of aggregation operations but also enables us to develop a unified graph neural network framework UGNN. To demonstrate its promising potential, we instantiate a novel GNN model, ADA-UGNN, derived from UGNN, to handle graphs with adaptive smoothness across nodes. Comprehensive experiments show the effectiveness of ADA-UGNN.


title: Non-degenerate Killing forms on Hom-Lie superalgebras

abstract: In this paper we investigate some important basic properties of simple Hom-Lie superalgebras and show that a Hom-Lie superalgebra does not have any left or right nontrivial ideals. Moreover, we classify invariant bilinear forms on a given simple Hom-Lie superalgebra. Then we study the Killing forms on a Hom-Lie algebra which are examples of the invariant bilinear forms. Making use of the Killing forms, we find conditions for a Hom-Lie superalgebra to be classical. Furthermore, we check the conditions in which the Killing form of a Hom-Lie superalgebra is non-degenerate.


title: Anomalous scaling regime for one-dimensional Mott variable-range hopping

abstract: We derive an anomalous, sub-diffusive scaling limit for a one-dimensional version of the Mott random walk. The limiting process can be viewed heuristically as a one-dimensional diffusion with an absolutely continuous speed measure and a discontinuous scale function, as given by a two-sided stable subordinator. Corresponding to intervals of low conductance in the discrete model, the discontinuities in the scale function act as barriers off which the limiting process reflects for some time before crossing. We also discuss how, by incorporating a Bouchaud trap model element into the setting, it is possible to combine this 'blocking' mechanism with one of 'trapping'. Our proof relies on a recently developed theory that relates the convergence of processes to that of associated resistance metric measure spaces.


title: Bounded Variation on the Sierpinski Gasket

abstract: Under certain continuity conditions, we estimate upper and lower box dimension of graph of a function defined on the Sierpinski gasket. We also give an upper bound for Hausdorff dimension and box dimension of graph of function having finite energy. Further, we introduce two sets of definitions of bounded variation for a function defined on the Sierpinski gasket. We show that fractal dimension of graph of a continuous function of bounded variation is log 3/log 2. We also prove that the class of all bounded variation functions is closed under arithmetic operations. Furthermore, we show that every function of bounded variation is continuous almost everywhere in the sense of log 3/log 2 dimensional Hausdorff measure.


title: Unsupervised Reference-Free Summary Quality Evaluation via Contrastive Learning

abstract: Evaluation of a document summarization system has been a critical factor to impact the success of the summarization task. Previous approaches, such as ROUGE, mainly consider the informativeness of the assessed summary and require human-generated references for each test summary. In this work, we propose to evaluate the summary qualities without reference summaries by unsupervised contrastive learning. Specifically, we design a new metric which covers both linguistic qualities and semantic informativeness based on BERT. To learn the metric, for each summary, we construct different types of negative samples with respect to different aspects of the summary qualities, and train our model with a ranking loss. Experiments on Newsroom and CNN/Daily Mail demonstrate that our new evaluation method outperforms other metrics even without reference summaries. Furthermore, we show that our method is general and transferable across datasets.


title: Observation of Inertial-range Energy Cascade within a Reconnection Jet in Earth's Magnetotail

abstract: Earth's magnetotail region provides a unique environment to study plasma turbulence. We investigate the turbulence developed in an exhaust produced by magnetic reconnection at the terrestrial magnetotail region. Magnetic and velocity spectra show broad-band fluctuations corresponding to the inertial range, with Kolmorogov $-5/3$ scaling, indicative of a well developed turbulent cascade. We examine the mixed, third-order structure functions, and obtain a linear scaling in the inertial range. This linear scaling of the third-order structure functions implies a scale-invariant cascade of energy through the inertial range. A Politano-Pouquet third-order analysis gives an estimate of the incompressive energy transfer rate of $\sim 10^{7}~\mathrm{J\,kg^{-1}\,s^{-1}}$. This is four orders of magnitude higher than the values typically measured in 1 AU solar wind, suggesting that the turbulence cascade plays an important role as a pathway of energy dissipation during reconnection events in the tail region.


title: Proof-of-concept thermoelectric oxygen sensor exploiting oxygen mobility of GdBaCo2O5+{\delta}

abstract: In this paper, we demonstrate a proof-of-concept oxygen sensor based on the thermoelectric principle using polycrystalline $GdBaCo_2O_{5+\delta}$ where 0.45<${\delta}$<0.55 (GDCO). The lattice oxygen in layered double perovskite oxides is highly susceptible to the ambient oxygen partial pressure. The as-synthesized GDCO sample processed in ambient conditions shows pure orthorhombic ($P_{mmm}$ space group) phase and a ${\delta}$-value close to 0.5 as confirmed from X-ray diffraction reitveld refinement. The X-ray photoelectron spectroscopy shows significant $Co^{3+}$ oxidation state in non-octahedral sites in addition to $Co^{3+}$ and $Co^{4+}$ in octahedral sites. The insulator-to-metal transition (MIT) is observed at nearly 340 K as seen in electrical resistivity and seebeck coefficient measurements. The seebeck coefficient shows a large change of about 10-13 $\mu$V/K with time constant of ~20 sec, at room temperature (300 K) when the gas ambience changes from 100% oxygen to 100% nitrogen and vice versa, under a constant temperature gradient of 1 K. The response in seebeck is found to be particularly large below MIT. The diffusion of oxygen into the lattice leading to hole doping shows a large change in carrier concentration resulting in a large change in the seebeck coefficient in insulating state. On the other hand, due to insignificant increase in already large carrier concentration in metallic state the change in seebeck is minimal. Nevertheless, below MIT the response is fairly reproducible within stoichiometry ${\delta}$ = 0.5 $\pm$ 0.05. This principle shall be of significant utility to design the oxygen sensors which work at room temperature or even cryogenic temperatures.


title: On the directions determined by Cartesian products and the clique number of generalized Paley graphs

abstract: It is known that the number of directions formed by a Cartesian product $A \times B \subset AG(2,p)$ is at least $|A||B| - \min\{|A|,|B|\} + 2$, provided $p$ is prime and $|A||B|<p$. This implies the best known upper bound on the clique number of the Paley graph over $\mathbb{F}_p$. In this paper, we extend this result to $AG(2,q)$, where $q$ is a prime power. We also give improved upper bounds on the clique number of generalized Paley graphs over $\mathbb{F}_q$. In particular, for a cubic Paley graph, we improve the trivial upper bound $\sqrt{q}$ to $0.769\sqrt{q}+1$. In general, as an application of our key result on the number of directions, for any positive function $h$ such that $h(x)=o(x)$ as $x \to \infty$, we improve the trivial upper bound $\sqrt{q}$ to $\sqrt{q}-h(p)$ for almost all non-squares $q$.


title: UNIFUZZ: A Holistic and Pragmatic Metrics-Driven Platform for Evaluating Fuzzers

abstract: A flurry of fuzzing tools (fuzzers) have been proposed in the literature, aiming at detecting software vulnerabilities effectively and efficiently. To date, it is however still challenging to compare fuzzers due to the inconsistency of the benchmarks, performance metrics, and/or environments for evaluation, which buries the useful insights and thus impedes the discovery of promising fuzzing primitives. In this paper, we design and develop UNIFUZZ, an open-source and metrics-driven platform for assessing fuzzers in a comprehensive and quantitative manner. Specifically, UNIFUZZ to date has incorporated 35 usable fuzzers, a benchmark of 20 real-world programs, and six categories of performance metrics. We first systematically study the usability of existing fuzzers, find and fix a number of flaws, and integrate them into UNIFUZZ. Based on the study, we propose a collection of pragmatic performance metrics to evaluate fuzzers from six complementary perspectives. Using UNIFUZZ, we conduct in-depth evaluations of several prominent fuzzers including AFL [1], AFLFast [2], Angora [3], Honggfuzz [4], MOPT [5], QSYM [6], T-Fuzz [7] and VUzzer64 [8]. We find that none of them outperforms the others across all the target programs, and that using a single metric to assess the performance of a fuzzer may lead to unilateral conclusions, which demonstrates the significance of comprehensive metrics. Moreover, we identify and investigate previously overlooked factors that may significantly affect a fuzzer's performance, including instrumentation methods and crash analysis tools. Our empirical results show that they are critical to the evaluation of a fuzzer. We hope that our findings can shed light on reliable fuzzing evaluation, so that we can discover promising fuzzing primitives to effectively facilitate fuzzer designs in the future.


title: Corpora Evaluation and System Bias Detection in Multi-document Summarization

abstract: Multi-document summarization (MDS) is the task of reflecting key points from any set of documents into a concise text paragraph. In the past, it has been used to aggregate news, tweets, product reviews, etc. from various sources. Owing to no standard definition of the task, we encounter a plethora of datasets with varying levels of overlap and conflict between participating documents. There is also no standard regarding what constitutes summary information in MDS. Adding to the challenge is the fact that new systems report results on a set of chosen datasets, which might not correlate with their performance on the other datasets. In this paper, we study this heterogeneous task with the help of a few widely used MDS corpora and a suite of state-of-the-art models. We make an attempt to quantify the quality of summarization corpus and prescribe a list of points to consider while proposing a new MDS corpus. Next, we analyze the reason behind the absence of an MDS system which achieves superior performance across all corpora. We then observe the extent to which system metrics are influenced, and bias is propagated due to corpus properties. The scripts to reproduce the experiments in this work are available at https://github.com/LCS2-IIITD/summarization_bias.git.


title: Improving Relational Regularized Autoencoders with Spherical Sliced Fused Gromov Wasserstein

abstract: Relational regularized autoencoder (RAE) is a framework to learn the distribution of data by minimizing a reconstruction loss together with a relational regularization on the latent space. A recent attempt to reduce the inner discrepancy between the prior and aggregated posterior distributions is to incorporate sliced fused Gromov-Wasserstein (SFG) between these distributions. That approach has a weakness since it treats every slicing direction similarly, meanwhile several directions are not useful for the discriminative task. To improve the discrepancy and consequently the relational regularization, we propose a new relational discrepancy, named spherical sliced fused Gromov Wasserstein (SSFG), that can find an important area of projections characterized by a von Mises-Fisher distribution. Then, we introduce two variants of SSFG to improve its performance. The first variant, named mixture spherical sliced fused Gromov Wasserstein (MSSFG), replaces the vMF distribution by a mixture of von Mises-Fisher distributions to capture multiple important areas of directions that are far from each other. The second variant, named power spherical sliced fused Gromov Wasserstein (PSSFG), replaces the vMF distribution by a power spherical distribution to improve the sampling time in high dimension settings. We then apply the new discrepancies to the RAE framework to achieve its new variants. Finally, we conduct extensive experiments to show that the new proposed autoencoders have favorable performance in learning latent manifold structure, image generation, and reconstruction.


title: On classification of non-unital amenable simple C*-algebras, III, the range and the reduction

abstract: Following Elliott's earlier work, we show that the Elliott invariant of any finite separable simple $C^*$-algebra with finite nuclear dimension can always be described as a scaled simple ordered group pairing together with a countable abelian group which unifies the unital and nonunital, as well as stably projectionless cases. We also show that, for any given such invariant set, there is a finite separable simple $C^*$-algebra, whose Elliott invariant is the given set, a refinement of the range theorem of Elliott in the stable case. In the stably projectionless case, modified model $C^*$-algebras are constructed in such a way that they are of generalized tracial rank one and have other technical features. We also show that every stably projectionless separable simple amenable $C^*$-algebra in the UCT class has rationally generalized tracial rank one.


title: Composite values of shifted exponentials

abstract: A well-known open problem asks to show that $2^n+5$ is composite for almost all values of $n$. This was proposed by Gil Kalai as a possible Polymath project, and was posed originally by Christopher Hooley. We show that, assuming GRH and a form of the pair correlation conjecture, the answer to this problem is affirmative. We in fact do not need the full power of the pair correlation conjecture, and it suffices to assume a generalization of the Brun-Titchmarsh inequality for the Chebotarev density theorem that is implied by it. Our methods apply to any shifted exponential sequence of the form $a^n-b$ and show that, under the same assumptions, such numbers are $k$-almost primes for a density $0$ of natural numbers $n$. Furthermore, we show that $a^p-b$ is composite for almost all primes $p$ whenever $(a, b) \neq (2, 1)$.


title: $\Upsilon$ electroproduction at HERA, EIC, and LHeC within the nonrelativistic QCD framework

abstract: Based on the nonrelativistic QCD framework, we study the $\Upsilon$ production in semi-inclusive deep inelastic electron-proton scattering (SIDIS) at HERA, EIC, and LHeC, with the main aim of assessing the viability of observing $\Upsilon$ electroproduction at the three colliders. The color-octet (CO) contributions are found to have a crucial effect on both the integrated and differential cross sections, serving to further establish the significance of the CO mechanism. By setting the kinematic cuts to $p_{t,\Upsilon}^{\star 2}>1~\textrm{GeV}^{2}$, $W>50$ GeV, $2<Q^2<100~\textrm{GeV}^2$, and $0.3<z<0.9$, only a few electroproduced $\Upsilon$ events can be generated at HERA, partially accounting for its lack of measured $\Upsilon$ electroproduction. However, under the same cut conditions, the EIC and LHeC can accumulate about $8.7\times10^{2}$ and $3.7\times10^{4}$ reconstructed $\Upsilon$ events in one operation year, respectively, which manifestly indicates the prospect of detecting the $\Upsilon$-related SIDIS processes at the two forthcoming $ep(eA)$ colliders.


title: Pruning Redundant Mappings in Transformer Models via Spectral-Normalized Identity Prior

abstract: Traditional (unstructured) pruning methods for a Transformer model focus on regularizing the individual weights by penalizing them toward zero. In this work, we explore spectral-normalized identity priors (SNIP), a structured pruning approach that penalizes an entire residual module in a Transformer model toward an identity mapping. Our method identifies and discards unimportant non-linear mappings in the residual connections by applying a thresholding operator on the function norm. It is applicable to any structured module, including a single attention head, an entire attention block, or a feed-forward subnetwork. Furthermore, we introduce spectral normalization to stabilize the distribution of the post-activation values of the Transformer layers, further improving the pruning effectiveness of the proposed methodology. We conduct experiments with BERT on 5 GLUE benchmark tasks to demonstrate that SNIP achieves effective pruning results while maintaining comparable performance. Specifically, we improve the performance over the state-of-the-art by 0.5 to 1.0% on average at 50% compression ratio.


title: Can we Generalize and Distribute Private Representation Learning?

abstract: We study the problem of learning representations that are private yet informative, i.e., provide information about intended "ally" targets while hiding sensitive "adversary" attributes. We propose Exclusion-Inclusion Generative Adversarial Network (EIGAN), a generalized private representation learning (PRL) architecture that accounts for multiple ally and adversary attributes unlike existing PRL solutions. While centrally-aggregated dataset is a prerequisite for most PRL techniques, data in real-world is often siloed across multiple distributed nodes unwilling to share the raw data because of privacy concerns. We address this practical constraint by developing D-EIGAN, the first distributed PRL method that learns representations at each node without transmitting the source data. We theoretically analyze the behavior of adversaries under the optimal EIGAN and D-EIGAN encoders and the impact of dependencies among ally and adversary tasks on the optimization objective. Our experiments on various datasets demonstrate the advantages of EIGAN in terms of performance, robustness, and scalability. In particular, EIGAN outperforms the previous state-of-the-art by a significant accuracy margin (47% improvement), and D-EIGAN's performance is consistently on par with EIGAN under different network settings.


title: JSSS: free Japanese speech corpus for summarization and simplification

abstract: In this paper, we construct a new Japanese speech corpus for speech-based summarization and simplification, "JSSS" (pronounced "j-triple-s"). Given the success of reading-style speech synthesis from short-form sentences, we aim to design more difficult tasks for delivering information to humans. Our corpus contains voices recorded for two tasks that have a role in providing information under constraints: duration-constrained text-to-speech summarization and speaking-style simplification. It also contains utterances of long-form sentences as an optional task. This paper describes how we designed the corpus, which is available on our project page.


title: GenAug: Data Augmentation for Finetuning Text Generators

abstract: In this paper, we investigate data augmentation for text generation, which we call GenAug. Text generation and language modeling are important tasks within natural language processing, and are especially challenging for low-data regimes. We propose and evaluate various augmentation methods, including some that incorporate external knowledge, for finetuning GPT-2 on a subset of Yelp Reviews. We also examine the relationship between the amount of augmentation and the quality of the generated text. We utilize several metrics that evaluate important aspects of the generated text including its diversity and fluency. Our experiments demonstrate that insertion of character-level synthetic noise and keyword replacement with hypernyms are effective augmentation methods, and that the quality of generations improves to a peak at approximately three times the amount of original data.


title: DCT-SNN: Using DCT to Distribute Spatial Information over Time for Learning Low-Latency Spiking Neural Networks

abstract: Spiking Neural Networks (SNNs) offer a promising alternative to traditional deep learning frameworks, since they provide higher computational efficiency due to event-driven information processing. SNNs distribute the analog values of pixel intensities into binary spikes over time. However, the most widely used input coding schemes, such as Poisson based rate-coding, do not leverage the additional temporal learning capability of SNNs effectively. Moreover, these SNNs suffer from high inference latency which is a major bottleneck to their deployment. To overcome this, we propose a scalable time-based encoding scheme that utilizes the Discrete Cosine Transform (DCT) to reduce the number of timesteps required for inference. DCT decomposes an image into a weighted sum of sinusoidal basis images. At each time step, the Hadamard product of the DCT coefficients and a single frequency base, taken in order, is given to an accumulator that generates spikes upon crossing a threshold. We use the proposed scheme to learn DCT-SNN, a low-latency deep SNN with leaky-integrate-and-fire neurons, trained using surrogate gradient descent based backpropagation. We achieve top-1 accuracy of 89.94%, 68.3% and 52.43% on CIFAR-10, CIFAR-100 and TinyImageNet, respectively using VGG architectures. Notably, DCT-SNN performs inference with 2-14X reduced latency compared to other state-of-the-art SNNs, while achieving comparable accuracy to their standard deep learning counterparts. The dimension of the transform allows us to control the number of timesteps required for inference. Additionally, we can trade-off accuracy with latency in a principled manner by dropping the highest frequency components during inference.


title: Influence of Se doping in recently synthesized NaInS2-xSex solid solutions for potential thermo-mechanical applications studied via first-principles method

abstract: In the present work, the structural and hitherto unexplored thermal and mechanical properties of NaInS2-xSex (x = 0, 0.5, 1.0, 1.5 and 2.0) compounds have been studied using the density functional theory. Besides, the elastic anisotropy indices and hardnesses of NaInS2-xSex have been investigated as Se content is varied. The mechanical stability of all the compounds under study has been confirmed. The ratio of shear to bulk modulus (G/B) is low suggesting that the NaInS2-xSex (x = 0.5 and 1.5) compounds exhibit damage tolerant (ductility) properties while rest of the compositions are brittle in nature. The predicted hardness (H) values are also influenced with the Se content in the following order: H (NaInSSe) > H (NaInS2) > H (NaInSe2) > H (NaInS1.5Se0.5) > H (NaInS0.5Se1.5). All the anisotropic indices under study indicate that NaInS2-xSex compounds are anisotropic in nature. The Mulliken bond population analysis suggests that the degree of covalency of In-S/Se bonds decreases when S is substituted by Se. The origin of low Debye temperature ({\Theta}D) and low minimum thermal conductivity (Kmin) have been successfully explained by considering the mean atomic weight (M/n) and average bond strength of the compounds. Temperature dependence of heat capacities (Cv, Cp) and linear thermal expansion coefficient ({\alpha} ) are also estimated using the quasi-harmonic Debye model and discussed. The low values of Kmin, {\Theta}D and {\alpha} and damage tolerant behavior clearly indicate that the NaInS2-xSex (x = 0.5 and 1.5) compounds can be used as promising thermal barrier coating materials for high temperature applications.


title: Elastic elements in 3-connected matroids

abstract: It follows by Bixby's Lemma that if $e$ is an element of a $3$-connected matroid $M$, then either ${\rm co}(M\delete e)$, the cosimplification of $M\delete e$, or ${\rm si}(M/e)$, the simplification of $M/e$, is $3$-connected. A natural question to ask is whether $M$ has an element $e$ such that both ${\rm co}(M\delete e)$ and ${\rm si}(M/e)$ are $3$-connected. Calling such an element "elastic", in this paper we show that if $|E(M)|\ge 4$, then $M$ has at least four elastic elements provided $M$ has no $4$-element fans and, up to duality, $M$ has no $3$-separating set $S$ that is the disjoint union of a rank-$2$ subset and a corank-$2$ subset of $E(M)$ such that $M|S$ is isomorphic to a member or a single-element deletion of a member of a certain family of matroids.


title: Robust laboratory limits on a cosmological spatial gradient in the electromagnetic fine-structure constant from accelerometer experiments

abstract: Quasar absorption spectral data indicate the presence of a spatial gradient in the electromagnetic fine-structure constant $\alpha$ on cosmological length scales. We point out that experiments with accelerometers, including torsion pendula and atom interferometers, can be used as sensitive probes of cosmological spatial gradients in the fundamental constants of nature, which give rise to equivalence-principle-violating forces on test masses. Using laboratory data from the E\"ot-Wash experiment, we constrain spatial gradients in $\alpha$ along any direction to be $| \boldsymbol{\nabla} \alpha / \alpha | < 6.6 \times 10^{-4}~(\textrm{Glyr})^{-1}$ at $95\%$ confidence level. Our result represents an order of magnitude improvement over laboratory bounds from clock-based searches for a spatial gradient in $\alpha$ directed along the observed cosmological $\alpha$-dipole axis. Improvements to accelerometer experiments in the foreseeable future are expected to provide sufficient sensitivity to test the cosmological $\alpha$-dipole seen in astrophysical data.

categories: physics.atom-ph astro-ph.CO gr-qc hep-ph quant-ph


title: Understanding Catastrophic Overfitting in Single-step Adversarial Training

abstract: Although fast adversarial training has demonstrated both robustness and efficiency, the problem of "catastrophic overfitting" has been observed. This is a phenomenon in which, during single-step adversarial training, the robust accuracy against projected gradient descent (PGD) suddenly decreases to 0% after a few epochs, whereas the robust accuracy against fast gradient sign method (FGSM) increases to 100%. In this paper, we demonstrate that catastrophic overfitting is very closely related to the characteristic of single-step adversarial training which uses only adversarial examples with the maximum perturbation, and not all adversarial examples in the adversarial direction, which leads to decision boundary distortion and a highly curved loss surface. Based on this observation, we propose a simple method that not only prevents catastrophic overfitting, but also overrides the belief that it is difficult to prevent multi-step adversarial attacks with single-step adversarial training.


title: Robust and Efficient Estimation of Potential Outcome Means under Random Assignment

abstract: We study efficiency improvements in estimating a vector of potential outcome means using linear regression adjustment when there are more than two treatment levels. We show that using separate regression adjustments for each assignment level is never worse, asymptotically, than using the subsample averages. We also show that separate regression adjustment improves over pooled regression adjustment except in the obvious case where slope parameters in the linear projections are identical across the different assignment levels. We also characterize the class of nonlinear regression adjustment methods that preserve consistency of the potential outcome means despite arbitrary misspecification of the conditional mean functions. Finally, we apply this general potential outcomes framework to a contingent valuation study for estimating lower bound mean willingness to pay for an oil spill prevention program in California.


title: No quantum speedup over gradient descent for non-smooth convex optimization

abstract: We study the first-order convex optimization problem, where we have black-box access to a (not necessarily smooth) function $f:\mathbb{R}^n \to \mathbb{R}$ and its (sub)gradient. Our goal is to find an $\epsilon$-approximate minimum of $f$ starting from a point that is distance at most $R$ from the true minimum. If $f$ is $G$-Lipschitz, then the classic gradient descent algorithm solves this problem with $O((GR/\epsilon)^{2})$ queries. Importantly, the number of queries is independent of the dimension $n$ and gradient descent is optimal in this regard: No deterministic or randomized algorithm can achieve better complexity that is still independent of the dimension $n$. In this paper we reprove the randomized lower bound of $\Omega((GR/\epsilon)^{2})$ using a simpler argument than previous lower bounds. We then show that although the function family used in the lower bound is hard for randomized algorithms, it can be solved using $O(GR/\epsilon)$ quantum queries. We then show an improved lower bound against quantum algorithms using a different set of instances and establish our main result that in general even quantum algorithms need $\Omega((GR/\epsilon)^2)$ queries to solve the problem. Hence there is no quantum speedup over gradient descent for black-box first-order convex optimization without further assumptions on the function family.


title: Ollivier Ricci-flow on weighted graphs

abstract: We study the existence of solutions of Ricci flow equations of Ollivier-Lin-Lu-Yau curvature defined on weighted graphs. Our work is motivated by\cite{NLLG} in which the discrete time Ricci flow algorithm has been applied successfully as a discrete geometric approach in detecting complex networks. Our main result is the existence and uniqueness theorem for solutions to a continuous time normalized Ricci flow. We also display possible solutions to the Ricci flow on path graph and prove the Ricci flow on finite star graph with at least three leaves converges to constant-weighted star.


title: Pro-nilfactors of the space of arithmetic progressions in topological dynamical systems

abstract: For a topological dynamical system $(X, T)$, $l\in\mathbb{N}$ and $x\in X$, let $N_l(X)$ and $L_x^l(X)$ be the orbit closures of the diagonal point $(x,x,\ldots,x)$ ($l $ times) under the actions $\mathcal{G}_{l}$ and $\tau_l $ respectively, where $\mathcal{G}_{l}$ is generated by $T\times T\times \ldots \times T$ ($l $ times) and $\tau_l=T\times T^2\times \ldots \times T^l$. In this paper, we show that for a minimal system $(X,T)$ and $l\in \mathbb{N}$, the maximal $d$-step pro-nilfactor of $(N_l(X),\mathcal{G}_{l})$ is $(N_l(X_d),\mathcal{G}_{l})$, where $\pi_d:X\to X/\mathbf{RP}^{[d]}=X_d,d\in \mathbb{N}$ is the factor map and $\mathbf{RP}^{[d]}$ is the regionally proximal relation of order $d$. Meanwhile, when $(X,T)$ is a minimal nilsystem, we also calculate the pro-nilfactors of $(L_x^l(X),\tau_l)$ for almost every $x$ w.r.t. the Haar measure. In particular, there exists a minimal $2$-step nilsystem $(Y,T)$ and a countable set $\Omega\subset Y$ such that for $y\in Y\backslash \Omega$ the maximal equicontinuous factor of $(L_y^2(Y),\tau_2)$ is not $(L_{\pi_1(y)}^2(Y_{1}),\tau_2)$.


title: Graph Cross Networks with Vertex Infomax Pooling

abstract: We propose a novel graph cross network (GXN) to achieve comprehensive feature learning from multiple scales of a graph. Based on trainable hierarchical representations of a graph, GXN enables the interchange of intermediate features across scales to promote information flow. Two key ingredients of GXN include a novel vertex infomax pooling (VIPool), which creates multiscale graphs in a trainable manner, and a novel feature-crossing layer, enabling feature interchange across scales. The proposed VIPool selects the most informative subset of vertices based on the neural estimation of mutual information between vertex features and neighborhood features. The intuition behind is that a vertex is informative when it can maximally reflect its neighboring information. The proposed feature-crossing layer fuses intermediate features between two scales for mutual enhancement by improving information flow and enriching multiscale features at hidden layers. The cross shape of the feature-crossing layer distinguishes GXN from many other multiscale architectures. Experimental results show that the proposed GXN improves the classification accuracy by 2.12% and 1.15% on average for graph classification and vertex classification, respectively. Based on the same network, the proposed VIPool consistently outperforms other graph-pooling methods.


title: Synchrotron emission and neutral hydrogen in the simulated cosmic web

abstract: We present the first results of a campaign of ENZO cosmological simulations targeting the shocked and the neutral parts of the cosmic web, obtained with Supercomputing facilities provided by the INAF-CINECA agreement.


title: Moduli spaces of fundamental groups of curves in positive characteristic I

abstract: In this series of papers, we investigate a new anabelian phenomenon of curves over algebraically closed fields of positive characteristic. Let $\overline M_{g, n}$ be the moduli space of curves of type $(g, n)$ over $\overline {\mathbb{F}}_p$. We introduce a topological space $\overline \Pi_{g, n}$ which can be determined group-theoretically from admissible fundamental groups of pointed stable curves of type $(g, n)$. By introducing a certain equivalence relation $\sim_{fe}$ on the underlying topological space $|\overline M_{g, n}|$ of $\overline M_{g, n}$, we obtain a topological space $\overline {\mathfrak{M}_{g, n}}:= |\overline {M_{g, n}}|/\sim_{fe}$. Moreover, there is a natural continuous map $\pi_{g,n}^{\rm adm}: \overline {\mathfrak{M}}_{g, n} \rightarrow \overline \Pi_{g, n}.$ Furthermore, we pose a conjecture (=the Homeomorphism Conjecture) which says that $\pi_{g,n}^{\rm adm}$ is a homeomorphism. The Homeomorphism Conjecture generalizes all the conjectures in the theory of anableian geometry of curves over algebraically closed fields of characteristic $p$. One of main results of the present series of papers says that the Homeomorphism Conjecture holds when $\text{dim}(\overline M_{g, n})=1$ (i.e., $(g, n)=(0,4)$ or $(g, n)=(1,1)$). In the present paper, we establish two fundamental tools to analyze the geometric behavior of curves from open continuous homomorphisms of admissible fundamental groups, which play central roles in the theory developed in the series of papers. Moreover, we prove that $\pi_{0,n}^{\rm adm}([q])$ is a closed point of $\overline \Pi_{0,n}$ when $[q]$ is a closed point of $\overline {\mathfrak{M}}_{0, n}$. In particular, we obtain that the Homeomorphism Conjecture holds when $(g, n)=(0, 4)$.


title: Reciprocal-log approximation and planar PDE solvers

abstract: This article is about both approximation theory and the numerical solution of partial differential equations (PDEs). First we introduce the notion of {\em reciprocal-log} or {\em log-lightning approximation} of analytic functions with branch point singularities at points $\{z_k\}$ by functions of the form $g(z) = \sum_k c_k /(\log(z-z_k) - s_k)$, which have $N$ poles potentially distributed along a Riemann surface. We prove that the errors of best reciprocal-log approximations decrease exponentially with respect to $N$ and that exponential or near-exponential convergence (i.e., at a rate $O(\exp(-C N / \log N))$) also holds for near-best approximations with preassigned singularities constructed by linear least-squares fitting on the boundary. We then apply these results to derive a "log-lightning method" for numerical solution of Laplace and related PDEs in two-dimensional domains with corner singularities. The convergence is near-exponential, in contrast to the root-exponential convergence for the original lightning methods based on rational functions.


title: Excited lepton triplet contribution to electroweak observables at one loop level

abstract: In this paper, we present the one-loop radiative corrections to the electroweak precision observable $\Delta \rho$ coming from the $I_W=1$ multiplet excited leptons. We have calculated the couplings of the exotic lepton triplet to the vector bosons and ordinary leptons using effective Lagrangian approach. These couplings are then used to estimate the excited lepton triplet contribution to the $\Delta \rho$ parameter. The mass degenerate excited lepton contribution to $\Delta \rho $ is small and can be neglected. However, if the excited leptons are non-degenerate, their contribution can be large which can result in more stringent constraints on the excited fermion parameter space compared to the constraints from present experimental searches and perturbative unitarity condition.


title: Long-tailed Recognition by Routing Diverse Distribution-Aware Experts

abstract: Natural data are often long-tail distributed over semantic classes. Existing recognition methods tackle this imbalanced classification by placing more emphasis on the tail data, through class re-balancing/re-weighting or ensembling over different data groups, resulting in increased tail accuracies but reduced head accuracies. We take a dynamic view of the training data and provide a principled model bias and variance analysis as the training data fluctuates: Existing long-tail classifiers invariably increase the model variance and the head-tail model bias gap remains large, due to more and larger confusion with hard negatives for the tail. We propose a new long-tailed classifier called RoutIng Diverse Experts (RIDE). It reduces the model variance with multiple experts, reduces the model bias with a distribution-aware diversity loss, reduces the computational cost with a dynamic expert routing module. RIDE outperforms the state-of-the-art by 5% to 7% on CIFAR100-LT, ImageNet-LT and iNaturalist 2018 benchmarks. It is also a universal framework that is applicable to various backbone networks, long-tailed algorithms, and training mechanisms for consistent performance gains. Our code is available at: https://github.com/frank-xwang/RIDE-LongTailRecognition.


title: Painting Outside as Inside: Edge Guided Image Outpainting via Bidirectional Rearrangement with Progressive Step Learning

abstract: Image outpainting is a very intriguing problem as the outside of a given image can be continuously filled by considering as the context of the image. This task has two main challenges. The first is to maintain the spatial consistency in contents of generated regions and the original input. The second is to generate a high-quality large image with a small amount of adjacent information. Conventional image outpainting methods generate inconsistent, blurry, and repeated pixels. To alleviate the difficulty of an outpainting problem, we propose a novel image outpainting method using bidirectional boundary region rearrangement. We rearrange the image to benefit from the image inpainting task by reflecting more directional information. The bidirectional boundary region rearrangement enables the generation of the missing region using bidirectional information similar to that of the image inpainting task, thereby generating the higher quality than the conventional methods using unidirectional information. Moreover, we use the edge map generator that considers images as original input with structural information and hallucinates the edges of unknown regions to generate the image. Our proposed method is compared with other state-of-the-art outpainting and inpainting methods both qualitatively and quantitatively. We further compared and evaluated them using BRISQUE, one of the No-Reference image quality assessment (IQA) metrics, to evaluate the naturalness of the output. The experimental results demonstrate that our method outperforms other methods and generates new images with 360{\deg}panoramic characteristics.


title: Systolic inequalities, Ginzburg dg algebras and Milnor fibers

abstract: We prove categorical systolic inequalities for the derived categories of 2-Calabi--Yau Ginzburg dg algebras associated to ADE quivers and explore their symplecto-geometric aspects.


title: Quantum coherence and spin nematic to nematic quantum phase transitions in biquadratic spin-1 and -2 XY chains with rhombic single-ion anisotropy

abstract: We investigate quantum phase transitions and quantum coherence in infinite biquadratic spin-1 and -2 XY chains with rhombic single-ion anisotropy. All considered coherence measures such as the $l_1$ norm of coherence, the relative entropy of coherence, and the quantum Jensen-Shannon divergence, and the quantum mutual information show consistently that singular behaviors occur for the spin-1 system, which enables to identity quantum phase transitions. For the spin-2 system, the relative entropy of coherence and the quantum mutual information properly detect no singular behavior in the whole system parameter range, while the $l_1$ norm of coherence and the quantum Jensen-Shannon divergence show a conflicting singular behavior of their first-order derivatives. Examining local magnetic moments and spin quadrupole moments lead to the explicit identification of novel orderings of spin quadrupole moments with zero magnetic moments in the whole parameter space. We find the three uniaxial spin nematic quadrupole phases for the spin-1 system and the two biaxial spin nematic phases for the spin-2 system. For the spin-2 system, the two orthogonal biaxial spin nematic states are connected adiabatically without an explicit phase transition, which can be called quantum crossover. The quantum crossover region is estimated by using the quantum fidelity. Whereas for the spin-1 system, the two discontinuous quantum phase transitions occur between three distinct uniaxial spin nematic phases. We discuss the quantum coherence measures and the quantum mutual information in connection with the quantum phase transitions including the quantum crossover.


title: Experimental validation of differential evolution indicators for ultrasonic imaging in unknown backgrounds

abstract: The differential evolution indicators, recently introduced for imaging mechanical evolution in highly scattering solids, is examined in a laboratory setting with the focus on spatiotemporal tracking of an advancing damage zone in an elastic specimen. To this end, a prismatic slab of charcoal granite is quasi-statically fractured in the three-point-bending (3PB) configuration, while ultrasonic shear waves are periodically generated in the sample at certain time steps $t_\kappa$, $\kappa = \circ, 1, 2, ..., 4$. The interaction of probing waves with the propagating damage give rise to transient velocity responses measured on the plate's boundary by a 3D scanning laser Doppler vibrometer. Thus obtained sensory data are then carefully processed to retrieve the associated spectra of scattered displacement fields $v^\kappa$ at every $t_\kappa$. On deploying consecutive pairs of multi-frequency data $(v^\kappa, v^{\kappa+1})$, the differential indicators are computed exposing the progress of 3PB-induced damage in the specimen. Verified with in-situ observations, each indicator map successfully reconstructs (a) the support of newborn fractures, and (b) the loci of discontinuities in the process zone that undergo interfacial evolution in the designated timeframe $[t_\kappa \,\,\, t_{\kappa+1}]$. Further, it is shown that the evolution indicators help better understand the damage mechanism e.g., by shining light on the fragmented nature of induced cracks and their coalescence. For completeness, data inversion via reduced and partial-aperture data is investigated, including the one-sided reconstruction.


title: Observation of contact angle hysteresis due to inhomogeneous electric fields

abstract: Static contact angle hysteresis (CAH) is widely attributed to surface roughness and chemical contamination. In the latter case, chemical defects create free-energy barriers that prevent the contact line motion. Electrowetting studies have demonstrated the similar ability of electric fields to alter the surface free-energy landscape. Yet, the increase of apparent static CAH by electric fields remains unseen. Here, we report the observation and theoretical analysis of electrowetting hysteresis. This phenomenon enables the continuous and dynamic control of CAH, not only for fundamental studies but also to manufacture sticky-on-demand surfaces for sample collection.


title: High-resolution Piano Transcription with Pedals by Regressing Onset and Offset Times

abstract: Automatic music transcription (AMT) is the task of transcribing audio recordings into symbolic representations. Recently, neural network-based methods have been applied to AMT, and have achieved state-of-the-art results. However, many previous systems only detect the onset and offset of notes frame-wise, so the transcription resolution is limited to the frame hop size. There is a lack of research on using different strategies to encode onset and offset targets for training. In addition, previous AMT systems are sensitive to the misaligned onset and offset labels of audio recordings. Furthermore, there are limited researches on sustain pedal transcription on large-scale datasets. In this article, we propose a high-resolution AMT system trained by regressing precise onset and offset times of piano notes. At inference, we propose an algorithm to analytically calculate the precise onset and offset times of piano notes and pedal events. We show that our AMT system is robust to the misaligned onset and offset labels compared to previous systems. Our proposed system achieves an onset F1 of 96.72% on the MAESTRO dataset, outperforming previous onsets and frames system of 94.80%. Our system achieves a pedal onset F1 score of 91.86\%, which is the first benchmark result on the MAESTRO dataset. We have released the source code and checkpoints of our work at https://github.com/bytedance/piano_transcription.


title: NaInX2 (X = S, Se) layered materials for energy harvesting applications: First-principles insights into optoelectronic and thermoelectric properties

abstract: In the present study, the structural, electronic, optical and thermoelectric properties of two isostructural chalcogenide materials, NaInS2 and NaInSe2 with hexagonal symmetry (R-3m) have been studied using the first principles method. A very good agreement has been found between our results with the available experimental and theoretical ones. The studied materials are semiconducting in nature as confirmed from the electronic band structure and optical properties.The strong hybridizations among s orbitals of Na, In and Se atoms push the bottom of the conduction band downward resulting in a narrower band gap of NaInSe2 compared to that of NaInS2 compound. Different optical (dielectric function, photoconductivity, absorption coefficient, reflectivity, refractive index and loss function) and thermoelectric (Seebeck coefficient, electrical conductivity, power factor and thermal conductivity) properties of NaInX2 (X = S, Se) have been studied in detail for the first time. It is found that all these properties are significantly anisotropic due to the strongly layered structure of NaInX2 (X = S, Se). Strong optical absorption with sharp peaks is found in the far visible to mid ultraviolet (UV) regions while the reflectivity is low in the UV region for both the compounds. Such features indicate feasibility of applications in optoelectronic sector.The calculated thermoelectric power factors at 1000 K for NaInS2 and NaInSe2 along a-axis are found to be 151.5 micro Watt /cmK2 and 154 micro Watt/cmK2, respectively and the corresponding ZT values are ~0.70. The obtained thermal conductivity along a-axis for both compounds is high (~22 W/mK).This suggests that the reduction of such high thermal conductivity is important to achieve higher ZT values of the NaInX2(X = S, Se) compounds.


title: Off-the-grid data-driven optimization of sampling schemes in MRI

abstract: We propose a novel learning based algorithm to generate efficient and physically plausible sampling patterns in MRI. This method has a few advantages compared to recent learning based approaches: i) it works off-the-grid and ii) allows to handle arbitrary physical constraints. These two features allow for much more versatility in the sampling patterns that can take advantage of all the degrees of freedom offered by an MRI scanner. The method consists in a high dimensional optimization of a cost function defined implicitly by an algorithm. We propose various numerical tools to address this numerical challenge.


title: An Efficient Algorithm for Cooperative Semi-Bandits

abstract: We consider the problem of asynchronous online combinatorial optimization on a network of communicating agents. At each time step, some of the agents are stochastically activated, requested to make a prediction, and the system pays the corresponding loss. Then, neighbors of active agents receive semi-bandit feedback and exchange some succinct local information. The goal is to minimize the network regret, defined as the difference between the cumulative loss of the predictions of active agents and that of the best action in hindsight, selected from a combinatorial decision set. The main challenge in such a context is to control the computational complexity of the resulting algorithm while retaining minimax optimal regret guarantees. We introduce Coop-FTPL, a cooperative version of the well-known Follow The Perturbed Leader algorithm, that implements a new loss estimation procedure generalizing the Geometric Resampling of Neu and Bart{\'o}k [2013] to our setting. Assuming that the elements of the decision set are k-dimensional binary vectors with at most m non-zero entries and $\alpha$ 1 is the independence number of the network, we show that the expected regret of our algorithm after T time steps is of order Q mkT log(k)(k$\alpha$ 1 /Q + m), where Q is the total activation probability mass. Furthermore, we prove that this is only $\sqrt$ k log k-away from the best achievable rate and that Coop-FTPL has a state-of-the-art T 3/2 worst-case computational complexity.


abstract: Variational auto-encoders (VAEs) are an influential and generally-used class of likelihood-based generative models in unsupervised learning. The likelihood-based generative models have been reported to be highly robust to the out-of-distribution (OOD) inputs and can be a detector by assuming that the model assigns higher likelihoods to the samples from the in-distribution (ID) dataset than an OOD dataset. However, recent works reported a phenomenon that VAE recognizes some OOD samples as ID by assigning a higher likelihood to the OOD inputs compared to the one from ID. In this work, we introduce a new model, namely Bigeminal Priors Variational auto-encoder (BPVAE), to address this phenomenon. The BPVAE aims to enhance the robustness of the VAEs by combing the power of VAE with the two independent priors that belong to the training dataset and simple dataset, which complexity is lower than the training dataset, respectively. BPVAE learns two datasets'features, assigning a higher likelihood for the training dataset than the simple dataset. In this way, we can use BPVAE's density estimate for detecting the OOD samples. Quantitative experimental results suggest that our model has better generalization capability and stronger robustness than the standard VAEs, proving the effectiveness of the proposed approach of hybrid learning by collaborative priors. Overall, this work paves a new avenue to potentially overcome the OOD problem via multiple latent priors modeling.