title: HGC: Hierarchical Group Convolution for Highly Efficient Neural Network

abstract: Group convolution works well with many deep convolutional neural networks (CNNs) that can effectively compress the model by reducing the number of parameters and computational cost. Using this operation, feature maps of different group cannot communicate, which restricts their representation capability. To address this issue, in this work, we propose a novel operation named Hierarchical Group Convolution (HGC) for creating computationally efficient neural networks. Different from standard group convolution which blocks the inter-group information exchange and induces the severe performance degradation, HGC can hierarchically fuse the feature maps from each group and leverage the inter-group information effectively. Taking advantage of the proposed method, we introduce a family of compact networks called HGCNets. Compared to networks using standard group convolution, HGCNets have a huge improvement in accuracy at the same model size and complexity level. Extensive experimental results on the CIFAR dataset demonstrate that HGCNets obtain significant reduction of parameters and computational cost to achieve comparable performance over the prior CNN architectures designed for mobile devices such as MobileNet and ShuffleNet.


title: Prokhorov-like conditions for weak compactness of sets of bounded Radon measures on different topological spaces

abstract: The paper presents some weak compactness criterion for a subset $M$ of the set $\mathfrak{RM}_b(T,\mathcal{G})$ of all positive bounded Radon measures on a Hausdorff topological space $(T,\mathcal{G})$ similar to the Prokhorov criterion for a complete separable metric space. Since for a general topological space the classical space $C_b(T,\mathcal{G})$ of all bounded continuous functions on $T$ can be trivial and so does not separate points and closed sets, instead of $C_b(T,\mathcal{G})$-weak compactness we consider $S(T,\mathcal{G})$-weak compactness with respect to the new uniformly closed linear space $S(T,\mathcal{G})$ of all (symmetrizable) metasemicontinuous functions.


title: Spin dynamics and unconventional magnetism in insulating La$_{(1-2x)}$Sr$_{2x}$Co$_{(1-x)}$Nb$_{x}$O$_3$

abstract: We study the structural, magnetic, transport and electronic properties of LaCoO$_3$ with Sr/Nb co-substitution, i.e., La$_{(1-2x)}$Sr$_{2x}$Co$_{(1-x)}$Nb$_{x}$O$_3$ using x-ray and neutron diffraction, dc and ac-magnetization, neutron depolarization, dc-resistivity and photoemission measurements. The powder x-ray and neutron diffraction data were fitted well with the rhombohedral crystal symmetry (space group \textit{R$\bar{3}$c}) in Rietveld refinement analysis. The calculated effective magnetic moment ($\approx$3.85~$\mu_B$) and average spin ($\approx$1.5) of Co ions from the analysis of magnetic susceptibility data are consistent with 3+ state of Co ions in intermediate-spin (IS) and high-spin (HS) states in the ratio of $\approx$50:50, i.e., spin-state of Co$^{3+}$ is preserved at least up to $x=$ 0.1 sample. Interestingly, the magnetization values were significantly increased with respect to the $x=$ 0 sample, and the M-H curves show non-saturated behavior up to an applied maximum magnetic field of $\pm$70 kOe. The ac-susceptibility data show a shift in the freezing temperature with excitation frequency and the detailed analysis confirm the slower dynamics and a non-zero value of the Vogel-Fulcher temperature T$_0$, which suggests for the cluster spin glass. The unusual magnetic behavior indicates the presence of complex magnetic interactions at low temperatures. The dc-resistivity measurements show the insulating nature in all the samples. However, relatively large density of states $\approx$10$^{22}$ eV$^{-1}$cm$^{-3}$ and low activation energy $\approx$130~meV are found in $x=$ 0.05 sample. Using x-ray photoemission spectroscopy, we study the core-level spectra of La 3$d$, Co 2$p$, Sr 3$d$, and Nb 3$d$ to confirm the valence state.


title: Critical phenomena in the temperature-pressure-crowding phase diagram of a protein

abstract: In the cell, proteins fold and perform complex functions through global structural rearrangements. Function requires a protein to be at the brink of stability to be susceptible to small environmental fluctuations, yet stable enough to maintain structural integrity. These apparently conflicting behaviors are exhibited by systems near a critical point, where distinct phases merge $-$ a concept beyond previous studies indicating proteins have a well-defined folded/unfolded phase boundary in the pressure-temperature plane. Here, by modeling the protein phosphoglycerate kinase (PGK) on the temperature (T), pressure (P), and crowding volume-fraction ($\phi$) phase diagram, we demonstrate a critical transition where phases merge, and PGK exhibits large structural fluctuations. Above the critical temperature (Tc), the difference between the intermediate and unfolded phases disappears. When $\phi$ increases, the Tc moves to a lower T. We verify the calculations with experiments mapping the T-P-$\phi$ space, which likewise reveal a critical point at 305 K and 170 MPa that moves to a lower T as $\phi$ increases. Crowding places PGK near a critical line in its natural parameter space, where large conformational changes can occur without costly free energy barriers. Specific structures are proposed for each phase based on simulation.


title: Graph Independence Testing

abstract: Identifying statistically significant dependency between variables is a key step in scientific discoveries. Many recent methods, such as distance and kernel tests, have been proposed for valid and consistent independence testing and can be applied to data in Euclidean and non-Euclidean spaces. However, in those works, $n$ pairs of points in $\mathcal{X} \times \mathcal{Y}$ are observed. Here, we consider the setting where a pair of $n \times n$ graphs are observed, and the corresponding adjacency matrices are treated as kernel matrices. Under a $\rho$-correlated stochastic block model, we demonstrate that a na\"ive test (permutation and Pearson's) for a conditional dependency graph model is invalid. Instead, we propose a block-permutation procedure. We prove that our procedure is valid and consistent -- even when the two graphs have different marginal distributions, are weighted or unweighted, and the latent vertex assignments are unknown -- and provide sufficient conditions for the tests to estimate $\rho$. Simulations corroborate these results on both binary and weighted graphs. Applying these tests to the whole-organism, single-cell-resolution structural connectomes of C. elegans, we identify strong statistical dependency between the chemical synapse connectome and the gap junction connectome.


title: The key to the weak-ties phenomenon

abstract: The study of the weak-ties phenomenon has a long and well documented history, research into the application of this social phenomenon has recently attracted increasing attention. However, further exploration of the reasons behind the weak-ties phenomenon is still challenging. Fortunately, data-driven network science provides a novel way with substantial explanatory power to analyze the causal mechanism behind social phenomenon. Inspired by this perspective, we propose an approach to further explore the driving factors behind the temporal weak-ties phenomenon. We find that the obvious intuition underlying the weak-ties phenomenon is incorrect, and often large numbers of unknown mutual friends associated with these weak ties is one of the key reason for the emergence of the weak-ties phenomenon. In particular, for example scientific collaborators with weak ties prefer to be involved in direct collaboration rather than share ideas with mutual colleagues -- there is a natural tendency to collapse short strong chains of connection.


title: Physics-Informed Probabilistic Learning of Linear Embeddings of Non-linear Dynamics With Guaranteed Stability

abstract: The Koopman operator has emerged as a powerful tool for the analysis of nonlinear dynamical systems as it provides coordinate transformations to globally linearize the dynamics. While recent deep learning approaches have been useful in extracting the Koopman operator from a data-driven perspective, several challenges remain. In this work, we formalize the problem of learning the continuous-time Koopman operator with deep neural networks in a measure-theoretic framework. Our approach induces two types of models: differential and recurrent form, the choice of which depends on the availability of the governing equations and data. We then enforce a structural parameterization that renders the realization of the Koopman operator provably stable. A new autoencoder architecture is constructed, such that only the residual of the dynamic mode decomposition is learned. Finally, we employ mean-field variational inference (MFVI) on the aforementioned framework in a hierarchical Bayesian setting to quantify uncertainties in the characterization and prediction of the dynamics of observables. The framework is evaluated on a simple polynomial system, the Duffing oscillator, and an unstable cylinder wake flow with noisy measurements.


title: New solutions for graphene with scalar potentials by means of generalized intertwining

abstract: The intertwining relations between superpartner Hamiltonians are the main ingredients of well known Supersymmetrical Quantum Mechanics (SUSY QM). In the present paper, the generalized form of intertwining is used for investigation of a massless (zero energy) two-dimensional Dirac equation with scalar external potential. This equation is related to the description of graphene and some other materials in the field of external electrostatic potential. The use of modified intertwining relations allows to find analytically solutions for the wave functions in the field of some external scalar potentials which depend on both space coordinates. A few examples of this construction are given explicitly.


title: Magnetotransport in a perturbed periodic antidot superlattice

abstract: We study a 2-dimensional model for an antidot periodic superlattice with perturbed positions of the antidots. To do so we use a quasiperiodic LG model obtained from a 3-dimensional billiard model. Our results show that infinite drifting trajectories present in the periodic antidot models disappear, but if the perturbation is small enough, those trajectories remain for long times. The probability to visit the region of the phase space where electrons have ballistic behavior tends to $0$ as the length of the drifting trajectories tends to infinity, leading to separation of these regions in phase space. As a result, we infer that the particles follow Levy walks and the system has superdiffusive behavior for short times. The superdiffusive exponent is correlated to the length of time where the superdiffusive behavior is present.


title: Study of the pseudoscalar glueball in $J/\psi$ radiative decays

abstract: We aim to explore the production rate of the pseudoscalar glueball in $J/\psi$ radiative decay by lattice QCD in quenched approximation. The calculation is performed on three anisotropic lattices with the spatial lattice spacing ranging from 0.222(2) fm to 0.110(1) fm. As a calibration of some systematical uncertainties, we first extract the $M1$ form factor $\hat{V}(0)$ of the process $J/\psi\to\gamma\eta_{c}$ and get the result $\hat{V}(0)=1.933(41)$ in the continuum limit, which gives the partial width $\Gamma(J/\psi\to\gamma\eta_{c})=2.47(11)$ keV. These results are in agreement with that of previous lattice studies. As for the pseudoscalar glueball $G_{0^{-+}}$, its mass is derived to be $2.395(14)$ GeV, and the form factor $\hat{V}(0)$ of the process $J/\psi\to\gamma G_{0^{-+}}$ is determined to be $\hat{V}(0)=0.0246(43)$ after continuum extrapolation. Finally, the production rate of the pseudoscalar glueball is predicted to be $2.31(90)\times10^{-4}$, which is much smaller than that of conventional light $q\bar{q}$ $\eta$ states. After the subtraction of the phase space factor, the couplings of $J/\psi X\gamma$ are similar where $X$ stands for $\eta$ states and the pseudoscalar glueball. Possibly, the $U_{A}(1)$ anomaly plays an important role for the large couplings of gluons to the flavor singlet $\eta$ states in $J/\psi$ radiative decays.


title: Understanding overfitting peaks in generalization error: Analytical risk curves for $l_2$ and $l_1$ penalized interpolation

abstract: Traditionally in regression one minimizes the number of fitting parameters or uses smoothing/regularization to trade training (TE) and generalization error (GE). Driving TE to zero by increasing fitting degrees of freedom (dof) is expected to increase GE. However modern big-data approaches, including deep nets, seem to over-parametrize and send TE to zero (data interpolation) without impacting GE. Overparametrization has the benefit that global minima of the empirical loss function proliferate and become easier to find. These phenomena have drawn theoretical attention. Regression and classification algorithms have been shown that interpolate data but also generalize optimally. An interesting related phenomenon has been noted: the existence of non-monotonic risk curves, with a peak in GE with increasing dof. It was suggested that this peak separates a classical regime from a modern regime where over-parametrization improves performance. Similar over-fitting peaks were reported previously (statistical physics approach to learning) and attributed to increased fitting model flexibility. We introduce a generative and fitting model pair ("Misparametrized Sparse Regression" or MiSpaR) and show that the overfitting peak can be dissociated from the point at which the fitting function gains enough dof's to match the data generative model and thus provides good generalization. This complicates the interpretation of overfitting peaks as separating a "classical" from a "modern" regime. Data interpolation itself cannot guarantee good generalization: we need to study the interpolation with different penalty terms. We present analytical formulae for GE curves for MiSpaR with $l_2$ and $l_1$ penalties, in the interpolating limit $\lambda\rightarrow 0$.These risk curves exhibit important differences and help elucidate the underlying phenomena.


title: Non-boundedness of the number of super level domains of eigenfunctions

abstract: Generalizing Courant's nodal domain theorem, the "Extended Courant property" is the statement that a linear combination of the first $n$ eigenfunctions has at most $n$ nodal domains. A related question is to estimate the number of connected components of the (super) level sets of a Neumann eigenfunction $u$. Indeed, in this case, the first eigenfunction is constant, and looking at the level sets of $u$ amounts to looking at the nodal sets $\{u-a=0\}$, where $a$ is a real constant. In the first part of the paper, we prove that the Extended Courant property is false for the subequilateral triangle and for regular $N$-gons ($N$ large), with the Neumann boundary condition. More precisely, we prove that there exists a Neumann eigenfunction $u_k$ of the $N$-gon, with labelling $k$, $4 \le k \le 6$, such that the set $\{u_k \not = 1\}$ has $(N+1)$ connected components. In the second part, we prove that there exists a metric $g$ on $\mathbb{T}^2$ (resp. on $\mathbb{S}^2$), which can be chosen arbitrarily close to the flat metric (resp. round metric), and an eigenfunction $u$ of the associated Laplace-Beltrami operator, such that the set $\{u \not = 1\}$ has infinitely many connected components. In particular the Extended Courant property is false for these closed surfaces. These results are strongly motivated by a recent paper by Buhovsky, Logunov and Sodin. As for the positive direction, in Appendix~B, we prove that the Extended Courant property is true for the isotropic quantum harmonic oscillator in $\mathbb{R}^2$.


title: Eigenstate Thermalization Hypothesis and Approximate Quantum Error Correction

abstract: The eigenstate thermalization hypothesis (ETH) is a powerful conjecture for understanding how statistical mechanics emerges in a large class of many-body quantum systems. It has also been interpreted in a CFT context, and, in particular, holographic CFTs are expected to satisfy ETH. Recently, it was observed that the ETH condition corresponds to a necessary and sufficient condition for an approximate quantum error correcting code (AQECC), implying the presence of AQECCs in systems satisfying ETH. In this paper, we explore the properties of ETH as an error correcting code and show that there exists an explicit universal recovery channel for the code. Based on the analysis, we discuss a generalization that all chaotic theories contain error correcting codes. We then specialize to AdS/CFT to demonstrate the possibility of total bulk reconstruction in black holes with a well-defined macroscopic geometry. When combined with the existing AdS/CFT error correction story, this shows that black holes are enormously robust against erasure errors.


title: Signatures of relic quantum nonequilibrium

abstract: [Shortened Abstract:] This thesis explores the possibility that quantum probabilities arose thermodynamically. A chief concern is the detection of primordial `quantum nonequilibrium', since this is observably distinct from textbook quantum physics. Chapters 2, 3, 4, and 5 are adaptations of references [1,2,3], and [4] respectively. Chapter 2 proposes (information) entropy conservation as a minimal requirement for a theory to feature classical-style thermodynamic relaxation. The resulting structure is dubbed `the iRelax framework'. Both classical mechanics and de Broglie-Bohm quantum theory are shown to be special cases. Indications for a possible extension or unification of de Broglie-Bohm theory are briefly highlighted. Chapter 3 examines ways in which quantum relaxation may be prevented. The method of the drift-field is introduced. A systematic treatment of nodes is given. A category of quantum states is found for which relaxation is significantly impeded, and may not complete at all. Chapters 4 and 5 consider the possibility that primordial quantum nonequilibrium may be conserved in the statistics of a species of relic cosmological particle. Necessary factors for this to be the case are discussed and illustrative scenarios are given both in terms of nonequilibrium particles created by inflaton decay, as well as relic vacuum modes for species that decoupled close to the Planck temperature. The search for so-called `smoking-gun' spectral lines created by dark matter decay or annihilation is argued to be a particularly promising setting for the detection of quantum nonequilibrium. Unintuitive spectral effects relating to the contextuality of quantum measurements are described. If such a suspected source of quantum nonequilibrium were found, its subjection to a specifically quantum mechanical test would confirm or deny the presence of the quantum nonequilibrium conclusively.


title: Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Bounds

abstract: We design a new algorithm for batch active learning with deep neural network models. Our algorithm, Batch Active learning by Diverse Gradient Embeddings (BADGE), samples groups of points that are disparate and high-magnitude when represented in a hallucinated gradient space, a strategy designed to incorporate both predictive uncertainty and sample diversity into every selected batch. Crucially, BADGE trades off between diversity and uncertainty without requiring any hand-tuned hyperparameters. We show that while other approaches sometimes succeed for particular batch sizes or architectures, BADGE consistently performs as well or better, making it a versatile option for practical active learning problems.


title: Question Answering as Global Reasoning over Semantic Abstractions

abstract: We propose a novel method for exploiting the semantic structure of text to answer multiple-choice questions. The approach is especially suitable for domains that require reasoning over a diverse set of linguistic constructs but have limited training data. To address these challenges, we present the first system, to the best of our knowledge, that reasons over a wide range of semantic abstractions of the text, which are derived using off-the-shelf, general-purpose, pre-trained natural language modules such as semantic role labelers, coreference resolvers, and dependency parsers. Representing multiple abstractions as a family of graphs, we translate question answering (QA) into a search for an optimal subgraph that satisfies certain global and local properties. This formulation generalizes several prior structured QA systems. Our system, SEMANTICILP, demonstrates strong performance on two domains simultaneously. In particular, on a collection of challenging science QA datasets, it outperforms various state-of-the-art approaches, including neural models, broad coverage information retrieval, and specialized techniques using structured knowledge bases, by 2%-6%.


title: The ssos Pipeline: Identification of Solar System Objects in Astronomical Images

abstract: Observatories and satellites around the globe produce tremendous amounts of imaging data to study many different astrophysical phenomena. The serendipitous observations of Solar System objects are a fortunate by-product which have often been neglected due to the lack of a simple yet efficient identification algorithm. Meanwhile, the determination of the orbit, chemical composition, and physical properties such as rotation period and 3D-shape of Solar System objects requires a large number of astrometry and multi-band photometry observations. Such observations are hidden in current and future astrophysical archives, and a method to harvest these goldmines is needed. This article presents an easy-to-implement, light-weight software package which detects bodies of the Solar System in astronomical images and measures their astrometry and photometry. The ssos pipeline is versatile, allowing for application to all kinds of observatory imaging products. The sole principle requirement is that the images observe overlapping areas of the sky within a reasonable time range. Both known and unknown Solar System objects are recovered, from fast-moving near-Earth asteroids to slow objects in the Kuiper belt. The high-level pipeline design and two test applications are described here, highlighting the versatility of the algorithm with both narrow-field pointed and wide-field survey observations. In the first study, 2,828 detections of 204 SSOs are recovered from publicly available images of the GTC OSIRIS Broad Band DR1. The false-positive ratio of SSO detections ranges from 0%-23% depending on the pipeline setup. The second test study utilizes the images of the first data release of J-PLUS, a 12-band optical survey. 4,606 SSO candidates are recovered, with a false-positive ratio of (2.0 +- 0.2)%.


title: Attention-based Conditioning Methods for External Knowledge Integration

abstract: In this paper, we present a novel approach for incorporating external knowledge in Recurrent Neural Networks (RNNs). We propose the integration of lexicon features into the self-attention mechanism of RNN-based architectures. This form of conditioning on the attention distribution, enforces the contribution of the most salient words for the task at hand. We introduce three methods, namely attentional concatenation, feature-based gating and affine transformation. Experiments on six benchmark datasets show the effectiveness of our methods. Attentional feature-based gating yields consistent performance improvement across tasks. Our approach is implemented as a simple add-on module for RNN-based models with minimal computational overhead and can be adapted to any deep neural architecture.


title: Pfaffian formalism for higher-order topological insulators

abstract: We generalize the Pfaffian formalism, which has been playing an important role in the study of time-reversal invariant topological insulators (TIs), to 3D chiral higher-order topological insulators (HOTIs) protected by the product of four-fold rotational symmetry $C_4$ and the time-reversal symmetry $T$. This Pfaffian description reveals a deep and fundamental link between TIs and HOTIs, and allows important conclusions about TIs to be generalized to HOTIs. As examples, we demonstrate in the Letter how to generalize Fu-Kane's parity criterion for TIs to HOTIs, and also present a general method to efficiently compute the $Z_2$ index of 3D chiral HOTIs without a global gauge.


title: The Packed Interval Covering Problem is NP-complete

abstract: We introduce a new decision problem, called Packed Interval Covering (PIC) and show that it is NP-complete.


title: Happy Together: Learning and Understanding Appraisal From Natural Language

abstract: In this paper, we explore various approaches for learning two types of appraisal components from happy language. We focus on 'agency' of the author and the 'sociality' involved in happy moments based on the HappyDB dataset. We develop models based on deep neural networks for the task, including uni- and bi-directional long short-term memory networks, with and without attention. We also experiment with a number of novel embedding methods, such as embedding from neural machine translation (as in CoVe) and embedding from language models (as in ELMo). We compare our results to those acquired by several traditional machine learning methods. Our best models achieve 87.97% accuracy on agency and 93.13% accuracy on sociality, both of which are significantly higher than our baselines.


title: Active glasses

abstract: Active glassy matter has recently emerged as a novel class of non-equilibrium soft matter, combining energy-driven, active particle movement with dense and disordered glass-like behavior. Here we review the state-of-the-art in this field from an experimental, numerical, and theoretical perspective. We consider both non-living and living active glassy systems, and discuss how several hallmarks of glassy dynamics (dynamical slowdown, fragility, dynamical heterogeneity, violation of the Stokes-Einstein relation, and aging) are manifested in such materials. We start by reviewing the recent experimental evidence in this area of research, followed by an overview of the main numerical simulation studies and physical theories of active glassy matter. We conclude by outlining several open questions and possible directions for future work.


title: Sweeping effect and Taylor's hypothesis via correlation function

abstract: We demonstrate the sweeping effect in turbulence using numerical simulations of hydrodynamic turbulence without a mean velocity. The velocity correlation function, C(k, {\tau} ) decays with time due to the eddy viscosity. In addition, C(k, {\tau} ) shows oscillations due to the sweeping effect by "random mean velocity field" U_0. We also perform numerical simulation with a mean velocity U_0 = 10 for which C(k, {\tau} ) exhibits damped oscillations with the frequency of |U_0|k and decay time scale corresponding to the U_0 = 0 case. For U_0 = 10z, the phase of C(k, {\tau} ) show the sweeping effect, but it is overshadowed by oscillations caused by U_0 . We also demonstrate that for U0 = 0 and 10z, the frequency spectra of the velocity fields measured by real-space probes are respectively f^{-2} and f^{-5/3} these spectra are related to the Lagrangian and Eulerian space-time correlations respectively. respectively.


title: Integrable Fishnet from $\gamma$-Deformed $\mathcal{N}=2$ Quivers

abstract: We introduce bi-fermion fishnet theories, a class of models describing integrable sectors of four-dimensional gauge theories with non-maximal supersymmetry. Bi-fermion theories are characterized by a single complex scalar field and two Weyl fermions interacting only via chiral Yukawa couplings. The latter generate oriented Feynman diagrams forming hexagonal lattices, whose fishnet structure signals an underlying integrability that we exploit to compute anomalous dimensions of BMN-vacuum operators. Furthermore, we investigate Lunin-Maldacena deformations of $\mathcal{N}=2$ superconformal field theories with deformation parameter $\gamma$ and prove that bi-fermion models emerge in the limit of large imaginary $\gamma$ and vanishing 't Hooft coupling $g$, with $g e^{-i \gamma/2}$ fixed. Finally, we explicitly find non-trivial conformal fixed points and compute the scaling dimensions of operators for any $\gamma$ and in presence of double-trace deformations.


title: Experimental Investigation of Crack Jumps during Initiation and Growth in IN718

abstract: The following study investigates the statistical nature of crack jumps during fatigue of Inconel 718. In-situ measurement in atmospheric air of the crack length at several loading and temperature conditions was conducted using a direct current potential drop (DCPD) method. Both annealed and heat-treated Inconel 718 samples were investigated. For a single sample, the normalized change of crack length was confirmed to not be a random process. This finding is significant in highlighting the time history features, which could be used in training machine learning models for the fundamental understanding of oxidation and the prediction of crack initiation and growth.


title: Testing the weak equivalence principle by differential measurements of fundamental constants in the Magellanic Clouds

abstract: Non-standard fields are assumed to be responsible for phenomena attributed to dark energy and dark matter. Being coupled to ordinary matter, these fields modify the masses and/or charges of the elementary particles, thereby violating the Weak Equivalence Principle. Thus, values of fundamental constants such as the proton-to-electron mass ratio, mu, and/or the fine structure constant, alpha, measured in different environment conditions can be used as probes for this coupling. Here we perform differential measurements of F = mu*alpha^2 to test a non-standard coupling in the Magellanic Clouds - dwarf galaxies where the overall mass budget is dominated by dark matter. The analysis is based on [CI] and CO lines observed with the Herschel Space Observatory. Since these lines have different sensitivities to changes in mu and alpha, the combined alpha and mu variations can be evaluated through the radial velocity offsets, Delta V, between the CO and [CI] lines. Averaging over nine positions in the Magellanic Clouds, we obtain <Delta V> = -0.02+/-0.07 km/s, leading to |Delta F/F| < 2*10^-7 (1sigma), where Delta F/F = (F_obs-F_lab)/F_lab}. However, for one position observed with five times higher spectral resolution we find Delta V = -0.05+/-0.02 km/s, resulting in Delta F/F = (-1.7+/-0.7)*10^-7. Whether this offset is due to changes in the fundamental constants, due to chemical segregation in the emitting gas or merely due to Doppler noise requires further investigations.

categories: astro-ph.CO astro-ph.GA gr-qc physics.space-ph


title: An Attention-based Recurrent Convolutional Network for Vehicle Taillight Recognition

abstract: Vehicle taillight recognition is an important application for automated driving, especially for intent prediction of ado vehicles and trajectory planning of the ego vehicle. In this work, we propose an end-to-end deep learning framework to recognize taillights, i.e. rear turn and brake signals, from a sequence of images. The proposed method starts with a Convolutional Neural Network (CNN) to extract spatial features, and then applies a Long Short-Term Memory network (LSTM) to learn temporal dependencies. Furthermore, we integrate attention models in both spatial and temporal domains, where the attention models learn to selectively focus on both spatial and temporal features. Our method is able to outperform the state of the art in terms of accuracy on the UC Merced Vehicle Rear Signal Dataset, demonstrating the effectiveness of attention models for vehicle taillight recognition.


title: Trajectory Optimization for Robust Humanoid Locomotion with Sample-Efficient Learning

abstract: Trajectory optimization (TO) is one of the most powerful tools for generating feasible motions for humanoid robots. However, including uncertainties and stochasticity in the TO problem to generate robust motions can easily lead to an interactable problem. Furthermore, since the models used in the TO have always some level of abstraction, it is hard to find a realistic set of uncertainty in the space of abstract model. In this paper we aim at leveraging a sample-efficient learning technique (Bayesian optimization) to robustify trajectory optimization for humanoid locomotion. The main idea is to use Bayesian optimization to find the optimal set of cost weights which compromises performance with respect to robustness with a few realistic simulation/experiment. The results show that the proposed approach is able to generate robust motions for different set of disturbances and uncertainties.


title: Novelty Detection via Network Saliency in Visual-based Deep Learning

abstract: Machine-learning driven safety-critical autonomous systems, such as self-driving cars, must be able to detect situations where its trained model is not able to make a trustworthy prediction. Often viewed as a black-box, it is non-obvious to determine when a model will make a safe decision and when it will make an erroneous, perhaps life-threatening one. Prior work on novelty detection deal with highly structured data and do not translate well to dynamic, real-world situations. This paper proposes a multi-step framework for the detection of novel scenarios in vision-based autonomous systems by leveraging information learned by the trained prediction model and a new image similarity metric. We demonstrate the efficacy of this method through experiments on a real-world driving dataset as well as on our in-house indoor racing environment.


title: GASP XVII. HI imaging of the jellyfish galaxy JO206: gas stripping and enhanced star formation

abstract: We present VLA HI observations of JO206, a prototypical ram-pressure stripped galaxy in the GASP sample. This massive galaxy (M$_{\ast} =$ 8.5 $\times$ 10$^{10}$ M$_{\odot}$) is located at a redshift of $z =$ 0.0513, near the centre of the low-mass galaxy cluster, IIZw108 ($\sigma \sim575$ km/s). JO206 is characterised by a long tail ($\geq$90 kpc) of ionised gas stripped away by ram-pressure. We find a similarly long HI tail in the same direction as the ionised gas tail and measure a total HI mass of $3.2 \times 10^{9}$ M$_{\odot}$. This is about half the expected HI mass given the stellar mass and surface density of JO206. A total of $1.8 \times 10^{9}$ M$_{\odot}$ (60%) of the detected HI is in the gas stripped tail. An analysis of the star formation rate shows that the galaxy is forming more stars compared to galaxies with the same stellar and HI mass. On average we find a HI gas depletion time of $\sim$0.5 Gyr which is about four times shorter than that of "normal" spiral galaxies. We performed a spatially resolved analysis of the relation between star formation rate density and gas density in the disc and tail of the galaxy at the resolution of our HI data. The star formation efficiency of the disc is about 10 times higher than that of the tail at fixed HI surface densities. Both the inner and outer parts of JO206 show an enhanced star formation compared to regions of similar HI surface density in field galaxies. The enhanced star formation is due to ram-pressure stripping during the galaxy's first infall into the cluster.


title: Decomposition of the tensor product of two Hilbert modules

abstract: Given a pair of positive real numbers $\alpha, \beta$ and a sesqui-analytic function $K$ on a bounded domain $\Omega \subset \mathbb C^m$, in this paper, we investigate the properties of the sesqui-analytic function $\mathbb K^{(\alpha, \beta)}:= K^{\alpha+\beta}\big(\partial_i\bar{\partial}_j\log K\big )_{i,j=1}^ m,$ taking values in $m\times m$ matrices. One of the key findings is that $\mathbb K^{(\alpha, \beta)}$ is non-negative definite whenever $K^\alpha$ and $K^\beta$ are non-negative definite. In this case, a realization of the Hilbert module determined by the kernel $\mathbb K^{(\alpha,\beta)}$ is obtained. Let $\mathcal M_i$, $i=1,2,$ be two Hilbert modules over the polynomial ring $\mathbb C[z_1, \ldots, z_m]$. Then $\mathbb C[z_1, \ldots, z_{2m}]$ acts naturally on the tensor product $\mathcal M_1\otimes \mathcal M_2$. The restriction of this action to the polynomial ring $\mathbb C[z_1, \ldots, z_m]$ obtained using the restriction map $p \mapsto p_{|\Delta}$ leads to a natural decomposition of the tensor product $\mathcal M_1\otimes \mathcal M_2$, which is investigated. Two of the initial pieces in this decomposition are identified.


title: Two quantum particles trapped in three dimensions harmonic oscillator and interacting via finite range soft-core interaction

abstract: We study the exactly solvable quantum system of two particles confined in a three-dimensional harmonic trap and interacting via finite-range soft-core interaction by means of the separation of variables and ansatz method. Supposing the solution in the form of ansatz $\Psi(r)=r^{a}e^{-\lambda r^2} \psi(r)$ we transform the time independent Schr\"{o}dinger equation into Kummer's differential equation whose solution are given in the form of confluent hypergeometric function. We also discuss that in the absence of central force potential, the quantum system map into the problem of two quantum particle trapped in one-dimension harmonic oscillator and interacting through finite distance soft-core potential. In such special case the eigen value equation become the Weber's differential equation and its solution are also given in the form of confluent hypergeometric function.


title: Borders, Palindrome Prefixes, and Square Prefixes

abstract: We show that the number of length-n words over a k-letter alphabet having no even palindromic prefix is the same as the number of length-n unbordered words, by constructing an explicit bijection between the two sets. A slightly different but analogous result holds for those words having no odd palindromic prefix. Using known results on borders, we get an asymptotic enumeration for the number of words having no even (resp., odd) palindromic prefix . We obtain an analogous result for words having no nontrivial palindromic prefix. Finally, we obtain similar results for words having no square prefix, thus proving a 2013 conjecture of Chaffin, Linderman, Sloane, and Wilks.


title: A sensitivity analysis of the long-term expected utility of optimal portfolios

abstract: This paper discusses the sensitivity of the long-term expected utility of optimal portfolios for an investor with constant relative risk aversion. Under an incomplete market given by a factor model, we consider the utility maximization problem with long-time horizon. The main purpose is to find the long-term sensitivity, that is, the extent how much the optimal expected utility is affected in the long run for small changes of the underlying factor model. The factor model induces a specific eigenpair of an operator, and this eigenpair does not only characterize the long-term behavior of the optimal expected utility but also provides an explicit representation of the expected utility on a finite time horizon. We conclude that this eigenpair therefore determines the long-term sensitivity. As examples, explicit results for several market models such as the Kim--Omberg model for stochastic excess returns and the Heston stochastic volatility model are presented.


title: Interpreting Age Effects of Human Fetal Brain from Spontaneous fMRI using Deep 3D Convolutional Neural Networks

abstract: Understanding human fetal neurodevelopment is of great clinical importance as abnormal development is linked to adverse neuropsychiatric outcomes after birth. Recent advances in functional Magnetic Resonance Imaging (fMRI) have provided new insight into development of the human brain before birth, but these studies have predominately focused on brain functional connectivity (i.e. Fisher z-score), which requires manual processing steps for feature extraction from fMRI images. Deep learning approaches (i.e., Convolutional Neural Networks) have achieved remarkable success on learning directly from image data, yet have not been applied on fetal fMRI for understanding fetal neurodevelopment. Here, we bridge this gap by applying a novel application of deep 3D CNN to fetal blood oxygen-level dependence (BOLD) resting-state fMRI data. Specifically, we test a supervised CNN framework as a data-driven approach to isolate variation in fMRI signals that relate to younger v.s. older fetal age groups. Based on the learned CNN, we further perform sensitivity analysis to identify brain regions in which changes in BOLD signal are strongly associated with fetal brain age. The findings demonstrate that deep CNNs are a promising approach for identifying spontaneous functional patterns in fetal brain activity that discriminate age groups. Further, we discovered that regions that most strongly differentiate groups are largely bilateral, share similar distribution in older and younger age groups, and are areas of heightened metabolic activity in early human development.


title: UBC-NLP at SemEval-2019 Task 6:Ensemble Learning of Offensive Content With Enhanced Training Data

abstract: We examine learning offensive content on Twitter with limited, imbalanced data. For the purpose, we investigate the utility of using various data enhancement methods with a host of classical ensemble classifiers. Among the 75 participating teams in SemEval-2019 sub-task B, our system ranks 6th (with 0.706 macro F1-score). For sub-task C, among the 65 participating teams, our system ranks 9th (with 0.587 macro F1-score).


title: Geometric Partial Differential Equations from Unified String Theories

abstract: An informal introduction to some new geometric partial differential equations motivated by string theories is provided. Some of these equations are also interesting from the point of view of non-K\"ahler geometry and the theory of non-linear partial differential equations. In particular, a survey is given of joint works of the author with Teng Fei, Bin Guo, Sebastien Picard, and Xiangwen Zhang.


title: Balanced off-policy evaluation in general action spaces

abstract: Estimation of importance sampling weights for off-policy evaluation of contextual bandits often results in imbalance - a mismatch between the desired and the actual distribution of state-action pairs after weighting. In this work we present balanced off-policy evaluation (B-OPE), a generic method for estimating weights which minimize this imbalance. Estimation of these weights reduces to a binary classification problem regardless of action type. We show that minimizing the risk of the classifier implies minimization of imbalance to the desired counterfactual distribution of state-action pairs. The classifier loss is tied to the error of the off-policy estimate, allowing for easy tuning of hyperparameters. We provide experimental evidence that B-OPE improves weighting-based approaches for offline policy evaluation in both discrete and continuous action spaces.


title: Gendered Pronoun Resolution using BERT and an extractive question answering formulation

abstract: The resolution of ambiguous pronouns is a longstanding challenge in Natural Language Understanding. Recent studies have suggested gender bias among state-of-the-art coreference resolution systems. As an example, Google AI Language team recently released a gender-balanced dataset and showed that performance of these coreference resolvers is significantly limited on the dataset. In this paper, we propose an extractive question answering (QA) formulation of pronoun resolution task that overcomes this limitation and shows much lower gender bias (0.99) on their dataset. This system uses fine-tuned representations from the pre-trained BERT model and outperforms the existing baseline by a significant margin (22.2% absolute improvement in F1 score) without using any hand-engineered features. This QA framework is equally performant even without the knowledge of the candidate antecedents of the pronoun. An ensemble of QA and BERT-based multiple choice and sequence classification models further improves the F1 (23.3% absolute improvement upon the baseline). This ensemble model was submitted to the shared task for the 1st ACL workshop on Gender Bias for Natural Language Processing. It ranked 9th on the final official leaderboard. Source code is available at https://github.com/rakeshchada/corefqa


title: Modeling the light curve of `Oumuamua: evidence for torque and disc-like shape

abstract: We present the first attempt to fit the light curve of the interstellar visitor `Oumuamua using a physical model which includes optional torque. We consider both conventional (Lommel-Seeliger triaxial ellipsoid) and alternative ("black-and-white ball", "solar sail") brightness models. With all the brightness models, some torque is required to explain the timings of the most conspicuous features -- deep minima -- of the asteroid's light curve. Our best-fitting models are a thin disc (aspect ratio 1:6) and a thin cigar (aspect ratio 1:8) which are very close to being axially symmetric. Both models are tumbling and require some torque which has the same amplitude in relation to `Oumuamua's linear non-gravitational acceleration as in Solar System comets which dynamics is affected by outgassing. Assuming random orientation of the angular momentum vector, we compute probabilities for our best-fitting models. We show that cigar-shaped models suffer from a fine-tuning problem and have only 16 per cent probability to produce light curve minima as deep as the ones present in `Oumuamua's light curve. Disc-shaped models, on the other hand, are very likely (at 91 per cent) to produce minima of the required depth. From our analysis, the most likely model for `Oumuamua is a thin disc (slab) experiencing moderate torque from outgassing.


title: Deep Unsupervised Drum Transcription

abstract: We introduce DrummerNet, a drum transcription system that is trained in an unsupervised manner. DrummerNet does not require any ground-truth transcription and, with the data-scalability of deep neural networks, learns from a large unlabeled dataset. In DrummerNet, the target drum signal is first passed to a (trainable) transcriber, then reconstructed in a (fixed) synthesizer according to the transcription estimate. By training the system to minimize the distance between the input and the output audio signals, the transcriber learns to transcribe without ground truth transcription. Our experiment shows that DrummerNet performs favorably compared to many other recent drum transcription systems, both supervised and unsupervised.


title: Essential dimension of double covers of symmetric and alternating groups

abstract: I. Schur studied double covers $\widetilde{\Sym}^{\pm}_n$ and $\widetilde{\Alt}_n$ of symmetric groups $\Sym_n$ and alternating groups $\Alt_n$, respectively. Representations of these groups are closely related to projective representations of $\Sym_n$ and $\Alt_n$; there is also a close relationship between these groups and spinor groups. We study the essential dimension $\ed(\widetilde{\Sym}^{\pm}_n)$ and $\ed(\widetilde{\Alt}_n)$. We show that over a base field of characteristic $\neq 2$, $\ed(\widetilde{\Sym}^{\pm}_n)$ and $\ed(\widetilde{\Alt}_n)$ grow exponentially with $n$, similar to $\ed(\Spin_n)$. On the other case, in characteristic $2$, they grow sublinearly, similar to $\ed(\Sym_n)$ and $\ed(\Alt_n)$. We give an application of our result in good characteristic to the theory of trace forms.


title: Fully quantum embedding with density functional theory for full configuration interaction quantum Monte Carlo

abstract: In common with many high-accuracy electronic structure methods, the initiator adaptation of full configuration interaction quantum Monte Carlo (i-FCIQMC) has difficulty treating realistic systems with large numbers of electrons. This barrier has prevented the application of i-FCIQMC to questions of catalysis that, even for the simplest of models, require high-accuracy modeling of several features of the electronic structure, such as strong and dynamic correlation, and localized vs. delocalized bonding. We here present a fully-quantum embedded version of i-FCIQMC , which we apply to calculate the bond dissociation energy of an ionic bond (LiH) and a covalent bond (HF) physisorbed to a benzene molecule. The embedding is performed using a recently-developed Huzinaga projection operator approach, which affords good synergy with i-FCIQMC by minimizing the number of orbitals in the calculation. We find that, without embedding, i-FCIQMC struggles to converge these calculations due to their substantial system sizes and a lack of error cancellation between reactants and products. With embedding, the i-FCIQMC calculation converges straightforwardly to CCSD(T) benchmarks. Our results suggest that embedded i-FCIQMC will be able treat system sizes well beyond our current reach (even though embedding introduces an error). We discuss how embedding might be improved (and thus the introduced error reduced) using i-FCIQMC energies as benchmarks.


title: Solving general elliptical mixture models through an approximate Wasserstein manifold

abstract: We address the estimation problem for general finite mixture models, with a particular focus on the elliptical mixture models (EMMs). Compared to the widely adopted Kullback-Leibler divergence, we show that the Wasserstein distance provides a more desirable optimisation space. We thus provide a stable solution to the EMMs that is both robust to initialisations and reaches a superior optimum by adaptively optimising along a manifold of an approximate Wasserstein distance. To this end, we first provide a unifying account of computable and identifiable EMMs, which serves as a basis to rigorously address the underpinning optimisation problem. Due to a probability constraint, solving this problem is extremely cumbersome and unstable, especially under the Wasserstein distance. To relieve this issue, we introduce an efficient optimisation method on a statistical manifold defined under an approximate Wasserstein distance, which allows for explicit metrics and computable operations, thus significantly stabilising and improving the EMM estimation. We further propose an adaptive method to accelerate the convergence. Experimental results demonstrate the excellent performance of the proposed EMM solver.


title: Bounded $H_{\infty}$-calculus for Boundary Value Problems on Manifolds with Conical Singularities

abstract: Realizations of differential operators subject to differential boundary conditions on manifolds with conical singularities are shown to have a bounded $H_{\infty}$-calculus in appropriate $L_{p}$-Sobolev spaces provided suitable conditions of parameter-ellipticity are satisfied. Applications concern the Dirichlet and Neumann Laplacian and the porous medium equation.


title: Driving-assisted open quantum transport in qubit networks

abstract: We determine the characteristic of dissipative quantum transport in a coupled qubit network in the presence of on-site and off-diagonal external driving. The work is motivated by the dephasing-assisted quantum transport where noise is beneficial to the transport efficiency. Using Floquet-Magnus expansion extended to Markovian open systems, we analytically derive transport efficiency and compare it to exact numerical results. We find that driving may increase the efficiency at frequencies near the coupling rate. On the contrary, at some other frequencies the transport may be suppressed. We then propose the enhancement mechanism as the ramification of interplay between driving frequency, dissipative, and trapping rates.


title: Ab initio calculations of p-shell nuclei up to N2LO in chiral Effective Field Theory

abstract: Nuclear structure and reaction theory are undergoing a major renaissance with advances in many-body methods, realistic interactions with greatly improved links to Quantum Chromodynamics, the advent of high performance computing, and improved computational algorithms. State-of-the-art two- and three-nucleon interactions obtained from chiral Effective Field Theory provide a theoretical foundation for nuclear theory with controlled approximations. With highly efficient numerical codes, tuned to the current generation of supercomputers, we can perform ab-initio nuclear structure calculations for a range of nuclei to a remarkable level of numerical accuracy, with quantifiable numerical uncertainties. Here we present an overview of recent results for No-Core Configuration Interaction calculations of p-shell nuclei using these chiral interactions up to next-to-next-to-leading order, including three-body forces. We show the dependence of the ground state energies on the chiral order; we also present excitation spectra for selected nuclei and compare the results with experimental data.


title: SVRG for Policy Evaluation with Fewer Gradient Evaluations

abstract: Stochastic variance-reduced gradient (SVRG) is an optimization method originally designed for tackling machine learning problems with a finite sum structure. SVRG was later shown to work for policy evaluation, a problem in reinforcement learning in which one aims to estimate the value function of a given policy. SVRG makes use of gradient estimates at two scales. At the slower scale, SVRG computes a full gradient over the whole dataset, which could lead to prohibitive computation costs. In this work, we show that two variants of SVRG for policy evaluation could significantly diminish the number of gradient calculations while preserving a linear convergence speed. More importantly, our theoretical result implies that one does not need to use the entire dataset in every epoch of SVRG when it is applied to policy evaluation with linear function approximation. Our experiments demonstrate large computational savings provided by the proposed methods.


title: Representation of integers by sparse binary forms

abstract: We will give new upper bounds for the number of solutions to the inequalities of the shape $|F(x , y)| \leq h$, where $F(x , y)$ is a sparse binary form, with integer coefficients, and $h$ is a sufficiently small integer in terms of the absolute value of the discriminant of the binary form $F$. Our bounds depend on the number of non-vanishing coefficients of $F(x , y)$. When $F$ is really sparse, we establish a sharp upper bound for the number of solutions that is linear in terms of the number of non-vanishing coefficients. This work will provide affirmative answers to a number of conjectures posed by Mueller and Schmidt in 1988, for special but important cases.


title: Single-photon interferometry and spectroscopy with two laser frequency combs

abstract: We demonstrate single-photon time-domain interference in a new realm. We observe interferences in the photon counting statistics with two separate mode-locked femtosecond lasers of slightly different repetition frequencies, each emitting a comb of evenly spaced spectral lines over a wide spectral span. We exploit the interference pattern for spectroscopic diagnostics over a broad spectral range. An experimental proof-of-concept shows that the emerging technique of high-resolution dual-comb Fourier transform spectroscopy can be performed at light powers that are a billion-fold weaker than those commonly employed. Our experiments challenge the intuitive concept that a photon exists before detection and they open the prospect of precise spectroscopy over broad spectral bandwidth in light-starved conditions.

categories: physics.optics physics.atom-ph physics.chem-ph quant-ph


title: Redundancy-Free Computation Graphs for Graph Neural Networks

abstract: Graph Neural Networks (GNNs) are based on repeated aggregations of information across nodes' neighbors in a graph. However, because common neighbors are shared between different nodes, this leads to repeated and inefficient computations. We propose Hierarchically Aggregated computation Graphs (HAGs), a new GNN graph representation that explicitly avoids redundancy by managing intermediate aggregation results hierarchically, eliminating repeated computations and unnecessary data transfers in GNN training and inference. We introduce an accurate cost function to quantitatively evaluate the runtime performance of different HAGs and use a novel HAG search algorithm to find optimized HAGs. Experiments show that the HAG representation significantly outperforms the standard GNN graph representation by increasing the end-to-end training throughput by up to 2.8x and reducing the aggregations and data transfers in GNN training by up to 6.3x and 5.6x, while maintaining the original model accuracy.


title: Note on the bias and variance of variational inference

abstract: In this note, we study the relationship between the variational gap and the variance of the (log) likelihood ratio. We show that the gap can be upper bounded by some form of dispersion measure of the likelihood ratio, which suggests the bias of variational inference can be reduced by making the distribution of the likelihood ratio more concentrated, such as via averaging and variance reduction.


title: Finitary Boolean functions

abstract: We study functions on the infinite-dimensional Hamming cube $\{-1,1\}^\infty$, in particular Boolean functions into $\{-1,1\}$, generalising results on analysis of Boolean functions on $\{-1,1\}^n$ for $n\in\mathbb{N}$. The notion of noise sensitivity, first studied in arXiv:math/9811157 , is extended to this setting, and basic Fourier formulas are established. We also prove hypercontractivity estimates for these functions, and give a version of the Kahn-Kalai-Linial theorem giving a bound relating the total influence to the maximal influence. Particular attention is paid to so-called finitary functions, which are functions for which there exists an algorithm that almost surely queries only finitely many bits. Two versions of the Benjamini-Kalai-Schramm theorem characterizing noise sensitivity in terms of the sum of squared influences are given, under additional moment hypotheses on the amount of bits looked at by an algorithm. A version of the Kahn-Kalai-Linial theorem giving that the maximal influence is of order $\frac{\log(n)}{n}$ is also given, replacing $n$ with the expected number of bits looked at by an algorithm. Finally, we show that the result in arXiv:math/0504586 that revealments going to zero implies noise sensitivity also holds for finitary functions, and apply this to show noise sensitivity of a version of the voter model on sufficiently sparse graphs.


title: Curiosity-Driven Multi-Criteria Hindsight Experience Replay

abstract: Dealing with sparse rewards is a longstanding challenge in reinforcement learning. The recent use of hindsight methods have achieved success on a variety of sparse-reward tasks, but they fail on complex tasks such as stacking multiple blocks with a robot arm in simulation. Curiosity-driven exploration using the prediction error of a learned dynamics model as an intrinsic reward has been shown to be effective for exploring a number of sparse-reward environments. We present a method that combines hindsight with curiosity-driven exploration and curriculum learning in order to solve the challenging sparse-reward block stacking task. We are the first to stack more than two blocks using only sparse reward without human demonstrations.


title: Aggregation of pairwise comparisons with reduction of biases

abstract: We study the problem of ranking from crowdsourced pairwise comparisons. Answers to pairwise tasks are known to be affected by the position of items on the screen, however, previous models for aggregation of pairwise comparisons do not focus on modeling such kind of biases. We introduce a new aggregation model factorBT for pairwise comparisons, which accounts for certain factors of pairwise tasks that are known to be irrelevant to the result of comparisons but may affect workers' answers due to perceptual reasons. By modeling biases that influence workers, factorBT is able to reduce the effect of biased pairwise comparisons on the resulted ranking. Our empirical studies on real-world data sets showed that factorBT produces more accurate ranking from crowdsourced pairwise comparisons than previously established models.


title: Segregation and Gap Formation in Cross-Diffusion Models

abstract: In this paper we analyse a class of nonlinear cross-diffusion systems for two species with local repulsive interactions that exhibit a formal gradient flow structure with respect to the Wasserstein metric. We show that systems where the population pressure is given by a function of the total population are critical with respect to cross-diffusion perturbations. This criticality is showcased by proving that adding an extra cross-diffusion term that breaks the symmetry of the population pressure in the system leads to completely different behaviours, namely segregation or mixing, depending on the sign of the perturbation. We show these results at the level of the minimisers of the associated free energy functionals. We also analyse certain implications of these results for the gradient flow systems of PDEs associated to these functionals and we present a numerical exploration of the time evolution of these phenomena.


title: Gravity-capillary waves in reduced models for wave-structure interactions

abstract: In order to determine the steady-state subcritical gravity-capillary waves that are produced by potential flow past a wave-making body, it is typically necessary to impose a radiation condition that allows for capillary waves upstream, but disallows those corresponding to gravity. However, this radiation condition is not known a priori and consequently, the computation of accurate numerical solutions to the steady-state problem remains problematic. Although the physical model might be modified (e.g. with viscosity), recovery of the original problem is not always possible. In this work, we discuss the above radiation problem, and show how, in the low-speed limit, the steady gravity-capillary waves can be resolved using a Sommerfeld-type boundary condition applied to an asymptotically reduced set of water-wave equations. These results allow us to validate the specialized classes of low-speed waves theoretically predicted by Trinh & Chapman (2013) using methods in exponential asymptotics [J. Fluid Mech. 724, pp. 392--424]. The issues of numerically solving the full set of gravity-capillary equations for a potential flow are discussed, and the sensitivity to errors in the boundary conditions is clearly demonstrated.


title: Modeling Excess Deaths After a Natural Disaster with Application to Hurricane Maria

abstract: Estimation of excess deaths due to a natural disaster is an important public health problem. The CDC provides guidelines to fill death certificates to help determine the death toll of such events. But, even when followed by medical examiners, the guidelines can not guarantee a precise calculation of excess deaths.%particularly due to the ambiguity of indirect deaths. We propose two models to estimate excess deaths due to an emergency. The first model is simple, permitting excess death estimation with little data through a profile likelihood method. The second model is more flexible, incorporating: temporal variation, covariates, and possible population displacement; while allowing inference on how the emergency's effect changes with time. The models are implemented to build confidence intervals estimating Hurricane Maria's death toll.


title: Fenchel-Nielsen coordinates on the augmented moduli space of anti-de Sitter structures

abstract: In this paper we combine our recent work on regular globally hyperbolic maximal anti-de Sitter structures with the classical theory of globally hyperbolic maximal Cauchy-compact anti-de Sitter manifolds in order to define an augmented moduli space. Moreover, we introduce a coordinate system in this space that resembles the complex Fenchel-Nielsen coordinates for hyperbolic quasi-Fuchsian manifolds.


title: A note on norms of signed sums of vectors

abstract: Our starting point is an improved version of a result of D. Hajela related to a question of Koml\'{o}s: we show that if $f(n)$ is a function such that $\lim\limits_{n\to\infty }f(n)=\infty $ and $f(n)=o(n)$, there exists $n_0=n_0(f)$ such that for every $n\geqslant n_0$ and any $S\subseteq \{-1,1\}^n$ with cardinality $|S|\leqslant 2^{n/f(n)}$ one can find orthonormal vectors $x_1,\ldots ,x_n\in {\mathbb R}^n$ that satisfy $$\|\epsilon_1x_1+\cdots +\epsilon_nx_n\|_{\infty }\geqslant c\sqrt{\log f(n)}$$ for all $(\epsilon_1,\ldots ,\epsilon_n)\in S$. We obtain analogous results in the case where $x_1,\ldots ,x_n$ are independent random points uniformly distributed in the Euclidean unit ball $B_2^n$ or any symmetric convex body, and the $\ell_{\infty }^n$-norm is replaced by an arbitrary norm on ${\mathbb R}^n$.


title: Argument Generation with Retrieval, Planning, and Realization

abstract: Automatic argument generation is an appealing but challenging task. In this paper, we study the specific problem of counter-argument generation, and present a novel framework, CANDELA. It consists of a powerful retrieval system and a novel two-step generation model, where a text planning decoder first decides on the main talking points and a proper language style for each sentence, then a content realization decoder reflects the decisions and constructs an informative paragraph-level argument. Furthermore, our generation model is empowered by a retrieval system indexed with 12 million articles collected from Wikipedia and popular English news media, which provides access to high-quality content with diversity. Automatic evaluation on a large-scale dataset collected from Reddit shows that our model yields significantly higher BLEU, ROUGE, and METEOR scores than the state-of-the-art and non-trivial comparisons. Human evaluation further indicates that our system arguments are more appropriate for refutation and richer in content.


title: Accretion of perfect fluids onto a class of regular black holes

abstract: We consider the stationary spherical accretion process of perfect fluids onto a class of spherically symmetric regular black holes corresponding to quantum-corrected Schwarzschild spacetimes. We show that the accretion rates can differ from the Schwarzschild case, suggesting that the de Sitter core inside these regular black holes, which indeed precludes the central singularity, can act for some cases as a sort of antigravitational source, decreasing the fluid's radial infall velocity in the accretion process, and for others as a gravitational enhancer, increasing the fluid flow into the black hole horizon. Our analysis and results can be extended and also applied to the problem of black hole evaporation in cosmological scenarios with phantom fluids. In particular, we show that the mass of typical regular black holes can be used in order to constrain turnaround events in cyclic cosmologies.


title: Norms of weighted sums of log-concave random vectors

abstract: Let $C$ and $K$ be centrally symmetric convex bodies of volume $1$ in ${\mathbb R}^n$. We provide upper bounds for the multi-integral expression \begin{equation*}\|{\bf t}\|_{C^s,K}=\int_{C}\cdots\int_{C}\Big\|\sum_{j=1}^st_jx_j\Big\|_K\,dx_1\cdots dx_s\end{equation*} in the case where $C$ is isotropic. Our approach provides an alternative proof of the sharp lower bound, due to Gluskin and V. Milman, for this quantity. We also present some applications to "randomized" vector balancing problems.


title: Association of genomic subtypes of lower-grade gliomas with shape features automatically extracted by a deep learning algorithm

abstract: Recent analysis identified distinct genomic subtypes of lower-grade glioma tumors which are associated with shape features. In this study, we propose a fully automatic way to quantify tumor imaging characteristics using deep learning-based segmentation and test whether these characteristics are predictive of tumor genomic subtypes. We used preoperative imaging and genomic data of 110 patients from 5 institutions with lower-grade gliomas from The Cancer Genome Atlas. Based on automatic deep learning segmentations, we extracted three features which quantify two-dimensional and three-dimensional characteristics of the tumors. Genomic data for the analyzed cohort of patients consisted of previously identified genomic clusters based on IDH mutation and 1p/19q co-deletion, DNA methylation, gene expression, DNA copy number, and microRNA expression. To analyze the relationship between the imaging features and genomic clusters, we conducted the Fisher exact test for 10 hypotheses for each pair of imaging feature and genomic subtype. To account for multiple hypothesis testing, we applied a Bonferroni correction. P-values lower than 0.005 were considered statistically significant. We found the strongest association between RNASeq clusters and the bounding ellipsoid volume ratio ($p<0.0002$) and between RNASeq clusters and margin fluctuation ($p<0.005$). In addition, we identified associations between bounding ellipsoid volume ratio and all tested molecular subtypes ($p<0.02$) as well as between angular standard deviation and RNASeq cluster ($p<0.02$). In terms of automatic tumor segmentation that was used to generate the quantitative image characteristics, our deep learning algorithm achieved a mean Dice coefficient of 82% which is comparable to human performance.


title: Thermographic Laplacian-pyramid filtering to enhance delamination detection in concrete structure

abstract: Despite decades of efforts using thermography to detect delamination in concrete decks, challenges still exist in removing environmental noise from thermal images. The performance of conventional temperature-contrast approaches can be significantly limited by environment-induced non-uniform temperature distribution across imaging spaces. Time-series based methodologies were found robust to spatial temperature non-uniformity but require the extended period to collect data. A new empirical image filtering method is introduced in this paper to enhance the delamination detection using blob detection method that originated from computer vision. The proposed method employs a Laplacian of Gaussian filter to achieve multi-scale detection of abnormal thermal patterns by delaminated areas. Results were compared with the state-of-the-art methods and benchmarked with time-series methods in the case of handling the non-uniform heat distribution issue. To further evaluate the performance of the method numerical simulations using transient heat transfer models were used to generate the 'theoretical' noise-free thermal images for comparison. Significant performance improvement was found compared to the conventional methods in both indoor and outdoor tests. This methodology proved to be capable to detect multi-size delamination using a single thermal image. It is robust to the non-uniform temperature distribution. The limitations were discussed to refine the applicability of the proposed procedure.


title: Integrative Factorization of Bidimensionally Linked Matrices

abstract: Advances in molecular "omics'" technologies have motivated new methodology for the integration of multiple sources of high-content biomedical data. However, most statistical methods for integrating multiple data matrices only consider data shared vertically (one cohort on multiple platforms) or horizontally (different cohorts on a single platform). This is limiting for data that take the form of bidimensionally linked matrices (e.g., multiple cohorts measured on multiple platforms), which are increasingly common in large-scale biomedical studies. In this paper, we propose BIDIFAC (Bidimensional Integrative Factorization) for integrative dimension reduction and signal approximation of bidimensionally linked data matrices. Our method factorizes the data into (i) globally shared, (ii) row-shared, (iii) column-shared, and (iv) single-matrix structural components, facilitating the investigation of shared and unique patterns of variability. For estimation we use a penalized objective function that extends the nuclear norm penalization for a single matrix. As an alternative to the complicated rank selection problem, we use results from random matrix theory to choose tuning parameters. We apply our method to integrate two genomics platforms (mRNA and miRNA expression) across two sample cohorts (tumor samples and normal tissue samples) using the breast cancer data from TCGA. We provide R code for fitting BIDIFAC, imputing missing values, and generating simulated data.


title: Bridge Deck Delamination Segmentation Based on Aerial Thermography Through Regularized Grayscale Morphological Reconstruction and Gradient Statistics

abstract: Environmental and surface texture-induced temperature variation across the bridge deck is a major source of errors in delamination detection through thermography. This type of external noise poses a significant challenge for conventional quantitative methods such as global thresholding and k-means clustering. An iterative top-down approach is proposed for delamination segmentation based on grayscale morphological reconstruction. A weight-decay function was used to regularize the reconstruction for regional maxima extraction. The mean and coefficient of variation of temperature gradient estimated from delamination boundaries were used for discrimination. The proposed approach was tested on a lab experiment and an in-service bridge deck. The result showed the ability of the framework to handle the non-uniform background situation which often occurred in practice and thus eliminates the need for inferencing the background required by existing methods. The gradient statistics of the delamination boundary in the thermal image were indicated as the valid criterion refine the segmentation under the proposed framework. Thus, improved performance was achieved compared to conventional methods. The parameter selection and the limitation of this approach were also discussed.


title: Neural Heterogeneous Scheduler

abstract: Access to parallel and distributed computation has enabled researchers and developers to improve algorithms and performance in many applications. Recent research has focused on next generation special purpose systems with multiple kinds of coprocessors, known as heterogeneous system-on-chips (SoC). In this paper, we introduce a method to intelligently schedule--and learn to schedule--a stream of tasks to available processing elements in such a system. We use deep reinforcement learning enabling complex sequential decision making and empirically show that our reinforcement learning system provides for a viable, better alternative to conventional scheduling heuristics with respect to minimizing execution time.


title: Puzzling out the mass-superselection rule

abstract: Mass-superselection rule (MSR) states that in the non-relativistic quantum theory superpositions of states with different masses are unphysical. While MSR features even in textbooks, its validity, physical content and consequences remain debated. Its original derivation is known to be inconsistent, while a consistent approach does not yield a superselection rule. Yet, superpositions of masses do not seem to be present in Newtonian physics. Here we offer a resolution of the MSR puzzle. Crucial for the result is the understanding of two issues: how the notion of a mass parameter arises from the fundamentally dynamical relativistic notion of mass-energy, and what is the correct Newtonian limit of relativistic dynamics of composite particles. The result explains the physical content of the MSR without invoking any non-standard physics and clarifies the relation between MSR and a formalism describing relativistic composite particles, developed for studying relativistic effects in table top experiments.


title: Machine learning with kernels for portfolio valuation and risk management

abstract: We introduce a simulation method for dynamic portfolio valuation and risk management building on machine learning with kernels. We learn the dynamic value process of a portfolio from a finite sample of its cumulative cash flow. The learned value process is given in closed form thanks to a suitable choice of the kernel. We show asymptotic consistency and derive finite sample error bounds under conditions that are suitable for finance applications. Numerical experiments show good results in large dimensions for a moderate training sample size.


title: On pointwise convergence of Schr\"odinger means

abstract: For functions in the Sobolev space $H^s$ and decreasing sequences $t_n\to 0$ we examine convergence almost everywhere of the generalized Schr\"odinger means on the real line, given by \[S^af(x,t_n)=\exp( it_n (-\partial_{xx})^{a/2})f(x);\] here $a>0$, $a\neq 1$. For decreasing convex sequences we obtain a simple characterization of convergence a.e. for all functions in $H^s$ when $0<s<\min\{a/4,1/4\}$ and $a\neq 1$. We prove sharp quantitative local and global estimates for the associated maximal functions. We also obtain sharp results for the case $a=1$.


title: The Generalization-Stability Tradeoff In Neural Network Pruning

abstract: Pruning neural network parameters is often viewed as a means to compress models, but pruning has also been motivated by the desire to prevent overfitting. This motivation is particularly relevant given the perhaps surprising observation that a wide variety of pruning approaches increase test accuracy despite sometimes massive reductions in parameter counts. To better understand this phenomenon, we analyze the behavior of pruning over the course of training, finding that pruning's benefit to generalization increases with pruning's instability (defined as the drop in test accuracy immediately following pruning). We demonstrate that this "generalization-stability tradeoff" is present across a wide variety of pruning settings and propose a mechanism for its cause: pruning regularizes similarly to noise injection. Supporting this, we find less pruning stability leads to more model flatness and the benefits of pruning do not depend on permanent parameter removal. These results explain the compatibility of pruning-based generalization improvements and the high generalization recently observed in overparameterized networks.


title: Deep-learning-based reduced-order modeling for subsurface flow simulation

abstract: A new deep-learning-based reduced-order modeling (ROM) framework is proposed for application in subsurface flow simulation. The reduced-order model is based on an existing embed-to-control (E2C) framework and includes an auto-encoder, which projects the system to a low-dimensional subspace, and a linear transition model, which approximates the evolution of the system states in low dimension. In addition to the loss function for data mismatch considered in the original E2C framework, we introduce a physics-based loss function that penalizes predictions that are inconsistent with the governing flow equations. The loss function is also modified to emphasize accuracy in key well quantities of interest (e.g., fluid production rates). The E2C ROM is shown to be very analogous to an existing ROM, POD-TPWL, which has been extensively developed for subsurface flow simulation. The new ROM is applied to oil-water flow in a heterogeneous reservoir, with flow driven by nine wells operating under time-varying control specifications. A total of 300 high-fidelity training simulations are performed in the offline stage, and the network training requires 10-12~minutes on a Tesla V100 GPU node. Online (runtime) computations achieve speedups of $\mathcal{O}$(1000) relative to full-order simulations. Extensive test case results, with well controls varied over large ranges, are presented. Accurate ROM predictions are achieved for global saturation and pressure fields at particular times, and for injection and production well responses as a function of time. Error is shown to increase when 100 or 200 (rather than 300) training runs are used to construct the E2C ROM.


title: Explicit methods for the Hasse norm principle and applications to $A_n$ and $S_n$ extensions

abstract: Let $K/k$ be an extension of number fields. We describe theoretical results and computational methods for calculating the obstruction to the Hasse norm principle for $K/k$ and the defect of weak approximation for the norm one torus $R^1_{K/k} \mathbb{G}_m$. We apply our techniques to give explicit and computable formulae for the obstruction to the Hasse norm principle and the defect of weak approximation when the normal closure of $K/k$ has symmetric or alternating Galois group.


title: Is Attention Interpretable?

abstract: Attention mechanisms have recently boosted performance on a range of NLP tasks. Because attention layers explicitly weight input components' representations, it is also often assumed that attention can be used to identify information that models found important (e.g., specific contextualized word tokens). We test whether that assumption holds by manipulating attention weights in already-trained text classification models and analyzing the resulting differences in their predictions. While we observe some ways in which higher attention weights correlate with greater impact on model predictions, we also find many ways in which this does not hold, i.e., where gradient-based rankings of attention weights better predict their effects than their magnitudes. We conclude that while attention noisily predicts input components' overall importance to a model, it is by no means a fail-safe indicator.


title: Strange hadron production in Au+Au collisions at $\sqrt{s_{_{\mathrm{NN}}}}$ = 7.7, 11.5, 19.6, 27, and 39 GeV

abstract: We present STAR measurements of strange hadron ($\mathrm{K}^{0}_{\mathrm S}$, $\Lambda$, $\overline{\Lambda}$, $\Xi^-$, $\overline{\Xi}^+$, $\Omega^-$, $\overline{\Omega}^+$, and $\phi$) production at mid-rapidity ($|y| < 0.5$) in Au+Au collisions at $\sqrt{s_{_{\mathrm{NN}}}}$ = 7.7 - 39 GeV from the Beam Energy Scan Program at the Relativistic Heavy Ion Collider (RHIC). Transverse momentum spectra, averaged transverse mass, and the overall integrated yields of these strange hadrons are presented versus the centrality and collision energy. Antibaryon-to-baryon ratios ($\overline{\Lambda}$/$\Lambda$, $\overline{\Xi}^+$/$\Xi^-$, $\overline{\Omega}^+$/$\Omega^-$) are presented as well, and used to test a thermal statistical model and to extract the temperature normalized strangeness and baryon chemical potentials at hadronic freeze-out ($\mu_{B}/T_{\rm ch}$ and $\mu_{S}/T_{\rm ch}$) in central collisions. Strange baryon-to-pion ratios are compared to various model predictions in central collisions for all energies. The nuclear modification factors ($R_{\textrm{CP}}$) and antibaryon-to-meson ratios as a function of transverse momentum are presented for all collision energies. The $\mathrm{K}^{0}_{\mathrm S}$ $R_{\textrm{CP}}$ shows no suppression for $p_{\rm T}$ up to 3.5 $\mathrm{GeV} / c$ at energies of 7.7 and 11.5 GeV. The $\overline{\Lambda}$/$\mathrm{K}^{0}_{\mathrm S}$ ratio also shows baryon-to-meson enhancement at intermediate $p_{\rm T}$ ($\approx$2.5 $\mathrm{GeV} / c$) in central collisions at energies above 19.6 GeV. Both observations suggest that there is likely a change of the underlying strange quark dynamics at collision energies below 19.6 GeV.


title: The stability manifold of local orbifold elliptic quotients

abstract: In this paper, we investigate the stability manifold of local models of orbifold quotients of elliptic curves. In particular, we describe a component of the stability manifold which maps as a covering space onto the universal unfolding space of the mirror singularity. The construction requires a detailed study of the McKay correspondence for $A_N$ surface singularities and a study of wall-crossing phenomena.


title: The Poschl-Teller Like Description of Quantum Mechanical Carnot Engine

abstract: In this work an example of a cyclic engine based on a quantum-mechanical properties of the strongly non linear quantum oscillator described by the Poschl-Teller [PT] model is examined. Using the [PT] model as shown in our earlier works [1-4], a quantum-mechanical analog of Carnot cycle (i.e quantum heat engine) has been constructed through the changes of both, the width L of the well and its quantum state. This quantum heat engine has a cycle consisting of adiabatic and isothermal quantum processes. The efficiency of the quantum engine based on the Poschl-Teller-like potential is derived and it is analogous to classical thermodynamic engines.


title: Intrinsically Efficient, Stable, and Bounded Off-Policy Evaluation for Reinforcement Learning

abstract: Off-policy evaluation (OPE) in both contextual bandits and reinforcement learning allows one to evaluate novel decision policies without needing to conduct exploration, which is often costly or otherwise infeasible. The problem's importance has attracted many proposed solutions, including importance sampling (IS), self-normalized IS (SNIS), and doubly robust (DR) estimates. DR and its variants ensure semiparametric local efficiency if Q-functions are well-specified, but if they are not they can be worse than both IS and SNIS. It also does not enjoy SNIS's inherent stability and boundedness. We propose new estimators for OPE based on empirical likelihood that are always more efficient than IS, SNIS, and DR and satisfy the same stability and boundedness properties as SNIS. On the way, we categorize various properties and classify existing estimators by them. Besides the theoretical guarantees, empirical studies suggest the new estimators provide advantages.


title: Reconstructing $d$-manifold subcomplexes of cubes from their $(\lfloor d/2 \rfloor + 1)$-skeletons

abstract: In 1984, Dancis proved that any $d$-dimensional simplicial manifold is determined by its $(\lfloor d/2 \rfloor + 1)$-skeleton. This paper adapts his proof to the setting of cubical complexes that can be embedded into a cube of arbitrary dimension. Under some additional conditions (for example, if the cubical manifold is a sphere), the result can be tightened to the $\lceil d/2 \rceil$-skeleton when $d \geq 3$.


title: Factorization Bandits for Online Influence Maximization

abstract: We study the problem of online influence maximization in social networks. In this problem, a learner aims to identify the set of "best influencers" in a network by interacting with it, i.e., repeatedly selecting seed nodes and observing activation feedback in the network. We capitalize on an important property of the influence maximization problem named network assortativity, which is ignored by most existing works in online influence maximization. To realize network assortativity, we factorize the activation probability on the edges into latent factors on the corresponding nodes, including influence factor on the giving nodes and susceptibility factor on the receiving nodes. We propose an upper confidence bound based online learning solution to estimate the latent factors, and therefore the activation probabilities. Considerable regret reduction is achieved by our factorization based online influence maximization algorithm. And extensive empirical evaluations on two real-world networks showed the effectiveness of our proposed solution.


title: Dynamical properties of binary stars hosting planets in the Galactic Center

abstract: We present some preliminary results of our work about the close encounter of binary stars hosting planets on S-type orbits with the Sgr A* supermassive black hole in the center of our Galaxy.


title: Nonlinear elliptic equations on the upper half space

abstract: In this paper we shall classify all positive solutions of $ \Delta u =a u^p$ on the upper half space $ H =\Bbb{R}_+^n$ with nonlinear boundary condition $ {\partial u}/{\partial t}= - b u^q $ on $\partial H$ for both positive parameters $a, \ b>0$. We will prove that for $p \ge {(n+2)}/{(n-2)}, 1\leq q<{n}/{(n-2)}$ (and $n \ge 3$) all positive solutions are functions of last variable; for $p= {(n+2)}/{(n-2)}, q= {n}/{(n-2)}$ (and $n \ge 3$) positive solutions must be either some functions depending only on last variable, or radially symmetric functions.


title: Monodromy of Rank 2 Parabolic Hitchin Systems

abstract: We study the monodromy of the Hitchin fibration for moduli spaces of parabolic G-Higgs bundles in the cases when G=SL(2,R), GL(2,R) and PGL(2,R) A calculation of the orbits of the monodromy with Z2-coefficients provides an exact count of the components of the moduli spaces for these groups.


title: BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarization

abstract: Most existing text summarization datasets are compiled from the news domain, where summaries have a flattened discourse structure. In such datasets, summary-worthy content often appears in the beginning of input articles. Moreover, large segments from input articles are present verbatim in their respective summaries. These issues impede the learning and evaluation of systems that can understand an article's global content structure as well as produce abstractive summaries with high compression ratio. In this work, we present a novel dataset, BIGPATENT, consisting of 1.3 million records of U.S. patent documents along with human written abstractive summaries. Compared to existing summarization datasets, BIGPATENT has the following properties: i) summaries contain a richer discourse structure with more recurring entities, ii) salient content is evenly distributed in the input, and iii) lesser and shorter extractive fragments are present in the summaries. Finally, we train and evaluate baselines and popular learning models on BIGPATENT to shed light on new challenges and motivate future directions for summarization research.


title: Degrees of Freedom Analysis of Unrolled Neural Networks

abstract: Unrolled neural networks emerged recently as an effective model for learning inverse maps appearing in image restoration tasks. However, their generalization risk (i.e., test mean-squared-error) and its link to network design and train sample size remains mysterious. Leveraging the Stein's Unbiased Risk Estimator (SURE), this paper analyzes the generalization risk with its bias and variance components for recurrent unrolled networks. We particularly investigate the degrees-of-freedom (DOF) component of SURE, trace of the end-to-end network Jacobian, to quantify the prediction variance. We prove that DOF is well-approximated by the weighted \textit{path sparsity} of the network under incoherence conditions on the trained weights. Empirically, we examine the SURE components as a function of train sample size for both recurrent and non-recurrent (with many more parameters) unrolled networks. Our key observations indicate that: 1) DOF increases with train sample size and converges to the generalization risk for both recurrent and non-recurrent schemes; 2) recurrent network converges significantly faster (with less train samples) compared with non-recurrent scheme, hence recurrence serves as a regularization for low sample size regimes.


title: Coin Theorems and the Fourier Expansion

abstract: In this note we compare two measures of the complexity of a class $\mathcal F$ of Boolean functions studied in (unconditional) pseudorandomness: $\mathcal F$'s ability to distinguish between biased and uniform coins (the coin problem), and the norms of the different levels of the Fourier expansion of functions in $\mathcal F$ (the Fourier growth). We show that for coins with low bias $\varepsilon = o(1/n)$, a function's distinguishing advantage in the coin problem is essentially equivalent to $\varepsilon$ times the sum of its level $1$ Fourier coefficients, which in particular shows that known level $1$ and total influence bounds for some classes of interest (such as constant-width read-once branching programs) in fact follow as a black-box from the corresponding coin theorems, thereby simplifying the proofs of some known results in the literature. For higher levels, it is well-known that Fourier growth bounds on all levels of the Fourier spectrum imply coin theorems, even for large $\varepsilon$, and we discuss here the possibility of a converse.


title: Generative Continual Concept Learning

abstract: After learning a concept, humans are also able to continually generalize their learned concepts to new domains by observing only a few labeled instances without any interference with the past learned knowledge. In contrast, learning concepts efficiently in a continual learning setting remains an open challenge for current Artificial Intelligence algorithms as persistent model retraining is necessary. Inspired by the Parallel Distributed Processing learning and the Complementary Learning Systems theories, we develop a computational model that is able to expand its previously learned concepts efficiently to new domains using a few labeled samples. We couple the new form of a concept to its past learned forms in an embedding space for effective continual learning. Doing so, a generative distribution is learned such that it is shared across the tasks in the embedding space and models the abstract concepts. This procedure enables the model to generate pseudo-data points to replay the past experience to tackle catastrophic forgetting.


title: Adelic geometry on arithmetic surfaces II: completed adeles and idelic Arakelov intersection theory

abstract: We work with completed adelic structures on an arithmetic surface and justify that the construction under consideration is compatible with Arakelov geometry. The ring of completed adeles is algebraically and topologically self-dual and fundamental adelic subspaces are self orthogonal with respect to a natural differential pairing. We show that the Arakelov intersection pairing can be lifted to an idelic intersection pairing.


title: New cohomological invariants of foliations

abstract: Given a smooth foliation on a closed manifold, basic forms are differential forms that can be expressed locally in terms of the transverse variables. The space of basic forms yields a differential complex, because the exterior derivative fixes this set. The basic cohomology is the cohomology of this complex, and this has been studied extensively. Given a Riemannian metric, the adjoint of the exterior derivative maps the orthogonal complement of the basic forms to itself, and we call the resulting cohomology the "antibasic cohomology". Although these groups are defined using the metric, the dimensions of the antibasic cohomology groups are invariant under diffeomorphism and metric changes. If the underlying foliation is Riemannian, the groups are foliated homotopy invariants that are independent of basic cohomology and ordinary cohomology of the manifold. For this class of foliations we use the codifferential on antibasic forms to obtain the corresponding Laplace operator, develop its analytic properties, and prove a Hodge theorem. We then find some topological and geometric properties that impose restrictions on the antibasic Betti numbers.


title: Low-degree Rational curves on hypersurfaces in projective spaces and their degenerations

abstract: We study rational curves on general Fano hypersurfaces in projective space, mostly by degenerating the hypersurface along with its ambient projective space to reducible varieties. We prove results on existence of low-degree rational curves with balanced normal bundle, and reprove some results on irreducibility of spaces of rational curves of low degree.


title: A note on Hedetniemi's conjecture, Stahl's conjecture and the Poljak-R\"odl function

abstract: We prove that $\min\{\chi(G), \chi(H)\} - \chi(G\times H)$ can be arbitrarily large, and that if Stahl's conjecture on the multichromatic number of Kneser graphs holds, then $\min\{\chi(G), \chi(H)\}/\chi(G\times H) \leq 1/2 + \epsilon$ for large values of $\min\{\chi(G), \chi(H)\}$.


title: Improved Adversarial Robustness via Logit Regularization Methods

abstract: While great progress has been made at making neural networks effective across a wide range of visual tasks, most models are surprisingly vulnerable. This frailness takes the form of small, carefully chosen perturbations of their input, known as adversarial examples, which represent a security threat for learned vision models in the wild -- a threat which should be responsibly defended against in safety-critical applications of computer vision. In this paper, we advocate for and experimentally investigate the use of a family of logit regularization techniques as an adversarial defense, which can be used in conjunction with other methods for creating adversarial robustness at little to no marginal cost. We also demonstrate that much of the effectiveness of one recent adversarial defense mechanism can in fact be attributed to logit regularization, and show how to improve its defense against both white-box and black-box attacks, in the process creating a stronger black-box attack against PGD-based models. We validate our methods on three datasets and include results on both gradient-free attacks and strong gradient-based iterative attacks with as many as 1,000 steps.


title: Attacking Graph Convolutional Networks via Rewiring

abstract: Graph Neural Networks (GNNs) have boosted the performance of many graph related tasks such as node classification and graph classification. Recent researches show that graph neural networks are vulnerable to adversarial attacks, which deliberately add carefully created unnoticeable perturbation to the graph structure. The perturbation is usually created by adding/deleting a few edges, which might be noticeable even when the number of edges modified is small. In this paper, we propose a graph rewiring operation which affects the graph in a less noticeable way compared to adding/deleting edges. We then use reinforcement learning to learn the attack strategy based on the proposed rewiring operation. Experiments on real world graphs demonstrate the effectiveness of the proposed framework. To understand the proposed framework, we further analyze how its generated perturbation to the graph structure affects the output of the target model.