title: MaxHedge: Maximising a Maximum Online

abstract: We introduce a new online learning framework where, at each trial, the learner is required to select a subset of actions from a given known action set. Each action is associated with an energy value, a reward and a cost. The sum of the energies of the actions selected cannot exceed a given energy budget. The goal is to maximise the cumulative profit, where the profit obtained on a single trial is defined as the difference between the maximum reward among the selected actions and the sum of their costs. Action energy values and the budget are known and fixed. All rewards and costs associated with each action change over time and are revealed at each trial only after the learner's selection of actions. Our framework encompasses several online learning problems where the environment changes over time; and the solution trades-off between minimising the costs and maximising the maximum reward of the selected subset of actions, while being constrained to an action energy budget. The algorithm that we propose is efficient and general in that it may be specialised to multiple natural online combinatorial problems.


title: On the Grothendieck-Serre Conjecture about principal bundles and its generalizations

abstract: Let $U$ be a regular connected affine semi-local scheme over a field $k$. Let $G$ be a reductive group scheme over $U$. Assuming that $G$ has an appropriate parabolic subgroup scheme, we prove the following statement. Given an affine $k$-scheme $W$, a principal $G$-bundle over $W\times_kU$ is trivial if it is trivial over the generic fiber of the projection $W\times_kU\to U$. We also simplify the proof of the Grothendieck-Serre conjecture: let $U$ be a regular connected affine semi-local scheme over a field $k$. Let $G$ be a reductive group scheme over $U$. A principal $G$-bundle over $U$ is trivial if it is trivial over the generic point of $U$. We generalize some other related results from the simple simply-connected case to the case of arbitrary reductive group schemes.


title: Moduli of rank 1 isocrystals

abstract: In this article we express the set of rank 1 isocrystals on a proper curve as a subset of the de Rham moduli space, defined by Simpson and Langer. Using results from the theory of Berkovich spaces, we compare the $\ell$-adic cohomology of this subspace with the $\ell$-adic cohomology of the whole moduli space. This confirms a conjecture of Deligne in the rank 1 case and explains one of his examples in this case from the point of view of isocrystals.


title: LPCNet: Improving Neural Speech Synthesis Through Linear Prediction

abstract: Neural speech synthesis models have recently demonstrated the ability to synthesize high quality speech for text-to-speech and compression applications. These new models often require powerful GPUs to achieve real-time operation, so being able to reduce their complexity would open the way for many new applications. We propose LPCNet, a WaveRNN variant that combines linear prediction with recurrent neural networks to significantly improve the efficiency of speech synthesis. We demonstrate that LPCNet can achieve significantly higher quality than WaveRNN for the same network size and that high quality LPCNet speech synthesis is achievable with a complexity under 3 GFLOPS. This makes it easier to deploy neural synthesis applications on lower-power devices, such as embedded systems and mobile phones.


title: The spectrum of teleparallel gravity

abstract: The observer's frame is the more elementary description of the gravitational field than the metric. The most general covariant, even-parity quadratic form for the frame field in arbitrary dimension generalises the New General Relativity by nine functions of the d'Alembertian operator. The degrees of freedom are clarified by a covariant derivation of the propagator. The consistent and viable models can incorporate an ultra-violet completion of the gravity theory, an additional polarisation of the gravitational wave, and the dynamics of a magnetic scalar potential.


title: Triangle varieties and surface decomposition of hyper-K\"ahler manifolds

abstract: We introduce and study the notion of "surface decomposable" variety, and discuss the possibility that any projective hyper-K\"ahler manifold is surface decomposable, which would produce new evidence for Beauville's weak splitting conjecture. We show that surface decomposability relates to the Beauville-Fujiki relation, a constraint on the cohomology ring of the variety, and that general varieties with $h^{2,0}\not=0$ are not surface decomposable. We also formalize the notion of triangle variety that is useful to produce surface decomposition. We show the existence of these geometric structures on most explicitly constructed classes of projective hyper-K\"ahler manifolds of Picard number $1$.


title: Systemic Greeks: Measuring risk in financial networks

abstract: Since the latest financial crisis, the idea of systemic risk has received considerable interest. In particular, contagion effects arising from cross-holdings between interconnected financial firms have been studied extensively. Drawing inspiration from the field of complex networks, these attempts are largely unaware of models and theories for credit risk of individual firms. Here, we note that recent network valuation models extend the seminal structural risk model of Merton (1974). Furthermore, we formally compute sensitivities to various risk factors -- commonly known as Greeks -- in a network context. In particular, we propose the network $\Delta$ as a quantitative measure of systemic risk and illustrate our findings on some numerical examples.


title: Harmonic analysis meets stationarity: A general framework for series expansions of special Gaussian processes

abstract: In this paper, we present a new approach to derive series expansions for some Gaussian processes based on harmonic analysis of their covariance function. In particular, we propose a new simple rate-optimal series expansion for fractional Brownian motion. The convergence of the latter series holds in mean square and uniformly almost surely, with a rate-optimal decay of the remainder of the series. We also develop a general framework of convergent series expansions for certain classes of Gaussian processes with stationarity. Finally, an application to optimal functional quantization is described.


title: Total-internal-reflection elastic metasurfaces: design and application to structural vibration isolation

abstract: This letter presents the concept of Total Internal Reflection metasurface (TIR-MS) which supports the realization of structure-embedded subwavelength acoustic shields for elastic waves propagating in thin waveguides. The proposed metasurface design exploits extreme phase gradients, implemented via locally resonant elements, in order to achieve operating conditions that are largely beyond the critical angle. Such artificial discontinuity is capable of producing complete reflection of the incoming waves regardless of the specific angle of incidence. From a practical perspective, the TIR-MS behaves as a sound hard barrier that is impenetrable to long-wavelength modes at a selected frequency. The TIR metasurface concept is first conceived for a flat interface embedded in a rectangular waveguide and designed to block longitudinal S0-type guided modes. Then, it is extended to circular plates in order to show how enclosed areas can be effectively shielded by incoming waves. Given the same underlying physics, an equivalent dynamic behavior was also numerically and experimentally illustrated for flexural A0-type guided modes. This study shows numerical and experimental evidence that, when the metasurface is excited at the target frequency, significant vibration isolation can be achieved in presence of waves having any arbitrary angle of incidence. These results open interesting paths to achieve vibration isolation and energy filtering in certain prototypical structures of interest for practical engineering applications.


title: Local Langlands correspondence for Asai L-functions and epsilon factors

abstract: Let E/F be a quadratic extension of p-adic fields. The local Langlands correspondence establishes a bijection between n-dimensional Frobenius semisimple representations of the Weil-Deligne group of E and smooth, irreducible representations of GL(n,E). We reinterpret this bijection in the setting of the Weil restriction of scalars Res(GL(n),E/F), and show that the Asai L-function and epsilon factor on the analytic side match up with the expected Artin L-function and epsilon factor on the Galois side. This paper is based off of the author's forthcoming doctoral thesis.


title: A stacky approach to crystals

abstract: Inspired by a theorem of Bhatt-Morrow-Scholze, we develop a stacky approach to crystals and isocrystals on "Frobenius-smooth" schemes over F_p . This class of schemes goes back to Berthelot-Messing and contains all smooth schemes over perfect fields of characteristic p. To treat isocrystals, we prove some descent theorems for sheaves of Banachian modules, which could be interesting in their own right.


title: Search for nonresonant Higgs boson pair production in the $\mathrm{b\overline{b}b\overline{b}}$ final state at $\sqrt{s} =$ 13 TeV

abstract: Results of a search for nonresonant production of Higgs boson pairs, with each Higgs boson decaying to a $\mathrm{b\overline{b}}$ pair are presented. This search uses data from proton-proton collisions at a centre-of-mass energy of 13 TeV, corresponding to an integrated luminosity of 35.9 fb$^{-1}$, collected by the CMS detector at the LHC. No signal is observed, and a 95% confidence level upper limit of 847 fb is set on the cross section for standard model nonresonant Higgs boson pair production times the squared branching fraction of the Higgs boson decay to a $\mathrm{b\overline{b}}$ pair. The same signature is studied, and upper limits are set, in the context of models of physics beyond the standard model that predict modified couplings of the Higgs boson.


title: An analytic implementation of the IR-resummation for the BAO peak

abstract: We develop an analytic method for implementing the IR-resummation of arXiv:1404.5954, which allows one to correctly and consistently describe the imprint of baryon acoustic oscillations (BAO) on statistical observables in large-scale structure. We show that the final IR-resummed correlation function can be computed analytically without relying on numerical integration, thus allowing for an efficient and accurate use of these predictions on real data in cosmological parameter fitting. In this work we focus on the one-loop correlation function and the BAO peak. We show that, compared with the standard numerical integration method of IR-resummation, the new method is accurate to better than 0.2 %, and is quite easily improvable. We also give an approximate resummation scheme which is based on using the linear displacements of a fixed fiducial cosmology, which when combined with the method described above, is about six times faster than the standard numerical integration. Finally, we show that this analytic method is generalizable to higher loop computations.


title: Scale Estimation of Monocular SfM for a Multi-modal Stereo Camera

abstract: This paper proposes a novel method of estimating the absolute scale of monocular SfM for a multi-modal stereo camera. In the fields of computer vision and robotics, scale estimation for monocular SfM has been widely investigated in order to simplify systems. This paper addresses the scale estimation problem for a stereo camera system in which two cameras capture different spectral images (e.g., RGB and FIR), whose feature points are difficult to directly match using descriptors. Furthermore, the number of matching points between FIR images can be comparatively small, owing to the low resolution and lack of thermal scene texture. To cope with these difficulties, the proposed method estimates the scale parameter using batch optimization, based on the epipolar constraint of a small number of feature correspondences between the invisible light images. The accuracy and numerical stability of the proposed method are verified by synthetic and real image experiments.


title: Exploring $k$ out of Top $\rho$ Fraction of Arms in Stochastic Bandits

abstract: This paper studies the problem of identifying any $k$ distinct arms among the top $\rho$ fraction (e.g., top 5\%) of arms from a finite or infinite set with a probably approximately correct (PAC) tolerance $\epsilon$. We consider two cases: (i) when the threshold of the top arms' expected rewards is known and (ii) when it is unknown. We prove lower bounds for the four variants (finite or infinite arms, and known or unknown threshold), and propose algorithms for each. Two of these algorithms are shown to be sample complexity optimal (up to constant factors) and the other two are optimal up to a log factor. Results in this paper provide up to $\rho n/k$ reductions compared with the "$k$-exploration" algorithms that focus on finding the (PAC) best $k$ arms out of $n$ arms. We also numerically show improvements over the state-of-the-art.


title: Particle-hole symmetry breaking due to Pauli blocking

abstract: Particle-hole symmetry has been used on several occasions in nuclear structure over the years. We prove that particle-hole symmetry is broken in nuclear shells possessing the proxy-SU(3) symmetry. The breaking of the symmetry is rooted in the Pauli principle and the short range nature of the nucleon-nucleon interaction. The breaking of the symmetry explains the dominance of prolate over oblate shapes in deformed nuclei and determines the regions of prolate to oblate shape transitions in the nuclear chart. Furthermore, it is related to the existence of specific regions of shape coexistence across the nuclear chart, surrounded by regions in which shape coexistence does not occur.


title: Consistency of ELBO maximization for model selection

abstract: The Evidence Lower Bound (ELBO) is a quantity that plays a key role in variational inference. It can also be used as a criterion in model selection. However, though extremely popular in practice in the variational Bayes community, there has never been a general theoretic justification for selecting based on the ELBO. In this paper, we show that the ELBO maximization strategy has strong theoretical guarantees, and is robust to model misspecification while most works rely on the assumption that one model is correctly specified. We illustrate our theoretical results by an application to the selection of the number of principal components in probabilistic PCA.


title: Nucleon numbers for nuclei with shape coexistence

abstract: We consider two competing sets of nuclear magic numbers, namely the harmonic oscillator (HO) set (2, 8, 20, 40, 70, 112, 168, 240,...) and the set corresponding to the proxy-SU(3) scheme, possessing shells 0-2, 2-4, 6-12, 14-26, 28-48, 50-80, 82-124, 126-182, 184-256... The two sets provide 0+ bands with different deformation and band-head energies. We show that for proton (neutron) numbers starting from the regions where the quadrupole-quadrupole interaction, as derived by the HO, becomes weaker than the one obtained in the proxy-SU(3) scheme, to the regions of HO shell closure, the shape coexistence phenomenon may emerge. Our analysis suggests that the possibility for appearance of shape coexistence has to be investigated in the following regions of proton (neutron) numbers: 8, 18-20, 34-40, 60-70, 96-112, 146-168, 210-240,...


title: Change Surfaces for Expressive Multidimensional Changepoints and Counterfactual Prediction

abstract: Identifying changes in model parameters is fundamental in machine learning and statistics. However, standard changepoint models are limited in expressiveness, often addressing unidimensional problems and assuming instantaneous changes. We introduce change surfaces as a multidimensional and highly expressive generalization of changepoints. We provide a model-agnostic formalization of change surfaces, illustrating how they can provide variable, heterogeneous, and non-monotonic rates of change across multiple dimensions. Additionally, we show how change surfaces can be used for counterfactual prediction. As a concrete instantiation of the change surface framework, we develop Gaussian Process Change Surfaces (GPCS). We demonstrate counterfactual prediction with Bayesian posterior mean and credible sets, as well as massive scalability by introducing novel methods for additive non-separable kernels. Using two large spatio-temporal datasets we employ GPCS to discover and characterize complex changes that can provide scientific and policy relevant insights. Specifically, we analyze twentieth century measles incidence across the United States and discover previously unknown heterogeneous changes after the introduction of the measles vaccine. Additionally, we apply the model to requests for lead testing kits in New York City, discovering distinct spatial and demographic patterns.


title: Stiffness pathologies in discrete granular systems: bifurcation, neutral equilibrium, and instability in the presence of kinematic constraints

abstract: The paper develops the stiffness relationship between the movements and forces among a system of discrete interacting grains. The approach is similar to that used in structural analysis, but the stiffness matrix of granular material is inherently non-symmetric because of the geometrics of particle interactions and of the frictional behavior of the contacts. Internal geometric constraints are imposed by the particles' shapes, in particular, by the surface curvatures of the particles at their points of contact. Moreover, the stiffness relationship is incrementally non-linear, and even small assemblies require the analysis of multiple stiffness branches, with each branch region being a pointed convex cone in displacement-space. These aspects of the particle-level stiffness relationship gives rise to three types of micro-scale failure: neutral equilibrium, bifurcation and path instability, and instability of equilibrium. These three pathologies are defined in the context of four types of displacement constraints, which can be readily analyzed with certain generalized inverses. That is, instability and non-uniqueness are investigated in the presence of kinematic constraints. Bifurcation paths can be either stable or unstable, as determined with the Hill-Bazant-Petryk criterion. Examples of simple granular systems of three, sixteen, and sixty four disks are analyzed. With each system, multiple contacts were assumed to be at the friction limit. Even with these small systems, micro-scale failure is expressed in many different forms, with some systems having hundreds of micro-scale failure modes. The examples suggest that micro-scale failure is pervasive within granular materials, with particle arrangements being in a nearly continual state of instability.


title: Near-Linear Time Insertion-Deletion Codes and (1+$\varepsilon$)-Approximating Edit Distance via Indexing

abstract: We introduce fast-decodable indexing schemes for edit distance which can be used to speed up edit distance computations to near-linear time if one of the strings is indexed by an indexing string $I$. In particular, for every length $n$ and every $\varepsilon >0$, one can in near linear time construct a string $I \in \Sigma'^n$ with $|\Sigma'| = O_{\varepsilon}(1)$, such that, indexing any string $S \in \Sigma^n$, symbol-by-symbol, with $I$ results in a string $S' \in \Sigma''^n$ where $\Sigma'' = \Sigma \times \Sigma'$ for which edit distance computations are easy, i.e., one can compute a $(1+\varepsilon)$-approximation of the edit distance between $S'$ and any other string in $O(n \text{poly}(\log n))$ time. Our indexing schemes can be used to improve the decoding complexity of state-of-the-art error correcting codes for insertions and deletions. In particular, they lead to near-linear time decoding algorithms for the insertion-deletion codes of [Haeupler, Shahrasbi; STOC `17] and faster decoding algorithms for list-decodable insertion-deletion codes of [Haeupler, Shahrasbi, Sudan; ICALP `18]. Interestingly, the latter codes are a crucial ingredient in the construction of fast-decodable indexing schemes.


title: Very weak solutions to hypoelliptic wave equations

abstract: In this paper we study the Cauchy problem for the wave equations for hypoelliptic homogeneous left-invariant operators on graded Lie groups when the time-dependent non-negative propagation speed is regular, H\"older, and distributional. For H\"older coefficients we derive the well-posedness in the spaces of ultradistributions associated to Rockland operators on graded groups. In the case when the propagation speed is a distribution, we employ the notion of "very weak solutions" to the Cauchy problem, that was already successfully used in similar contexts in [GR15] and [RT17b]. We show that the Cauchy problem for the wave equation with the distributional coefficient has a unique "very weak solution" in an appropriate sense, which coincides with classical or distributional solutions when the latter exist. Examples include the time dependent wave equation for the sub-Laplacian on the Heisenberg group or on general stratified Lie groups, or $p$-evolution equations for higher order operators on $\mathbb{R}^{n}$ or on groups, the results already being new in all these cases.


title: McFly: Time-Travel Debugging for the Web

abstract: Time-traveling debuggers offer the promise of simplifying debugging by letting developers freely step forwards and backwards through a program's execution. However, web applications present multiple challenges that make time-travel debugging especially difficult. A time-traveling debugger for web applications must accurately reproduce all network interactions, asynchronous events, and visual states observed during the original execution, both while stepping forwards and backwards. This must all be done in the context of a complex and highly multithreaded browser runtime. At the same time, to be practical, a time-traveling debugger must maintain interactive speeds. This paper presents McFly, the first time-traveling debugger for web applications. McFly departs from previous approaches by operating on a high-level representation of the browser's internal state. This approach lets McFly provide accurate time-travel debugging - maintaining JavaScript and visual state in sync at all times - at interactive speeds. McFly's architecture is browser-agnostic, building on web standards supported by all major browsers. We have implemented McFly as an extension to the Microsoft Edge web browser, and core parts of McFly have been integrated into a time-traveling debugger product from Microsoft.


title: Why do Nilsson quantum numbers remain good at moderate deformations?

abstract: The Nilsson model is a simple microscopic model which has been extensively used over the years for the interpretation of a bulk of experimental results. The single particle orbitals in this model are labeled by quantum numbers which are good in the limit of large nuclear deformations. However, it is generally admitted that these quantum numbers remain good even at moderate deformations. We show that this fact is due to the existence of an underlying approximate symmetry, called the proxy-SU(3) symmetry. The implications of proxy-SU(3) on various aspects of nuclear structure will be discussed.


title: Experimental Design for Cost-Aware Learning of Causal Graphs

abstract: We consider the minimum cost intervention design problem: Given the essential graph of a causal graph and a cost to intervene on a variable, identify the set of interventions with minimum total cost that can learn any causal graph with the given essential graph. We first show that this problem is NP-hard. We then prove that we can achieve a constant factor approximation to this problem with a greedy algorithm. We then constrain the sparsity of each intervention. We develop an algorithm that returns an intervention design that is nearly optimal in terms of size for sparse graphs with sparse interventions and we discuss how to use it when there are costs on the vertices.


title: Sequential anatomy localization in fetal echocardiography videos

abstract: Fetal heart motion is an important diagnostic indicator for structural detection and functional assessment of congenital heart disease. We propose an approach towards integrating deep convolutional and recurrent architectures that utilize localized spatial and temporal features of different anatomical substructures within a global spatiotemporal context for interpretation of fetal echocardiography videos. We formulate our task as a cardiac structure localization problem with convolutional architectures for aggregating global spatial context and detecting anatomical structures on spatial region proposals. This information is aggregated temporally by recurrent architectures to quantify the progressive motion patterns. We experimentally show that the resulting architecture combines anatomical landmark detection at the frame-level over multiple video sequences-with temporal progress of the associated anatomical motions to encode local spatiotemporal fetal heart dynamics and is validated on a real-world clinical dataset.


title: Magnetic excitations of the classical spin liquid MgCr2O4

abstract: We report a comprehensive inelastic neutron-scattering study of the frustrated pyrochlore antiferromagnet MgCr2O4 in its cooperative paramagnetic regime. Theoretical modeling yields a microscopic Heisenberg model with exchange interactions up to third-nearest neighbors, which quantitatively explains all the details of the dynamic magnetic response. Our work demonstrates that the magnetic excitations in paramagnetic MgCr2O4 are faithfully represented in the entire Brillouin zone by a theory of magnons propagating in a highly-correlated paramagnetic background. Our results also suggest that MgCr2O4 is proximate to a spiral spin-liquid phase distinct from the Coulomb phase, which has implications for the magneto-structural phase transition in MgCr2O4 .


title: Highest weight SU(3) irreducible representations for nuclei with shape coexistence

abstract: The SU(3) irreducible representations (irreps) are characterised by the (lambda, mu) Elliott quantum numbers, which are necessary for the extraction of the nuclear deformation, the energy spectrum and the transition probabilities. These irreps can be calculated through a code which requires high computational power. In the following text a hand-writing method is presented for the calculation of the highest weight (h.w.) irreps, using two different sets of magic numbers, namely proxy-SU(3) and three-dimensional isotropic harmonic oscillator.


title: Chain of Antichains: An Efficient and Secure Distributed Ledger Technology and Its Applications

abstract: Since the inception of blockchain and Bitcoin (Nakamoto (2008)), a decentralized-distributed ledger system and its associated cryptocurrency, respectively, the world has witnessed a slew of newer adaptations and applications. Although the original distributed ledger technology (DLT) of blockchain is deemed secure and decentralized, the confirmation of transactions is inefficient by design. Recently adopted, directed acyclic graph (DAG)-based distributed ledgers validate transactions efficiently without the physically and environmentally costly building process of blocks (Lerner (2015)). However, centrally-controlled confirmation against the odds of multiple validation disqualifies the DAG as a decentralized-distributed ledger. In this regard, we introduce an innovative DLT by reconstructing a chain of antichains based on a given DAG-pool of transactions. Each antichain (box) contains distinct nodes whose approved transactions are recursively validated by subsequently augmenting nodes. The boxer node closes the box and keeps the hash of all transactions confirmed by the box-genesis node. Designation of boxers and box-geneses is conditionally randomized for decentralization. The boxes are serially concatenated with recursive confirmation (boxchain) without incurring the cost of box generation. Rewards (boxcoin) are paid to the contributing nodes of the ecosystem whose trust is built on the doubly-secure protocol of confirmation. A value-preserving medium of payment (boxdollar) is among numerous practical applications discussed herein.


title: Quasinormal modes and dispersion relations for quarkonium in a plasma

abstract: Recent investigations show that the thermal spectral function of heavy $ {b \bar b } $ and $ {c \bar c} $ vector mesons can be described using holography. These studies consider a bottom up model that captures the heavy flavour spectroscopy of masses and decay constants in the vacuum and is consistently extended to finite temperature. The corresponding spectral functions provide a picture of the dissociation process in terms of the decrease of the quasi-state peaks with temperature. Another related tool that provides important information about the thermal behaviour is the analysis of the quasinormal modes. They are field solutions in a curved background assumed to represent, in gauge/gravity duality, quasi-particle states in a thermal medium. The associated complex frequencies are related to the thermal mass and width. We present here the calculation of quasinormal modes for charmonium and bottomonium using the holographic approach. The temperature dependence of mass and thermal width are investigated. Solutions corresponding to heavy mesons moving into the plasma are also studied. They provide the dependence of the real and imaginary parts of the frequency with the quasi-particle momenta, the so called dispersion relations.


title: Hilbert squares: derived categories and deformations

abstract: For a smooth projective variety $X$ with exceptional structure sheaf, and $\operatorname{Hilb}^2X$ the Hilbert scheme of two points on $X$, we show that the Fourier-Mukai functor $\mathbf{D}^{\mathrm{b}}(X) \to\mathbf{D}^{\mathrm{b}}(\operatorname{Hilb}^2X)$ induced by the universal ideal sheaf is fully faithful, provided the dimension of $X$ is at least 2. This fully faithfulness allows us to construct a spectral sequence relating the deformation theories of $X$ and $\operatorname{Hilb}^2X$ and to show that it degenerates at the second page, giving a Hochschild-Kostant-Rosenberg-type filtration on the Hochschild cohomology of $X$. These results generalise known results for surfaces due to Krug-Sosna, Fantechi and Hitchin. Finally, as a by-product, we discover the following surprising phenomenon: for a smooth projective variety of dimension at least 3 with exceptional structure sheaf, it is rigid if and only if its Hilbert scheme of two points is rigid. This last fact contrasts drastically to the surface case: non-commutative deformations of a surface contribute to commutative deformations of its Hilbert square.


title: Learning with Bad Training Data via Iterative Trimmed Loss Minimization

abstract: In this paper, we study a simple and generic framework to tackle the problem of learning model parameters when a fraction of the training samples are corrupted. We first make a simple observation: in a variety of such settings, the evolution of training accuracy (as a function of training epochs) is different for clean and bad samples. Based on this we propose to iteratively minimize the trimmed loss, by alternating between (a) selecting samples with lowest current loss, and (b) retraining a model on only these samples. We prove that this process recovers the ground truth (with linear convergence rate) in generalized linear models with standard statistical assumptions. Experimentally, we demonstrate its effectiveness in three settings: (a) deep image classifiers with errors only in labels, (b) generative adversarial networks with bad training images, and (c) deep image classifiers with adversarial (image, label) pairs (i.e., backdoor attacks). For the well-studied setting of random label noise, our algorithm achieves state-of-the-art performance without having access to any a-priori guaranteed clean samples.


title: Automatically Evolving CNN Architectures Based on Blocks

abstract: The performance of Convolutional Neural Networks (CNNs) highly relies on their architectures. In order to design a CNN with promising performance, extended expertise in both CNNs and the investigated problem is required, which is not necessarily held by every user interested in CNNs or the problem domain. In this paper, we propose to automatically evolve CNN architectures by using a genetic algorithm based on ResNet blocks and DenseNet blocks. The proposed algorithm is \textbf{completely} automatic in designing CNN architectures, particularly, neither pre-processing before it starts nor post-processing on the designed CNN is needed. Furthermore, the proposed algorithm does not require users with domain knowledge on CNNs, the investigated problem or even genetic algorithms. The proposed algorithm is evaluated on CIFAR10 and CIFAR100 against 18 state-of-the-art peer competitors. Experimental results show that it outperforms state-of-the-art CNNs hand-crafted and CNNs designed by automatic peer competitors in terms of the classification accuracy, and achieves the competitive classification accuracy against semi-automatic peer competitors. In addition, the proposed algorithm consumes much less time than most peer competitors in finding the best CNN architectures.


title: Magnetism in the Early Universe

abstract: Blazar observations point toward the possible presence of magnetic fields over intergalactic scales of the order of up to $\sim1\,$Mpc, with strengths of at least $\sim10^{-16}\,$G. Understanding the origin of these large-scale magnetic fields is a challenge for modern astrophysics. Here we discuss the cosmological scenario, focussing on the following questions: (i) How and when was this magnetic field generated? (ii) How does it evolve during the expansion of the universe? (iii) Are the amplitude and statistical properties of this field such that they can explain the strengths and correlation lengths of observed magnetic fields? We also discuss the possibility of observing primordial turbulence through direct detection of stochastic gravitational waves in the mHz range accessible to LISA.


title: Fourier multipliers for nonlocal Laplace operators

abstract: Fourier multiplier analysis is developed for nonlocal peridynamic-type Laplace operators, which are defined for scalar fields in $\mathbb{R}^n$. The Fourier multipliers are given through an integral representation. We show that the integral representation of the Fourier multipliers is recognized explicitly through a unified and general formula in terms of the hypergeometric function $_2F_3$ in any spatial dimension $n$. Asymptotic analysis of $_2F_3$ is utilized to identify the asymptotic behavior of the Fourier multipliers $m(\nu)$ as $\|\nu\|\rightarrow \infty$. We show that the multipliers are bounded when the peridynamic Laplacian has an integrable kernel, and diverge when the kernel is singular. The bounds and decay rates are presented explicitly in terms of the dimension $n$, the integral kernel, and the peridynamic Laplacian nonlocality. The asymptotic analysis is applied in the periodic setting to prove a regularity result for the peridynamic Poisson equation and, moreover, show that its solution converges to the solution of the classical Poisson equation.


title: Unsupervised Evaluation Metrics and Learning Criteria for Non-Parallel Textual Transfer

abstract: We consider the problem of automatically generating textual paraphrases with modified attributes or properties, focusing on the setting without parallel data (Hu et al., 2017; Shen et al., 2017). This setting poses challenges for evaluation. We show that the metric of post-transfer classification accuracy is insufficient on its own, and propose additional metrics based on semantic preservation and fluency as well as a way to combine them into a single overall score. We contribute new loss functions and training strategies to address the different metrics. Semantic preservation is addressed by adding a cyclic consistency loss and a loss based on paraphrase pairs, while fluency is improved by integrating losses based on style-specific language models. We experiment with a Yelp sentiment dataset and a new literature dataset that we propose, using multiple models that extend prior work (Shen et al., 2017). We demonstrate that our metrics correlate well with human judgments, at both the sentence-level and system-level. Automatic and manual evaluation also show large improvements over the baseline method of Shen et al. (2017). We hope that our proposed metrics can speed up system development for new textual transfer tasks while also encouraging the community to address our three complementary aspects of transfer quality.


title: Star Cluster Detection and Characterization using Generalized Parzen Density Estimation

abstract: Star cluster studies hold the key to understanding star formation, stellar evolution, and origin of galaxies. The detection and characterization of clusters depend on the underlying background density and the cluster richness. We examine the ability of the Parzen Density Estimation (a.k.a. Parzen Windows) method, which is a generalization of the well-known Star Count method, to detect clusters and measure their properties. We apply it on a range of simulated and real star fields, considering square and circular windows, with and without Gaussian kernel smoothing. Our method successfully identifies clusters and we suggest an optimal standard deviation of the Gaussian Parzen window for obtaining the best estimates of these parameters. Finally, we demonstrate that the Parzen Windows with Gaussian kernels are able to detect small clusters in regions of relatively high background density where the Star Count method fails.


title: Complex Langevin for Lattice QCD

abstract: We simulate lattice QCD at finite quark-number chemical potential, $\mu$, using the complex-Langevin equation (CLE) with gauge-cooling and adaptive updating to prevent instabilities. The CLE is used because QCD at finite $\mu$ has a complex fermion determinant which precludes the use of standard simulation methods based on importance sampling. Since, even when CLE simulations converge, they are not guaranteed to produce correct results except under very stringent conditions, which lattice QCD at finite $\mu$ does not obey, we need extensive testing to determine under what conditions it produces reliable results. We performed simulations at $\beta=6/g^2=5.6$ and $\beta=5.7$, both at $m=0.025$. For small $\mu$ and $\mu$ large enough to produce saturation, measured observables appear to be approaching their correct values as the coupling is decreased. However, for intermediate $\mu$ values, these simulations predict a transition from hadronic to nuclear matter at a $\mu$ which is far too small. Since there is evidence that for CLE simulations to produce correct results the trajectories should remain close to the $SU(3)$ manifold (at least for small $\mu$), we explore the parameter space to see where this is true. We find that the distance from this manifold decreases as the coupling decreases and as the quark mass (in lattice units) decreases, i.e. as we approach the continuum limit. This indicates that we need to simulate at smaller couplings and quark masses (requiring larger lattices) to see if these can produce the correct physics.


title: Bounded Regression with Gaussian Process Projection

abstract: Examples with bound information on the regression function and density abound in many real applications. We propose a novel approach for estimating such functions by incorporating the prior knowledge on the bounds. Specially, a Gaussian process is first imposed on the regression function whose posterior distribution is then projected onto the bounded space. The resulting projected measure is then used for inference. The projected sample path has closed form which facilitates efficient computations. In particular, our projection approach maintains a comparable computational efficiency with that of the original GP. The proposed method yield predictions that respects bound constraints everywhere, while allows varying bounds across the input domain. An extensive simulation study is carried out which demonstrates that the performance of our approach dominates that of the competitors. An application to real data set is also considered.


title: Knotting Probability of Equilateral Hexagons

abstract: For a positive integer $n\ge 3$, the collection of $n$-sided polygons embedded in $3$-space defines the space of geometric knots. We will consider the subspace of equilateral knots, consisting of embedded $n$-sided polygons with unit length edges. Paths in this space determine isotopies of polygons, so path-components correspond to equilateral knot types. When $n\le 5$, the space of equilateral knots is connected. Therefore, we examine the space of equilateral hexagons. Using techniques from symplectic geometry, we can parametrize the space of equilateral hexagons with a set of measure preserving action-angle coordinates. With this coordinate system, we provide new bounds on the knotting probability of equilateral hexagons.


title: FFT, FMM, and Multigrid on the Road to Exascale: performance challenges and opportunities

abstract: FFT, FMM, and multigrid methods are widely used fast and highly scalable solvers for elliptic PDEs. However, emerging large-scale computing systems are introducing challenges in comparison to current petascale computers. Recent efforts (Dongarra et al. 2011) have identified several constraints in the design of exascale software that includes massive concurrency, resilience management, exploiting the high performance of heterogeneous systems, energy efficiency, and utilizing the deeper and more complex memory hierarchy expected at exascale. In this paper, we perform a model-based comparison of the FFT, FMM, and multigrid methods in the context of these projected constraints. In addition, we use performance models to offer predictions about the expected performance on upcoming exascale system configurations based on current technology trends.


title: Pattern formation for a local/nonlocal interaction functional arising in colloidal systems

abstract: In this paper we study pattern formation for a physical local/nonlocal interaction functional where the local attractive term is given by the $1$-perimeter and the nonlocal repulsive term is the Yukawa (or screened Coulomb) potential. This model is physically interesting as it is the $\Gamma$-limit of a double Yukawa model used to explain and simulate pattern formation in colloidal systems \cite{BBCH,CCA,IR,GCLW}. Following a strategy introduced in~\cite{DR} we prove that in a suitable regime minimizers are periodic stripes, in any space dimension.


title: Complete spectrum of quantum integrable lattice models associated to Y(gl(n)) by separation of variables

abstract: We apply our new approach of quantum Separation of Variables (SoV) to the complete characterization of the transfer matrix spectrum of quantum integrable lattice models associated to gl(n)-invariant R-matrices in the fundamental representations. We consider lattices with N sites and quasi-periodic boundary conditions associated to an arbitrary twist K having simple spectrum (but not necessarily diagonalizable). In our approach the SoV basis is constructed in an universal manner starting from the direct use of the conserved charges of the models, i.e., from the commuting family of transfer matrices. Using the integrable structure of the models, incarnated in the hierarchy of transfer matrices fusion relations, we prove that our SoV basis indeed separates the spectrum of the corresponding transfer matrices. Moreover, the combined use of the fusion rules, of the known analytic properties of the transfer matrices and of the SoV basis allows us to obtain the complete characterization of the transfer matrix spectrum and to prove its simplicity. Any transfer matrix eigenvalue is completely characterized as a solution of a so-called quantum spectral curve equation that we obtain as a difference functional equation of order n. Namely, any eigenvalue satisfies this equation and any solution of this equation having prescribed properties leads to an eigenvalue. We construct the associated eigenvector, unique up to normalization, by computing its decomposition on the SoV basis that is of a factorized form written in terms of the powers of the corresponding eigenvalues. If the twist matrix K is diagonalizable with simple spectrum then the transfer matrix is also diagonalizable with simple spectrum. In that case, we give a construction of the Baxter Q-operator satisfying a T-Q equation of order n, the quantum spectral curve equation, involving the hierarchy of the fused transfer matrices.


title: On the intrinsic volumes of intersections of congruent balls

abstract: Let ${\mathbb E}^d$ denote the $d$-dimensional Euclidean space. The $r$-ball body generated by a given set in ${\mathbb E}^d$ is the intersection of balls of radius $r$ centered at the points of the given set. In this paper we prove the following Blaschke-Santal\'o-type inequalities for $r$-ball bodies: for all $1\leq k\leq d$ and for any set of given volume in ${\mathbb E}^d$ the $k$-th intrinsic volume of the $r$-ball body generated by the set becomes maximal if the set is a ball. As an application we investigate the Gromov-Klee-Wagon problem for congruent balls in ${\mathbb E}^d$, which is a question on proving or disproving that if the centers of a family of $N$ congruent balls in ${\mathbb E}^d$ are contracted, then the volume of the intersection does not decrease. In particular, we investigate this problem for uniform contractions, which are contractions where all the pairwise distances in the first set of centers are larger than all the pairwise distances in the second set of centers, that is, when the pairwise distances of the two sets are separated by some positive real number. The author and M. Nasz\'odi [Discrete Comput. Geom. 60/4 (2018), 967-980] proved that the intrinsic volumes of the intersection of $N$ congruent balls in ${\mathbb E}^d$, $d>1$ increase under any uniform contraction of the center points when $ N\geq \left(1+\sqrt{2}\right)^d$. We give a short proof of this result using the Blaschke-Santal\'o-type inequalities of $r$-ball bodies and improve it for $d\geq 42$.


title: Stress controlled rheology of dense suspensions using transient flows

abstract: Dense suspensions of hard particles in a Newtonian liquid can be jammed by shear when the applied stress exceeds a certain threshold. However, this jamming transition from a fluid into a solidified state cannot be probed with conventional steady-state rheology because the stress distribution inside the material cannot be controlled with sufficient precision. Here we introduce and validate a method that overcomes this obstacle. Rapidly propagating shear fronts are generated and used to establish well-controlled local stress conditions that sweep across the material. Exploiting such transient flows, we are able to track how a dense suspension approaches its shear jammed state dynamically, and can quantitatively map out the onset stress for solidification in a state diagram.


title: ELSA: Efficient Long-Term Secure Storage of Large Datasets

abstract: An increasing amount of information today is generated, exchanged, and stored digitally. This also includes long-lived and highly sensitive information (e.g., electronic health records, governmental documents) whose integrity and confidentiality must be protected over decades or even centuries. While there is a vast amount of cryptography-based data protection schemes, only few are designed for long-term protection. Recently, Braun et al. (AsiaCCS'17) proposed the first long-term protection scheme that provides renewable integrity protection and information-theoretic confidentiality protection. However, computation and storage costs of their scheme increase significantly with the number of stored data items. As a result, their scheme appears suitable only for protecting databases with a small number of relatively large data items, but unsuitable for databases that hold a large number of relatively small data items (e.g., medical record databases). In this work, we present a solution for efficient long-term integrity and confidentiality protection of large datasets consisting of relatively small data items. First, we construct a renewable vector commitment scheme that is information-theoretically hiding under selective decommitment. We then combine this scheme with renewable timestamps and information-theoretically secure secret sharing. The resulting solution requires only a single timestamp for protecting a dataset while the state of the art requires a number of timestamps linear in the number of data items. We implemented our solution and measured its performance in a scenario where 12 000 data items are aggregated, stored, protected, and verified over a time span of 100 years. Our measurements show that our new solution completes this evaluation scenario an order of magnitude faster than the state of the art.


title: Inferring Cosmic String Tension through the Neural Network Prediction of String Locations in CMB Maps

abstract: In previous work, we constructed a convolutional neural network used to estimate the location of cosmic strings in simulated cosmic microwave background temperature anisotropy maps. We derived a connection between the estimates of cosmic string locations by this neural network and the posterior probability distribution of the cosmic string tension $G\mu$. Here, we significantly improve the calculation of the posterior distribution of the string tension $G\mu$. We also improve our previous plain convolutional neural network by using residual networks. We apply our new neural network and posterior calculation method to maps from the same simulation used in our previous work and quantify the improvement.


title: Active Learning of Uniformly Accurate Inter-atomic Potentials for Materials Simulation

abstract: An active learning procedure called Deep Potential Generator (DP-GEN) is proposed for the construction of accurate and transferable machine learning-based models of the potential energy surface (PES) for the molecular modeling of materials. This procedure consists of three main components: exploration, generation of accurate reference data, and training. Application to the sample systems of Al, Mg and Al-Mg alloys demonstrates that DP-GEN can produce uniformly accurate PES models with a minimal number of reference data.


title: Prediction of severity and treatment outcome for ASD from fMRI

abstract: Autism spectrum disorder (ASD) is a complex neurodevelopmental syndrome. Early diagnosis and precise treatment are essential for ASD patients. Although researchers have built many analytical models, there has been limited progress in accurate predictive models for early diagnosis. In this project, we aim to build an accurate model to predict treatment outcome and ASD severity from early stage functional magnetic resonance imaging (fMRI) scans. The difficulty in building large databases of patients who have received specific treatments and the high dimensionality of medical image analysis problems are challenges in this work. We propose a generic and accurate two-level approach for high-dimensional regression problems in medical image analysis. First, we perform region-level feature selection using a predefined brain parcellation. Based on the assumption that voxels within one region in the brain have similar values, for each region we use the bootstrapped mean of voxels within it as a feature. In this way, the dimension of data is reduced from number of voxels to number of regions. Then we detect predictive regions by various feature selection methods. Second, we extract voxels within selected regions, and perform voxel-level feature selection. To use this model in both linear and non-linear cases with limited training examples, we apply two-level elastic net regression and random forest (RF) models respectively. To validate accuracy and robustness of this approach, we perform experiments on both task-fMRI and resting state fMRI datasets. Furthermore, we visualize the influence of each region, and show that the results match well with other findings.


title: A mesoscopic model for the effective electrical conductivity of composite polymeric electrolytes

abstract: The effective quasistatic conductivity of composite polymeric electrolytes is studied in terms of a hard-core--penetrable-layer model. Used to incorporate the interface phenomena (such as amorphization of the polymer matrix around filler particles, stiffening effect by those on the amorphous phase, irregularities of the filler grains' surfaces, etc.), the layers are assumed to be electrically inhomogeneous, consisting of a finite or infinite number of concentric uniform shells. The rules of dominance, imposed on the overlapping regions, are equivalent to the requirement that the local electric properties in the system be determined by the distance from the point of interest to the nearest particle's center. The desired conductivity is calculated using our original many-particle (compact-group) approach which, however, avoids an in-depth elaboration of polarization and correlation processes. The result is expressed through the electrical and geometrical parameters of the constituents. Contrasting it with experiment reveals that the theory adequately describes the effective conductivity as a function of the filler concentration and temperature for a number of polymeric composites based on poly(ethylene oxide) or oxymethylene-linked poly(ethylene oxide) and is more flexible in comparison with other theories.


title: An Efficient Implementation of Riemannian Manifold Hamiltonian Monte Carlo for Gaussian Process Models

abstract: This technical report presents pseudo-code for a Riemannian manifold Hamiltonian Monte Carlo (RMHMC) method to efficiently simulate samples from $N$-dimensional posterior distributions $p(x|y)$, where $x \in R^N$ is drawn from a Gaussian Process (GP) prior, and observations $y_n$ are independent given $x_n$. Sufficient technical and algorithmic details are provided for the implementation of RMHMC for distributions arising from GP priors.


title: A unifying picture of generalized thermodynamic uncertainty relations

abstract: The thermodynamic uncertainty relation is a universal trade-off relation connecting the precision of a current with the average dissipation at large times. For continuous time Markov chains (also called Markov jump processes) this relation is valid in the time-homogeneous case, while it fails in the time-periodic case. The latter is relevant for the study of several small thermodynamic systems. We consider here a time-periodic Markov chain with continuous time and a broad class of functionals of stochastic trajectories, which are general linear combinations of the empirical flow and the empirical density. Inspired by the analysis done in our previous work [1], we provide general methods to get local quadratic bounds for large deviations, which lead to universal lower bounds on the ratio of the diffusion coefficient to the squared average value in terms of suitable universal rates, independent of the empirical functional. These bounds are called "generalized thermodynamic uncertainty relations" (GTUR's), being generalized versions of the thermodynamic uncertainty relation to the time-periodic case and to functionals which are more general than currents. Previously, GTUR's in the time-periodic case have been obtained in [1, 27, 42]. Here we recover the GTUR's in [1, 27] and produce new ones, leading to even stronger bounds and also to new trade-off relations for time-homogeneous systems. Moreover, we generalize to arbitrary protocols the GTUR obtained in [42] for time-symmetric protocols. We also generalize to the time-periodic case the GTUR obtained in [19] for the so called dynamical activity, and provide a new GTUR which, in the time-homogeneous case, is stronger than the one in [19]. The unifying picture is completed with a comprehensive comparison between the different GTUR's.

categories: cond-mat.stat-mech math-ph math.MP math.PR


title: Language Modeling for Code-Switching: Evaluation, Integration of Monolingual Data, and Discriminative Training

abstract: We focus on the problem of language modeling for code-switched language, in the context of automatic speech recognition (ASR). Language modeling for code-switched language is challenging for (at least) three reasons: (1) lack of available large-scale code-switched data for training; (2) lack of a replicable evaluation setup that is ASR directed yet isolates language modeling performance from the other intricacies of the ASR system; and (3) the reliance on generative modeling. We tackle these three issues: we propose an ASR-motivated evaluation setup which is decoupled from an ASR system and the choice of vocabulary, and provide an evaluation dataset for English-Spanish code-switching. This setup lends itself to a discriminative training approach, which we demonstrate to work better than generative language modeling. Finally, we explore a variety of training protocols and verify the effectiveness of training with large amounts of monolingual data followed by fine-tuning with small amounts of code-switched data, for both the generative and discriminative cases.


title: Smoothed Analysis of Discrete Tensor Decomposition and Assemblies of Neurons

abstract: We analyze linear independence of rank one tensors produced by tensor powers of randomly perturbed vectors. This enables efficient decomposition of sums of high-order tensors. Our analysis builds upon [BCMV14] but allows for a wider range of perturbation models, including discrete ones. We give an application to recovering assemblies of neurons. Assemblies are large sets of neurons representing specific memories or concepts. The size of the intersection of two assemblies has been shown in experiments to represent the extent to which these memories co-occur or these concepts are related; the phenomenon is called association of assemblies. This suggests that an animal's memory is a complex web of associations, and poses the problem of recovering this representation from cognitive data. Motivated by this problem, we study the following more general question: Can we reconstruct the Venn diagram of a family of sets, given the sizes of their $\ell$-wise intersections? We show that as long as the family of sets is randomly perturbed, it is enough for the number of measurements to be polynomially larger than the number of nonempty regions of the Venn diagram to fully reconstruct the diagram.


title: Magnetic-field enhancement of performance of superconducting nanowire single-photon detector

abstract: We present SNSPDs from NbN nanowires shaped after square-spiral that allows an increase not only in critical currents but also an extension of spectral detection efficiencies by just applying an external magnetic field. Using negative electron-beam lithography with the positive resist for shaping nanowires, made it possible to reduce the inner bend radius. Consequently, the effect of critical-current enhancement in the magnetic field becomes stronger than it was demonstrated earlier. Here we achieved a 13% increase of the critical current in the magnetic field. We measured spectra of the single-photon detection efficiency in the wavelength range from 400 to 1100 nm in the magnetic field. At zero field, the square spiral has the spectrum similar to that of a meander. At the field providing the maximum of the critical current, the detection efficiency and the cut-off wavelength in the spectrum increase by 20% and by 54%, correspondingly. The magnetic-field dependence of dark count rate is well described by proposed analytical model.


title: Small Values of Indefinite Diagonal Quadratic Forms at Integer Points in at least five Variables

abstract: For any $\varepsilon > 0$ we derive effective estimates for the size of a non-zero integral point $m \in \mathbb{Z}^d \setminus \{0\}$ solving the Diophantine inequality $\lvert Q[m] \rvert < \varepsilon$, where $Q[m] = q_1 m_1^2 + \ldots + q_d m_d^2$ denotes a non-singular indefinite diagonal quadratic form in $d \geq 5$ variables. In order to prove our quantitative variant of the Oppenheim conjecture, we extend an approach developed by Birch and Davenport [BD58b] to higher dimensions combined with a theorem of Schlickewei [Sch85]. The result obtained is an optimal extension of Schlickewei's result, giving bounds on small zeros of integral quadratic forms depending on the signature $(r,s)$, to diagonal forms up to a negligible growth factor.


title: Accurate, Efficient and Scalable Graph Embedding

abstract: The Graph Convolutional Network (GCN) model and its variants are powerful graph embedding tools for facilitating classification and clustering on graphs. However, a major challenge is to reduce the complexity of layered GCNs and make them parallelizable and scalable on very large graphs -- state-of the art techniques are unable to achieve scalability without losing accuracy and efficiency. In this paper, we propose novel parallelization techniques for graph sampling-based GCNs that achieve superior scalable performance on very large graphs without compromising accuracy. Specifically, our GCN guarantees work-efficient training and produces order of magnitude savings in computation and communication. To scale GCN training on tightly-coupled shared memory systems, we develop parallelization strategies for the key steps in training: For the graph sampling step, we exploit parallelism within and across multiple sampling instances, and devise an efficient data structure for concurrent accesses that provides theoretical guarantee of near-linear speedup with number of processing units. For the feature propagation step within the sampled graph, we improve cache utilization and reduce DRAM communication by data partitioning. We prove that our partitioning strategy is a 2-approximation for minimizing the communication time compared to the optimal strategy. We demonstrate that our parallel graph embedding outperforms state-of-the-art methods in scalability (with respect to number of processors, graph size and GCN model size), efficiency and accuracy on several large datasets. On a 40-core Xeon platform, our parallel training achieves $64\times$ speedup (with AVX) in the sampling step and $25\times$ speedup in the feature propagation step, compared to the serial implementation, resulting in a net speedup of $21\times$.


title: Cultural transmission modes of music sampling traditions remain stable despite delocalization in the digital age

abstract: Music sampling is a common practice among hip-hop and electronic producers that has played a critical role in the development of particular subgenres. Artists preferentially sample drum breaks, and previous studies have suggested that these may be culturally transmitted. With the advent of digital sampling technologies and social media the modes of cultural transmission may have shifted, and music communities may have become decoupled from geography. The aim of the current study was to determine whether drum breaks are culturally transmitted through musical collaboration networks, and to identify the factors driving the evolution of these networks. Using network-based diffusion analysis we found strong evidence for the cultural transmission of drum breaks via collaboration between artists, and identified several demographic variables that bias transmission. Additionally, using network evolution methods we found evidence that the structure of the collaboration network is no longer biased by geographic proximity after the year 2000, and that gender disparity has relaxed over the same period. Despite the delocalization of communities by the internet, collaboration remains a key transmission mode of music sampling traditions. The results of this study provide valuable insight into how demographic biases shape cultural transmission in complex networks, and how the evolution of these networks has shifted in the digital age.


title: Uniqueness of certain Fourier-Jacobi models over finite fields

abstract: In this paper, we prove the uniqueness of certain Fourier-Jacobi models for the split exceptional group $G_2$ over finite fields with odd characteristic. Similar results are also proved for $Sp_4$ and $U_4$.


title: Energy-Reliability Aware Link Optimization for Battery-Powered IoT Devices with Non-Ideal Power Amplifiers

abstract: In this paper, we study cross-layer optimization of low-power wireless links for reliability-aware applications while considering both the constraints and the non-ideal characteristics of the hardware in Internet-of-things (IoT) devices. Specifically, we define an energy consumption (EC) model that captures the energy cost---of transceiver circuitry, power amplifier, packet error statistics, packet overhead, etc.---in delivering a useful data bit. We derive the EC models for an ideal and two realistic non-linear power amplifier models. To incorporate packet error statistics, we develop a simple, in the form of elementary functions, and accurate closed-form packet error rate (PER) approximation in Rayleigh block-fading. Using the EC models, we derive energy-optimal yet reliability and hardware compliant conditions for limiting unconstrained optimal signal-to-noise ratio (SNR), and payload size. Together with these conditions, we develop a semi-analytic algorithm for resource-constrained IoT devices to jointly optimize parameters on physical (modulation size, SNR) and MAC (payload size and the number of retransmissions) layers in relation to link distance. Our results show that despite reliability constraints, the common notion---higher $M$-ary QAM modulations are energy optimal for short-range communication---prevails, and can provide up to 180% lifetime extension as compared to often employed OQPSK modulation in IoT devices. However, the reliability constraints reduce both their range and the energy efficiency, while non-ideal traditional PA reduces the range further by 50%, and diminishes the energy gains unless a better PA is employed.


title: Dynamic Thresholding Mechanisms for IR-Based Filtering in Efficient Source Code Plagiarism Detection

abstract: To solve time inefficiency issue, only potential pairs are compared in string-matching-based source code plagiarism detection; wherein potentiality is defined through a fast-yet-order-insensitive similarity measurement (adapted from Information Retrieval) and only pairs which similarity degrees are higher or equal to a particular threshold is selected. Defining such threshold is not a trivial task considering the threshold should lead to high efficiency improvement and low effectiveness reduction (if it is unavoidable). This paper proposes two thresholding mechanisms---namely range-based and pair-count-based mechanism---that dynamically tune the threshold based on the distribution of resulted similarity degrees. According to our evaluation, both mechanisms are more practical to be used than manual threshold assignment since they are more proportional to efficiency improvement and effectiveness reduction.


title: Eigenvalue Fluctuations of Symmetric Group Permutation Representations on k-tuples and k-subsets

abstract: Let the term $k$-representation refer to the permutation representations of the symmetric group $\mathfrak{S}_n$ on $k$-tuples and $k$-subsets as well as the $S^{(n-k,1^k)}$ irreducible representation of $\mathfrak{S}_n$. Endow $\mathfrak{S}_n$ with the Ewens distribution and let $\alpha$ and $\beta$ be linearly independent irrational numbers over $\mathbb{Q}$. Then for fixed $k > 1$ we show that as $n \to \infty$, the normalized count of the number of eigenangles in a fixed interval $(\alpha, \beta)$ of a $k$-representation evaluated at a random element $\sigma \in \mathfrak{S}_n$ converges weakly to a compactly supported distribution. In particular, we compute the limiting moments and moreover provide an explicit formula for the limiting density when $k = 2$ and the Ewens parameter $\theta = 1$ (uniform probability measure). This is in contrast to the $k = 1$ case where it has been shown previously that the distribution is asymptotically Gaussian.


title: Sparse Logistic Regression Learns All Discrete Pairwise Graphical Models

abstract: We characterize the effectiveness of a classical algorithm for recovering the Markov graph of a general discrete pairwise graphical model from i.i.d. samples. The algorithm is (appropriately regularized) maximum conditional log-likelihood, which involves solving a convex program for each node; for Ising models this is $\ell_1$-constrained logistic regression, while for more general alphabets an $\ell_{2,1}$ group-norm constraint needs to be used. We show that this algorithm can recover any arbitrary discrete pairwise graphical model, and also characterize its sample complexity as a function of model width, alphabet size, edge parameter accuracy, and the number of variables. We show that along every one of these axes, it matches or improves on all existing results and algorithms for this problem. Our analysis applies a sharp generalization error bound for logistic regression when the weight vector has an $\ell_1$ constraint (or $\ell_{2,1}$ constraint) and the sample vector has an $\ell_{\infty}$ constraint (or $\ell_{2, \infty}$ constraint). We also show that the proposed convex programs can be efficiently solved in $\tilde{O}(n^2)$ running time (where $n$ is the number of variables) under the same statistical guarantees. We provide experimental results to support our analysis.


title: Semi-Supervised Translation with MMD Networks

abstract: This work aims to improve semi-supervised learning in a neural network architecture by introducing a hybrid supervised and unsupervised cost function. The unsupervised component is trained using a differentiable estimator of the Maximum Mean Discrepancy (MMD) distance between the network output and the target dataset. We introduce the notion of an $n$-channel network and several methods to improve performance of these nets based on supervised pre-initialization, and multi-scale kernels. This work investigates the effectiveness of these methods on language translation where very few quality translations are known \textit{a priori}. We also present a thorough investigation of the hyper-parameter space of this method on both synthetic data.


title: Semileptonic $D_{(s)}$-meson decays in the light of recent data

abstract: Inspired by recent improved measurements of charm semileptonic decays at BESIII, we study a large set of $D(D_s)$-meson semileptonic decays where the hadron in the final state is one of $D^0$, $\rho$, $\omega$, $\eta^{(\prime)}$ in the case of $D^+$ decays, and $D^0$, $\phi$, $K^0$, $K^\ast(892)^0$, $\eta^{(\prime)}$ in the case of $D^+_s$ decays. The required hadronic form factors are computed in the full kinematical range of momentum transfer by employing the covariant confined quark model developed by us. A detailed comparison of the form factors with those from other approaches is provided. We calculate the decay branching fractions and their ratios, which show good agreement with available experimental data. We also give predictions for the forward-backward asymmetry and the longitudinal and transverse polarizations of the charged lepton in the final state.


title: Mean-field theory of graph neural networks in graph partitioning

abstract: A theoretical performance analysis of the graph neural network (GNN) is presented. For classification tasks, the neural network approach has the advantage in terms of flexibility that it can be employed in a data-driven manner, whereas Bayesian inference requires the assumption of a specific model. A fundamental question is then whether GNN has a high accuracy in addition to this flexibility. Moreover, whether the achieved performance is predominately a result of the backpropagation or the architecture itself is a matter of considerable interest. To gain a better insight into these questions, a mean-field theory of a minimal GNN architecture is developed for the graph partitioning problem. This demonstrates a good agreement with numerical experiments.


title: On abstract commensurators of surface groups

abstract: Let $\Gamma$ be the fundamental group of a surface of finite type and Comm$(\Gamma)$ be its abstract commensurator. Then Comm$(\Gamma)$ contains the solvable Baumslag--Solitar groups $\langle a ,b : a b a^{-1} = b^n \rangle$ for any $n > 1$. Moreover, the Baumslag--Solitar group $\langle a ,b : a b^2 a^{-1} = b^3 \rangle$ has an image in Comm$(\Gamma)$ that is not residually finite. Our proofs are computer-assisted. Our results also illustrate that finitely-generated subgroups of Comm$(\Gamma)$ are concrete objects amenable to computational methods. For example, we give a proof that $\langle a ,b : a b^2 a^{-1} = b^3 \rangle$ is not residually finite without the use of normal forms of HNN extensions.


title: Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interference

abstract: Lack of performance when it comes to continual learning over non-stationary distributions of data remains a major challenge in scaling neural network learning to more human realistic settings. In this work we propose a new conceptualization of the continual learning problem in terms of a temporally symmetric trade-off between transfer and interference that can be optimized by enforcing gradient alignment across examples. We then propose a new algorithm, Meta-Experience Replay (MER), that directly exploits this view by combining experience replay with optimization based meta-learning. This method learns parameters that make interference based on future gradients less likely and transfer based on future gradients more likely. We conduct experiments across continual lifelong supervised learning benchmarks and non-stationary reinforcement learning environments demonstrating that our approach consistently outperforms recently proposed baselines for continual learning. Our experiments show that the gap between the performance of MER and baseline algorithms grows both as the environment gets more non-stationary and as the fraction of the total experiences stored gets smaller.


title: Probabilistic Multilevel Clustering via Composite Transportation Distance

abstract: We propose a novel probabilistic approach to multilevel clustering problems based on composite transportation distance, which is a variant of transportation distance where the underlying metric is Kullback-Leibler divergence. Our method involves solving a joint optimization problem over spaces of probability measures to simultaneously discover grouping structures within groups and among groups. By exploiting the connection of our method to the problem of finding composite transportation barycenters, we develop fast and efficient optimization algorithms even for potentially large-scale multilevel datasets. Finally, we present experimental results with both synthetic and real data to demonstrate the efficiency and scalability of the proposed approach.


title: Open Strings On The Rindler Horizon

abstract: It has been proposed that a certain Z_N orbifold, analytically continued in N, can be used to describe the thermodynamics of Rindler space in string theory. In this paper, we attempt to implement this idea for the open-string sector. The most interesting result is that, although the orbifold is tachyonic for positive integer N, the tachyon seems to disappear after analytic continuation to the region that is appropriate for computing ${\mathrm {Tr}} \rho^{\mathcal N}$, where $\rho$ is the density matrix of Rindler space and Re $\mathcal N$>1. Analytic continuation of the full orbifold conformal field theory remains a challenge, but we find some evidence that if such analytic continuation is possible, the resulting theory is a logarithmic conformal field theory, necessarily nonunitary.


title: On the resonant reflection of weak, nonlinear sound waves off an entropy wave

abstract: We derive a degenerate quasilinear Schr\"odinger equation that describes the resonant reflection of very weak, nonlinear sound waves off a weak sawtooth entropy wave.


title: Rademacher Complexity for Adversarially Robust Generalization

abstract: Many machine learning models are vulnerable to adversarial attacks; for example, adding adversarial perturbations that are imperceptible to humans can often make machine learning models produce wrong predictions with high confidence. Moreover, although we may obtain robust models on the training dataset via adversarial training, in some problems the learned models cannot generalize well to the test data. In this paper, we focus on $\ell_\infty$ attacks, and study the adversarially robust generalization problem through the lens of Rademacher complexity. For binary linear classifiers, we prove tight bounds for the adversarial Rademacher complexity, and show that the adversarial Rademacher complexity is never smaller than its natural counterpart, and it has an unavoidable dimension dependence, unless the weight vector has bounded $\ell_1$ norm. The results also extend to multi-class linear classifiers. For (nonlinear) neural networks, we show that the dimension dependence in the adversarial Rademacher complexity also exists. We further consider a surrogate adversarial loss for one-hidden layer ReLU network and prove margin bounds for this setting. Our results indicate that having $\ell_1$ norm constraints on the weight matrices might be a potential way to improve generalization in the adversarial setting. We demonstrate experimental results that validate our theoretical findings.


title: The large scale structure in the 3D luminosity-distance space and its cosmological applications

abstract: Future gravitational wave (GW) observations are capable of detecting millions of compact star binary mergers in extragalactic galaxies, with $1\%$ luminosity-distance ($D_L$) measurement accuracy and better than arcminute positioning accuracy. This will open a new window of the large scale structure (LSS) of the universe, in the 3D {\bf luminosity-distance space (LDS)}, instead of the 3D redshift space of galaxy spectroscopic surveys. The baryon acoustic oscillation and the AP test encoded in the LDS LSS constrain the $D_L$-$D^{\rm co}_A$ (comoving angular diameter distance) relation and therefore the expansion history of the universe. Peculiar velocity induces the LDS distortion, analogous to the redshift space distortion, and allows for a new structure growth measure $f_L\sigma_8$. When the distance duality is enforced ($1+z=D_L/D^{\rm co}_A$), the LDS LSS by itself determines the redshift to $\sim 1\%$ level accuracy, and alleviates the need of spectroscopic follow-up of GW events.But a more valuable application is to test the distance duality to $1\%$ level accuracy, in combination with conventional BAO and supernovae measurements. This will put stringent constraints on modified gravity models in which the gravitational wave $D^{\rm GW}_L$ deviates from the electromagnetic wave $D^{EM}_L$. All these applications require no spectroscopic follow-ups.


title: Bumpless Pipedreams, Reduced Word Tableaux and Stanley Symmetric Functions

abstract: Lam, Lee and Shimozono introduced the structure of bumpless pipedreams in their study of back stable Schubert calculus. They found that a specific family of bumpless pipedreams, called EG-pipedreams, can be used to interpret the Edelman-Greene coefficients appearing in the expansion of a Stanley symmetric function in the basis of Schur functions. It is well known that the Edelman-Greene coefficients can also be interpreted in terms of reduced word tableaux for permutations. Lam, Lee and Shimozono proposed the problem of finding a shape preserving bijection between reduced word tableaux for a permutation $w$ and EG-pipedreams of $w$. In this paper, we construct such a bijection. The key ingredients are two new developed isomorphic tree structures associated to $w$: the modified Lascoux-Sch\"{u}tzenberger tree of $w$ and the Edelman-Greene tree of $w$. Using the Little map, we show that the leaves in the modified Lascoux-Sch\"{u}tzenberger of $w$ are in bijection with the reduced word tableaux for $w$. On the other hand, applying the droop operation on bumpless pipedreams also introduced by Lam, Lee and Shimozono, we show that the leaves in the Edelman-Greene tree of $w$ are in bijection with the EG-pipedreams of $w$. This allows us to establish a shape preserving one-to-one correspondence between reduced word tableaux for $w$ and EG-pipedreams of $w$.


title: Location and scale behaviour of the quantiles of a natural exponential family

abstract: Let $P_0$ be a probability on the real line generating a natural exponential family $(P_t)_{t\in \mathbb {R}}$. Fix $\alpha$ in $ (0,1).$ We show that the property that $P_t((-\infty,t)) \leq \alpha \leq P_t((-\infty,t])$ for all $t$ implies that there exists a number $\mu_\alpha$ such that $P_0$ is the Gaussian distribution $N(\mu_{\alpha},1).$ In other terms, if for all $t$, $t$ is a quantile of $P_t$ associated to some threshold $\alpha\in (0,1)$, then the exponential family must be Gaussian. The case $\alpha=1/2$, \textit{i.e.} $t$ is always a median of $P_t,$ has been considered in Letac \textit{et al.} (2018). Analogously let $Q$ be a measure on $[0,\infty)$ generating a natural exponential family $(Q_{-t})_{t>0}$. We show that $Q_{-t}([0,t^{-1}))\leq \alpha \leq Q_{-t}([0,t^{-1}])$ for all $t>0$ implies that there exists a number $p=p_{\alpha}>0$ such that $Q(dx)\propto x^{p-1}dx,$ and thus $Q_{-t}$ has to be a gamma distribution with parameters $p$ and $t.$


title: Phylodynamics of rapidly adapting pathogens: extinction and speciation of a Red Queen

abstract: Rapidly evolving pathogens like influenza viruses can persist by accumulating antigenic novelty fast enough to evade the adaptive immunity of the host population, yet without continuous accumulation of genetic diversity. This dynamical state is often compared to the Red Queen evolving as fast as it can just to maintain its foothold in the host population: Accumulation of antigenic novelty is balanced by the build-up of host immunity. Such Red Queen States (RQS) of continuous adaptation in large rapidly mutating populations are well understood in terms of Traveling Wave (TW) theories of population genetics. Here we shall make explicit the mapping of the established Multi-strain Susceptible-Infected-Recovered (SIR) model onto the TW theory and demonstrate that a pathogen can persist in RQS if cross-immunity is long-ranged and its population size is large populations allowing for rapid adaptation. We then investigate the stability of this state focusing on the rate of extinction and the rate of "speciation" defined as antigenic divergence of viral strains beyond the range of cross-inhibition. RQS states are transient, but in a certain range of evolutionary parameters can exist for the time long compared to the typical time to the most recent common ancestor ($T_{MRCA}$). In this range the steady TW is unstable and the antigenic advance of the lead strains relative to the typical co-circulating viruses tends to oscillate. This results in large fluctuations in prevalence that facilitate extinction. We shall demonstrate that the rate of TW fission into antigenically uncoupled viral populations is related to fluctuations of $T_{MRCA}$ and construct a "phase diagram" identifying different regimes of viral phylodynamics as a function of evolutionary parameters.


title: Text-Adaptive Generative Adversarial Networks: Manipulating Images with Natural Language

abstract: This paper addresses the problem of manipulating images using natural language description. Our task aims to semantically modify visual attributes of an object in an image according to the text describing the new visual appearance. Although existing methods synthesize images having new attributes, they do not fully preserve text-irrelevant contents of the original image. In this paper, we propose the text-adaptive generative adversarial network (TAGAN) to generate semantically manipulated images while preserving text-irrelevant contents. The key to our method is the text-adaptive discriminator that creates word-level local discriminators according to input text to classify fine-grained attributes independently. With this discriminator, the generator learns to generate images where only regions that correspond to the given text are modified. Experimental results show that our method outperforms existing methods on CUB and Oxford-102 datasets, and our results were mostly preferred on a user study. Extensive analysis shows that our method is able to effectively disentangle visual attributes and produce pleasing outputs.


title: A Sweet Pepper Harvesting Robot for Protected Cropping Environments

abstract: Using robots to harvest sweet peppers in protected cropping environments has remained unsolved despite considerable effort by the research community over several decades. In this paper, we present the robotic harvester, Harvey, designed for sweet peppers in protected cropping environments that achieved a 76.5% success rate (within a modified scenario) which improves upon our prior work which achieved 58% and related sweet pepper harvesting work which achieved 33\%. This improvement was primarily achieved through the introduction of a novel peduncle segmentation system using an efficient deep convolutional neural network, in conjunction with 3D post-filtering to detect the critical cutting location. We benchmark the peduncle segmentation against prior art demonstrating a considerable improvement in performance with an F_1 score of 0.564 compared to 0.302. The robotic harvester uses a perception pipeline to detect a target sweet pepper and an appropriate grasp and cutting pose used to determine the trajectory of a multi-modal harvesting tool to grasp the sweet pepper and cut it from the plant. A novel decoupling mechanism enables the gripping and cutting operations to be performed independently. We perform an in-depth analysis of the full robotic harvesting system to highlight bottlenecks and failure points that future work could address.


title: AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networks

abstract: Click-through rate (CTR) prediction, which aims to predict the probability of a user clicking on an ad or an item, is critical to many online applications such as online advertising and recommender systems. The problem is very challenging since (1) the input features (e.g., the user id, user age, item id, item category) are usually sparse and high-dimensional, and (2) an effective prediction relies on high-order combinatorial features (\textit{a.k.a.} cross features), which are very time-consuming to hand-craft by domain experts and are impossible to be enumerated. Therefore, there have been efforts in finding low-dimensional representations of the sparse and high-dimensional raw features and their meaningful combinations. In this paper, we propose an effective and efficient method called the \emph{AutoInt} to automatically learn the high-order feature interactions of input features. Our proposed algorithm is very general, which can be applied to both numerical and categorical input features. Specifically, we map both the numerical and categorical features into the same low-dimensional space. Afterwards, a multi-head self-attentive neural network with residual connections is proposed to explicitly model the feature interactions in the low-dimensional space. With different layers of the multi-head self-attentive neural networks, different orders of feature combinations of input features can be modeled. The whole model can be efficiently fit on large-scale raw data in an end-to-end fashion. Experimental results on four real-world datasets show that our proposed approach not only outperforms existing state-of-the-art approaches for prediction but also offers good explainability. Code is available at: \url{https://github.com/DeepGraphLearning/RecommenderSystems}.


title: The Expressive Power of Parameterized Quantum Circuits

abstract: Parameterized quantum circuits (PQCs) have been broadly used as a hybrid quantum-classical machine learning scheme to accomplish generative tasks. However, whether PQCs have better expressive power than classical generative neural networks, such as restricted or deep Boltzmann machines, remains an open issue. In this paper, we prove that PQCs with a simple structure already outperform any classical neural network for generative tasks, unless the polynomial hierarchy collapses. Our proof builds on known results from tensor networks and quantum circuits (in particular, instantaneous quantum polynomial circuits). In addition, PQCs equipped with ancillary qubits for post-selection have even stronger expressive power than those without post-selection. We employ them as an application for Bayesian learning, since it is possible to learn prior probabilities rather than assuming they are known. We expect that it will find many more applications in semi-supervised learning where prior distributions are normally assumed to be unknown. Lastly, we conduct several numerical experiments using the Rigetti Forest platform to demonstrate the performance of the proposed Bayesian quantum circuit.


title: Optimal identification of non-Markovian environments for spin chains

abstract: Correlations of an environment are crucial for the dynamics of non-Markovian quantum systems, which may not be known in advance. In this paper, we propose a gradient algorithm for identifying the correlations in terms of time-varying damping rate functions in a time-convolution-less master equation for spin chains. By measuring time trace observables of the system, the identification procedure can be formulated as an optimization problem. The gradient algorithm is designed based on a calculation of the derivative of an objective function with respect to the damping rate functions, whose effectiveness is shown in a comparison to a differential approach for a two-qubit spin chain.


title: The Discovery of a Gravitationally Lensed Quasar at z = 6.51

abstract: Strong gravitational lensing provides a powerful probe of the physical properties of quasars and their host galaxies. A high fraction of the most luminous high-redshift quasars was predicted to be lensed due to magnification bias. However, no multiple imaged quasar was found at z>5 in previous surveys. We report the discovery of J043947.08+163415.7, a strongly lensed quasar at z=6.51, the first such object detected at the epoch of reionization, and the brightest quasar yet known at z>5. High-resolution HST imaging reveals a multiple imaged system with a maximum image separation theta ~ 0.2", best explained by a model of three quasar images lensed by a low luminosity galaxy at z~0.7, with a magnification factor of ~50. The existence of this source suggests that a significant population of strongly lensed, high redshift quasars could have been missed by previous surveys, as standard color selection techniques would fail when the quasar color is contaminated by the lensing galaxy.


title: The Discovery of A Luminous Broad Absorption Line Quasar at A Redshift of 7.02

abstract: Despite extensive efforts, only two quasars have been found at $z>7$ to date due to a combination of low spatial density and high contamination from more ubiquitous Galactic cool dwarfs in quasar selection. This limits our current knowledge of the super-massive black hole (SMBH) growth mechanism and reionization history. In this letter, we report the discovery of a luminous quasar at $z=7.021$, DELS J003836.10$-$152723.6 (hereafter J0038$-$1527), selected using photometric data from DESI Legacy imaging Survey (DELS), Pan-STARRS1 (PS1) imaging Survey, as well as Wide-field Infrared Survey Explore ($WISE$) mid-infrared all-sky survey. With an absolute magnitude of $M_{1450}$=$-$27.1 and bolometric luminosity of $L_{\rm Bol}$=5.6$\times$10$^{13}$ $L_\odot$, J0038$-$1527 is the most luminous quasar known at $z>7$. Deep optical to near infrared spectroscopic observations suggest that J0038-1527 hosts a 1.3 billion solar mass BH accreting at the Eddington limit, with an Eddington ratio of 1.25$\pm$0.19. The CIV broad emission line of J0038$-$1527 is blue-shifted by more than 3000 km s$^{-1}$ to the systemic redshift. More detailed investigations of the high quality spectra reveal three extremely high velocity CIV broad absorption lines (BALs) with velocity from 0.08 to 0.14 times the speed of light and total balnicity index of more than 5000 km s$^{-1}$, suggesting the presence of relativistic outflows. J0038$-$1527 is the first quasar found at the epoch of reionization (EoR) with such strong outflows and provides a unique laboratory to investigate AGN feedback on the formation and growth of the most massive galaxies in the early universe.


title: Exploring Reionization-Era Quasars III: Discovery of 16 Quasars at $6.4\lesssim z \lesssim 6.9$ with DESI Legacy Imaging Surveys and UKIRT Hemisphere Survey and Quasar Luminosity Function at $z\sim6.7$

abstract: This is the third paper in a series aims at finding reionzation-era quasars with the combination of DESI Legacy imaging Surveys (DELS) and near-infrared imaging surveys, such as the UKIRT Hemisphere Survey (UHS), as well as the Wide-field Infrared Survey Explore ($WISE$) mid-infrared survey. In this paper, we describe the updated quasar candidate selection procedure, report the discovery of 16 quasars at $6.4\lesssim z \lesssim6.9$ from area of $\sim$13,020 deg$^2$, and present the quasar luminosity function (QLF) at $z\sim6.7$. The measured QLF follows $\Phi(L_{1450})\propto L_{1450}^{-2.35}$ in the magnitude range $27.6<M_{1450}<-25.5$. We determine the quasar comoving spatial density at $\langle z \rangle$=6.7 and $M_{1450}<-26.0$ to be $\rm 0.39\pm0.11 Gpc^{-3}$ and find that the exponential density evolution parameter to be $k=-0.78\pm0.18$ from $z\sim6$ to $z\sim6.7$, corresponding to a rapid decline by a factor of $\sim 6$ per unit redshift towards earlier epoch, a rate significantly faster than that at $z\sim 3- 5$. The cosmic time between $z\sim6$ and $z\sim6.7$ is only 121 Myrs. The quasar density declined by a factor of more than three within such short time requires that SMBHs must grow rapidly or they are less radiatively efficient at higher redshifts. We measured quasar comoving emissivity at $z\sim6.7$ which indicate that high redshift quasars are highly unlikely to make a significant contribution to hydrogen reionization. The broad absorption line (BAL) quasar fraction at $z\gtrsim6.5$ is measured to be $\gtrsim$22%. In addition, we also report the discovery of additional five quasars at $z\sim6$ in the appendix.


title: Filling in the Quasar Redshift Gap at $z \sim 5.5$ II: A Complete Survey of Luminous Quasars in the Post-Reionization Universe

abstract: We present the final results from our survey of luminous $z \sim $ 5.5 quasars. This is the first systematic quasar survey focusing on quasars at $z \sim$ 5.5, during the post-reionization epoch. It has been challenging to select quasars at $5.3 < z < 5.7$ using conventional color selections, due to their similar optical colors to those of late-type stars, especially M dwarfs. We developed a new selection technique for $z \sim$ 5.5 quasars based on optical, near-IR, and mid-IR photometry, using data from the Sloan Digital Sky Survey (SDSS), PanSTARR1 (PS1), the UKIRT Infrared Deep Sky Surveys - Large Area Survey, the UKIRT Hemisphere Survey, the VISTA Hemisphere Survey, and the Wide Field Infrared Survey Explorer ($WISE$), covering $\sim$ 11000 deg$^2$ of high galactic latitude sky. In this paper, we present the discovery of 15 new quasars at $z\sim 5.5$. Together with results from Yang et al. (2017), our survey provides a complete, flux-limited sample of 31 quasars at $5.3 \le z \le 5.7$. We measure the quasar spatial density at $z \sim 5.5$ and $M_{1450} < -26.2$. Our result is consistent with the rapid decline of quasar spatial density from $z = 5$ to 6, with $k=-0.66 \pm 0.05$ ($\rho(z) \propto 10^{kz}$). In addition, we present a new survey using optical colors only from the full PS1 area for luminous quasars at $z = 5.0 - 5.5$, beyond the SDSS footprint, and report the preliminary results from this survey, including 51 new quasars discovered at $4.61\le z \le5.71$.


title: Lithium Niobate Metasurfaces

abstract: Lithium niobate is a multi-functional material, which has been regarded as one of the most promising platform for the multi-purpose optical components and photonic circuits. Targeting at the miniature optical components and systems, lithium niobate microstructures with feature sizes of several to hundreds of micrometers have been demonstrated, such as waveguides, photonic crystals, micro-cavities, and modulators, et al. In this paper, we presented subwavelength nanograting metasurfaces fabricated in a crystalline lithium niobate film, which hold the possibilities towards further shrinking the footprint of the photonic devices with new optical functionalities. Due to the collective lattice interactions between isolated ridge resonances, distinct transmission spectral resonances were observed, which could be tunable by varying the structural parameters. Furthermore, our metasurfaces are capable to show high efficiency transmission structural colors as a result of structural resonances and intrinsic high transparency of lithium niobate in visible spectral range. Our results would pave the way for the new types of ultracompact photonic devices based on lithium niobate.