title: The Cone of Silence: Speech Separation by Localization

abstract: Given a multi-microphone recording of an unknown number of speakers talking concurrently, we simultaneously localize the sources and separate the individual speakers. At the core of our method is a deep network, in the waveform domain, which isolates sources within an angular region $\theta \pm w/2$, given an angle of interest $\theta$ and angular window size $w$. By exponentially decreasing $w$, we can perform a binary search to localize and separate all sources in logarithmic time. Our algorithm allows for an arbitrary number of potentially moving speakers at test time, including more speakers than seen during training. Experiments demonstrate state-of-the-art performance for both source separation and source localization, particularly in high levels of background noise.


title: Almost non-negative scalar curvature on Riemannian manifolds conformal to tori

abstract: In this article we reduce the geometric stability conjecture for the scalar torus rigidity theorem to the conformal case via the Yamabe problem. Then we are able to prove the case where a sequence of Riemannian manifolds is conformal to a uniformly controlled sequence of flat tori and satisfies the geometric stability conjecture. We are also able to handle the case where a sequence of Riemannian manifolds is conformal to a sequence of constant negative scalar curvature Riemannian manifolds which converge to a flat torus in $C^1$. The full conjecture from the conformal perspective is also discussed as a possible approach to resolving the conjecture.


title: An Auto-Generated Geometry-Based Discrete Finite Element Model for Damage Evolution in Composite Laminates with Arbitrary Stacking Sequence

abstract: Stiffness degradation and progressive failure of composite laminates are complex processes involving evolution and multi-mode interactions among fiber fractures, intra-ply matrix cracks and inter-ply delaminations. This paper presents a novel finite element model capable of explicitly treating such discrete failures in laminates of random layup. Matching of nodes is guaranteed at potential crack bifurcations to ensure correct displacement jumps near crack tips and explicit load transfer among cracks. The model is entirely geometry-based (no mesh prerequisite) with distinct segments assembled together using surface-based tie constraints, and thus requires no element partitioning or enrichment. Several numerical examples are included to demonstrate the model's ability to generate results that are in qualitative and quantitative agreement with experimental observations on both damage evolution and tensile strength of specimens. The present model is believed unique in realizing simultaneous and accurate coupling of all three types of failures in laminates having arbitrary ply angles and layup.


title: Machine Learning for Material Characterization with an Application for Predicting Mechanical Properties

abstract: Currently, the growth of material data from experiments and simulations is expanding beyond processable amounts. This makes the development of new data-driven methods for the discovery of patterns among multiple lengthscales and time-scales and structure-property relationships essential. These data-driven approaches show enormous promise within materials science. The following review covers machine learning applications for metallic material characterization. Many parameters associated with the processing and the structure of materials affect the properties and the performance of manufactured components. Thus, this study is an attempt to investigate the usefulness of machine learning methods for material property prediction. Material characteristics such as strength, toughness, hardness, brittleness or ductility are relevant to categorize a material or component according to their quality. In industry, material tests like tensile tests, compression tests or creep tests are often time consuming and expensive to perform. Therefore, the application of machine learning approaches is considered helpful for an easier generation of material property information. This study also gives an application of machine learning methods on small punch test data for the determination of the property ultimate tensile strength for various materials. A strong correlation between small punch test data and tensile test data was found which ultimately allows to replace more costly tests by simple and fast tests in combination with machine learning.


title: Strong constraints on the $b \to s\gamma$ photon polarisation from $B^0 \to K^{*0} e^+ e^-$ decays

abstract: An angular analysis of the $B^0 \to K^{*0} e^+ e^-$ decay is performed using a data sample corresponding to an integrated luminosity of $9~{\rm fb}^{-1}$ of $pp$ collisions collected with the LHCb experiment. The analysis is conducted in the very low dielectron mass squared ($q^2$) interval between $0.0008$ and $0.257~{\rm GeV}^2$, where the rate is dominated by the $B^0\to K^{\ast 0}\gamma$ transition with a virtual photon. The fraction of longitudinal polarisation of the $K^{\ast 0}$ meson, $F_{\rm L}$, is measured to be $F_{\rm L} = (4.4 \pm 2.6 \pm 1.4)\%$, where the first uncertainty is statistical and the second systematic. The $A_{\rm T}^{\rm Re}$ observable, which is related to the lepton forward-backward asymmetry, is measured to be $A_{\rm T}^{\rm Re}=-0.06 \pm 0.08 \pm 0.02$. The $A_{\rm T}^{(2)}$ and $A_{\rm T}^{\rm Im}$ transverse asymmetries, which are sensitive to the virtual photon polarisation, are found to be $A_{\rm T}^{(2)} = 0.11 \pm 0.10 \ \pm 0.02$ and $A_{\rm T}^{\rm Im} = 0.02 \pm 0.10 \pm 0.01$. The results are consistent with Standard Model predictions and provide the world's best constraint on the $b\to s\gamma$ photon polarisation.


title: Neutrino Telescopes

abstract: This paper addresses the working principle of neutrino telescopes, important detector parameters as well as the layout and performance of current and future neutrino telescopes. It was prepared for the book "Probing Particle Physics with Neutrino Telescopes", C.~P{\'e}rez de los Heros, editor, 2020 (World Scientific) in 2018.


title: Arithmetic progressions of Carmichael numbers in a reduced residue class

abstract: Fix coprime natural numbers $a,q$. Assuming the Prime $k$-tuple Conjecture, we show that there exist arbitrarily long arithmetic progressions of Carmichael numbers, each of which lies in the reduced residue class $a$ mod $q$ and is a product of three distinct prime numbers.


title: Low-loss integrated nanophotonic circuits with layered semiconductor materials

abstract: Monolayer transition metal dichalcogenides with direct bandgaps are emerging candidates for microelectronics, nano-photonics, and optoelectronics. Transferred onto photonic integrated circuits (PICs), these semiconductor materials have enabled new classes of light-emitting diodes, modulators and photodetectors, that could be amenable to wafer-scale manufacturing. For integrated photonic devices, the optical losses of the PICs are critical. In contrast to silicon, silicon nitride (Si3N4) has emerged as a low-loss integrated platform with a wide transparency window from ultraviolet to mid-infrared and absence of two-photon absorption at telecommunication bands. Moreover, it is suitable for nonlinear integrated photonics due to its high Kerr nonlinearity and high-power handing capability. These features of Si3N4 are intrinsically beneficial for nanophotonics and optoelectronics applications. Here we report a low-loss integrated platform incorporating monolayer molybdenum ditelluride (1L-MoTe2) with Si3N4 photonic microresonators. We show that, with the 1L-MoTe2, microresonator quality factors exceeding 3 million in the telecommunication O-band to E-band are maintained. We further investigate the change of microresonator dispersion and resonance shift due to the presence of 1L-MoTe2, and extrapolate the optical loss introduced by 1L-MoTe2 in the telecommunication bands, out of the excitonic transition region. Our work presents a key step for low-loss, hybrid PICs with layered semiconductors without using heterogeneous wafer bonding.


title: MiniBooNE Neutrino Oscillation Search Results and Predicted Background Events

abstract: In this short review, we discuss the 2020 MiniBooNE electron neutrino appearance oscillation results with special attention on background predictions relevant to the MiniBooNE oscillation results and other (anti)electron neutrino appearance search experiments.


title: Perspectives for analyzing non-linear photo ionization spectra with deep neural networks trained with synthetic Hamilton matrices

abstract: We have constructed deep neural networks, which can map fluctuating photo-electron spectra obtained from noisy pulses to spectra from noise-free pulses. The network is trained on spectra from noisy pulses in combination with random Hamilton matrices, representing systems which could exist but do not necessarily exist. In [Giri et al., Phys. Rev. Lett. 124,113201 (2020)] we performed a purification of fluctuating spectra, that is mapping them to those from Fourier-limited Gaussian pulses. Here, we investigate the performance of such neural-network-based maps for predicting spectra of double pulses, pulses with a chirp and even partially-coherent pulses pulses from fluctuating spectra generated by noisy pulses. Secondly, we demonstrate that along with a purification of a fluctuating double-pulse spectrum, one can estimate the time-delay of the underlying double pulse, an attractive feature for single-shot spectra from SASE FELs. We demonstrate our approach with resonant two-photon ionization, a non-linear process, sensitive to details of the laser pulse.


title: One- and two-dimensional correlation spectroscopy analyses for resonant and non-resonant coherent nonlinear optical processes

abstract: Three-color coherent anti-Stokes Raman scattering represents non-degenerate four wave mixing process that includes both a non-resonant and resonant processes, the contributions of which depend on how the molecular vibrational modes are being excited by the input laser pulses. Non-degenerate four wave mixing processes are complex and understanding these processes requires rigorous data analytical tools, which still lack in this research field. In this work, we introduce one- and two-dimensional intensity-intensity correlation functions in terms of a new variable (e.g., probe pulse delay) and new perturbation parameter (e.g., probe pulse linewidth). In particular, diagonal projections are defined here as a tool to reduce both synchronous and asynchronous two-dimensional correlation spectroscopy analyses down to one-dimensional analysis, revealing valuable analytical information. Detailed analyses using the all Gaussian coherent Raman scattering closed-form solutions and the representative experimental data for resonant and non-resonant processes are presented and compared. This intensity-intensity correlation analytical tool holds a promising potential in resolving and visualizing resonant versus non-resonant four wave mixing processes for quantitative label-free species-specific nonlinear spectroscopy and microscopy.


title: Gender Coreference and Bias Evaluation at WMT 2020

abstract: Gender bias in machine translation can manifest when choosing gender inflections based on spurious gender correlations. For example, always translating doctors as men and nurses as women. This can be particularly harmful as models become more popular and deployed within commercial systems. Our work presents the largest evidence for the phenomenon in more than 19 systems submitted to the WMT over four diverse target languages: Czech, German, Polish, and Russian. To achieve this, we use WinoMT, a recent automatic test suite which examines gender coreference and bias when translating from English to languages with grammatical gender. We extend WinoMT to handle two new languages tested in WMT: Polish and Czech. We find that all systems consistently use spurious correlations in the data rather than meaningful contextual information.


title: Probabilistic Social Learning Improves the Public's Detection of Misinformation

abstract: The digital spread of misinformation is one of the leading threats to democracy, public health, and the global economy. Popular strategies for mitigating misinformation include crowdsourcing, machine learning, and media literacy programs that require social media users to classify news in binary terms as either true or false. However, research on peer influence suggests that framing decisions in binary terms can amplify judgment errors and limit social learning, whereas framing decisions in probabilistic terms can reliably improve judgments. In this preregistered experiment, we compare online peer networks that collaboratively evaluate the veracity of news by communicating either binary or probabilistic judgments. Exchanging probabilistic estimates of news veracity substantially improved individual and group judgments, with the effect of eliminating polarization in news evaluation. By contrast, exchanging binary classifications reduced social learning and entrenched polarization. The benefits of probabilistic social learning are robust to participants' education, gender, race, income, religion, and partisanship.


title: Cayley graphs with few automorphisms: the case of infinite groups

abstract: We characterize the finitely generated groups that admit a Cayley graph whose only automorphisms are the translations, confirming a conjecture by Watkins from 1976. The proof relies on random walk techniques. As a consequence, every finitely generated group admits a Cayley graph with countable automorphism group. We also treat the case of directed graphs.


title: The Long-Term Forecast of Station View Periods for Elliptical Orbits

abstract: In a previous paper, using ergodic theory, Lo [1] derived a simple definite integral that provided an estimate of the view periods of ground stations to satellites. This assumes the satellites are in circular orbits with non-repeating ground tracks under linear $J_2$ perturbations. The novel feature is that this is done without the propagation of the trajectory by employing ergodic theory. This accelerated the telecommunications mission design and analysis by several orders of magnitude and greatly simplified the process. In this paper, we extend the view period integral to elliptical orbits.


title: Adapting to Delays and Data in Adversarial Multi-Armed Bandits

abstract: We consider the adversarial multi-armed bandit problem under delayed feedback. We analyze variants of the Exp3 algorithm that tune their step-size using only information (about the losses and delays) available at the time of the decisions, and obtain regret guarantees that adapt to the observed (rather than the worst-case) sequences of delays and/or losses. First, through a remarkably simple proof technique, we show that with proper tuning of the step size, the algorithm achieves an optimal (up to logarithmic factors) regret of order $\sqrt{\log(K)(TK + D)}$ both in expectation and in high probability, where $K$ is the number of arms, $T$ is the time horizon, and $D$ is the cumulative delay. The high-probability version of the bound, which is the first high-probability delay-adaptive bound in the literature, crucially depends on the use of implicit exploration in estimating the losses. Then, following Zimmert and Seldin [2019], we extend these results so that the algorithm can "skip" rounds with large delays, resulting in regret bounds of order $\sqrt{TK\log(K)} + |R| + \sqrt{D_{\bar{R}}\log(K)}$, where $R$ is an arbitrary set of rounds (which are skipped) and $D_{\bar{R}}$ is the cumulative delay of the feedback for other rounds. Finally, we present another, data-adaptive (AdaGrad-style) version of the algorithm for which the regret adapts to the observed (delayed) losses instead of only adapting to the cumulative delay (this algorithm requires an a priori upper bound on the maximum delay, or the advance knowledge of the delay for each decision when it is made). The resulting bound can be orders of magnitude smaller on benign problems, and it can be shown that the delay only affects the regret through the loss of the best arm.


title: One-parameter families of multiview varieties via quotient lattices

abstract: We develop a novel theory of one-parameter families of multi-view varieties. These families are induced by quotient lattices over discrete valuation rings and generalise the notion of \textit{Mustafin varieties}. We study the geometry and the combinatorics of the limit of these families.


title: Autonomous quantum absorption refrigerators

abstract: We propose a quantum absorption refrigerator using the quantum physics of resonant tunneling through quantum dots. The cold and hot reservoirs are fermionic leads, tunnel coupled via quantum dots to a central fermionic cavity, and we propose configurations in which the heat absorbed from the (very hot) central cavity is used as a resource to selectively transfer heat from the cold reservoir on the left, to the hot reservoir on the right. The heat transport in the device is particle---hole symmetric; we find two regimes of cooling as a function of the energy of the dots---symmetric with respect to the Fermi energy of the reservoirs---and we associate them to heat transfer by electrons above the Fermi level, and holes below the Fermi level, respectively. We also discuss optimizing the cooling effect by fine-tuning the energy of the dots as well as their linewidth, and characterize regimes where the transport is thermodynamically reversible such that Carnot Coefficent of Performance is achieved with zero cooling power delivered.


title: The replicator equation in stochastic spatial evolutionary games

abstract: We study the multi-strategy stochastic evolutionary game with death-birth updating in expanding spatial populations of size $N\to \infty$. The model is a voter model perturbation. For typical populations, we require perturbation strengths satisfying $1/N\ll w\ll 1$. Under appropriate conditions on the space, the limiting density processes of strategy are proven to obey the replicator equation, and the normalized fluctuations converge to a Gaussian process with the Wright-Fisher covariance function in the limiting densities. As an application, we resolve in the positive a conjecture from the biological literature that the expected density processes approximate the replicator equation on many non-regular graphs.


title: A Generalized Stacking for Implementing Ensembles of Gradient Boosting Machines

abstract: The gradient boosting machine is one of the powerful tools for solving regression problems. In order to cope with its shortcomings, an approach for constructing ensembles of gradient boosting models is proposed. The main idea behind the approach is to use the stacking algorithm in order to learn a second-level meta-model which can be regarded as a model for implementing various ensembles of gradient boosting models. First, the linear regression of the gradient boosting models is considered as a simplest realization of the meta-model under condition that the linear model is differentiable with respect to its coefficients (weights). Then it is shown that the proposed approach can be simply extended on arbitrary differentiable combination models, for example, on neural networks which are differentiable and can implement arbitrary functions of gradient boosting models. Various numerical examples illustrate the proposed approach.


title: Assessing Lesion Segmentation Bias of Neural Networks on Motion Corrupted Brain MRI

abstract: Patient motion during the magnetic resonance imaging (MRI) acquisition process results in motion artifacts, which limits the ability of radiologists to provide a quantitative assessment of a condition visualized. Often times, radiologists either "see through" the artifacts with reduced diagnostic confidence, or the MR scans are rejected and patients are asked to be recalled and re-scanned. Presently, there are many published approaches that focus on MRI artifact detection and correction. However, the key question of the bias exhibited by these algorithms on motion corrupted MRI images is still unanswered. In this paper, we seek to quantify the bias in terms of the impact that different levels of motion artifacts have on the performance of neural networks engaged in a lesion segmentation task. Additionally, we explore the effect of a different learning strategy, curriculum learning, on the segmentation performance. Our results suggest that a network trained using curriculum learning is effective at compensating for different levels of motion artifacts, and improved the segmentation performance by ~9%-15% (p < 0.05) when compared against a conventional shuffled learning strategy on the same motion data. Within each motion category, it either improved or maintained the dice score. To the best of our knowledge, we are the first to quantitatively assess the segmentation bias on various levels of motion artifacts present in a brain MRI image.


title: End-to-End Synthetic Data Generation for Domain Adaptation of Question Answering Systems

abstract: We propose an end-to-end approach for synthetic QA data generation. Our model comprises a single transformer-based encoder-decoder network that is trained end-to-end to generate both answers and questions. In a nutshell, we feed a passage to the encoder and ask the decoder to generate a question and an answer token-by-token. The likelihood produced in the generation process is used as a filtering score, which avoids the need for a separate filtering model. Our generator is trained by fine-tuning a pretrained LM using maximum likelihood estimation. The experimental results indicate significant improvements in the domain adaptation of QA models outperforming current state-of-the-art methods.


title: Laminations and 2-filling rays on infinite type surfaces

abstract: The loop graph of an infinite type surface is an infinite diameter hyperbolic graph first studied in detail by Juliette Bavard. An important open problem in the study of infinite type surfaces is to describe the boundary of the loop graph as a space of geodesic laminations. We approach this problem by constructing the first examples of 2-filling rays on infinite type surfaces. Such rays accumulate onto geodesic laminations which are in some sense filling, but without strong enough properties to correspond to points in the boundary of the loop graph. We give multiple constructions using both a hands-on combinatorial approach and an approach using train tracks and automorphisms of flat surfaces. In addition, our approaches are sufficiently robust to describe all 2-filling rays with certain other basic properties as well as to produce uncountably many distinct mapping class group orbits.


title: Dual-mode ASR: Unify and Improve Streaming ASR with Full-context Modeling

abstract: Streaming automatic speech recognition (ASR) aims to emit each hypothesized word as quickly and accurately as possible, while full-context ASR waits for the completion of a full speech utterance before emitting completed hypotheses. In this work, we propose a unified framework, Dual-mode ASR, to train a single end-to-end ASR model with shared weights for both streaming and full-context speech recognition. We show that the latency and accuracy of streaming ASR significantly benefit from weight sharing and joint training of full-context ASR, especially with inplace knowledge distillation during the training. The Dual-mode ASR framework can be applied to recent state-of-the-art convolution-based and transformer-based ASR networks. We present extensive experiments with two state-of-the-art ASR networks, ContextNet and Conformer, on two datasets, a widely used public dataset LibriSpeech and a large-scale dataset MultiDomain. Experiments and ablation studies demonstrate that Dual-mode ASR not only simplifies the workflow of training and deploying streaming and full-context ASR models, but also significantly improves both emission latency and recognition accuracy of streaming ASR. With Dual-mode ASR, we achieve new state-of-the-art streaming ASR results on both LibriSpeech and MultiDomain in terms of accuracy and latency.


title: Dynamics and entropy of $\mathcal{S}$-graph shifts

abstract: $S$-gap shifts are a well-studied class of shift spaces, which has led to several proposed generalizations. This paper introduces a new class of shift spaces called $\mathcal{S}$-graph shifts whose essential structure is encoded in a novel way, as a finite directed graph with a set of natural numbers assigned to each vertex. $\mathcal{S}$-graph shifts contain $S$-gap shifts and their generalizations, as well as all vertex shifts and SFTs, as special cases, thereby providing a method to study these shift spaces in a uniform way. The main result in this paper is a formula for the entropy of any $\mathcal{S}$-graph shift, which, by specialization, resolves a problem proposed by Matson and Sattler. A second result establishes an explicit formula for the zeta functions of $\mathcal{S}$-graph shifts. Additionally, we show that every entropy value is obtained by uncountably many $\mathcal{S}$-graph shifts.


title: Measuring and Reducing Gendered Correlations in Pre-trained Models

abstract: Pre-trained models have revolutionized natural language understanding. However, researchers have found they can encode artifacts undesired in many applications, such as professions correlating with one gender more than another. We explore such gendered correlations as a case study for how to address unintended correlations in pre-trained models. We define metrics and reveal that it is possible for models with similar accuracy to encode correlations at very different rates. We show how measured correlations can be reduced with general-purpose techniques, and highlight the trade offs different strategies have. With these results, we make recommendations for training robust models: (1) carefully evaluate unintended correlations, (2) be mindful of seemingly innocuous configuration differences, and (3) focus on general mitigations.


title: Structured strong $\boldsymbol{\ell}$-ifications for structured matrix polynomials in the monomial basis

abstract: In the framework of Polynomial Eigenvalue Problems, most of the matrix polynomials arising in applications are structured polynomials (namely (skew-)symmetric, (skew-)Hermitian, (anti-)palindromic, or alternating). The standard way to solve Polynomial Eigenvalue Problems is by means of linearizations. The most frequently used linearizations belong to general constructions, valid for all matrix polynomials of a fixed degree, known as {\em companion linearizations}. It is well known, however, that is not possible to construct companion linearizations that preserve any of the previous structures for matrix polynomials of even degree. This motivates the search for more general companion forms, in particular {\em companion $\ell$-ifications}. In this paper, we present, for the first time, a family of (generalized) companion $\ell$-ifications that preserve any of these structures, for matrix polynomials of degree $k=(2d+1)\ell$. We also show how to construct sparse $\ell$-ifications within this family. Finally, we prove that there are no structured companion quadratifications for quartic matrix polynomials.


title: Deep learning for detection and segmentation of artefact and disease instances in gastrointestinal endoscopy

abstract: The Endoscopy Computer Vision Challenge (EndoCV) is a crowd-sourcing initiative to address eminent problems in developing reliable computer aided detection and diagnosis endoscopy systems and suggest a pathway for clinical translation of technologies. Whilst endoscopy is a widely used diagnostic and treatment tool for hollow-organs, there are several core challenges often faced by endoscopists, mainly: 1) presence of multi-class artefacts that hinder their visual interpretation, and 2) difficulty in identifying subtle precancerous precursors and cancer abnormalities. Artefacts often affect the robustness of deep learning methods applied to the gastrointestinal tract organs as they can be confused with tissue of interest. EndoCV2020 challenges are designed to address research questions in these remits. In this paper, we present a summary of methods developed by the top 17 teams and provide an objective comparison of state-of-the-art methods and methods designed by the participants for two sub-challenges: i) artefact detection and segmentation (EAD2020), and ii) disease detection and segmentation (EDD2020). Multi-center, multi-organ, multi-class, and multi-modal clinical endoscopy datasets were compiled for both EAD2020 and EDD2020 sub-challenges. The out-of-sample generalization ability of detection algorithms was also evaluated. Whilst most teams focused on accuracy improvements, only a few methods hold credibility for clinical usability. The best performing teams provided solutions to tackle class imbalance, and variabilities in size, origin, modality and occurrences by exploring data augmentation, data fusion, and optimal class thresholding techniques.


title: Making Mobile Augmented Reality Applications Accessible

abstract: Augmented Reality (AR) technology creates new immersive experiences in entertainment, games, education, retail, and social media. AR content is often primarily visual and it is challenging to enable access to it non-visually due to the mix of virtual and real-world content. In this paper, we identify common constituent tasks in AR by analyzing existing mobile AR applications for iOS, and characterize the design space of tasks that require accessible alternatives. For each of the major task categories, we create prototype accessible alternatives that we evaluate in a study with 10 blind participants to explore their perceptions of accessible AR. Our study demonstrates that these prototypes make AR possible to use for blind users and reveals a number of insights to move forward. We believe our work sets forth not only exemplars for developers to create accessible AR applications, but also a roadmap for future research to make AR comprehensively accessible.


title: Computing Hecke Operators for Arithmetic Subgroups of General Linear Groups

abstract: We present an algorithm to compute the Hecke operators on the equivariant cohomology of an arithmetic subgroup $\Gamma$ of the general linear group $\mathrm{GL}_n$. This includes $\mathrm{GL}_n$ over a number field or a finite-dimensional division algebra. As coefficients, we may use any finite-dimensional local coefficient system. Unlike earlier methods, the algorithm works for the cohomology $H^i$ in all degrees $i$. It starts from the well-rounded retract $\tilde{W}$, a $\Gamma$-invariant cell complex which computes the cohomology. It extends $\tilde{W}$ to a new well-tempered complex $\tilde{W}^+$ of one higher real dimension, using a real parameter called the temperament. The algorithm has been coded up for $\mathrm{SL}_n(\mathbb{Z})$ for $n=2,3,4$; we present some results for congruence subgroups of $\mathrm{SL}_3(\mathbb{Z})$.


title: Streaming enumeration on nested documents

abstract: Some of the most relevant document schemas used online, such as XML and JSON, have a nested format. In the last decade, the task of extracting data from nested documents over streams has become especially relevant. We focus on the streaming evaluation of queries with outputs of varied sizes over nested documents. We model queries of this kind as Visibly Pushdown Transducers (VPT), a computational model that extends visibly pushdown automata with outputs and has the same expressive power as MSO over nested documents. Since processing a document through a VPT can generate a massive number of results, we are interested in reading the input in a streaming fashion and enumerating the outputs one after another as efficiently as possible, namely, with constant-delay. This paper presents an algorithm that enumerates these elements with constant-delay after processing the document stream in a single pass. Furthermore, we show that this algorithm is worst-case optimal in terms of update-time per symbol and memory usage.


title: Radiation Testing of Optical and Semiconductor Components for Radiation-Tolerant LED Luminaires

abstract: An irradiation campaign was conducted to provide guidance in the selection of materials and components for the radiation hardening of LED lights for use in CERN accelerator tunnels. This work describes the effects of gamma-rays on commercial-grade borosilicate, fused quartz, polymethylmethacrylate, and polycarbonate samples up to doses of 100 kGy, to qualify their use as optical materials in rad-hard LED-based luminaires. In addition, a Si bridge rectifier and a SiC Junction Barrier Schottky diode for use in power supplies of rad-hard LED lighting systems are tested using 24 GeV/c protons. The physical degradation mechanisms are discussed for each element.


title: Implementation and validation of the relativistic transient absorption theory within the dipole approximation

abstract: A relativistic transient absorption theory is derived, implemented and validated within the dipole approximation based on the time-dependent Dirac equation. Time-dependent simulations have been performed using the Dirac equation and the Schr\"odinger equation for the Hydrogen atom in two different attosecond transient absorption scenarios. These simulations validate the present relativistic theory. The presented work can be seen as a first step in the development of a more general relativistic attosecond transient absorption spectroscopy method for studying heavy atoms, but it also suggests the possibility of studying relativistic effects, such as Zitterbewegung, in the time domain.


title: Improving Self-supervised Pre-training via a Fully-Explored Masked Language Model

abstract: Masked Language Model (MLM) framework has been widely adopted for self-supervised language pre-training. In this paper, we argue that randomly sampled masks in MLM would lead to undesirably large gradient variance. Thus, we theoretically quantify the gradient variance via correlating the gradient covariance with the Hamming distance between two different masks (given a certain text sequence). To reduce the variance due to the sampling of masks, we propose a fully-explored masking strategy, where a text sequence is divided into a certain number of non-overlapping segments. Thereafter, the tokens within one segment are masked for training. We prove, from a theoretical perspective, that the gradients derived from this new masking schema have a smaller variance and can lead to more efficient self-supervised training. We conduct extensive experiments on both continual pre-training and general pre-training from scratch. Empirical results confirm that this new masking strategy can consistently outperform standard random masking. Detailed efficiency analysis and ablation studies further validate the advantages of our fully-explored masking strategy under the MLM framework.


title: Towards Machine Translation for the Kurdish Language

abstract: Machine translation is the task of translating texts from one language to another using computers. It has been one of the major tasks in natural language processing and computational linguistics and has been motivating to facilitate human communication. Kurdish, an Indo-European language, has received little attention in this realm due to the language being less-resourced. Therefore, in this paper, we are addressing the main issues in creating a machine translation system for the Kurdish language, with a focus on the Sorani dialect. We describe the available scarce parallel data suitable for training a neural machine translation model for Sorani Kurdish-English translation. We also discuss some of the major challenges in Kurdish language translation and demonstrate how fundamental text processing tasks, such as tokenization, can improve translation performance.


title: Benchmarking density functional approximations for diamagnetic and paramagnetic molecules in nonuniform magnetic fields

abstract: In this paper, correlated studies on a test set of 36 small molecules are carried out with both wavefunction (HF, MP2, CCSD) and density functional (LDA, KT3, cTPSS, cM06-L) methods. The effect of correlation on exotic response properties such as molecular electronic anapole susceptibilities is studied and the performance of the various density functional approximations are benchmarked against CCSD and/or MP2. Atoms and molecules are traditionally classified into `diamagnetic' and `paramagnetic' based on their isotropic response to uniform magnetic fields. However, in this paper we propose a more fine-grained classification of molecular systems on the basis of their response to generally non-uniform magnetic fields. The relation of orientation to different qualitative responses is also considered.


title: On the genus and area of constant mean curvature surfaces with bounded index

abstract: Using the local picture of the degeneration of sequences of minimal surfaces developed by Chodosh, Ketover and Maximo we show that in any closed Riemannian 3-manifold $(M,g)$, the genus of an embedded CMC surface can be bounded only in terms of its index and area, independently of the value of its mean curvature. We also show that if $M$ has finite fundamental group, the genus and area of any non-minimal embedded CMC surface can be bounded in term of its index and a lower bound for its mean curvature.


title: An accelerator facility for intermediate energy proton irradiation and testing of nuclear materials

abstract: The bulk irradiation of materials with 10-30 MeV protons promises to advance the study of radiation damage for fission and fusion power plants. Intermediate energy proton beams can now be dedicated to materials irradiation within university-scale laboratories. This paper describes the first such facility, with an Ionetix ION-12SC cyclotron producing 12 MeV proton beams. Samples are mm-scale tensile specimens with thicknesses up to 300 um, mounted to a cooled beam target with control over temperature. A specialized tensile tester for radioactive specimens at high temperature (500+ {\deg}C) and/or vacuum represents the conditions in fission and fusion systems, while a digital image correlation system remotely measures strain. Overall, the facility provides university-scale irradiation and testing capability with intermediate energy protons to complement traditional in-core fission reactor and micro-scale ion irradiation. This facility demonstrates that bulk proton irradiation is a scalable and effective approach for nuclear materials research, down-selection, and qualification.


title: Spectral Synthesis for Satellite-to-Satellite Translation

abstract: Earth observing satellites carrying multi-spectral sensors are widely used to monitor the physical and biological states of the atmosphere, land, and oceans. These satellites have different vantage points above the earth and different spectral imaging bands resulting in inconsistent imagery from one to another. This presents challenges in building downstream applications. What if we could generate synthetic bands for existing satellites from the union of all domains? We tackle the problem of generating synthetic spectral imagery for multispectral sensors as an unsupervised image-to-image translation problem with partial labels and introduce a novel shared spectral reconstruction loss. Simulated experiments performed by dropping one or more spectral bands show that cross-domain reconstruction outperforms measurements obtained from a second vantage point. On a downstream cloud detection task, we show that generating synthetic bands with our model improves segmentation performance beyond our baseline. Our proposed approach enables synchronization of multispectral data and provides a basis for more homogeneous remote sensing datasets.


title: Right-angled Artin subgroups of Artin groups

abstract: The Tits Conjecture, proved by Crisp and Paris, states that squares of the standard generators of any Artin group generate an obvious right-angled Artin subgroup. We consider a larger set of elements consisting of all the centers of the irreducible spherical special subgroups of the Artin group, and conjecture that sufficiently large powers of those elements generate an obvious right-angled Artin subgroup. This alleged right-angled Artin subgroup is in some sense as large as possible; its nerve is homeomorphic to the nerve of the ambient Artin group. We verify this conjecture for the class of locally reducible Artin groups, which includes all $2$-dimensional Artin groups, and for spherical Artin groups of any type other than $E_6$, $E_7$, $E_8$. We use our results to conclude that certain Artin groups contain hyperbolic surface subgroups, answering questions of Gordon, Long and Reid.


title: Artificial Intelligence, speech and language processing approaches to monitoring Alzheimer's Disease: a systematic review

abstract: Language is a valuable source of clinical information in Alzheimer's Disease, as it declines concurrently with neurodegeneration. Consequently, speech and language data have been extensively studied in connection with its diagnosis. This paper summarises current findings on the use of artificial intelligence, speech and language processing to predict cognitive decline in the context of Alzheimer's Disease, detailing current research procedures, highlighting their limitations and suggesting strategies to address them. We conducted a systematic review of original research between 2000 and 2019, registered in PROSPERO (reference CRD42018116606). An interdisciplinary search covered six databases on engineering (ACM and IEEE), psychology (PsycINFO), medicine (PubMed and Embase) and Web of Science. Bibliographies of relevant papers were screened until December 2019. From 3,654 search results 51 articles were selected against the eligibility criteria. Four tables summarise their findings: study details (aim, population, interventions, comparisons, methods and outcomes), data details (size, type, modalities, annotation, balance, availability and language of study), methodology (pre-processing, feature generation, machine learning, evaluation and results) and clinical applicability (research implications, clinical potential, risk of bias and strengths/limitations). While promising results are reported across nearly all 51 studies, very few have been implemented in clinical research or practice. We concluded that the main limitations of the field are poor standardisation, limited comparability of results, and a degree of disconnect between study aims and clinical applications. Attempts to close these gaps should support translation of future research into clinical practice.


title: Deciphering Solar Magnetic Activity: 140 Years Of The `Extended Solar Cycle' -- Mapping the Hale Cycle

abstract: We investigate the occurrence of the "extended solar cycle" (ESC) as it occurs in a host observational data spanning 140 years. Investigating coronal, chromospheric, photospheric and interior diagnostics we develop a consistent picture of solar activity migration linked to the 22-year Hale (magnetic) cycle using superposed epoch analysis (SEA) using previously identified Hale cycle termination events as the key time for the SEA. Our analysis shows that the ESC and Hale cycle, as highlighted by the terminator-keyed SEA, is strongly recurrent throughout the entire observational record studied, some 140 years. Applying the same SEA method to the sunspot record confirms that Maunder's butterfly pattern is a subset of the underlying Hale cycle, strongly suggesting that the production of sunspots is not the fundamental feature of the Hale cycle, but the ESC is. The ESC (and Hale cycle) pattern highlights the importance of 55\degree\ latitude in the evolution, and possible production, of solar magnetism.


title: Implementation of a neural network for non-linearities estimation in a tail-sitter aircraft

abstract: The control of a tail-sitter aircraft is a challenging task, especially during transition maneuver where the lift and drag forces are highly nonlinear. In this work, we implement a Neural Network (NN) capable of estimate such nonlinearities. Once they are estimated, one can propose a control scheme where these forces can correctly feed-forwarded. Our implementation of the NN has been programmed in C++ on the PX4 Autopilot an open-source autopilot for drones. To ensure that this implementation does not considerably affect the autopilot's performance, the coded NN must be of a light computational load. With the aim to test our approach, we have carried out a series of realistic simulations in the Software in The Loop (SITL) using the PX4 Autopilot. These experiments demonstrate that the implemented NN can be used to estimate the tail-sitter aerodynamic forces, and can be used to improve the control algorithms during all the flight phases of the tail-sitter aircraft: hover, cruise flight, and transition.


title: A Physics-Guided Neural Network Framework for Elastic Plates: Comparison of Governing Equations-Based and Energy-Based Approaches

abstract: One of the obstacles hindering the scaling-up of the initial successes of machine learning in practical engineering applications is the dependence of the accuracy on the size of the database that "drives" the algorithms. Incorporating the already-known physical laws into the training process can significantly reduce the size of the required database. In this study, we establish a neural network-based computational framework to characterize the finite deformation of elastic plates, which in classic theories is described by the F\"oppl--von K\'arm\'an (FvK) equations with a set of boundary conditions (BCs). A neural network is constructed by taking the spatial coordinates as the input and the displacement field as the output to approximate the exact solution of the FvK equations. The physical information (PDEs, BCs, and potential energies) is then incorporated into the loss function, and a pseudo dataset is sampled without knowing the exact solution to finally train the neural network. The prediction accuracy of the modeling framework is carefully examined by applying it to four different loading cases: in-plane tension with non-uniformly distributed stretching forces, in-plane central-hole tension, out-of-plane deflection, and buckling under compression. \hl{Three ways of formulating the loss function are compared: 1) purely data-driven, 2) PDE-based, and 3) energy-based. Through the comparison with the finite element simulations, it is found that all the three approaches can characterize the elastic deformation of plates with a satisfactory accuracy if trained properly. Compared with incorporating the PDEs and BCs in the loss, using the total potential energy shows certain advantage in terms of the simplicity of hyperparameter tuning and the computational efficiency.


title: Magnetization steps of $J_{1}$ quintets in the hcp lattice

abstract: The magnetization steps of quintets, consisting of five identical magnetic ions coupled by isotropic nearest neighbors antiferromagnetic exchange interaction, in the hcp lattice, have been investigated. In that model there are 17 types of quintets. The values of the magnetic field of the magnetization steps of the quintets have been determined by numerical diagonalization of the spin Hamiltonian, which is composed by the isotropic exchange and the Zeeman interactions. The quintets are composed of individual spin $S$ = 1/2, 3/2 and 5/2. The contribution of the quintets for the effective concentration (or technical saturation) as a function of the magnetic ions concentration was also calculated.


title: On Optimizing the Secrecy Performance of RIS-Assisted Cooperative Networks

abstract: Employing reconfigurable intelligent surfaces (RIS) is emerging as a game-changer candidate, thanks to their unique capabilities in improving the power efficiency and supporting the ubiquity of future wireless communication systems. Conventionally, a wireless network design has been limited to the communicating end points, i.e., the transmitter and the receiver. In general, we take advantage of the imposed channel state knowledge to manipulate the transmitted signal and to improve the detection quality at the receiver. With the aid of RISs, and to some extent, the propagation channel has become a part of the design problem. In this paper, we consider a single-input single-output cooperative network and investigate the effect of using RISs in enhancing the physical layer security of the system. Specifically, we formulate an optimization problem to study the effectiveness of the RIS in improving the system secrecy by introducing a weighted variant of the secrecy capacity definition. Numerical simulations are provided to show the design trade-offs and to present the superiority of RIS-assisted networks over the conventional ones in terms of the system's secrecy performance.


title: TextHide: Tackling Data Privacy in Language Understanding Tasks

abstract: An unsolved challenge in distributed or federated learning is to effectively mitigate privacy risks without slowing down training or reducing accuracy. In this paper, we propose TextHide aiming at addressing this challenge for natural language understanding tasks. It requires all participants to add a simple encryption step to prevent an eavesdropping attacker from recovering private text data. Such an encryption step is efficient and only affects the task performance slightly. In addition, TextHide fits well with the popular framework of fine-tuning pre-trained language models (e.g., BERT) for any sentence or sentence-pair task. We evaluate TextHide on the GLUE benchmark, and our experiments show that TextHide can effectively defend attacks on shared gradients or representations and the averaged accuracy reduction is only $1.9\%$. We also present an analysis of the security of TextHide using a conjecture about the computational intractability of a mathematical problem. Our code is available at https://github.com/Hazelsuko07/TextHide


title: Detecting Entanglement in Unfaithful States

abstract: Entanglement witness is an effective method to detect entanglement in unknown states without doing full tomography. One of the most widespread schemes of witnessing entanglement is measuring its fidelity with respect to a pure entangled state. Recently, a large class of states whose entanglement can not be detected with the fidelity witness has been discovered in Phys.Rev.Lett \textbf{124},200502(2020). They are called unfaithful states. In this paper we propose a new way to detect entanglement by calculating the lower bound of entanglement using measurement results. Numerical simulation shows our method can detect entanglement in unfaithful states with a small number of measurements. Moreover, we generalize our scheme to multipartite states and show that it can tolerate higher noise than previous entanglement witness operators with same number of measurement settings.


title: A Pseudo-BCS Wavefunction from Density Matrix Decomposition:Application in Auxiliary-Field Quantum Monte Carlo

abstract: We present a method to construct pseudo-BCS wave functions from the one-body density matrix. The resulting many-body wave function, which can be produced for any fermion systems, including those with purely repulsive interactions, has the form of a number-projected BCS form, or antisymmetrized germinal power (AGP). Such wave functions provide a better ansatz for correlated fermion systems than a single Slater determinant, and often better than a linear combination of Slater determinants (for example from a truncated active space calculation). We describe a procedure to build such a wave function conveniently from a given reduced density matrix of the system, rather than from a mean-field solution (which gives a Slater determinant for repulsive interactions). The pseudo-BCS wave function thus obtained reproduces the density matrix or minimizes the difference between the input and resulting density matrices. One application of the pseudo-BCS wave function is in auxiliary-field quantum Monte Carlo (AFQMC) calculations as the trial wave function to control the sign/phase problem. AFQMC is often among the most accurate general methods for correlated fermion systems. We show that the pseudo-BCS form further reduces the constraint bias and leads to improved accuracy compared to the usual Slater determinant trial wave functions, using the two-dimensional Hubbard model as an example. Furthermore, the pseudo-BCS trial wave function allows a new systematically improvable self-consistent approach, with pseudo-BCS trial wave function iteratively generated by AFQMC via the one-body density matrix.


title: Detectable environmental effects in GW190521-like black-hole binaries with LISA

abstract: GW190521 is the compact binary with the largest masses observed to date, with at least one in the pair-instability gap. This event has also been claimed to be associated with an optical flare observed by the Zwicky Transient Facility in an Active Galactic Nucleus (AGN), possibly due to the post-merger motion of the merger remnant in the AGN gaseous disk. We show that the Laser Interferometer Space Antenna (LISA) will detect up to ten of such gas-rich black hole binaries months to years before their detection by LIGO/Virgo-like interferometers, localizing them in the sky within $\approx1$ deg$^2$. LISA will also measure directly deviations from purely vacuum and stationary waveforms, arising from gas accretion, dynamical friction, and orbital motion around the AGN's massive black hole (acceleration, strong lensing, and Doppler modulation). LISA will therefore be crucial to alert and point electromagnetic telescopes ahead of time on this novel class of gas-rich sources, to gain direct insight on their physics, and to disentangle environmental effects from corrections to General Relativity that may also appear in the waveforms at low frequencies.


title: Hom-Lie algebra structures on quadratic Lie algebras and twisted invariant Killing-like forms defined on them

abstract: Hom-Lie algebras defined on central extensions of a given quadratic Lie algebra that in turn admit an invariant metric, are studied. It is shown how some of these algebras are naturally equipped with other symmetric, bilinear forms that satisfy an invariant condition for their twisted multiplication maps. The twisted invariant bilinear forms so obtained resemble the Cartan-Killing forms defined on ordinary Lie algebras. This fact allows one to reproduce on the Hom-Lie algebras hereby studied, some results that are classically associated to the ordinary Cartan-Killing form.


title: On pushed wavefronts of monostable equation with unimodal delayed reaction

abstract: We study the Mackey-Glass type monostable delayed reaction-diffusion equation with a unimodal birth function $g(u)$. This model, designed to describe evolution of single species populations, is considered here in the presence of the weak Allee effect ($g(u_0)>g'(0)u_0$ for some $u_0>0$). We focus our attention on the existence of slow monotonic traveling fronts to the equation: under given assumptions, this problem seems to be rather difficult since the usual positivity and monotonicity arguments are not effective. First, we solve the front existence problem for small delays, $h \in [0,h_p]$, where $h_p$ (given by an explicit formula) is optimal in a certain sense. Then we take a representative piece-wise linear unimodal birth function making possible explicit computation of traveling fronts. In this case, we find out that a) increase of delay can destroy asymptotically stable pushed fronts; b) the set of all admissible wavefront speeds has usual structure of a semi-infinite interval $[c_*, +\infty)$; c) for each $h\geq 0$, the pushed wavefront is unique (if it exists); d) pushed wave can oscillate slowly around the positive equilibrium for sufficiently large delays.


title: A Framework for Addressing the Risks and Opportunities In AI-Supported Virtual Health Coaches

abstract: Virtual coaching has rapidly evolved into a foundational component of modern clinical practice. At a time when healthcare professionals are in short supply and the demand for low-cost treatments is ever-increasing, virtual health coaches (VHCs) offer intervention-on-demand for those limited by finances or geographic access to care. More recently, AI-powered virtual coaches have become a viable complement to human coaches. However, the push for AI-powered coaching systems raises several important issues for researchers, designers, clinicians, and patients. In this paper, we present a novel framework to guide the design and development of virtual coaching systems. This framework augments a traditional data science pipeline with four key guiding goals: reliability, fairness, engagement, and ethics.


title: BioMegatron: Larger Biomedical Domain Language Model

abstract: There has been an influx of biomedical domain-specific language models, showing language models pre-trained on biomedical text perform better on biomedical domain benchmarks than those trained on general domain text corpora such as Wikipedia and Books. Yet, most works do not study the factors affecting each domain language application deeply. Additionally, the study of model size on domain-specific models has been mostly missing. We empirically study and evaluate several factors that can affect performance on domain language applications, such as the sub-word vocabulary set, model size, pre-training corpus, and domain transfer. We show consistent improvements on benchmarks with our larger BioMegatron model trained on a larger domain corpus, contributing to our understanding of domain language model applications. We demonstrate noticeable improvements over the previous state-of-the-art (SOTA) on standard biomedical NLP benchmarks of named entity recognition, relation extraction, and question answering. Model checkpoints and code are available at [https://ngc.nvidia.com] and [https://github.com/NVIDIA/NeMo].


title: CADET: Debugging and Fixing Misconfigurations using Counterfactual Reasoning

abstract: Modern computing platforms are highly-configurable with thousands of interacting configurations. However, configuring these systems is challenging. Erroneous configurations can cause unexpected non-functional faults. This paper proposes CADET (short for Causal Debugging Toolkit) that enables users to identify, explain, and fix the root cause of non-functional faults early and in a principled fashion. CADET builds a causal model by observing the performance of the system under different configurations. Then, it uses casual path extraction followed by counterfactual reasoning over the causal model to: (a) identify the root causes of non-functional faults, (b) estimate the effects of various configurable parameters on the performance objective(s), and (c) prescribe candidate repairs to the relevant configuration options to fix the non-functional fault. We evaluated CADET on 5 highly-configurable systems deployed on 3 NVIDIA Jetson systems-on-chip. We compare CADET with state-of-the-art configuration optimization and ML-based debugging approaches. The experimental results indicate that CADET can find effective repairs for faults in multiple non-functional properties with (at most) 17% more accuracy, 28% higher gain, and $40\times$ speed-up than other ML-based performance debugging methods. Compared to multi-objective optimization approaches, CADET can find fixes (at most) $9\times$ faster with comparable or better performance gain. Our case study of non-functional faults reported in NVIDIA's forum show that CADET can find $14%$ better repairs than the experts' advice in less than 30 minutes.


title: An Elastic IoT Device Management Platform

abstract: With the recent advancement of technologies over the past year, IoT has become a paradigm in which devices communicate with each other and the cloud to achieve various applications in multidisciplinary fields. However, developing, deploying, and experimenting with IoT applications are still tedious, expensive, and time-consuming due to the factors like heterogeneity of hardware and software. This is where an IoT testbed plays a vital role in aiding developers to test their applications without being deploying it to the target environment. In this paper, we present a testbed that is scalable for heterogeneous devices and mainly focused on a small scale and medium scale IoT application. This testbed would be best suited for testing applications which demand robust nature, remote monitoring and control, incorporation of heterogeneous devices, location tracking of devices, and easy troubleshooting with security and internet connectivity concerns. This testbed is also embraced with the feature to work limit access to the internet. A detailed explanation of the design and architecture of the proposed testbed is provided. We also present a conceptual prototype of the testbed and the results obtained on experimenting under various conditions.


title: Bayesian Weighted Triplet and Quartet Methods for Species Tree Inference

abstract: Inference of the evolutionary histories of species, commonly represented by a species tree, is complicated by the divergent evolutionary history of different parts of the genome. Different loci on the genome can have different histories from the underlying species tree (and each other) due to processes such as incomplete lineage sorting (ILS), gene duplication and loss, and horizontal gene transfer. The multispecies coalescent is a commonly used model for performing inference on species and gene trees in the presence of ILS. This paper introduces Lily-T and Lily-Q, two new methods for species tree inference under the multispecies coalescent. We then compare them to two frequently used methods, SVDQuartets and ASTRAL, using simulated and empirical data. Both methods generally showed improvement over SVDQuartets, and Lily-Q was superior to Lily-T for most simulation settings. The comparison to ASTRAL was more mixed - Lily-Q tended to be better than ASTRAL when the length of recombination-free loci was short, when the coalescent population parameter {\theta} was small, or when the internal branch lengths were longer.


title: The End of Galaxy Surveys

abstract: For nearly a century, imaging and spectroscopic surveys of galaxies have given us information about the contents of the universe. We attempt to define the logical endpoint of such surveys by defining not the next galaxy survey, but the final galaxy survey at NIR wavelengths; this would be the galaxy survey that exhausts the information content useful for addressing extant questions. Such a survey would require incredible advances in a number of technologies and the survey details will depend on the as yet poorly constrained properties of the earliest galaxies. Using an exposure time calculator, we define nominal surveys for extracting the useful information for three science cases: dark energy cosmology, galaxy evolution, and supernovae. We define scaling relations that trade off sky background, telescope aperture, and focal plane size to allow for a survey of a given depth over a given area. For optimistic assumptions, a 280m telescope with a marginally resolved focal plane of 20 deg$^2$ operating at L2 could potentially exhaust the cosmological information content of galaxies in a 10 year survey. For galaxy evolution (making use of gravitational lensing to magnify the earliest galaxies) and SN, the same telescope would suffice. We discuss the technological advances needed to complete the last galaxy survey. While the final galaxy survey remains well outside of our technical reach today, we present scaling relations that show how we can progress toward the goal of exhausting the information content encoded in the shapes, positions, and colors of galaxies.


title: Zero-shot Entity Linking with Efficient Long Range Sequence Modeling

abstract: This paper considers the problem of zero-shot entity linking, in which a link in the test time may not present in training. Following the prevailing BERT-based research efforts, we find a simple yet effective way is to expand the long-range sequence modeling. Unlike many previous methods, our method does not require expensive pre-training of BERT with long position embedding. Instead, we propose an efficient position embeddings initialization method called Embedding-repeat, which initializes larger position embeddings based on BERT-Base. On Wikia's zero-shot EL dataset, our method improves the SOTA from 76.06% to 79.08%, and for its long data, the corresponding improvement is from 74.57% to 82.14%. Our experiments suggest the effectiveness of long-range sequence modeling without retraining the BERT model.


title: Quenching to fix metastable states in models of prebiotic chemistry

abstract: For prebiotic chemistry to succeed in producing a starting metastable, autocatalytic and reproducing system subject to evolutionary selection it must satisfy at least two apparently contradictory requirements: Because such systems are rare, a search among vast numbers of molecular combinations must take place naturally, requiring rapid rearrangement and breaking of covalent bonds. But once a relevant system is found, such rapid disruption and rearrangement would be very likely to destroy the system before much evolution could take place. In this paper we explore the possibility, using a model developed previously, that the search process could occur under different environmental conditions than the subsequent fixation and growth of a lifelike chemical system. We use the example of a rapid change in temperature to illustrate the effect and refer to the rapid change as a `quench' borrowing terminology from study of the physics and chemistry of glass formation. The model study shows that interrupting a high temperature nonequilibrium state with a rapid quench to lower temperatures can substantially increase the probability of producing a chemical state with lifelike characteristics of nonequilibrium metastability, internal dynamics and exponential population growth in time. Previously published data on the length distributions of proteomes of prokaryotes may be consistent with such an idea and suggest a prebiotic high temperature `search' phase near the boiling point of water. A rapid change in pH could have a similar effect. We discuss possible scenarios on early earth which might have allowed frequent quenches of the sort considered here to have occurred. The models show a strong dependence of the effect on the number of chemical monomers available for bond formation.


title: Minuscule embeddings

abstract: We study embeddings $J \rightarrow G$ of simple linear algebraic groups with the following property: the simple components of the $J$ module Lie($G$)/Lie($J$) are all minuscule representations of $J$. One family of examples occurs when the group $G$ has roots of two different lengths and $J$ is the subgroup generated by the long roots. We classify all such embeddings when $J = SL_2$ and $J = SL_3$, show how each embedding implies the existence of exceptional algebraic structures on the graded components of Lie($G$), and relate properties of those structures to the existence of various twisted forms of $G$ with certain relative root systems.


title: Quantum Kolmogorov-Sinai entropy and Pesin relation

abstract: We discuss a quantum Kolmogorov-Sinai entropy defined as the entropy production per unit time resulting from coupling the system to a weak, auxiliary bath. The expressions we obtain are fully quantum, but require that the system is such that there is a separation between the Ehrenfest and the correlation timescales. We show that they reduce to the classical definition in the semiclassical limit, one instance where this separation holds. We show a quantum (Pesin) relation between this entropy and the sum of positive eigenvalues of a matrix describing phase-space expansion. Generalizations to the case where entropy grows sublinearly with time are possible.


title: Are Some Words Worth More than Others?

abstract: Current evaluation metrics for language modeling and generation rely heavily on the accuracy of predicted (or generated) words as compared to a reference ground truth. While important, token-level accuracy only captures one aspect of a language model's behavior, and ignores linguistic properties of words that may allow some mis-predicted tokens to be useful in practice. Furthermore, statistics directly tied to prediction accuracy (including perplexity) may be confounded by the Zipfian nature of written language, as the majority of the prediction attempts will occur with frequently-occurring types. A model's performance may vary greatly between high- and low-frequency words, which in practice could lead to failure modes such as repetitive and dull generated text being produced by a downstream consumer of a language model. To address this, we propose two new intrinsic evaluation measures within the framework of a simple word prediction task that are designed to give a more holistic picture of a language model's performance. We evaluate several commonly-used large English language models using our proposed metrics, and demonstrate that our approach reveals functional differences in performance between the models that are obscured by more traditional metrics.


title: Neural Representations in Hybrid Recommender Systems: Prediction versus Regularization

abstract: Autoencoder-based hybrid recommender systems have become popular recently because of their ability to learn user and item representations by reconstructing various information sources, including users' feedback on items (e.g., ratings) and side information of users and items (e.g., users' occupation and items' title). However, existing systems still use representations learned by matrix factorization (MF) to predict the rating, while using representations learned by neural networks as the regularizer. In this paper, we define the neural representation for prediction (NRP) framework and apply it to the autoencoder-based recommendation systems. We theoretically analyze how our objective function is related to the previous MF and autoencoder-based methods and explain what it means to use neural representations as the regularizer. We also apply the NRP framework to a direct neural network structure which predicts the ratings without reconstructing the user and item information. We conduct extensive experiments on two MovieLens datasets and two real-world e-commerce datasets. The results confirm that neural representations are better for prediction than regularization and show that the NRP framework, combined with the direct neural network structure, outperforms the state-of-the-art methods in the prediction task, with less training time and memory.


title: The {\L}ojasiewicz exponent of non-degenerate surface singularities

abstract: Let $f$ be an isolated singularity at the origin of $\mathbb{C}^n$. One of many invariants that can be associated with $f$ is its {\L}ojasiewicz exponent $\mathcal{L}_0 (f)$, which measures, to some extent, the topology of $f$. We give, for generic surface singularities $f$, an effective formula for $\mathcal{L}_0 (f)$ in terms of the Newton polyhedron of $f$. This is a realization of one of Arnold's postulates.


title: Multi-Level Group Testing with Application to One-Shot Pooled COVID-19 Tests

abstract: A key requirement in containing contagious diseases, such as the Coronavirus disease 2019 (COVID-19) pandemic, is the ability to efficiently carry out mass diagnosis over large populations. Some of the leading testing procedures, such as those utilizing qualitative polymerase chain reaction, involve using dedicated machinery which can simultaneously process a limited amount of samples. A candidate method to increase the test throughput is to examine pooled samples comprised of a mixture of samples from different patients. In this work we study pooling based tests which operate in a one-shot fashion, while providing an indication not solely on the presence of infection, but also on its level, without additional pool tests, as often required in COVID-19 testing. As these requirements limit the application of traditional group-testing (GT) methods, we propose a multi-level GT scheme, which builds upon GT principles to enable accurate recovery using much fewer tests than patients, while operating in a one-shot manner and providing multi-level indications. We provide a theoretical analysis of the proposed scheme and characterize conditions under which the algorithm operates reliably and at affordable computational complexity. Our numerical results demonstrate that multi level GT accurately and efficiently detects infection levels, while achieving improved performance over previously proposed one-shot COVID-19 pooled-testing methods.


title: A catalog of broad morphology of Pan-STARRS galaxies based on deep learning

abstract: Autonomous digital sky surveys such as Pan-STARRS have the ability to image a very large number of galactic and extra-galactic objects, and the large and complex nature of the image data reinforces the use of automation. Here we describe the design and implementation of a data analysis process for automatic broad morphology annotation of galaxies, and applied it to the data of Pan-STARRS DR1. The process is based on filters followed by a two-step convolutional neural network (CNN) classification. Training samples are generated by using an augmented and balanced set of manually classified galaxies. Results are evaluated for accuracy by comparison to the annotation of Pan-STARRS included in a previous broad morphology catalog of SDSS galaxies. Our analysis shows that a CNN combined with several filters is an effective approach for annotating the galaxies and removing unclean images. The catalog contains morphology labels for 1,662,190 galaxies with ~95% accuracy. The accuracy can be further improved by selecting labels above certain confidence thresholds. The catalog is publicly available.


title: A smoothed particle hydrodynamics algorithm for multigrain dust with separate sets of particles

abstract: We present a method for simulating the dynamics of a mixture of gas and multiple species of large Stokes number dust grains, typical of evolved protoplanetary discs and debris discs. The method improves upon earlier methods, in which only a single grain size could be represented, by capturing the differential backreaction of multiple dust species on the gas. This effect is greater for large dust-to-gas ratios that may be expected in the later stages of the protoplanetary disc life. We benchmark the method against analytic solutions for linear waves, drag and shocks in dust-gas mixtures, and radial drift in a protoplanetary disc showing that the method is robust and accurate.


title: When HLS Meets FPGA HBM: Benchmarking and Bandwidth Optimization

abstract: With the recent release of High Bandwidth Memory (HBM) based FPGA boards, developers can now exploit unprecedented external memory bandwidth. This allows more memory-bounded applications to benefit from FPGA acceleration. However, we found that it is not easy to fully utilize the available bandwidth when developing some applications with high-level synthesis (HLS) tools. This is due to the limitation of existing HLS tools when accessing HBM board's large number of independent external memory channels. In this paper, we measure the performance of three recent representative HBM FPGA boards (Intel's Stratix 10 MX and Xilinx's Alveo U50/U280 boards) with microbenchmarks and analyze the HLS overhead. Next, we propose HLS-based optimization techniques to improve the effective bandwidth when a PE accesses multiple HBM channels or multiple PEs access an HBM channel. Our experiment demonstrates that the effective bandwidth improves by 2.4X-3.8X. We also provide a list of insights for future improvement of the HBM FPGA HLS design flow.


title: An Information-Theoretic Perspective on Overfitting and Underfitting

abstract: We present an information-theoretic framework for understanding overfitting and underfitting in machine learning and prove the formal undecidability of determining whether an arbitrary classification algorithm will overfit a dataset. Measuring algorithm capacity via the information transferred from datasets to models, we consider mismatches between algorithm capacities and datasets to provide a signature for when a model can overfit or underfit a dataset. We present results upper-bounding algorithm capacity, establish its relationship to quantities in the algorithmic search framework for machine learning, and relate our work to recent information-theoretic approaches to generalization.


title: Evaluating the Effect of Audience in a Virtual Reality Presentation Training Tool

abstract: Public speaking is an essential skill in everyone's professional or academic career. Nevertheless, honing this skill is often tricky because training in front of a mirror does not give feedback or inspire the same anxiety as present-ing in front of an audience. Further, most people do not always have access to the place where the presentation will happen. In this research, we developed a Virtual Reality (VR) environment to assist in improving people's presentation skills. Our system uses 3D scanned people to create more realistic scenarios. We conducted a study with twelve participants who had no prior experience with VR. We validated our virtual environment by analyzing whether it was preferred to no VR system and accepted regardless of the existence of a virtual audience. Our results show that users overwhelmingly prefer to use the VR system as a tool to help them improve their public speaking skills than training in an empty environment. However, the preference for an audience is mixed.


title: Interoception Underlies The Therapeutic Effects of Mindfulness Meditation for Post-Traumatic Stress Disorder: A Randomized Clinical Trial

abstract: Mindfulness-based interventions have proven its efficacy in treating post-traumatic stress disorder (PTSD), but the underlying neurobiological mechanism is unknown. To determine the neurobiological mechanism of action of mindfulness-based stress reduction (MBSR) treating PTSD, we conducted a randomized clinical trial (RCT) in which 98 veterans with PTSD were randomly assigned to receive MBSR therapy (n = 47) or present-centered group therapy (PCGT; n = 51; an active-control condition). Pre- and post-intervention measures of PTSD symptom severity (PTSD Checklist) and brain activity measures of electroencephalography (EEG) were assessed, including spectral power of spontaneous neural oscillatory activities during resting and meditation periods, time-frequency (TF) power of cognitive task-related brain responses, and TF power of heartbeat-evoked brain responses (HEBR) that reflect cardiac interoceptive brain responses during resting and meditation. Compared to controls, the MBSR group had greater improvements in PTSD symptoms, spontaneous EEG alpha (8-13 Hz) power in posterior sites, task-related frontal theta power (4-7 Hz in 140-220 ms post-stimulus), and frontal theta HEBR (3-5 Hz and 265-328 ms post-R-peak). Latent difference score modeling found that only the changes in the frontal theta HEBR mediated the MBSR treatment effect. Brain source-level analysis found that the theta HEBR changes in the anterior cingulate cortex, anterior insular cortex, and the lateral prefrontal cortex predicted PTSD symptom improvements. These results indicated that mindfulness meditation improves spontaneous brain activities reflecting internally oriented relaxation and brain functions of attentional control. However, interoceptive brain capacity enhanced by MBSR appears to be the primary cerebral mechanism that regulates emotional disturbances and improves anxiety symptoms of PTSD.


title: An $\mathcal{O}$-acyclic variety of even index

abstract: We give the first examples of $\mathcal{O}$-acyclic smooth projective geometrically connected varieties over the function field of a complex curve, whose index is not equal to one. More precisely, we construct a family of Enriques surfaces over $\mathbb{P}^{1}$ such that any multi-section has even degree over the base $\mathbb{P}^{1}$ and show moreover that we can find such a family defined over $\mathbb{Q}$. This answers affirmatively a question of Colliot-Th\'el\`ene and Voisin. Furthermore, our construction provides counterexamples to: the failure of the Hasse principle accounted for by the reciprocity obstruction; the integral Hodge conjecture; and universality of Abel-Jacobi maps.


title: Point Process Modeling of Drug Overdoses with Heterogeneous and Missing Data

abstract: Opioid overdose rates have increased in the United States over the past decade and reflect a major public health crisis. Modeling and prediction of drug and opioid hotspots, where a high percentage of events fall in a small percentage of space-time, could help better focus limited social and health services. In this work we present a spatial-temporal point process model for drug overdose clustering. The data input into the model comes from two heterogeneous sources: 1) high volume emergency medical calls for service (EMS) records containing location and time, but no information on the type of non-fatal overdose and 2) fatal overdose toxicology reports from the coroner containing location and high-dimensional information from the toxicology screen on the drugs present at the time of death. We first use non-negative matrix factorization to cluster toxicology reports into drug overdose categories and we then develop an EM algorithm for integrating the two heterogeneous data sets, where the mark corresponding to overdose category is inferred for the EMS data and the high volume EMS data is used to more accurately predict drug overdose death hotspots. We apply the algorithm to drug overdose data from Indianapolis, showing that the point process defined on the integrated data outperforms point processes that use only homogeneous EMS (AUC improvement .72 to .8) or coroner data (AUC improvement .81 to .85).We also investigate the extent to which overdoses are contagious, as a function of the type of overdose, while controlling for exogenous fluctuations in the background rate that might also contribute to clustering. We find that drug and opioid overdose deaths exhibit significant excitation, with branching ratio ranging from .72 to .98.


title: Oort: Efficient Federated Learning via Guided Participant Selection

abstract: Federated Learning (FL) is an emerging direction in distributed machine learning (ML) that enables in-situ model training and testing on edge data. Despite having the same end goals as traditional ML, FL executions differ significantly in scale, spanning thousands to millions of participating devices. As a result, data characteristics and device capabilities vary widely across clients. Yet, existing efforts randomly select FL participants, which leads to poor model and system efficiency. In this paper, we propose Oort to improve the performance of federated training and testing with guided participant selection. With an aim to improve time-to-accuracy performance in model training, Oort prioritizes the use of those clients who have both data that offers the greatest utility in improving model accuracy and the capability to run training quickly. To enable FL developers to interpret their results in model testing, Oort enforces their requirements on the distribution of participant data while improving the duration of federated testing by cherry-picking clients. Our evaluation shows that, compared to existing participant selection mechanisms, Oort improves time-to-accuracy performance by 1.2x-14.1x and final model accuracy by 1.3%-9.8%, while efficiently enforcing developer-specified model testing criteria at the scale of millions of clients.


title: Preliminary Development of a Wearable Device to Help Children with Unilateral Cerebral Palsy Increase Their Consciousness of Their Upper Extremity

abstract: Children with unilateral cerebral palsy have movement impairments that are predominant to one of their upper extremities (UE) and are prone to a phenomenon named "developmental disregard", which is characterized by the neglect of their most affected UE because of their altered perception or consciousness of this limb. This can cause them not to use their most affected hand to its full capacity in their day-to-day life. This paper presents a prototype of a wearable technology with the appearance of a smartwatch, which delivers haptic feedback to remind children with unilateral cerebral palsy to use their most affected limb, and which increase sensory afferents to possibly influence brain plasticity. The prototype consists of an accelerometer, a vibration motor and a microcontroller with an algorithm that detects movement of the limb. After a given period of inactivity, the watch starts vibrating to alert the user.


title: Trace Reconstruction Problems in Computational Biology

abstract: The problem of reconstructing a string from its error-prone copies, the trace reconstruction problem, was introduced by Vladimir Levenshtein two decades ago. While there has been considerable theoretical work on trace reconstruction, practical solutions have only recently started to emerge in the context of two rapidly developing research areas: immunogenomics and DNA data storage. In immunogenomics, traces correspond to mutated copies of genes, with mutations generated naturally by the adaptive immune system. In DNA data storage, traces correspond to noisy copies of DNA molecules that encode digital data, with errors being artifacts of the data retrieval process. In this paper, we introduce several new trace generation models and open questions relevant to trace reconstruction for immunogenomics and DNA data storage, survey theoretical results on trace reconstruction, and highlight their connections to computational biology. Throughout, we discuss the applicability and shortcomings of known solutions and suggest future research directions.


title: Accelerating the Development of Multimodal, Integrative-AI Systems with Platform for Situated Intelligence

abstract: We describe Platform for Situated Intelligence, an open-source framework for multimodal, integrative-AI systems. The framework provides infrastructure, tools, and components that enable and accelerate the development of applications that process multimodal streams of data and in which timing is critical. The framework is particularly well-suited for developing physically situated interactive systems that perceive and reason about their surroundings in order to better interact with people, such as social robots, virtual assistants, smart meeting rooms, etc. In this paper, we provide a brief, high-level overview of the framework and its main affordances, and discuss its implications for HRI.


title: High-power few-cycle near-infrared OPCPA for soft X-ray generation at 100 kHz

abstract: We present a near-infrared optical parametric chirped-pulse amplifier (OPCPA) and soft X-ray (SXR) high-harmonic generation system. The OPCPA produces few-cycle pulses at a center wavelength of 800 nm and operates at a high repetition rate of 100 kHz. It is seeded by fully programmable amplitude and phase controlled ultra-broadband pulses from a Ti:sapphire oscillator. The output from the OPCPA system was compressed to near-transform-limited 9.3-fs pulses. High-power operation up to an average power of 35 W was achieved, and a fully characterized pulse compression was recorded for a power level of 22.5 W, demonstrating pulses with a peak power greater than 21 GW. We demonstrate that at such high repetition rates, spatiotemporally flattened pump pulses can be achieved through a cascaded second-harmonic generation approach with an efficiency of more than 70%, providing a compelling OPCPA architecture for power-scaling ultra-broadband systems in the near-infrared. The output of this 800-nm OPCPA system was used to generate SXR radiation reaching 190 eV photon energy through high-harmonic generation in helium.


title: Precise astrometry and diameters of asteroids from occultations -- a data-set of observations and their interpretation

abstract: Occultations of stars by asteroids have been observed since 1961, increasing from a very small number to now over 500 annually. We have created and regularly maintain a growing data-set of more than 5,000 observed asteroidal occultations. The data-set includes: the raw observations; astrometry at the 1 mas level based on centre of mass or figure (not illumination); where possible the asteroid's diameter to 5 km or better, and fits to shape models; the separation and diameters of asteroidal satellites; and double star discoveries with typical separations being in the tens of mas or less. The data-set is published at NASA's Planetary Data System and is regularly updated. We provide here an overview of the data-set, discuss the issues associated with determining the astrometry and diameters, and give examples of what can be derived from the data-set. We also compare the occultation diameters of asteroids with the diameters measured by the satellites NEOWISE, AKARI AcuA, and IRAS, and show that the best satellite-determined diameter is a combination of the diameters from all three satellites.


title: Contrast and Classify: Training Robust VQA Models

abstract: Recent Visual Question Answering (VQA) models have shown impressive performance on the VQA benchmark but remain sensitive to small linguistic variations in input questions. Existing approaches address this by augmenting the dataset with question paraphrases from visual question generation models or adversarial perturbations. These approaches use the combined data to learn an answer classifier by minimizing the standard cross-entropy loss. To more effectively leverage augmented data, we build on the recent success in contrastive learning. We propose a novel training paradigm (ConClaT) that optimizes both cross-entropy and contrastive losses. The contrastive loss encourages representations to be robust to linguistic variations in questions while the cross-entropy loss preserves the discriminative power of representations for answer prediction. We find that optimizing both losses -- either alternately or jointly -- is key to effective training. On the VQA-Rephrasings benchmark, which measures the VQA model's answer consistency across human paraphrases of a question, ConClaT improves Consensus Score by 1 .63% over an improved baseline. In addition, on the standard VQA 2.0 benchmark, we improve the VQA accuracy by 0.78% overall. We also show that ConClaT is agnostic to the type of data-augmentation strategy used.


title: Singular Hodge theory for combinatorial geometries

abstract: We introduce the intersection cohomology module of a matroid and prove that it satisfies Poincar\'e duality, the hard Lefschetz theorem, and the Hodge-Riemann relations. As applications, we obtain proofs of Dowling and Wilson's Top-Heavy conjecture and the nonnegativity of the coefficients of Kazhdan-Lusztig polynomials for all matroids.


title: Thermodynamics of 2+1 dimensional Coulomb-Like Black Holes from Non Linear Electrodynamics with a traceless energy momentum tensor

abstract: In this work we study thermodynamics of 2+1-dimensional static black holes with a nonlinear electric field. Besides employing the standard thermodynamic approach, we investigate the black hole thermodynamics by studying its thermodynamic geometry. We compute the Weinhold and Ruppeiner metrics and compare the thermodynamic geometry with the standard description on the black hole thermodynamics. We further consider the cosmological constant as an additional extensive thermodynamic variable. In the thermodynamic equilibrium three dimensional space, we compute the efficiency of the heat engine and show that it is possible to be built with this black hole.


title: A Model-free Approach for Testing Association

abstract: The question of association between outcome and feature is generally framed in the context of a model on functional and distributional forms. Our motivating application is that of identifying serum biomarkers of angiogenesis, energy metabolism, apoptosis, and inflammation, predictive of recurrence after lung resection in node-negative non-small cell lung cancer patients with tumor stage T2a or less. We propose an omnibus approach for testing association that is free of assumptions on functional forms and distributions and can be used as a black box method. This proposed maximal permutation test is based on the idea of thresholding, is readily implementable and is computationally efficient. We illustrate that the proposed omnibus tests maintain their levels and have strong power as black box tests for detecting linear, nonlinear and quantile-based associations, even with outlier-prone and heavy-tailed error distributions and under nonparametric setting. We additionally illustrate the use of this approach in model-free feature screening and further examine the level and power of these tests for binary outcome. We compare the performance of the proposed omnibus tests with comparator methods in our motivating application to identify preoperative serum biomarkers associated with non-small cell lung cancer recurrence in early stage patients.


title: Superconductor to metal transition in overdoped cuprates

abstract: We present a theoretical framework for understanding the behavior of the normal and superconducting states of overdoped cuprate high temperature superconductors in the vicinity of the doping-tuned quantum superconductor-to-metal transition. The key ingredients on which we focus are d-wave pairing, a flat antinodal dispersion, and disorder. Even for homogeneous disorder, these lead to effectively granular superconducting correlations and a superconducting transition temperature determined in large part by the superfluid stiffness rather than the pairing scale.


title: Evolution of mesoscopic interactions and scattering solutions of the Boltzmann equation

abstract: The purpose of this paper is to study the evolution of moving interacting particles on the mesoscopic scale. We will introduce an uncertainty principle and a new priori bound for the evolution of particles subject to a general mesoscopic interaction and use this setting to demonstrate evidence for the universal dispersion of particles in the absence of the conventional methods like velocity averaging lemmas or Strichartz-type estimates. We will develop a scattering theory in generality and use its frame work to show the existence and uniqueness of a class scattering solutions to the Boltzmann equation with asymptotic stability and completeness in the $L^{\infty}$ setting.


title: Hodge-Iwasawa Theory II

abstract: We continue our study on the Hodge-Iwasawa theory which is a continuation of our previous work on Hodge-Iwasawa theory, which is aimed at higher dimensional deformation of higher dimensional Hodge structures over general analytic spaces or adic spaces. We still follow closely the approaches of Kedlaya-Liu to study our Frobenius modules over the different kinds of period rings including more generalized perfect period rings and the corresponding imperfect period rings. It is desirable that one can globalize the deformed information in order to organize the deformed period rings into the corresponding sheaves with respect to the coefficient sheaves, which will build up some foundations on further application to moduli of Frobenius sheaves.


title: Star-Galaxy Separation via Gaussian Processes with Model Reduction

abstract: Modern cosmological surveys such as the Hyper Suprime-Cam (HSC) survey produce a huge volume of low-resolution images of both distant galaxies and dim stars in our own galaxy. Being able to automatically classify these images is a long-standing problem in astronomy and critical to a number of different scientific analyses. Recently, the challenge of "star-galaxy" classification has been approached with Deep Neural Networks (DNNs), which are good at learning complex nonlinear embeddings. However, DNNs are known to overconfidently extrapolate on unseen data and require a large volume of training images that accurately capture the data distribution to be considered reliable. Gaussian Processes (GPs), which infer posterior distributions over functions and naturally quantify uncertainty, haven't been a tool of choice for this task mainly because popular kernels exhibit limited expressivity on complex and high-dimensional data. In this paper, we present a novel approach to the star-galaxy separation problem that uses GPs and reap their benefits while solving many of the issues traditionally affecting them for classification of high-dimensional celestial image data. After an initial filtering of the raw data of star and galaxy image cutouts, we first reduce the dimensionality of the input images by using a Principal Components Analysis (PCA) before applying GPs using a simple Radial Basis Function (RBF) kernel on the reduced data. Using this method, we greatly improve the accuracy of the classification over a basic application of GPs while improving the computational efficiency and scalability of the method.


title: A high resolution multi-phase clock Time-Digital Convertor implemented on Kintex-7 FPGA

abstract: Time-digital Converter (TDC) aims to measure the arrival time of the leading edge of the pulse signal. Our recent work presented a high resolution multi-phase TDC based on the Kintex-7 Field Programmable Gate Array (FPGA) device. A simple I/O tile based circular input buffer is employed to oscillate the input signal periodically, and then a multi-phase TDC based on ISERDES core with a 625 ps bin size is used to accomplish the multiple measurements for getting higher resolution performance. In this paper, the design concept, architecture, as well as kernel implementation considerations are all discussed. To evaluate the TDC's performance, we built a verification system based on Kintex-7 FPGA. Initial test results indicate that the TDC's effective bin size is successfully reduced from 625 ps to 78.125 ps, and the measured dual-channel time resolution is better than 35 ps RMS.