title: Active learning for interactive satellite image change detection

abstract: We introduce in this paper a novel active learning algorithm for satellite image change detection. The proposed solution is interactive and based on a question and answer model, which asks an oracle (annotator) the most informative questions about the relevance of sampled satellite image pairs, and according to the oracle's responses, updates a decision function iteratively. We investigate a novel framework which models the probability that samples are relevant; this probability is obtained by minimizing an objective function capturing representativity, diversity and ambiguity. Only data with a high probability according to these criteria are selected and displayed to the oracle for further annotation. Extensive experiments on the task of satellite image change detection after natural hazards (namely tornadoes) show the relevance of the proposed method against the related work.


title: Co-link analysis as a monitoring tool: A webometric use case to map the web relationships of research projects

abstract: This study explores the societal embeddedness of the websites of research projects. It combines two aims: characterizing research projects based on their weblink relationships, and discovering external societal actors that relate to the projects via weblinks. The study was based on a set of 121 EU-funded research projects and their websites. Domains referring to the websites of the research projects were collected and used in visualizations of co-link relationships. These analyses revealed clusters of topical similarity among the research projects as well as among referring entities. Furthermore, a first step into unveiling potentially relevant stakeholders around research projects was made. Weblink analysis is discussed as an insightful tool for monitoring the internal and external linkages of research projects, representing a relevant application of webometric methods.


title: LCS: Learning Compressible Subspaces for Adaptive Network Compression at Inference Time

abstract: When deploying deep learning models to a device, it is traditionally assumed that available computational resources (compute, memory, and power) remain static. However, real-world computing systems do not always provide stable resource guarantees. Computational resources need to be conserved when load from other processes is high or battery power is low. Inspired by recent works on neural network subspaces, we propose a method for training a "compressible subspace" of neural networks that contains a fine-grained spectrum of models that range from highly efficient to highly accurate. Our models require no retraining, thus our subspace of models can be deployed entirely on-device to allow adaptive network compression at inference time. We present results for achieving arbitrarily fine-grained accuracy-efficiency trade-offs at inference time for structured and unstructured sparsity. We achieve accuracies on-par with standard models when testing our uncompressed models, and maintain high accuracy for sparsity rates above 90% when testing our compressed models. We also demonstrate that our algorithm extends to quantization at variable bit widths, achieving accuracy on par with individually trained networks.


title: F-Divergences and Cost Function Locality in Generative Modelling with Quantum Circuits

abstract: Generative modelling is an important unsupervised task in machine learning. In this work, we study a hybrid quantum-classical approach to this task, based on the use of a quantum circuit Born machine. In particular, we consider training a quantum circuit Born machine using $f$-divergences. We first discuss the adversarial framework for generative modelling, which enables the estimation of any $f$-divergence in the near term. Based on this capability, we introduce two heuristics which demonstrably improve the training of the Born machine. The first is based on $f$-divergence switching during training. The second introduces locality to the divergence, a strategy which has proved important in similar applications in terms of mitigating barren plateaus. Finally, we discuss the long-term implications of quantum devices for computing $f$-divergences, including algorithms which provide quadratic speedups to their estimation. In particular, we generalise existing algorithms for estimating the Kullback-Leibler divergence and the total variation distance to obtain a fault-tolerant quantum algorithm for estimating another $f$-divergence, namely, the Pearson divergence.


title: Assessment of Neural Networks for Stream-Water-Temperature Prediction

abstract: Climate change results in altered air and water temperatures. Increases affect physicochemical properties, such as oxygen concentration, and can shift species distribution and survival, with consequences for ecosystem functioning and services. These ecosystem services have integral value for humankind and are forecasted to alter under climate warming. A mechanistic understanding of the drivers and magnitude of expected changes is essential in identifying system resilience and mitigation measures. In this work, we present a selection of state-of-the-art Neural Networks (NN) for the prediction of water temperatures in six streams in Germany. We show that the use of methods that compare observed and predicted values, exemplified with the Root Mean Square Error (RMSE), is not sufficient for their assessment. Hence we introduce additional analysis methods for our models to complement the state-of-the-art metrics. These analyses evaluate the NN's robustness, possible maximal and minimal values, and the impact of single input parameters on the output. We thus contribute to understanding the processes within the NN and help applicants choose architectures and input parameters for reliable water temperature prediction models.


title: Celestial OPEs and $ w_{1+\infty}$ algebra from worldsheet in string theory

abstract: Celestial operator product expansions (OPEs) arise from the collinear limit of scattering amplitudes and play a vital role in celestial holography. In this paper, we derive the celestial OPEs of massless fields in string theory from the worldsheet. By studying the worldsheet OPEs of vertex operators in worldsheet CFT and further examining their behaviors in the collinear limit, we find that new vertex operators for the massless fields in string theory are generated and become dominant in the collinear limit. Mellin transforming to the conformal basis yields exactly the celestial OPEs in celestial CFT. We also derive the celestial OPEs from the collinear factorization of string amplitudes and the results derived in these two different methods are in perfect agreement with each other. Our final formulae of celestial OPEs are applicable to general dimensions, corresponding to Einstein-Yang-Mills theory supplemented by some possible higher derivative interactions. Specializing to 4D, we reproduce all the celestial OPEs for gluon and graviton in the literature. We consider various string theories, including the open and closed bosonic string, as well as the closed superstring theory with $\mathcal N=1$ and $\mathcal N=2$ worldsheet supersymmetry. In the case of $\mathcal N=2$ string, we also derive all the $\overline{SL (2,\mathbb R)}$ descendant contributions in the celestial OPE; the soft sector of such OPE just yields the $w_{1+\infty}$ algebra after rewriting in terms of chiral modes. Our stringy derivation of celestial OPEs thus initiates the first step towards the realization of celestial holography in string theory.


title: Big Machinery Data Preprocessing Methodology for Data-Driven Models in Prognostics and Health Management

abstract: Sensor monitoring networks and advances in big data analytics have guided the reliability engineering landscape to a new era of big machinery data. Low-cost sensors, along with the evolution of the internet of things and industry 4.0, have resulted in rich databases that can be analyzed through prognostics and health management (PHM) frameworks. Several da-ta-driven models (DDMs) have been proposed and applied for diagnostics and prognostics purposes in complex systems. However, many of these models are developed using simulated or experimental data sets, and there is still a knowledge gap for applications in real operating systems. Furthermore, little attention has been given to the required data preprocessing steps compared to the training processes of these DDMs. Up to date, research works do not follow a formal and consistent data preprocessing guideline for PHM applications. This paper presents a comprehensive, step-by-step pipeline for the preprocessing of monitoring data from complex systems aimed for DDMs. The importance of expert knowledge is discussed in the context of data selection and label generation. Two case studies are presented for validation, with the end goal of creating clean data sets with healthy and unhealthy labels that are then used to train machinery health state classifiers.


title: VieSum: How Robust Are Transformer-based Models on Vietnamese Summarization?

abstract: Text summarization is a challenging task within natural language processing that involves text generation from lengthy input sequences. While this task has been widely studied in English, there is very limited research on summarization for Vietnamese text. In this paper, we investigate the robustness of transformer-based encoder-decoder architectures for Vietnamese abstractive summarization. Leveraging transfer learning and self-supervised learning, we validate the performance of the methods on two Vietnamese datasets.


title: Noisy quantum amplitude estimation without noise estimation

abstract: Many quantum algorithms contain an important subroutine, the quantum amplitude estimation. As the name implies, this is essentially the parameter estimation problem and thus can be handled via the established statistical estimation theory. However, this problem has an intrinsic difficulty that the system, i.e., the real quantum computing device, inevitably introduces unknown noise; the probability distribution model then has to incorporate many nuisance noise parameters, resulting that the construction of an optimal estimator becomes inefficient and difficult. For this problem, we apply the theory of nuisance parameters (more specifically, the parameter orthogonalization method) to precisely compute the maximum likelihood estimator for only the target amplitude parameter, by removing the other nuisance noise parameters. That is, we can estimate the amplitude parameter without estimating the noise parameters. We validate the parameter orthogonalization method in a numerical simulation and study the performance of the estimator in the experiment using a real superconducting quantum device.


title: A Wireless Intrusion Detection System for 802.11 WPA3 Networks

abstract: Wi-Fi (802.11) networks have become an essential part of our daily lives; hence, their security is of utmost importance. However, Wi-Fi Protected Access 3 (WPA3), the latest security certification for 802.11 standards, has recently been shown to be vulnerable to several attacks. In this paper, we first describe the attacks on WPA3 networks that have been reported in prior work; additionally, we show that a deauthentication attack and a beacon flood attack, known to be possible on a WPA2 network, are still possible with WPA3. We launch and test all the above (a total of nine) attacks using a testbed that contains an enterprise Access Point (AP) and Intrusion Detection System (IDS). Our experimental results show that the AP is vulnerable to eight out of the nine attacks and the IDS is unable to detect any of them. We propose a design for a signature-based IDS, which incorporates techniques to detect all the above attacks. Also, we implement these techniques on our testbed and verify that our IDS is able to successfully detect all the above attacks. We provide schemes for mitigating the impact of the above attacks once they are detected. We make the code to perform the above attacks as well as that of our IDS publicly available, so that it can be used for future work by the research community at large.


title: Taming Sparsely Activated Transformer with Stochastic Experts

abstract: Sparsely activated models (SAMs), such as Mixture-of-Experts (MoE), can easily scale to have outrageously large amounts of parameters without significant increase in computational cost. However, SAMs are reported to be parameter inefficient such that larger models do not always lead to better performance. While most on-going research focuses on improving SAMs models by exploring methods of routing inputs to experts, our analysis reveals that such research might not lead to the solution we expect, i.e., the commonly-used routing methods based on gating mechanisms do not work better than randomly routing inputs to experts. In this paper, we propose a new expert-based model, THOR (Transformer witH StOchastic ExpeRts). Unlike classic expert-based models, such as the Switch Transformer, experts in THOR are randomly activated for each input during training and inference. THOR models are trained using a consistency regularized loss, where experts learn not only from training data but also from other experts as teachers, such that all the experts make consistent predictions. We validate the effectiveness of THOR on machine translation tasks. Results show that THOR models are more parameter efficient in that they significantly outperform the Transformer and MoE models across various settings. For example, in multilingual translation, THOR outperforms the Switch Transformer by 2 BLEU scores, and obtains the same BLEU score as that of a state-of-the-art MoE model that is 18 times larger. Our code is publicly available at: https://github.com/microsoft/Stochastic-Mixture-of-Experts.


title: Extragradient Method: $O(1/K)$ Last-Iterate Convergence for Monotone Variational Inequalities and Connections With Cocoercivity

abstract: Extragradient method (EG) (Korpelevich, 1976) is one of the most popular methods for solving saddle point and variational inequalities problems (VIP). Despite its long history and significant attention in the optimization community, there remain important open questions about convergence of EG. In this paper, we resolve one of such questions and derive the first last-iterate $O(1/K)$ convergence rate for EG for monotone and Lipschitz VIP without any additional assumptions on the operator unlike the only known result of this type (Golowich et al., 2020) that relies on the Lipschitzness of the Jacobian of the operator. The rate is given in terms of reducing the squared norm of the operator. Moreover, we establish several results on the (non-)cocoercivity of the update operators of EG, Optimistic Gradient Method, and Hamiltonian Gradient Method, when the original operator is monotone and Lipschitz.


title: Defect Dipole Induced Improved Electrocaloric Effect in Modified NBT-6BT Lead-Free Ceramics

abstract: The Rietveld refinement of the polycrystalline powders of 1% Fe and Mn-doped (Na0.5Bi0.5)0.94Ba0.06Ti0.98V0.02O3 at the Ti-site confirmed a single rhombohedral (R3c) phase. The bandgap, (Eg) was affected by the anti-phase octahedral tilt angle and the spin-orbit splitting energy of Ti4+2p3/2 and Ti4+2p1/2 states. The decrease in Bi loss and increase in the binding energy of Ba due to Fe/Mn doping has been correlated to the strengthening of Bi-O and Ba-O bonds which was revealed from the XPS studies thereby further related to the average A-O bond length from structural studies. Hence, a reduction of oxygen vacancy (VO) for the doped samples has been justified. A significant improvement of the dielectric constant, relaxation time ({\tau}0), and the decrease in conductivity due to doping was revealed from the frequency-dependent (10Hz-1MHz) dielectric measurement study. The conduction and relaxation process is dominated by the short-range movement of defects. The activation energy (Ea ~1eV) revealed that there is a presence of double-ionized VOs. The ECE study showed a significant enhancement of the changes in entropy, and the adiabatic temperature difference due to doping, with the change in tempearture being highest in the Fe-doped sample. Such improvement of dielectric and ECE properties was confirmed due to the reduction of the mobility of oxygen vacancy because of the formation defect dipoles.


title: The Multiplicative Persistence Conjecture Is True for Odd Targets

abstract: In 1973, Neil Sloane published a very short paper introducing an intriguing problem: Pick a decimal integer $n$ and multiply all its digits by each other. Repeat the process until a single digit $\Delta(n)$ is obtained. $\Delta(n)$ is called the \textsl{multiplicative digital root of $n$} or \textsl{the target of $n$}. The number of steps $\Xi(n)$ needed to reach $\Delta(n)$, called the multiplicative persistence of $n$ or \textsl{the height of $n$} is conjectured to always be at most $11$. Like many other very simple to state number-theoretic conjectures, the multiplicative persistence mystery resisted numerous explanation attempts. This paper proves that the conjecture holds for all odd target values: Namely that if $\Delta(n)\in\{1,3,7,9\}$, then $\Xi(n) \leq 1$ and that if $\Delta(n)=5$, then $\Xi(n) \leq 5$. Naturally, we overview the difficulties currently preventing us from extending the approach to (nonzero) even targets.


title: Centaur 2013 VZ70: Debris from Saturn's irregular moon population?

abstract: Context. Saturn has an excess of irregular moons. This is thought to be the result of past collisional events. Debris produced during such episodes in the neighborhood of a host planet can evolve into co-orbitals trapped in quasi-satellite and/or horseshoe resonant states. A recently announced centaur, 2013 VZ70, follows an orbit that could be compatible with those of prograde Saturn's co-orbitals. Aims. We perform an exploration of the short-term dynamical evolution of 2013 VZ70 to confirm or reject a co-orbital relationship with Saturn. A possible connection with Saturn's irregular moon population is also investigated. Methods. We studied the evolution of 2013 VZ70 backward and forward in time using N-body simulations, factoring uncertainties into the calculations. We computed the distribution of mutual nodal distances between this centaur and a sample of moons. Results. We confirm that 2013 VZ70 is currently trapped in a horseshoe resonant state with respect to Saturn but that it is a transient co-orbital. We also find that 2013 VZ70 may become a quasi-satellite of Saturn in the future and that it may experience brief periods of capture as a temporary irregular moon. This centaur might also pass relatively close to known irregular moons of Saturn. Conclusions. Although an origin in trans-Neptunian space is possible, the hostile resonant environment characteristic of Saturn's neighborhood favors a scenario of in situ formation via impact, fragmentation, or tidal disruption as 2013 VZ70 can experience encounters with Saturn at very low relative velocity. An analysis of its orbit within the context of those of the moons of Saturn suggests that 2013 VZ70 could be related to the Inuit group. Also, the mutual nodal distances of 2013 VZ70 and the moons Fornjot and Thrymr are below the first percentile of the distribution.


title: A study of the robustness of raw waveform based speaker embeddings under mismatched conditions

abstract: In this paper, we conduct a cross-dataset study on parametric and non-parametric raw-waveform based speaker embeddings through speaker verification experiments. In general, we observe a more significant performance degradation of these raw-waveform systems compared to spectral based systems. We then propose two strategies to improve the performance of raw-waveform based systems on cross-dataset tests. The first strategy is to change the real-valued filters into analytic filters to ensure shift-invariance. The second strategy is to apply variational dropout to non-parametric filters to prevent them from overfitting irrelevant nuance features.


title: Methods of Causal Inference in Physics Education Research

abstract: Finding good educational policies requires sound estimates of their potential effects. Methods for making such estimates, i.e. finding causal estimands, have made great progress in the last few decades. Nevertheless, serious errors in causal reasoning have been found previously in papers n a leading physics education journal, Physical Review Physics Education Research. Here we examine three more recent papers from that journal that present explicit methods of causal inference. The methods given include major errors, including in identifying causal mediation, choosing variables to control for, and imputing missing data.


title: Exploring Heterogeneous Characteristics of Layers in ASR Models for More Efficient Training

abstract: Transformer-based architectures have been the subject of research aimed at understanding their overparameterization and the non-uniform importance of their layers. Applying these approaches to Automatic Speech Recognition, we demonstrate that the state-of-the-art Conformer models generally have multiple ambient layers. We study the stability of these layers across runs and model sizes, propose that group normalization may be used without disrupting their formation, and examine their correlation with model weight updates in each layer. Finally, we apply these findings to Federated Learning in order to improve the training procedure, by targeting Federated Dropout to layers by importance. This allows us to reduce the model size optimized by clients without quality degradation, and shows potential for future exploration.


title: Fermions in AdS and Gross-Neveu BCFT

abstract: We study the boundary critical behavior of conformal field theories of interacting fermions in the Gross-Neveu universality class. By a Weyl transformation, the problem can be studied by placing the CFT in an anti de Sitter space background. After reviewing some aspects of free fermion theories in AdS, we use both large $N$ methods and the epsilon expansion near 2 and 4 dimensions to study the conformal boundary conditions in the Gross-Neveu CFT. At large $N$ and general dimension $d$, we find three distinct boundary conformal phases. Near four dimensions, where the CFT is described by the Wilson-Fisher fixed point of the Gross-Neveu-Yukawa model, two of these phases correspond respectively to the choice of Neumann or Dirichlet boundary condition on the scalar field, while the third one corresponds to the case where the bulk scalar field acquires a classical expectation value. One may flow between these boundary critical points by suitable relevant boundary deformations. We compute the AdS free energy on each of them, and verify that its value is consistent with the boundary version of the F-theorem. We also compute some of the BCFT observables in these theories, including bulk two-point functions of scalar and fermions, and four-point functions of boundary fermions.


title: Fast emulation of quantum three-body scattering

abstract: We develop a class of emulators for solving quantum three-body scattering problems. They are based on combining the variational method for scattering observables and the recently proposed eigenvector continuation concept. The emulators are first trained by the exact scattering solutions of the governing Hamiltonian at a small number of points in its parameter space, and then employed to make interpolations and extrapolations in that space. Through a schematic nuclear-physics model with finite-range two and three-body interactions, we demonstrate the emulators to be extremely accurate and efficient. The computing time for emulation is on the scale of milliseconds (on a laptop), with relative errors ranging from $10^{-13}$ to $10^{-4}$ depending on the case. The emulators also require little memory. We argue that these emulators can be generalized to even more challenging scattering problems. Furthermore, this general strategy may be applicable for building the same type of emulators in other fields, wherever variational methods can be developed for evaluating physical models.

categories: nucl-th hep-lat physics.atom-ph physics.comp-ph physics.data-an


title: VLA Observations of 9 Extended Green Objects in the Milky Way: Ubiquitous Weak, Compact Continuum Emission, and Multi-Epoch Emission from CH$_3$OH, H$_2$O, and NH$_3$ Masers

abstract: We have observed a sample of 9 Extended Green Objects (EGOs) at 1.3 and 5 cm with the VLA with sub-arcsecond resolution and ~7-14 uJy/beam sensitivities in order to characterize centimeter continuum emission as it first appears in these massive protoclusters. We find EGO-associated continuum emission - within 1 arcsec of the extended 4.5 um emission - in every field, which is typically faint (order 10^1-10^2 uJy) and compact (unresolved at 0.3-0.5 arcsec). The derived spectral indices of our 36 total detections are consistent with a wide array of physical processes, including both non-thermal (19% of detections) and thermal free-free processes (e.g. ionized jets and compact HII regions, 78% of sample), and warm dust (1 source). We also find EGO-associated 6.7 GHz CH$_3$OH and 22 GHz H$_2$O maser emission in 100% of the sample, and NH$_3$ (3,3) masers in ~45%; we do not detect any NH$_3$ (6,6) masers at ~5.6 mJy/beam sensitivity. We find statistically-significant correlations between radio-distance and bolometric luminosities at two physical scales and three frequencies, consistent with thermal emission from ionized jets, but no correlation between water-maser and radio-distance luminosities for our sample. From these data, we conclude that EGOs likely host multiple different centimeter continuum-producing processes simultaneously. Additionally, at our ~1000 au resolution, we find that all EGOs except G18.89$-$0.47 contain 1 to 2 massive sources based on the presence of methanol maser groups, which is consistent with our previous work suggesting that these are typical massive protoclusters in which only one to a few of the YSOs are massive.


title: Primordial black holes from bubble collisions during a first-order phase transition

abstract: We find that collisions of near-horizon-sized bubbles with a thick fluid shell can produce primordial black holes (PBHs) during a first-order phase transition. We predict an approximately monochromatic PBH mass spectrum. In terms of a few parameters to be obtained from future numerical simulation, we estimate the PBH abundance in an Abelian Higgs benchmark model and show that it can be significant. In particular, the PBHs can constitute entire dark matter or even over-close the universe. Our result thus shows that models with a first-order phase transition can be constrained by over-abundant PBHs or null results of other PBH searches.


title: Equivalence of JT Gravity and Near-extremal Black Hole Dynamics in Higher Derivative Theory

abstract: Two derivative Jackiw Teitelboim gravity theory captures the near horizon dynamics of higher dimensional near extremal black holes, which is governed by a Schwarzian action at the boundary in the near horizon region. The partition function corresponding to this boundary action correctly gives the statistical entropy of the near extremal black hole. In this paper, we study the thermodynamics of spherically symmetric four dimensional near extremal black holes in presence of arbitrary perturbative four derivative corrections. We find that the near horizon dynamics is again captured by a JT like action with a particular namely square of Ricci scalar higher derivative modification. Effectively the theory is described by a boundary Schwarzian action which gets suitably modified due to the presence of the higher derivative interactions. Near extremal entropy, free energy also get corrected accordingly.


title: On the relation between pressure and coupling potential in adaptive resolution simulations of open systems in contact with a reservoir

abstract: In a previous paper [Gholami et al. Adv.Th.Sim.4, 2000303 (2021)], we have identified a precise relation between the chemical potential of a fully atomistic simulation and the simulation of an open system in the adaptive resolution method (AdResS). The starting point was the equivalence derived from the statistical partition functions between the grand potentials, $\Omega$, of the open system and of the equivalent subregion in the fully atomistic simulation of reference. In this work, instead, we treat the identity for the grand potential based on the thermodynamic relation $\Omega=-pV$ and investigate the behaviour of the pressure in the coupling region of the adaptive resolution method (AdResS). We confirm the physical consistency of the method for determining the chemical potential described by the previous work and strengthen it further by identifying a clear numerical relation between the potential that couples the open system to the reservoir on the one hand and the local pressure of the reference fully atomistic system on the other hand. Such a relation is of crucial importance in the perspective of coupling the AdResS method for open system to the continuum hydrodynamic regime.


title: Kernel Interpolation as a Bayes Point Machine

abstract: A Bayes point machine is a single classifier that approximates the majority decision of an ensemble of classifiers. This paper observes that kernel interpolation is a Bayes point machine for Gaussian process classification. This observation facilitates the transfer of results from both ensemble theory as well as an area of convex geometry known as Brunn-Minkowski theory to derive PAC-Bayes risk bounds for kernel interpolation. Since large margin, infinite width neural networks are kernel interpolators, the paper's findings may help to explain generalisation in neural networks more broadly. Supporting this idea, the paper finds evidence that large margin, finite width neural networks behave like Bayes point machines too.


title: Multiple Myeloma Cancer Cell Instance Segmentation

abstract: Images remain the largest data source in the field of healthcare. But at the same time, they are the most difficult to analyze. More than often, these images are analyzed by human experts such as pathologists and physicians. But due to considerable variation in pathology and the potential fatigue of human experts, an automated solution is much needed. The recent advancement in Deep learning could help us achieve an efficient and economical solution for the same. In this research project, we focus on developing a Deep Learning-based solution for detecting Multiple Myeloma cancer cells using an Object Detection and Instance Segmentation System. We explore multiple existing solutions and architectures for the task of Object Detection and Instance Segmentation and try to leverage them and come up with a novel architecture to achieve comparable and competitive performance on the required task. To train our model to detect and segment Multiple Myeloma cancer cells, we utilize a dataset curated by us using microscopic images of cell slides provided by Dr.Ritu Gupta(Prof., Dept. of Oncology AIIMS).


title: Offline Meta-Reinforcement Learning for Industrial Insertion

abstract: Reinforcement learning (RL) can in principle let robots automatically adapt to new tasks, but current RL methods require a large number of trials to accomplish this. In this paper, we tackle rapid adaptation to new tasks through the framework of meta-learning, which utilizes past tasks to learn to adapt with a specific focus on industrial insertion tasks. Fast adaptation is crucial because prohibitively large number of on-robot trials will potentially damage hardware pieces. Additionally, effective adaptation is also feasible in that experience among different insertion applications can be largely leveraged by each other. In this setting, we address two specific challenges when applying meta-learning. First, conventional meta-RL algorithms require lengthy online meta-training. We show that this can be replaced with appropriately chosen offline data, resulting in an offline meta-RL method that only requires demonstrations and trials from each of the prior tasks, without the need to run costly meta-RL procedures online. Second, meta-RL methods can fail to generalize to new tasks that are too different from those seen at meta-training time, which poses a particular challenge in industrial applications, where high success rates are critical. We address this by combining contextual meta-learning with direct online finetuning: if the new task is similar to those seen in the prior data, then the contextual meta-learner adapts immediately, and if it is too different, it gradually adapts through finetuning. We show that our approach is able to quickly adapt to a variety of different insertion tasks, with a success rate of 100% using only a fraction of the samples needed for learning the tasks from scratch. Experiment videos and details are available at https://sites.google.com/view/offline-metarl-insertion.


title: Quantum computational advantage attested by nonlocal games with the cyclic cluster state

abstract: We propose a set of Bell-type nonlocal games that can be used to prove an unconditional quantum advantage in an objective and hardware-agnostic manner. In these games, the circuit depth needed to prepare a cyclic cluster state and measure a subset of its Pauli stabilizers on a quantum computer is compared to that of classical Boolean circuits with the same, nearest-neighboring gate connectivity. Using a circuit-based trapped-ion quantum computer, we prepare and measure a six-qubit cyclic cluster state with an overall fidelity of 60.6% and 66.4%, before and after correcting for measurement-readout errors, respectively. Our experimental results indicate that while this fidelity readily passes conventional (or depth-0) Bell bounds for local hidden-variable models, it is on the cusp of demonstrating a higher probability of success than what is possible by depth-1 classical circuits. Our games offer a practical and scalable set of quantitative benchmarks for quantum computers in the pre-fault-tolerant regime as the number of qubits available increases.


title: On Large Values of $|\zeta(\sigma+{\rm i}t)|$

abstract: We investigate the extreme values of the Riemann zeta function $\zeta(s)$. On the 1-line, we obtain a lower bound evaluation $$\max_{t\in[1,T]}|\zeta(1+\i t)|\ge {\rm e}^\gamma(\log_2T+\log_3T+c),$$ with an effective constant $c$ which improves the result of Aistleitner, Mahatab and Munsch. In the half-critical strip $1/2<\re s<1$, we get an improved $c(\sigma)$ in the evaluation $$\max_{t\in[0,T]}\log|\zeta(\sigma+\i t)|\ge c(\sigma)\frac{(\log T)^{1-\sigma}}{(\log_2T)^\sigma},$$ when $\sigma\searrow 1/2$, based on an improved lower bound of GCD sums. This improves the result of Bondarenko and Seip.


title: StairwayGraphNet for Inter- and Intra-modality Multi-resolution Brain Graph Alignment and Synthesis

abstract: Synthesizing multimodality medical data provides complementary knowledge and helps doctors make precise clinical decisions. Although promising, existing multimodal brain graph synthesis frameworks have several limitations. First, they mainly tackle only one problem (intra- or inter-modality), limiting their generalizability to synthesizing inter- and intra-modality simultaneously. Second, while few techniques work on super-resolving low-resolution brain graphs within a single modality (i.e., intra), inter-modality graph super-resolution remains unexplored though this would avoid the need for costly data collection and processing. More importantly, both target and source domains might have different distributions, which causes a domain fracture between them. To fill these gaps, we propose a multi-resolution StairwayGraphNet (SG-Net) framework to jointly infer a target graph modality based on a given modality and super-resolve brain graphs in both inter and intra domains. Our SG-Net is grounded in three main contributions: (i) predicting a target graph from a source one based on a novel graph generative adversarial network in both inter (e.g., morphological-functional) and intra (e.g., functional-functional) domains, (ii) generating high-resolution brain graphs without resorting to the time consuming and expensive MRI processing steps, and (iii) enforcing the source distribution to match that of the ground truth graphs using an inter-modality aligner to relax the loss function to optimize. Moreover, we design a new Ground Truth-Preserving loss function to guide both generators in learning the topological structure of ground truth brain graphs more accurately. Our comprehensive experiments on predicting target brain graphs from source graphs using a multi-resolution stairway showed the outperformance of our method in comparison with its variants and state-of-the-art method.


title: Pyxis: An Open-Source Performance Dataset of Sparse Accelerators

abstract: Specialized accelerators provide gains of performance and efficiency in specific domains of applications. Sparse data structures or/and representations exist in a wide range of applications. However, it is challenging to design accelerators for sparse applications because no architecture or performance-level analytic models are able to fully capture the spectrum of the sparse data. Accelerator researchers rely on real execution to get precise feedback for their designs. In this work, we present PYXIS, a performance dataset for specialized accelerators on sparse data. PYXIS collects accelerator designs and real execution performance statistics. Currently, there are 73.8 K instances in PYXIS. PYXIS is open-source, and we are constantly growing PYXIS with new accelerator designs and performance statistics. PYXIS can benefit researchers in the fields of accelerator, architecture, performance, algorithm, and many related topics.


title: Collaging Class-specific GANs for Semantic Image Synthesis

abstract: We propose a new approach for high resolution semantic image synthesis. It consists of one base image generator and multiple class-specific generators. The base generator generates high quality images based on a segmentation map. To further improve the quality of different objects, we create a bank of Generative Adversarial Networks (GANs) by separately training class-specific models. This has several benefits including -- dedicated weights for each class; centrally aligned data for each model; additional training data from other sources, potential of higher resolution and quality; and easy manipulation of a specific object in the scene. Experiments show that our approach can generate high quality images in high resolution while having flexibility of object-level control by using class-specific generators.


title: Field Extraction from Forms with Unlabeled Data

abstract: We propose a novel framework to conduct field extraction from forms with unlabeled data. To bootstrap the training process, we develop a rule-based method for mining noisy pseudo-labels from unlabeled forms. Using the supervisory signal from the pseudo-labels, we extract a discriminative token representation from a transformer-based model by modeling the interaction between text in the form. To prevent the model from overfitting to label noise, we introduce a refinement module based on a progressive pseudo-label ensemble. Experimental results demonstrate the effectiveness of our framework.


title: Testing the impact of electromagnetic fields on the directed flow of constituent quarks in heavy-ion collisions

abstract: It has been proposed that strong electromagnetic fields produced in the early stages of heavy-ion collisions can lead to splitting of the rapidity-odd directed flow of positive and negative hadrons. For light hadrons, the interpretation of such measurements is complicated by the low magnitude of directed flow as well as by ambiguities arising from transported quarks. To overcome these complications, we propose measurements using only hadrons carrying produced quarks ($\bar{u},\bar{d},s,\bar{s}$). We discuss how to identify the kinematics where such hadrons are produced via the coalescence mechanism and therefore their flow is the sum of the flow of their constituent quarks. With this sum rule verified for certain combinations of hadrons, the expected systematic violation of this rule with increasing electric charge can be measured, which could be a consequence of the electromagnetic fields produced in the collisions. Our approach can be tested with the high statistics data from Phase II of the Beam Energy Scan (BES) program at the Relativistic Heavy Ion Collider (RHIC).


title: Auto-DSP: Learning to Optimize Acoustic Echo Cancellers

abstract: Adaptive filtering algorithms are commonplace in signal processing and have wide-ranging applications from single-channel denoising to multi-channel acoustic echo cancellation and adaptive beamforming. Such algorithms typically operate via specialized online, iterative optimization methods and have achieved tremendous success, but require expert knowledge, are slow to develop, and are difficult to customize. In our work, we present a new method to automatically learn adaptive filtering update rules directly from data. To do so, we frame adaptive filtering as a differentiable operator and train a learned optimizer to output a gradient descent-based update rule from data via backpropagation through time. We demonstrate our general approach on an acoustic echo cancellation task (single-talk with noise) and show that we can learn high-performing adaptive filters for a variety of common linear and non-linear multidelayed block frequency domain filter architectures. We also find that our learned update rules exhibit fast convergence, can optimize in the presence of nonlinearities, and are robust to acoustic scene changes despite never encountering any during training.


title: Calibrated decoders for experimental quantum error correction

abstract: Arbitrarily long quantum computations require quantum memories that can be repeatedly measured without being corrupted. Here, we preserve the state of a quantum memory, notably with the additional use of flagged error events. All error events were extracted using fast, mid-circuit measurements and resets of the physical qubits. Among the error decoders we considered, we introduce a perfect matching decoder that was calibrated from measurements containing up to size-4 correlated events. To compare the decoders, we used a partial post-selection scheme shown to retain ten times more data than full post-selection. We observed logical errors per round of $2.2\pm0.1\times10^{-2}$ (decoded without post-selection) and $5.1\pm0.7\times10^{-4}$ (full post-selection), which was less than the physical measurement error of $7\times10^{-3}$ and therefore surpasses a pseudo-threshold for repeated logical measurements.


title: Is MC Dropout Bayesian?

abstract: MC Dropout is a mainstream "free lunch" method in medical imaging for approximate Bayesian computations (ABC). Its appeal is to solve out-of-the-box the daunting task of ABC and uncertainty quantification in Neural Networks (NNs); to fall within the variational inference (VI) framework; and to propose a highly multimodal, faithful predictive posterior. We question the properties of MC Dropout for approximate inference, as in fact MC Dropout changes the Bayesian model; its predictive posterior assigns $0$ probability to the true model on closed-form benchmarks; the multimodality of its predictive posterior is not a property of the true predictive posterior but a design artefact. To address the need for VI on arbitrary models, we share a generic VI engine within the pytorch framework. The code includes a carefully designed implementation of structured (diagonal plus low-rank) multivariate normal variational families, and mixtures thereof. It is intended as a go-to no-free-lunch approach, addressing shortcomings of mean-field VI with an adjustable trade-off between expressivity and computational complexity.


title: Finiteness of fppf cohomology

abstract: Let $R$ be a Henselian DVR with finite residue field. Let $G$ be a finite type, flat $R$-group scheme (not necessarily commutative) with smooth generic fiber. We show that $H^1_{\mathrm{fppf}}(\mathrm{Spec} R,G)$ is finite. We then give an application of the global analogue of this finiteness result to PEL type integral models of Shimura varieties.


title: Fermi surface expansion above critical temperature in a Hund ferromagnet

abstract: Using a cluster extension of the dynamical mean-field theory, we show that strongly correlated metals subject to Hund's physics exhibit significant electronic structure modulations above magnetic transition temperatures. In particular, in a ferromagnet having a large local moment due to Hund's coupling (Hund's ferromagnet), the Fermi surface expands even above the Curie temperature ($T_{\rm C}$) as if a spin polarization occurred. Behind this phenomenon, effective ``Hund's physics'' works in momentum space, originating from ferromagnetic fluctuations in the strong coupling regime. The resulting significantly momentum-dependent (spatially nonlocal) electron correlations induce an electronic structure reconstruction involving a Fermi-surface volume change and a redistribution of the momentum-space occupation. Our finding will give a deeper insight into the physics of Hund's ferromagnets above $T_{\rm C}$.


title: Location-based training for multi-channel talker-independent speaker separation

abstract: Permutation-invariant training (PIT) is a dominant approach for addressing the permutation ambiguity problem in talker-independent speaker separation. Leveraging spatial information afforded by microphone arrays, we propose a new training approach to resolving permutation ambiguities for multi-channel speaker separation. The proposed approach, named location-based training (LBT), assigns speakers on the basis of their spatial locations. This training strategy is easy to apply, and organizes speakers according to their positions in physical space. Specifically, this study investigates azimuth angles and source distances for location-based training. Evaluation results on separating two- and three-speaker mixtures show that azimuth-based training consistently outperforms PIT, and distance-based training further improves the separation performance when speaker azimuths are close. Furthermore, we dynamically select azimuth-based or distance-based training by estimating the azimuths of separated speakers, which further improves separation performance. LBT has a linear training complexity with respect to the number of speakers, as opposed to the factorial complexity of PIT. We further demonstrate the effectiveness of LBT for the separation of four and five concurrent speakers.


title: Entanglement and separability in continuum Rokhsar-Kivelson states

abstract: We study a vast family of continuum Rokhsar-Kivelson (RK) states, which have their groundstate encoded by a local quantum field theory. These describe certain quantum magnets, and are also important in quantum information. We prove the separability of the reduced density matrix of two disconnected subsystems, implying the absence of entanglement between the two subsystems -- a stronger statement than the vanishing of logarithmic negativity. As a particular instance, we investigate the case where the groundstate is described by a relativistic boson, which is relevant for certain magnets or Lifshitz critical points with dynamical exponent $z=2$, and we propose nontrivial deformations that preserve their RK structure. Specializing to 1D systems, we study a deformation that maps the groundstate to the quantum harmonic oscillator, leading to a gap for the boson. We study the resulting correlation functions, and find that cluster decomposition is restored. We analytically compute the $c$-function for the entanglement entropy along a renormalization group flow for the wavefunction, which is found to be strictly decreasing as in CFTs. Finally, we comment on the relations to certain stoquastic quantum spin chains. We show that the Motzkin and Fredkin chains possess unusual entanglement properties not properly captured by previous studies.


title: Local and Global Context-Based Pairwise Models for Sentence Ordering

abstract: Sentence Ordering refers to the task of rearranging a set of sentences into the appropriate coherent order. For this task, most previous approaches have explored global context-based end-to-end methods using Sequence Generation techniques. In this paper, we put forward a set of robust local and global context-based pairwise ordering strategies, leveraging which our prediction strategies outperform all previous works in this domain. Our proposed encoding method utilizes the paragraph's rich global contextual information to predict the pairwise order using novel transformer architectures. Analysis of the two proposed decoding strategies helps better explain error propagation in pairwise models. This approach is the most accurate pure pairwise model and our encoding strategy also significantly improves the performance of other recent approaches that use pairwise models, including the previous state-of-the-art, demonstrating the research novelty and generalizability of this work. Additionally, we show how the pre-training task for ALBERT helps it to significantly outperform BERT, despite having considerably lesser parameters. The extensive experimental results, architectural analysis and ablation studies demonstrate the effectiveness and superiority of the proposed models compared to the previous state-of-the-art, besides providing a much better understanding of the functioning of pairwise models.


title: Toward a Visual Concept Vocabulary for GAN Latent Space

abstract: A large body of recent work has identified transformations in the latent spaces of generative adversarial networks (GANs) that consistently and interpretably transform generated images. But existing techniques for identifying these transformations rely on either a fixed vocabulary of pre-specified visual concepts, or on unsupervised disentanglement techniques whose alignment with human judgments about perceptual salience is unknown. This paper introduces a new method for building open-ended vocabularies of primitive visual concepts represented in a GAN's latent space. Our approach is built from three components: (1) automatic identification of perceptually salient directions based on their layer selectivity; (2) human annotation of these directions with free-form, compositional natural language descriptions; and (3) decomposition of these annotations into a visual concept vocabulary, consisting of distilled directions labeled with single words. Experiments show that concepts learned with our approach are reliable and composable -- generalizing across classes, contexts, and observers, and enabling fine-grained manipulation of image style and content.


title: Function-private Conditional Disclosure of Secrets and Multi-evaluation Threshold Distributed Point Functions

abstract: Conditional disclosure of secrets (CDS) allows multiple parties to reveal a secret to a third party if and only if some pre-decided condition is satisfied. In this work, we bolster the privacy guarantees of CDS by introducing function-private CDS wherein the pre-decided condition is never revealed to the third party. We also derive a function secret sharing scheme from our function-private CDS solution. The second problem that we consider concerns threshold distributed point functions, which allow one to split a point function such that at least a threshold number of shares are required to evaluate it at any given input. We consider a setting wherein a point function is split among a set of parties such that multiple evaluations do not leak non-negligible information about it. Finally, we present a provably optimal procedure to perform threshold function secret sharing of any polynomial in a finite field.


title: 2nd Place Solution to Google Landmark Retrieval 2021

abstract: This paper presents the 2nd place solution to the Google Landmark Retrieval 2021 Competition on Kaggle. The solution is based on a baseline with training tricks from person re-identification, a continent-aware sampling strategy is presented to select training images according to their country tags and a Landmark-Country aware reranking is proposed for the retrieval task. With these contributions, we achieve 0.52995 mAP@100 on private leaderboard. Code available at https://github.com/WesleyZhang1991/Google_Landmark_Retrieval_2021_2nd_Place_Solution


title: Quantifying the COVID19 infection risk due to droplet/aerosol inhalation

abstract: The dose-response model has been widely used for quantifying the risk of infection of airborne diseases like COVID-19. The model has been used in the room-average analysis of infection risk and analysis using passive scalars as a proxy for aerosol transport. However, it has not been employed for risk estimation in numerical simulations of droplet dispersion. In this work, we develop a framework for the evaluation of the probability of infection in droplet dispersion simulations using the dose-response model. We introduce a version of the model that can incorporate the higher transmissibility of variant strains of SARS-CoV2 and the effect of vaccination in evaluating the probability of infection. Numerical simulations of droplet dispersion during speech are carried out to investigate the infection risk over space and time using the model. The advantage of droplet dispersion simulations for risk evaluation is demonstrated through the analysis of the effect of humidity on infection risk.

categories: q-bio.QM physics.bio-ph physics.flu-dyn q-bio.PE


title: Reconstructing Nearby Young Clusters with Gaia EDR3

abstract: We searched through a seven-million cubic-parsec volume surrounding each of the four nearest young open clusters with ages from 40 to 80 Myr to identify both the current and past members of the clusters within the Gaia EDR3 dataset. We find over 1,700 current cluster members and over 1,200 candidate escapees. Many of these candidates lie well in front and behind the cluster from our point of view, so formerly they were considered cluster members, but their parallaxes put them more than 10 pc from the centre of the cluster today. We found two candidate high-mass white dwarfs that may have escaped from the alpha Persei cluster and several candidate main-sequence-white-dwarf binaries associated with the younger clusters, NGC 2451A, IC 2391 and IC 2602. All of these objects require spectroscopic confirmation. Using these samples of escapee candidates, we develop and implement a novel technique to determine the ages of these clusters and the Pleiades using kinematics with typical uncertainties of $5-7$ Myr. For all five clusters, this kinematic age is younger than the age estimated with isochrones but within the uncertainties of the isochrone fitting. We find for the clusters that travel far from the Galactic plane (the Pleiades, NGC 2451A and IC 2602), the formation of the cluster coincides with when the cluster was in the Galactic plane within a few Myr, supporting these age determinations.


title: 3D Meta-Segmentation Neural Network

abstract: Though deep learning methods have shown great success in 3D point cloud part segmentation, they generally rely on a large volume of labeled training data, which makes the model suffer from unsatisfied generalization abilities to unseen classes with limited data. To address this problem, we present a novel meta-learning strategy that regards the 3D shape segmentation function as a task. By training over a number of 3D part segmentation tasks, our method is capable to learn the prior over the respective 3D segmentation function space which leads to an optimal model that is rapidly adapting to new part segmentation tasks. To implement our meta-learning strategy, we propose two novel modules: meta part segmentation learner and part segmentation learner. During the training process, the part segmentation learner is trained to complete a specific part segmentation task in the few-shot scenario. In the meantime, the meta part segmentation learner is trained to capture the prior from multiple similar part segmentation tasks. Based on the learned information of task distribution, our meta part segmentation learner is able to dynamically update the part segmentation learner with optimal parameters which enable our part segmentation learner to rapidly adapt and have great generalization ability on new part segmentation tasks. We demonstrate that our model achieves superior part segmentation performance with the few-shot setting on the widely used dataset: ShapeNet.


title: The Hobby-Eberly Telescope Dark Energy Experiment (HETDEX) Survey Design, Reductions, and Detections

abstract: We describe the survey design, calibration, commissioning, and emission-line detection algorithms for the Hobby-Eberly Telescope Dark Energy Experiment (HETDEX). The goal of HETDEX is to measure the redshifts of over a million Ly$\alpha$ emitting galaxies between 1.88<z<3.52, in a 540 deg^2 area encompassing a co-moving volume of 10.9 Gpc^3. No pre-selection of targets is involved; instead the HETDEX measurements are accomplished via a spectroscopic survey using a suite of wide-field integral field units distributed over the focal plane of the telescope. This survey measures the Hubble expansion parameter and angular diameter distance, with a final expected accuracy of better than 1%. We detail the project's observational strategy, reduction pipeline, source detection, and catalog generation, and present initial results for science verification in the COSMOS, Extended Groth Strip, and GOODS-N fields. We demonstrate that our data reach the required specifications in throughput, astrometric accuracy, flux limit, and object detection, with the end products being a catalog of emission-line sources, their object classifications, and flux-calibrated spectra.


title: Superdiffusion in self-reinforcing run-and-tumble model with rests

abstract: This paper introduces a run-and-tumble model with self-reinforcing directionality and rests. We derive a single governing hyperbolic partial differential equation for the probability density of random walk position, from which we obtain the second moment in the long time limit. We find the criteria for the transition between superdiffusion and diffusion caused by the addition of a rest state. The emergence of superdiffusion depends on both the parameter representing the strength of self-reinforcement and the ratio between mean running and resting times. The mean running time must be at least $2/3$ of the mean resting time for superdiffusion to be possible. Monte Carlo simulations validate this theoretical result. This work demonstrates the possibility of extending the telegrapher's (or Cattaneo) equation by adding self-reinforcing directionality so that superdiffusion occurs even when rests are introduced.


title: Off-the-grid covariance-based super-resolution fluctuation microscopy

abstract: Super-resolution fluorescence microscopy overcomes blurring arising from light diffraction, allowing the reconstruction of fine scale details in biological structures. Standard methods come at the expense of long acquisition time and/or harmful effects on the biological sample, which makes the problem quite challenging for the imaging of body cells. A promising new avenue is the exploitation of molecules fluctuations, allowing live-cell imaging with good spatio-temporal resolution through common microscopes and conventional fluorescent dyes. Several numerical algorithms have been developed in the literature and used for fluctuant time series. These techniques are developed within the discrete setting, namely the super-resolved image is defined on a finer grid than the observed images. On the contrary, gridless optimisation does not rely on a fine grid and is rather an optimisation of Dirac measures in number, amplitudes and positions. In this work, we present an off-the-grid problem accounting for the independence of fluctuations.


title: Salient ImageNet: How to discover spurious features in Deep Learning?

abstract: Deep neural networks can be unreliable in the real world especially when they heavily use {\it spurious} features for their predictions. Focusing on image classifications, we define {\it core features} as the set of visual features that are always a part of the object definition while {\it spurious features} are the ones that are likely to {\it co-occur} with the object but not a part of it (e.g., attribute "fingers" for class "band aid"). Traditional methods for discovering spurious features either require extensive human annotations (thus, not scalable), or are useful on specific models. In this work, we introduce a {\it general} framework to discover a subset of spurious and core visual features used in inferences of a general model and localize them on a large number of images with minimal human supervision. Our methodology is based on this key idea: to identify spurious or core \textit{visual features} used in model predictions, we identify spurious or core \textit{neural features} (penultimate layer neurons of a robust model) via limited human supervision (e.g., using top 5 activating images per feature). We then show that these neural feature annotations {\it generalize} extremely well to many more images {\it without} any human supervision. We use the activation maps for these neural features as the soft masks to highlight spurious or core visual features. Using this methodology, we introduce the {\it Salient Imagenet} dataset containing core and spurious masks for a large set of samples from Imagenet. Using this dataset, we show that several popular Imagenet models rely heavily on various spurious features in their predictions, indicating the standard accuracy alone is not sufficient to fully assess model performance. Code and dataset for reproducing all experiments in the paper is available at \url{https://github.com/singlasahil14/salient_imagenet}.


title: About the Primality of Primorials

abstract: A primorial prime is a prime number of the form $p_n\# \pm 1$ where $p_n\#$ denotes the product of all primes less than or equal to $p_{n}$, the $n$-th prime. We show that the probability along the lines of Mertens' Theorem that either $p_n\# -1$ or $p_n\# +1$ is prime is $O(n^{-1})$ and that the probability that both $p_n\# -1$ and $p_n\# +1$ are prime is $O(n^{-2})$, for $n>1$. The latter result provides evidence that there are in total three instances where both $p_n\# -1$ and $p_n\# +1$ are prime. We provide proof that numbers of the from $p_n\# \pm 1$ have the highest probability of being prime.


title: CFT$_2$ in the Bulk

abstract: We study non-Gaussian bulk 2d CFTs in AdS$_2$ using boundary CFT techniques and recent results in JT/Schwarzian gravity. We highlight the constraints on the operator content of a theory imposed by the boundary conditions by examining the relation between correlator coefficients and OPE coefficients in the presence of a boundary. We then calculate bulk and boundary correlators for various boundary conditions. Schwarzian techniques are used to calculate gravitational correlators perturbatively in $1/c$.


title: Toward a Better Understanding of Cosmic Chronometers: A new measurement of H(z) at z~0.7

abstract: We analyze the stellar ages obtained from a combination of Lick indices in Borghi et al. for 140 massive and passive galaxies selected in the LEGA-C survey at $0.6<z<0.9$. From their median age--redshift relation, we derive a new direct measurement of $H(z)$ without any cosmological model assumption using the cosmic chronometer approach. We thoroughly study the main systematics involved in this analysis: the choice of the Lick indices combination, the binning method, the assumed stellar population model, and the adopted star formation history; these effects are included in the total error budget. We obtain $H(z=0.75)= 98.8\pm33.6~\mathrm{km\,s^{-1}\,Mpc^{-1}}$. In parallel, we also propose a simple framework based on a cosmological model to describe the age--redshift relations in the context of galaxy downsizing. This allows us to derive constraints on the Hubble constant $H_0$ and the typical galaxy formation time. This new $H(z)$ measurement, whose accuracy is currently limited by the scarcity of the sample analyzed, paves the road for the joint study of the stellar populations of individual passive galaxies and the expansion history of the Universe in light of future spectroscopic surveys.


title: Rejuvenation triggers nuclear activity in nearby galaxies

abstract: Feedback, in particular from active galactic nuclei (AGN), is believed to play a crucial role in the evolution of galaxies. In the local Universe, many galaxies with an AGN are indeed observed to reside in the so-called green valley, usually interpreted as a transition phase from a blue star-forming to a red quenched state. We use data from the Sloan Digital Sky Survey to show that such an interpretation requires substantial revision. Optically-selected nearby AGN galaxies follow exponentially declining star formation histories, as normal galaxies of similar stellar and dark matter halo mass, reaching in the recent past ($\sim$0.1 Gyr ago) star formation rate levels consistent with a quiescent population. However, we find that local AGN galaxies have experienced a sudden increase in their star formation rate, unfolding on timescales similar to those typical of AGN activity, suggesting that both star formation and AGN activity were triggered simultaneously. We find that this quenching followed by an enhancement in the star formation rate is common to AGN galaxies and more pronounced in early type galaxies. Our results demonstrate that local AGN galaxies are not just a simple transition type between star-forming and quiescent galaxies as previously postulated.


title: Faintest of them all : ZTF 21aaoryiz/SN 2021fcg -- Discovery of an extremely low luminosity type Iax supernova

abstract: We present the discovery of ZTF 21aaoryiz/SN 2021fcg -- an extremely low-luminosity Type Iax supernova. SN 2021fcg was discovered by the Zwicky Transient Facility in the star-forming galaxy IC0512 at a distance of $\approx$ 27 Mpc. It reached a peak absolute magnitude of $M_{r} =$ $-12.66\pm0.20$ mag, making it the least luminous thermonuclear supernova discovered to date. The E(B-V) contribution from the underlying host galaxy is unconstrained. However, even if it were as large as 0.5 mag, the peak absolute magnitude would be $M_{r} = -13.78\pm0.20$ mag -- still consistent with being the lowest luminosity SN. Optical spectra of SN 2021fcg taken at 37 and 65 days post maximum show strong [Ca II], Ca II and Na I D emission and several weak [Fe II] emission lines. The [Ca II] emission in the two spectra has extremely low velocities of $\approx 1300$ and $1000$ km s$^{-1}$ respectively. The spectra very closely resemble those of the very low luminosity Type Iax supernovae SN 2008ha, SN 2010ae and SN 2019gsc taken at similar phases. The peak bolometric luminosity of SN 2021fcg is $\approx$ $2.5^{+1.5}_{-0.3}\times10^{40}$ erg s$^{-1}$ which is a factor of three lower than that for SN 2008ha. The bolometric lightcurve of SN 2021fcg is consistent with a very low ejected nickel mass (M$_{\rm{Ni}} \approx 0.8^{+0.4}_{-0.5}\times10^{-3}$ M$_{\odot}$). The low luminosity and nickel mass of SN 2021fcg pose a challenge to the picture that low luminosity SNe Iax originate from deflagrations of near M$_{\rm{ch}}$ hybrid carbon-oxygen-neon white dwarfs. Instead, the merger of a carbon-oxygen and oxygen-neon white dwarf is a promising model to explain SN 2021fcg.


title: Characterizing the protolunar disk of the accreting companion GQ Lupi B

abstract: GQ Lup B is a young and accreting, substellar companion that appears to drive a spiral arm in the circumstellar disk of its host star. We report high-contrast imaging observations of GQ Lup B with VLT/NACO at 4-5 $\mu$m and medium-resolution integral field spectroscopy with VLT/MUSE. The optical spectrum is consistent with an M9 spectral type, shows characteristics of a low-gravity atmosphere, and exhibits strong H$\alpha$ emission. The $H-M'$ color is $\gtrsim$1 mag redder than field dwarfs with similar spectral types and a detailed analysis of the spectral energy distribution (SED) from optical to mid-infrared wavelengths reveals excess emission in the $L'$, NB4.05, and $M'$ bands. The excess flux is well described by a blackbody component with $T_\mathrm{disk} \approx 460$ K and $R_\mathrm{disk} \approx 65\,R_\mathrm{J}$ and is expected to trace continuum emission from small grains in a protolunar disk. We derive an extinction of $A_V \approx 2.3$ mag from the broadband SED with a suspected origin in the vicinity of the companion. We also combine 15 yr of astrometric measurements and constrain the mutual inclination with the circumstellar disk to $84 \pm 9$ deg, indicating a tumultuous dynamical evolution or a stellar-like formation pathway. From the measured H$\alpha$ flux and the estimated companion mass, $M_\mathrm{p} \approx 30\,M_\mathrm{J}$, we derive an accretion rate of $\dot{M} \approx 10^{-6.5}\,M_\mathrm{J}\,\mathrm{yr}^{-1}$. We speculate that the disk is in a transitional stage in which the assembly of satellites from a pebble reservoir has opened a central cavity while GQ Lup B is in the final stages of its formation.


title: VIRUP : The Virtual Reality Universe Project

abstract: VIRUP is a new C++ open source software that provides an interactive virtual reality environment to navigate through large scientific astrophysical datasets obtained from both observations and simulations. It is tailored to visualize terabytes of data, rendering at 90 frames per second in order to ensure an optimal immersion experience. While VIRUP has initially been designed to work with gaming virtual reality headsets, it supports different modern immersive systems like 3D screens, 180 deg. domes or 360 deg. panorama. VIRUP is scriptable thanks to the Python language, a feature that allows to immerse visitors through pre-selected scenes or to pre-render sequences to create movies. A companion video (https://www.youtube.com/watch?v=KJJXbcf8kxA) to the last SDSS 2020 release as well as a 21 minute long documentary, The Archaeology of Light, https://go.epfl.ch/ArchaeologyofLight have been both 100% produced using VIRUP.


title: Misaligned disks induced by infall

abstract: Arc- and tail-like structures associated with disks around Herbig stars can be a consequence of infall events occurring after the initial collapse phase of a forming star. An encounter event of gas with a star can lead to the formation of a second-generation disk after the initial protostellar collapse phase. Additionally, observations of shadows in disks can be well described by a configuration of misaligned inner and outer disk, such that the inner disk casts a shadow on the outer disk. Carrying out altogether eleven 3D hydrodynamical models with the moving mesh code AREPO, we test whether a late encounter of an existing star-disk system with a cloudlet of gas can lead to the formation of an outer disk that is misaligned with respect to the primordial inner disk. Our models demonstrate that a second-generation disk with large misalignment with respect to an existing primordial disk can easily form if the infall angle is large. The second-generation outer disk is more eccentric, though the asymmetric infall also triggers eccentricity of the inner disk of $e\approx 0.05$ to $0.1$. Retrograde infall can lead to the formation of counter-rotating disks and enhanced accretion. As the angular momentum of the inner disk is reduced, the inner disk shrinks and a gap forms between the two disks. The resulting misaligned disk system can survive for $\sim 100$ kyr or longer without aligning each other even for low primordial disk masses given an infall mass of $\sim 10^{-4}$ M$_{\odot}$. A synthetic image reveals shadows in the outer disk similar to the ones observed in multiple transition disks that are caused by the misaligned inner disk. We conclude that late inclined infall onto a star-disk system leads to the formation of a misaligned outer disk. Infall might therefore be responsible for observations of shadows in at least some transition disks.


title: Climate uncertainties caused by unknown land distribution on habitable M-Earths

abstract: A planet's surface conditions can significantly impact its climate and habitability. In this study, we use the 3D general circulation model ExoPlaSim to systematically vary dayside land cover on a synchronously rotating, temperate rocky planet under two extreme and opposite continent configurations, in which either all of the land or all of the ocean is centred at the substellar point. We identify water vapour and sea ice as competing drivers of climate, and we isolate land-dependent regimes under which one or the other dominates. We find that the amount and configuration of land can change the planet's globally averaged surface temperature by up to 20K, and its atmospheric water vapour content by several orders of magnitude. The most discrepant models have partial dayside land cover with opposite continent configurations. Since transit spectroscopy may permit observations of M-dwarf planets' atmospheres, but not their surfaces, these land-related climate differences likely represent a limiting uncertainty in a given planet's climate, even if its atmospheric composition is known. Our results are robust to variations in atmospheric CO2 concentration, stellar temperature, and instellation.


title: Temperature effects on the $Z_2$ symmetry breaking in the scotogenic model

abstract: It is well-known that the scotogenic model for neutrino mass generation can explain correctly the relic abundance of cold dark matter. There have been claims in the literature that an important part of the parameter space of the simplest scotogentic model can be constrained by the requirement that no $Z_2$-breaking must occur in the early universe. Here we show that this requirement does not give any constraints on the underlying parameter space at least in those parts, where we can trust perturbation theory. To demonstrate this, we have taken into account the proper decoupling of heavy degrees of freedom in both, the thermal potential and in the RGE evolution.


title: ALP Dark Matter in a Primordial Black Hole Dominated Universe

abstract: We investigate the phenomenological consequences of axion-like particle (ALP) dark matter with an early matter domination triggered by primordial black holes (PBHs). We focus on light BHs with masses smaller than $\sim 10^9~$g which fully evaporate before Big Bang nucleosynthesis. We numerically solve the coupled Boltzmann equations, carefully taking the greybody factors and BH angular momentum into account. We find that the entropy injection from PBH evaporation dilutes the ALP relic abundance originally produced via the vacuum misalignment mechanism, opening the parameter space with larger scales $f_a$ or, equivalently, smaller ALP-photon couplings $g_{a\gamma}$, within the reach of future detectors as ABRACADABRA, KLASH, ADMX, and DM-Radio. Moreover, the ALP minicluster masses can be several orders of magnitude larger if the early Universe features an PBH dominated epoch. For the relativistic ALPs produced directly from Hawking radiation, we find that their contribution to the dark radiation is within the sensitivity of next generation CMB experiments. For the sake of completeness, we also revisit the particular case of the QCD axion.


title: Maximal speed for macroscopic particle transport in the Bose-Hubbard model

abstract: The Lieb-Robinson bound asserts the existence of a maximal propagation speed for the quantum dynamics of lattice spin systems. Such general bounds are not available for most bosonic lattice gases due to their unbounded local interactions. Here we establish for the first time a general ballistic upper bound on macroscopic particle transport in the paradigmatic Bose-Hubbard model. The bound is the first to cover a broad class of initial states with positive density including Mott states, which resolves a longstanding open problem. It applies to Bose-Hubbard type models on any lattice with not too long-ranged hopping. The proof is rigorous and rests on controlling the time evolution of a new kind of adiabatic spacetime localization observable via iterative differential inequalities.

categories: quant-ph cond-mat.stat-mech math-ph math.MP


title: A New Census of the 0.2< z <3.0 Universe, Part II: The Star-Forming Sequence

abstract: We use the panchromatic SED-fitting code Prospector to measure the galaxy logM$^*$-logSFR relationship (the `star-forming sequence') across $0.2 < z < 3.0$ using the COSMOS-2015 and 3D-HST UV-IR photometric catalogs. We demonstrate that the chosen method of identifying star-forming galaxies introduces a systematic uncertainty in the inferred normalization and width of the star-forming sequence, peaking for massive galaxies at $\sim 0.5$ dex and $\sim0.2$ dex respectively. To avoid this systematic, we instead parameterize the density of the full galaxy population in the logM$^*$-logSFR-redshift plane using a flexible neural network known as a normalizing flow. The resulting star-forming sequence has a low-mass slope near unity and a much flatter slope at higher masses, with a normalization $0.2-0.5$ dex lower than typical inferences in the literature. We show this difference is due to the sophistication of the Prospector stellar populations modeling: the nonparametric star formation histories naturally produce higher masses while the combination of individualized metallicity, dust, and star formation history constraints produce lower star formation rates than typical UV+IR formulae. We introduce a simple formalism to understand the difference between SFRs inferred from spectral energy distribution fitting and standard template-based approaches such as UV+IR SFRs. Finally, we demonstrate the inferred star-forming sequence is consistent with predictions from theoretical models of galaxy formation, resolving a long-standing $\sim0.2-0.5$ dex offset with observations at $0.5<z<3$. The fully trained normalizing flow including a nonparametric description of $\rho(\log{\rm M}^*,\log{\rm SFR},z)$ is made available online to facilitate straightforward comparisons with future work.


title: Expanding Bipolar X-ray Structure After the 2006 Eruption of RS Oph

abstract: We report on the detection and analysis of extended X-ray emission by the {\it Chandra} X-ray Observatory stemming from the 2006 eruption of the recurrent novae RS Oph. The extended emission was detected 1254 and 1927 days after the start of the 2006 eruption and is consistent with a bipolar flow oriented in the east-west direction of the sky with opening angles of approximately $70^{\circ}$. The length of both lobes appeared to expand from 1.3 arcsec in 2009 to 2.0 arcsec in 2011, suggesting a projected expansion rate of $1.1\pm0.1 {\rm ~mas~day}^{-1}$ and an expansion velocity of $4600\ {\rm km~s}^{-1}\ (D/2.4\ {\rm kpc})$ in the plane of the sky. This expansion rate is consistent with previous estimates from optical and radio observations of material in a similar orientation. The X-ray emission does not show any evidence of cooling between 2009 and 2011, consistent with free expansion of the material. This discovery suggests that some mechanism collimates ejecta away from the equatorial plane, and that after that material passes through the red-giant wind, it expands freely into the cavity left by the 1985 eruption. We expect similar structures to arise from latest eruption and to expand into the cavity shaped by the 2006 eruption.


title: COVID-19 Face Mask Recognition with Advanced Face Cut Algorithm for Human Safety Measures

abstract: In the last year, the outbreak of COVID-19 has deployed computer vision and machine learning algorithms in various fields to enhance human life interactions. COVID-19 is a highly contaminated disease that affects mainly the respiratory organs of the human body. We must wear a mask in this situation as the virus can be contaminated through the air and a non-masked person can be affected. Our proposal deploys a computer vision and deep learning framework to recognize face masks from images or videos. We have implemented a Boundary dependent face cut recognition algorithm that can cut the face from the image using 27 landmarks and then the preprocessed image can further be sent to the deep learning ResNet50 model. The experimental result shows a significant advancement of 3.4 percent compared to the YOLOV3 mask recognition architecture in just 10 epochs.


title: Mirror Twin Higgs Cosmology: Constraints and a Possible Resolution to the $H_0$ and $S_8$ Tensions

abstract: The mirror twin Higgs model (MTH) is a solution to the Higgs hierarchy problem that provides well-predicted cosmological signatures with only three extra parameters: the temperature of the twin sector, the abundance of twin baryons, and the vacuum expectation value (VEV) of twin electroweak symmetry breaking. These parameters specify the behavior of twin radiation and the acoustic oscillations of twin baryons, which lead to testable effects on the cosmic microwave background (CMB) and large-scale structure (LSS). While collider searches can only probe the twin VEV, through a fit to cosmological data we show that the existing CMB (Planck18 TTTEEE+lowE+lowT+lensing) and LSS (KV450) data already provide useful constraints on the remaining MTH parameters. Additionally, we show that the presence of twin radiation in this model can raise the Hubble constant $H_0$ while the scattering twin baryons can reduce the matter fluctuations $S_8$, which helps to relax the observed $H_0$ and $S_8$ tensions simultaneously. This scenario is different from the typical $\Lambda$CDM + $\Delta N_{\rm eff}$ model, in which extra radiation helps with the Hubble tension but worsens the $S_8$ tension. For instance, when including the SH0ES and Planck SZ data in the fit, we find that a universe with $\gtrsim 20\%$ of the dark matter comprised of twin baryons is preferred over $\Lambda$CDM by $\sim4\sigma$. If the twin sector is indeed responsible for resolving the $H_0$ and $S_8$ tensions, future measurements from the Euclid satellite and CMB Stage 4 experiment will further measure the twin parameters to $O(1-10\%)$-level precision. Our study demonstrates how models with hidden naturalness can potentially be probed using precision cosmological data.


title: Learning a Self-Expressive Network for Subspace Clustering

abstract: State-of-the-art subspace clustering methods are based on self-expressive model, which represents each data point as a linear combination of other data points. However, such methods are designed for a finite sample dataset and lack the ability to generalize to out-of-sample data. Moreover, since the number of self-expressive coefficients grows quadratically with the number of data points, their ability to handle large-scale datasets is often limited. In this paper, we propose a novel framework for subspace clustering, termed Self-Expressive Network (SENet), which employs a properly designed neural network to learn a self-expressive representation of the data. We show that our SENet can not only learn the self-expressive coefficients with desired properties on the training data, but also handle out-of-sample data. Besides, we show that SENet can also be leveraged to perform subspace clustering on large-scale datasets. Extensive experiments conducted on synthetic data and real world benchmark data validate the effectiveness of the proposed method. In particular, SENet yields highly competitive performance on MNIST, Fashion MNIST and Extended MNIST and state-of-the-art performance on CIFAR-10. The code is available at https://github.com/zhangsz1998/Self-Expressive-Network.


title: Debris Disks

abstract: Debris disk is a catch-all term that can be used to refer to any component of a planetary system which is not an actual planet. In the Solar System this refers to the asteroids and comets in the Asteroid and Kuiper belts as well as the dust and gas derived from them, such as the zodiacal cloud. Studying the structure of extrasolar debris disks provides unique constraints on the underlying planetary system and on the processes of planet formation and protoplanetary disk evolution. Debris disks also have important implications for processes affecting the planets, such as impact events that may strip an atmosphere or deliver volatiles. Their presence or absence also has consequences both positive and negative for the detectability of exoplanets in the system. Here I describe five of the most important ways in which debris disks will contribute to our understanding of extrasolar planetary systems in the coming years.


title: Constraint-Aware Deep Reinforcement Learning for End-to-End Resource Orchestration in Mobile Networks

abstract: Network slicing is a promising technology that allows mobile network operators to efficiently serve various emerging use cases in 5G. It is challenging to optimize the utilization of network infrastructures while guaranteeing the performance of network slices according to service level agreements (SLAs). To solve this problem, we propose SafeSlicing that introduces a new constraint-aware deep reinforcement learning (CaDRL) algorithm to learn the optimal resource orchestration policy within two steps, i.e., offline training in a simulated environment and online learning with the real network system. On optimizing the resource orchestration, we incorporate the constraints on the statistical performance of slices in the reward function using Lagrangian multipliers, and solve the Lagrangian relaxed problem via a policy network. To satisfy the constraints on the system capacity, we design a constraint network to map the latent actions generated from the policy network to the orchestration actions such that the total resources allocated to network slices do not exceed the system capacity. We prototype SafeSlicing on an end-to-end testbed developed by using OpenAirInterface LTE, OpenDayLight-based SDN, and CUDA GPU computing platform. The experimental results show that SafeSlicing reduces more than 20% resource usage while meeting SLAs of network slices as compared with other solutions.


title: Computing an Optimal Pitching Strategy in a Baseball At-Bat

abstract: The field of quantitative analytics has transformed the world of sports over the last decade. To date, these analytic approaches are statistical at their core, characterizing what is and what was, while using this information to drive decisions about what to do in the future. However, as we often view team sports, such as soccer, hockey, and baseball, as pairwise win-lose encounters, it seems natural to model these as zero-sum games. We propose such a model for one important class of sports encounters: a baseball at-bat, which is a matchup between a pitcher and a batter. Specifically, we propose a novel model of this encounter as a zero-sum stochastic game, in which the goal of the batter is to get on base, an outcome the pitcher aims to prevent. The value of this game is the on-base percentage (i.e., the probability that the batter gets on base). In principle, this stochastic game can be solved using classical approaches. The main technical challenges lie in predicting the distribution of pitch locations as a function of pitcher intention, predicting the distribution of outcomes if the batter decides to swing at a pitch, and characterizing the level of patience of a particular batter. We address these challenges by proposing novel pitcher and batter representations as well as a novel deep neural network architecture for outcome prediction. Our experiments using Kaggle data from the 2015 to 2018 Major League Baseball seasons demonstrate the efficacy of the proposed approach.


title: Nonminimally coupled ultralight axions as cold dark matter

abstract: We consider a nonminimally coupled scalar field as a potential cold dark matter candidate. These models are natural extensions of the ultralight axion models which are based on minimally coupled scalar fields. Such ultralight scalar fields are motivated by string theory and, in particular, have been studied in the context of the axiverse scenario. For a nonminimally coupled field, the scalar-field energy density behaves as radiation at early times, which yields a bound on the coupling constant, $\xi \lesssim 10$, from the primordial nucleosynthesis theory. The first-order perturbations of the nonminimally coupled field with adiabatic initial conditions cause the gravitational potential to decay on large scales. A comparison of the cosmological data with the theoretical matter power spectrum yields the following constraint on the coupling constant: $\xi \lesssim 0.01$. We also consider isocurvature modes in our analysis. We argue that a mix of adiabatic and isocurvature initial conditions for a nonminimally coupled scalar field might allow one to obtain the usual adiabatic CDM power spectrum.


title: Snowy: Recommending Utterances for Conversational Visual Analysis

abstract: Natural language interfaces (NLIs) have become a prevalent medium for conducting visual data analysis, enabling people with varying levels of analytic experience to ask questions of and interact with their data. While there have been notable improvements with respect to language understanding capabilities in these systems, fundamental user experience and interaction challenges including the lack of analytic guidance (i.e., knowing what aspects of the data to consider) and discoverability of natural language input (i.e., knowing how to phrase input utterances) persist. To address these challenges, we investigate utterance recommendations that contextually provide analytic guidance by suggesting data features (e.g., attributes, values, trends) while implicitly making users aware of the types of phrasings that an NLI supports. We present SNOWY, a prototype system that generates and recommends utterances for visual analysis based on a combination of data interestingness metrics and language pragmatics. Through a preliminary user study, we found that utterance recommendations in SNOWY support conversational visual analysis by guiding the participants' analytic workflows and making them aware of the system's language interpretation capabilities. Based on the feedback and observations from the study, we discuss potential implications and considerations for incorporating recommendations in future NLIs for visual analysis.


title: A new and simple proof of the false centre theorem

abstract: We present in this work a new and simple proof of the false centre theorem.


title: Quantum fields in teleparallel gravity: renormalization at one-loop

abstract: We consider the quantization of matter fields in a background described by the teleparallel equivalent to general relativity. The presence of local Lorentz and gauge symmetries gives rise to different coupling prescriptions, which we analyse separately. As expected, quantum matter fields produce divergences that cannot be absorbed by terms in the background action of teleparallel equivalent to general relativity. Nonetheless, the formulation of teleparallel gravity allows one to find out the source of the problem. By imposing local Lorentz invariance after quantization, we show that a modified teleparallel gravity, in which the coefficients in the action are replaced by free parameters, can be renormalized at one-loop order without introducing higher-order terms. This precludes the appearance of ghosts in the theory.


title: Near Optimal Interpolation based Time-Limited Model Order Reduction

abstract: This paper presents an interpolatory framework for time-limited $H_2$ optimal model order reduction named Limited Time Iterative Rational Krylov Algorithm (LT-IRKA). The algorithm yields high fidelity reduced order models over limited time intervals of the form, $\begin{bmatrix}0 & \tau \end{bmatrix}$ with $\tau < \infty$ for linear time invariant (LTI) systems. Using the time limited $H_2$ norm, we derive interpolation based $H_{2,\tau}$ optimality conditions. The LT-IRKA yields a near optimal $H_2(\tau)$ reduced order system. The nearness to the exact $H_2(\tau)$ optimal reduced system is quantized in terms of the errors in the interpolation based $H_2(\tau)$ optimality conditions. We demonstrate with numerical examples how the proposed algorithm nearly satisfies the time-limited optimality conditions and also how it performs with respect to the Time-Limited Two sided Iteration Algorithm (TL-TSIA), the Time-Limited Balanced Truncation (TL-BT), the Iterative Rational Krylov Algorithm (IRKA) and the Time-Limited Pseudo Optimal Rational Krylov (TL-PORK) Algorithm over a finite time interval.


title: DPUV3INT8: A Compiler View to programmable FPGA Inference Engines

abstract: We have a FPGA design, we make it fast, efficient, and tested for a few important examples. Now we must infer a general solution to deploy in the data center. Here, we describe the FPGA DPUV3INT8 design and our compiler effort. The hand-tuned SW-HW solution for Resnet50\_v1 has (close to) 2 times better images per second (throughput) than our best FPGA implementation; the compiler generalizes the hand written techniques achieving about 1.5 times better performance for the same example, the compiler generalizes the optimizations to a model zoo of networks, and it achieves 80+\% HW efficiency.


title: Distinguishing rule- and exemplar-based generalization in learning systems

abstract: Machine learning systems often do not share the same inductive biases as humans and, as a result, extrapolate or generalize in ways that are inconsistent with our expectations. The trade-off between exemplar- and rule-based generalization has been studied extensively in cognitive psychology; in this work, we present a protocol inspired by these experimental approaches to probe the inductive biases that control this tradeoff in category-learning systems. We isolate two such inductive biases: feature-level bias (differences in which features are more readily learned) and exemplar or rule bias (differences in how these learned features are used for generalization). We find that standard neural network models are feature-biased and exemplar-based, and discuss the implications of these findings for machine learning research on systematic generalization, fairness, and data augmentation.


title: Rubric-based holistic review: a promising route to equitable graduate admissions in physics

abstract: As systematic inequities in higher education and society have been brought to the forefront, graduate programs are interested in increasing the diversity of their applicants and enrollees. Yet, structures in place to evaluate applicants may not support such aims. One potential solution to support those aims is rubric-based holistic review. Starting in 2018, our physics department implemented a rubric-based holistic review process for all applicants to our graduate program. The rubric assessed applicants on 18 metrics covering their grades, test scores, research experiences, noncognitive competencies, and fit with the program. We then compared faculty's ratings of applicants by admission status, sex, and undergraduate program over a three-year period. We find that the rubric scores show statistically significant differences between admitted and non-admitted students as hoped and that statistically significant differences based on sex or undergraduate program aligned with known disparities in GRE scores and service work expectations. Our results then suggest rubric-based holistic review as a possible route to making graduate admissions in physics more equitable.


title: KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering

abstract: Current Open-Domain Question Answering (ODQA) model paradigm often contains a retrieving module and a reading module. Given an input question, the reading module predicts the answer from the relevant passages which are retrieved by the retriever. The recent proposed Fusion-in-Decoder (FiD), which is built on top of the pretrained generative model T5, achieves the state-of-the-art performance in the reading module. Although being effective, it remains constrained by inefficient attention on all retrieved passages which contain a lot of noise. In this work, we propose a novel method KG-FiD, which filters noisy passages by leveraging the structural relationship among the retrieved passages with a knowledge graph. We initiate the passage node embedding from the FiD encoder and then use graph neural network (GNN) to update the representation for reranking. To improve the efficiency, we build the GNN on top of the intermediate layer output of the FiD encoder and only pass a few top reranked passages into the higher layers of encoder and decoder for answer generation. We also apply the proposed GNN based reranking method to enhance the passage retrieval results in the retrieving module. Extensive experiments on common ODQA benchmark datasets (Natural Question and TriviaQA) demonstrate that KG-FiD can improve vanilla FiD by up to 1.5% on answer exact match score and achieve comparable performance with FiD with only 40% of computation cost.


title: MusicNet: Compact Convolutional Neural Network for Real-time Background Music Detection

abstract: With the recent growth of remote work, online meetings often encounter challenging audio contexts such as background noise, music, and echo. Accurate real-time detection of music events can help to improve the user experience. In this paper, we present MusicNet, a compact neural model for detecting background music in the real-time communications pipeline. In video meetings, music frequently co-occurs with speech and background noises, making the accurate classification quite challenging. We propose a compact convolutional neural network core preceded by an in-model featurization layer. MusicNet takes 9 seconds of raw audio as input and does not require any model-specific featurization in the product stack. We train our model on the balanced subset of the Audio Set~\cite{gemmeke2017audio} data and validate it on 1000 crowd-sourced real test clips. Finally, we compare MusicNet performance with 20 state-of-the-art models. MusicNet has a true positive rate (TPR) of 81.3% at a 0.1% false positive rate (FPR), which is significantly better than state-of-the-art models included in our study. MusicNet is also 10x smaller and has 4x faster inference than the best performing models we benchmarked.