title: A New Perspective for Understanding Generalization Gap of Deep Neural Networks Trained with Large Batch Sizes

abstract: Deep neural networks (DNNs) are typically optimized using various forms of mini-batch gradient descent algorithm. A major motivation for mini-batch gradient descent is that with a suitably chosen batch size, available computing resources can be optimally utilized (including parallelization) for fast model training. However, many works report the progressive loss of model generalization when the training batch size is increased beyond some limits. This is a scenario commonly referred to as generalization gap. Although several works have proposed different methods for alleviating the generalization gap problem, a unanimous account for understanding generalization gap is still lacking in the literature. This is especially important given that recent works have observed that several proposed solutions for generalization gap problem such learning rate scaling and increased training budget do not indeed resolve it. As such, our main exposition in this paper is to investigate and provide new perspectives for the source of generalization loss for DNNs trained with a large batch size. Our analysis suggests that large training batch size results in increased near-rank loss of units' activation (i.e. output) tensors, which consequently impacts model optimization and generalization. Extensive experiments are performed for validation on popular DNN models such as VGG-16, residual network (ResNet-56) and LeNet-5 using CIFAR-10, CIFAR-100, Fashion-MNIST and MNIST datasets.


title: Attention-Based Scattering Network for Satellite Imagery

abstract: Multi-channel satellite imagery, from stacked spectral bands or spatiotemporal data, have meaningful representations for various atmospheric properties. Combining these features in an effective manner to create a performant and trustworthy model is of utmost importance to forecasters. Neural networks show promise, yet suffer from unintuitive computations, fusion of high-level features, and may be limited by the quantity of available data. In this work, we leverage the scattering transform to extract high-level features without additional trainable parameters and introduce a separation scheme to bring attention to independent input channels. Experiments show promising results on estimating tropical cyclone intensity and predicting the occurrence of lightning from satellite imagery.


title: Improving the Factual Correctness of Radiology Report Generation with Semantic Rewards

abstract: Neural image-to-text radiology report generation systems offer the potential to improve radiology reporting by reducing the repetitive process of report drafting and identifying possible medical errors. These systems have achieved promising performance as measured by widely used NLG metrics such as BLEU and CIDEr. However, the current systems face important limitations. First, they present an increased complexity in architecture that offers only marginal improvements on NLG metrics. Secondly, these systems that achieve high performance on these metrics are not always factually complete or consistent due to both inadequate training and evaluation. Recent studies have shown the systems can be substantially improved by using new methods encouraging 1) the generation of domain entities consistent with the reference and 2) describing these entities in inferentially consistent ways. So far, these methods rely on weakly-supervised approaches (rule-based) and named entity recognition systems that are not specific to the chest X-ray domain. To overcome this limitation, we propose a new method, the RadGraph reward, to further improve the factual completeness and correctness of generated radiology reports. More precisely, we leverage the RadGraph dataset containing annotated chest X-ray reports with entities and relations between entities. On two open radiology report datasets, our system substantially improves the scores up to 14.2% and 25.3% on metrics evaluating the factual correctness and completeness of reports.


title: Syntactic Surprisal From Neural Models Predicts, But Underestimates, Human Processing Difficulty From Syntactic Ambiguities

abstract: Humans exhibit garden path effects: When reading sentences that are temporarily structurally ambiguous, they slow down when the structure is disambiguated in favor of the less preferred alternative. Surprisal theory (Hale, 2001; Levy, 2008), a prominent explanation of this finding, proposes that these slowdowns are due to the unpredictability of each of the words that occur in these sentences. Challenging this hypothesis, van Schijndel & Linzen (2021) find that estimates of the cost of word predictability derived from language models severely underestimate the magnitude of human garden path effects. In this work, we consider whether this underestimation is due to the fact that humans weight syntactic factors in their predictions more highly than language models do. We propose a method for estimating syntactic predictability from a language model, allowing us to weigh the cost of lexical and syntactic predictability independently. We find that treating syntactic predictability independently from lexical predictability indeed results in larger estimates of garden path. At the same time, even when syntactic predictability is independently weighted, surprisal still greatly underestimate the magnitude of human garden path effects. Our results support the hypothesis that predictability is not the only factor responsible for the processing cost associated with garden path sentences.


title: Molecular Structure, Dynamics, and Vibrational Spectroscopy of the Acetylene:Ammonia (1:1) Plastic Co-Crystal at Titan Conditions

abstract: The Saturnian moon Titan has a thick, organic-rich atmosphere, and condensed phases of small organic molecules are anticipated to be stable on its surface. Of particular importance are crystalline phases of organics, known as cryominerals, which can play important roles in surface chemistry and geological processes on Titan. Many of these cryominerals could exhibit rich phase behavior, especially multicomponent cryominerals whose component molecules have multiple solid phases. One such cryomineral is the acetylene:ammonia (1:1) co-crystal, and here we use density functional theory-based ab initio molecular dynamics simulations to quantify its structure and dynamics at Titan conditions. We show that the acetylene:ammonia (1:1) co-crystal is a plastic co-crystal (or rotator phase) at Titan conditions because the ammonia molecules are orientationally disordered. Moreover, the ammonia molecules within this co-crystal rotate on picosecond timescales, and this rotation is accompanied by the breakage and reformation of hydrogen bonds between the ammonia hydrogens and the {\pi}-system of acetylene. The robustness of our predictions is supported by comparing the predictions of two density functional approximations at different levels of theory, as well as through the prediction of infrared and Raman spectra that agree well with experimental measurements. We anticipate that these results will aid in understanding geochemistry on the surface of Titan.


title: Differences in the Resistive and Thermodynamic Properties of the Single Crystalline Chiral Superconductor Candidate SrPtAs

abstract: $\require{mediawiki-texvc}$The locally non-centrosymmetric superconductor SrPtAs is proposed to host a topological chiral $d$-wave state, but experimental reports have been limited to polycrystalline samples. Here we report the synthesis of single crystalline SrPtAs grown from Pb flux. SrPtAs crystallizes in the hexagonal space group $P6_{3}$/$mmc$ with lattice parameters $a$ = 4.2445(4) ${\AA}$ and $c$ = 8.9513(18) ${\AA}$. Magnetic susceptibility and electrical resistivity measurements reveal a superconducting transition at T$_c$ $\sim$2.2 K, in agreement with previous reports on polycrystalline samples. Surprisingly, heat capacity data show only a small bulk transition at 0.7 K. We discuss the possible origins of the discrepancy between the various measurements.


title: The Bergman number of a plane domain

abstract: Let $D$ be a domain in the complex plane $\mathbb{C}$. The Hardy number of $D$, which first introduced by Hansen, is the maximal number $h(D)$ in $[0,+\infty]$ such that $f$ belongs to the classical Hardy space $H^p (\mathbb{D})$ whenever $0<p<h(D)$ and $f$ is holomorphic on the unit disk $\mathbb{D}$ with values in $D$. As an analogue notion to the Hardy number of a domain $D$ in $\mathbb{C}$, we introduce the Bergman number of $D$ and we denote it by $b(D)$. Our main result is that, if $D$ is regular, then $h(D)=b(D)$. This generalizes earlier work by the author and Karamanlis for simply connected domains. The Bergman number $b(D)$ is the maximal number in $[0,+\infty]$ such that $f$ belongs to the weighted Bergman space $A^p_{\alpha} (\mathbb{D})$ whenever $p>0$ and $\alpha>-1$ satisfy $0<\frac{p}{\alpha+2}<b(D)$ and $f$ is holomorphic on $\mathbb{D}$ with values in $D$. We also establish several results about Hardy spaces and weighted Bergman spaces and we give a new characterization of the Hardy number and thus of the Bergman number of a regular domain with respect to the harmonic measure.


title: Rate-Splitting for Intelligent Reflecting Surface-Aided Multiuser VR Streaming

abstract: The growing demand for virtual reality (VR) applications requires wireless systems to provide a high transmission rate to support 360-degree video streaming to multiple users simultaneously. In this paper, we propose an intelligent reflecting surface (IRS)-aided rate-splitting (RS) VR streaming system. In the proposed system, RS facilitates the exploitation of the shared interests of the users in VR streaming, and IRS creates additional propagation channels to support the transmission of high-resolution 360-degree videos. IRS also enhances the capability to mitigate the performance bottleneck caused by the requirement that all RS users have to be able to decode the common message. We formulate an optimization problem for maximization of the achievable bitrate of the 360-degree video subject to the quality-of-service (QoS) constraints of the users. We propose a deep deterministic policy gradient with imitation learning (Deep-GRAIL) algorithm, in which we leverage deep reinforcement learning (DRL) and the hidden convexity of the formulated problem to optimize the IRS phase shifts, RS parameters, beamforming vectors, and bitrate selection of the 360-degree video tiles. We also propose RavNet, which is a deep neural network customized for the policy learning in our Deep-GRAIL algorithm. Performance evaluation based on a real-world VR streaming dataset shows that the proposed IRS-aided RS VR streaming system outperforms several baseline schemes in terms of system sum-rate, achievable bitrate of the 360-degree videos, and online execution runtime. Our results also reveal the respective performance gains obtained from RS and IRS for improving the QoS in multiuser VR streaming systems.


title: Conditional Diffusion with Less Explicit Guidance via Model Predictive Control

abstract: How much explicit guidance is necessary for conditional diffusion? We consider the problem of conditional sampling using an unconditional diffusion model and limited explicit guidance (e.g., a noised classifier, or a conditional diffusion model) that is restricted to a small number of time steps. We explore a model predictive control (MPC)-like approach to approximate guidance by simulating unconditional diffusion forward, and backpropagating explicit guidance feedback. MPC-approximated guides have high cosine similarity to real guides, even over large simulation distances. Adding MPC steps improves generative quality when explicit guidance is limited to five time steps.


title: A Trainable Sequence Learner that Learns and Recognizes Two-Input Sequence Patterns

abstract: We present two designs for an analog circuit that can learn to detect a temporal sequence of two inputs. The training phase is done by feeding the circuit with the desired sequence and, after the training is completed, each time the trained sequence is encountered again the circuit will emit a signal of correct recognition. Sequences are in the order of tens of nanoseconds. The first design can reset the trained sequence on runtime but assumes very strict timing of the inputs. The second design can only be trained once but is lenient in the input's timing.


title: GraphNeT: Graph neural networks for neutrino telescope event reconstruction

abstract: GraphNeT is an open-source python framework aimed at providing high quality, user friendly, end-to-end functionality to perform reconstruction tasks at neutrino telescopes using graph neural networks (GNNs). GraphNeT makes it fast and easy to train complex models that can provide event reconstruction with state-of-the-art performance, for arbitrary detector configurations, with inference times that are orders of magnitude faster than traditional reconstruction techniques. GNNs from GraphNeT are flexible enough to be applied to data from all neutrino telescopes, including future projects such as IceCube extensions or P-ONE. This means that GNN-based reconstruction can be used to provide state-of-the-art performance on most reconstruction tasks in neutrino telescopes, at real-time event rates, across experiments and physics analyses, with vast potential impact for neutrino and astro-particle physics.

categories: astro-ph.IM cs.LG hep-ex physics.data-an


title: Just Mix Once: Worst-group Generalization by Group Interpolation

abstract: Advances in deep learning theory have revealed how average generalization relies on superficial patterns in data. The consequences are brittle models with poor performance with shift in group distribution at test time. When group annotation is available, we can use robust optimization tools to tackle the problem. However, identification and annotation are time-consuming, especially on large datasets. A recent line of work leverages self-supervision and oversampling to improve generalization on minority groups without group annotation. We propose to unify and generalize these approaches using a class-conditional variant of mixup tailored for worst-group generalization. Our approach, Just Mix Once (JM1), interpolates samples during learning, augmenting the training distribution with a continuous mixture of groups. JM1 is domain agnostic and computationally efficient, can be used with any level of group annotation, and performs on par or better than the state-of-the-art on worst-group generalization. Additionally, we provide a simple explanation of why JM1 works.


title: Augmentation by Counterfactual Explanation -- Fixing an Overconfident Classifier

abstract: A highly accurate but overconfident model is ill-suited for deployment in critical applications such as healthcare and autonomous driving. The classification outcome should reflect a high uncertainty on ambiguous in-distribution samples that lie close to the decision boundary. The model should also refrain from making overconfident decisions on samples that lie far outside its training distribution, far-out-of-distribution (far-OOD), or on unseen samples from novel classes that lie near its training distribution (near-OOD). This paper proposes an application of counterfactual explanations in fixing an over-confident classifier. Specifically, we propose to fine-tune a given pre-trained classifier using augmentations from a counterfactual explainer (ACE) to fix its uncertainty characteristics while retaining its predictive performance. We perform extensive experiments with detecting far-OOD, near-OOD, and ambiguous samples. Our empirical results show that the revised model have improved uncertainty measures, and its performance is competitive to the state-of-the-art methods.


title: Life is a Circus and We are the Clowns: Automatically Finding Analogies between Situations and Processes

abstract: Analogy-making gives rise to reasoning, abstraction, flexible categorization and counterfactual inference -- abilities lacking in even the best AI systems today. Much research has suggested that analogies are key to non-brittle systems that can adapt to new domains. Despite their importance, analogies received little attention in the NLP community, with most research focusing on simple word analogies. Work that tackled more complex analogies relied heavily on manually constructed, hard-to-scale input representations. In this work, we explore a more realistic, challenging setup: our input is a pair of natural language procedural texts, describing a situation or a process (e.g., how the heart works/how a pump works). Our goal is to automatically extract entities and their relations from the text and find a mapping between the different domains based on relational similarity (e.g., blood is mapped to water). We develop an interpretable, scalable algorithm and demonstrate that it identifies the correct mappings 87% of the time for procedural texts and 94% for stories from cognitive-psychology literature. We show it can extract analogies from a large dataset of procedural texts, achieving 79% precision (analogy prevalence in data: 3%). Lastly, we demonstrate that our algorithm is robust to paraphrasing the input texts.


title: Anonymous Bandits for Multi-User Systems

abstract: In this work, we present and study a new framework for online learning in systems with multiple users that provide user anonymity. Specifically, we extend the notion of bandits to obey the standard $k$-anonymity constraint by requiring each observation to be an aggregation of rewards for at least $k$ users. This provides a simple yet effective framework where one can learn a clustering of users in an online fashion without observing any user's individual decision. We initiate the study of anonymous bandits and provide the first sublinear regret algorithms and lower bounds for this setting.


title: Resolved Molecular Gas Observations of MaNGA Post-starbursts Reveal a Tumultuous Past

abstract: Post-starburst galaxies (PSBs) have recently and rapidly quenched their star-formation, thus they are an important way to understand how galaxies transition from star-forming late-types to quiescent early-types. The recent discovery of large cold gas reservoirs in PSBs calls into question the theory that galaxies must lose their gas to become quiescent. Optical Integral Field Spectroscopy (IFS) surveys have revealed two classes of PSBs: central PSBs with central quenching regions and ring PSBs with quenching in their outskirts. We analyze a sample of 13 nearby (z < 0.1) PSBs with spatially resolved optical IFS data from the Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) survey and matched resolution Atacama Large (sub-)Millimeter Array (ALMA) observations of $^{12}$CO(1-0). Disturbed stellar kinematics in 7/13 of our PSBs and centrally concentrated molecular gas is consistent with a recent merger for most of our sample. In galaxies without merger evidence, alternate processes may funnel gas inwards and suppress star-formation, which may include outflows, stellar bars, and minor mergers or interactions. The star-formation efficiencies of the post-starburst regions in nearly half our galaxies are suppressed while the gas fractions are consistent with star-forming galaxies. AGN feedback may drive this stabilization, and we observe AGN-consistent emission in the centers of 5/13 galaxies. Finally, our central and ring PSBs have similar properties except the ionized and molecular gas in central PSBs is more disturbed. Overall, the molecular gas in our PSBs tends to be compact and highly disturbed, resulting in concentrated gas reservoirs unable to form stars efficiently.


title: Adaptive Tuning for Metropolis Adjusted Langevin Trajectories

abstract: Hamiltonian Monte Carlo (HMC) is a widely used sampler for continuous probability distributions. In many cases, the underlying Hamiltonian dynamics exhibit a phenomenon of resonance which decreases the efficiency of the algorithm and makes it very sensitive to hyperparameter values. This issue can be tackled efficiently, either via the use of trajectory length randomization (RHMC) or via partial momentum refreshment. The second approach is connected to the kinetic Langevin diffusion, and has been mostly investigated through the use of Generalized HMC (GHMC). However, GHMC induces momentum flips upon rejections causing the sampler to backtrack and waste computational resources. In this work we focus on a recent algorithm bypassing this issue, named Metropolis Adjusted Langevin Trajectories (MALT). We build upon recent strategies for tuning the hyperparameters of RHMC which target a bound on the Effective Sample Size (ESS) and adapt it to MALT, thereby enabling the first user-friendly deployment of this algorithm. We construct a method to optimize a sharper bound on the ESS and reduce the estimator variance. Easily compatible with parallel implementation, the resultant Adaptive MALT algorithm is competitive in terms of ESS rate and hits useful tradeoffs in memory usage when compared to GHMC, RHMC and NUTS.


title: A computational analysis on the relationship between melodic originality and thematic fame in classical music from the Romantic period

abstract: In this work, the researcher presents a novel approach to calculating melodic originality based on the research by Simonton (1994). This novel formula is then applied to a dataset of 428 classical music pieces from the Romantic period to analyze the relationship between melodic originality and thematic fame.


title: High-Quality RGB-D Reconstruction via Multi-View Uncalibrated Photometric Stereo and Gradient-SDF

abstract: Fine-detailed reconstructions are in high demand in many applications. However, most of the existing RGB-D reconstruction methods rely on pre-calculated accurate camera poses to recover the detailed surface geometry, where the representation of a surface needs to be adapted when optimizing different quantities. In this paper, we present a novel multi-view RGB-D based reconstruction method that tackles camera pose, lighting, albedo, and surface normal estimation via the utilization of a gradient signed distance field (gradient-SDF). The proposed method formulates the image rendering process using specific physically-based model(s) and optimizes the surface's quantities on the actual surface using its volumetric representation, as opposed to other works which estimate surface quantities only near the actual surface. To validate our method, we investigate two physically-based image formation models for natural light and point light source applications. The experimental results on synthetic and real-world datasets demonstrate that the proposed method can recover high-quality geometry of the surface more faithfully than the state-of-the-art and further improves the accuracy of estimated camera poses.


title: Existence and Non-Existence of Constant Scalar Curvature and Extremal Sasaki Metrics

abstract: We discuss the existence and non-existence of constant scalar curvature, as well as extremal, Sasaki metrics. We prove that the natural Sasaki-Boothby-Wang manifold over the admissible projective bundles over local products of non-negative CSC K\"ahler metrics, as described in https://link-springer-com.libproxy.unm.edu/article/10.1007/s00222-008-0126-x, always has a constant scalar curvature (CSC) Sasaki metric in its Sasaki-Reeb cone. Moreover, we give examples that show that the extremal Sasaki--Reeb cone, defined as the set of Sasaki--Reeb vector fields admitting a compatible extremal Sasaki metric, is not necessarily connected in the Sasaki--Reeb cone, and it can be empty even in the non-Gorenstein case. We also show by example that a non-empty extremal Sasaki--Reeb cone need not contain a (CSC) Sasaki metric which answers a question posed in https://mathscinet-ams-org.libproxy.unm.edu/mathscinet-getitem?mr=4420789. The paper also contains an appendix where we explore the existence of K\"ahler metrics of constant weighted scalar curvature, as defined in https://londmathsoc-onlinelibrary-wiley-com.libproxy.unm.edu/doi/full/10.1112/plms.12255, on admissible manifolds over local products of non-negative CSC K\"ahler metrics.


title: Physical limits to membrane curvature sensing by a single protein

abstract: Membrane curvature sensing is essential for a diverse range of biological processes. Recent experiments have revealed that a single nanometer-sized septin protein can distinguish between membrane-coated glass beads of one micron and three micron diameters, even though the septin is orders of magnitude smaller than the beads. This sensing ability is especially surprising since curvature-sensing proteins must deal with persistent thermal fluctuations of the membrane, leading to discrepancies between the bead's curvature and the local membrane curvature sensed instantaneously by a protein. Using continuum models of fluctuating membranes, we investigate whether it is feasible for a protein acting as a perfect observer of the membrane to sense micron-scale curvature either by measuring local membrane curvature or by using bilayer lipid densities as a proxy. To do this, we develop algorithms to simulate lipid density and membrane shape fluctuations. We derive physical limits to the sensing efficacy of a protein in terms of protein size, membrane thickness, membrane bending modulus, membrane-substrate adhesion strength, and bead size. To explain the experimental protein-bead association rates, we develop two classes of predictive models: i) for proteins that maximally associate to a preferred curvature, and ii) for proteins with enhanced association rates above a threshold curvature. We find that the experimentally observed sensing efficacy is close to the theoretical sensing limits imposed on a septin-sized protein, and that the variance in membrane curvature fluctuations sensed by a protein determines how sharply the association rate depends on the curvature of the bead.


title: Rapid variations of Si IV spectra in a flare observed by IRIS at a sub-second cadence

abstract: We report on observations of highly-varying Si IV 1402.77 line profiles observed with the Interface Region Imaging Spectrograph (IRIS) during the M-class flare from 2022 January 18 at an unprecedented 0.8 s cadence. Moment analysis of this line observed in flare ribbon kernels showed that the intensity, Doppler velocity, and non-thermal broadening exhibited variations with periods below 10 s. These variations were found to be correlated with properties of the Gaussian fit to a well-resolved secondary component of the line redshifted by up to 70 km s$^{-1}$, while the primary component was consistently observed near the rest wavelength of the line. A particularly high correlation was found between the non-thermal broadening of the line resulting from the moment analysis and the redshift of the secondary component. This means that the oscillatory enhancements in the line broadening were due to plasma flows (away from the observer) with varying properties. A simple de-projection of the Doppler velocities of the secondary component based on a three-dimensional reconstruction of flare loops rooted in the kernel suggests that the observed flows were caused by downflows and compatible with strong condensation flows recently predicted by numerical simulations. Furthermore, peaks of the intensity and the trends of Doppler velocity of the Gaussian fit to the secondary component (averaged in the ribbon) were found to correspond to one of the quasi-periodic pulsations (QPPs) detected during the event in the soft X-ray flux (as measured by the Geostationary Operational Environmental Satellite, GOES) and the microwave radio flux (as measured by the Expanded Owens Valley Solar Array, EOVSA). This result supports a scenario in which the QPPs were driven by repeated magnetic reconnection.


title: Probing with Noise: Unpicking the Warp and Weft of Embeddings

abstract: Improving our understanding of how information is encoded in vector space can yield valuable interpretability insights. Alongside vector dimensions, we argue that it is possible for the vector norm to also carry linguistic information. We develop a method to test this: an extension of the probing framework which allows for relative intrinsic interpretations of probing results. It relies on introducing noise that ablates information encoded in embeddings, grounded in random baselines and confidence intervals. We apply the method to well-established probing tasks and find evidence that confirms the existence of separate information containers in English GloVe and BERT embeddings. Our correlation analysis aligns with the experimental findings that different encoders use the norm to encode different kinds of information: GloVe stores syntactic and sentence length information in the vector norm, while BERT uses it to encode contextual incongruity.


title: A New Distance to the Supernova Remnant DA 530 Based on HI Absorption of Polarized Emission

abstract: Supernova remnants (SNRs) are significant contributors of matter and energy to the interstellar medium. Understanding the impact and the mechanism of this contribution requires knowledge of the physical size, energy, and expansion rate of individual SNRs, which can only come if reliable distances can be obtained. We aim to determine the distance to the SNR DA 530 (G93.3+6.9), an object of low surface brightness. To achieve this, we used the Dominion Radio Astrophysical Observatory Synthesis Telescope and the National Radio Astronomy Observatory Very Large Array to observe the absorption by intervening HI of the polarized emission from DA 530. Significant absorption was detected at velocities $-28$ and -67 km/s (relative to the local standard of rest), corresponding to distances of 4.4 and 8.3 kpc, respectively. Based on the radio and X-ray characteristics of DA 530, we conclude that the minimum distance is 4.4$^{+0.4}_{-0.2}$ kpc. At this minimum distance, the diameter of the SNR is 34$^{+4}_{-1}$ pc, and the elevation above the Galactic plane is 537$^{+40}_{-32}$ pc. The $-67$ km/s absorption likely occurs in gas whose velocity is not determined by Galactic rotation. We present a new data processing method for combining Stokes $Q$ and $U$ observations of the emission from an SNR into a single HI absorption spectrum, which avoids the difficulties of the noise-bias subtraction required for the calculation of polarized intensity. The polarized absorption technique can be applied to determine distances to many more SNRs.


title: Does strong repulsion lead to smooth solutions in a repulsion-attraction chemotaxis system even when starting with highly irregular initial data?

abstract: It has been well established that, in attraction-repulsion Keller-Segel systems of the form\begin{equation*} \left\{ \begin{aligned} u_t &= \Delta u - \chi \nabla \cdot (u\nabla v) + \xi \nabla \cdot (u\nabla w), \\ \tau v_t &= \Delta v + \alpha u - \beta v,\\ \tau w_t &= \Delta w + \gamma u - \delta w \end{aligned} \right. \end{equation*} in a smooth bounded domain $\Omega \subseteq \mathbb{R}^n$, $n\in\mathbb{N}$, with Neumann boundary conditions and parameters $\chi, \xi \geq 0$, $\alpha,\beta,\gamma,\delta > 0$ and $\tau \in \{0,1\}$, finite-time blow-up can be ruled out in many scenarios given sufficiently smooth initial data if the repulsive chemotaxis is sufficiently stronger than its attractive counterpart. In this paper, we will go - in a sense - a step further than this by studying the same system with initial data that could already be understood as being in a blown-up state (e.g. a positive Radon measure for the first solution component) and then ask the question whether sufficiently strong repulsion has enough of a regularizing effect to lead to the existence of a smooth solution, which is still connected to said initial data in a sensible fashion. Regarding this, we in fact establish that the construction of such a solution is possible in the two-dimensional parabolic-parabolic system and the two- and three-dimensional parabolic-elliptic system under appropriate assumptions on the interaction of repulsion and attraction as well as the initial data.


title: Motion Policy Networks

abstract: Collision-free motion generation in unknown environments is a core building block for robot manipulation. Generating such motions is challenging due to multiple objectives; not only should the solutions be optimal, the motion generator itself must be fast enough for real-time performance and reliable enough for practical deployment. A wide variety of methods have been proposed ranging from local controllers to global planners, often being combined to offset their shortcomings. We present an end-to-end neural model called Motion Policy Networks (M$\pi$Nets) to generate collision-free, smooth motion from just a single depth camera observation. M$\pi$Nets are trained on over 3 million motion planning problems in over 500,000 environments. Our experiments show that M$\pi$Nets are significantly faster than global planners while exhibiting the reactivity needed to deal with dynamic scenes. They are 46% better than prior neural planners and more robust than local control policies. Despite being only trained in simulation, M$\pi$Nets transfer well to the real robot with noisy partial point clouds. Code and data are publicly available at https://mpinets.github.io.


title: Does a low-carrier density ferromagnet hold the key to understanding high temperature superconductors?

abstract: We conducted a small-angle neutron scattering experiments (SANS) on the ferromagnetic semi-metal EuB$_6$, where we observed direct evidence for the presence of magnetic polarons. We carried out SANS experiments over a large range of scattering vectors $|\vec{q}|$ from 0.006 to 0.140~\AA$^{-1}$ and 2 to 60~K. Just above $T_{\mathrm{C}}$ our experiments show magnetic scattering intensity, which has a Lorentzian dependence on the wave vector, which is characteristic for the presence of magnetic polarons. Below $T_{\mathrm{C}}$ the polarons merge and most of the observed intensity is due to scattering from domain walls.We were able to extract a correlation length $\xi$ which ranges from $100$ to $300$~\AA\ for the size of the magnetic polarons. This size is much larger than one would expect for magnetic fluctuations, demonstrating the influence the magnetic polarons on the phase transition. We were able to extract a correlation length $\xi$ which ranges from $100$ to $300$~\AA\ for the size of the magnetic polarons. This size is much larger than one would expect for magnetic fluctuations, demonstrating the influence the magnetic polarons on the phase transition.


title: Independent validation of the temperate Super-Earth HD79211 b using HARPS-N

abstract: We present high-precision radial velocities (RVs) from the HARPS-N spectrograph for HD79210 and HD79211, two M0V members of a gravitationally-bound binary system. We detect a planet candidate with a period of $24.421^{+0.016}_{-0.017}$ days around HD79211 in these HARPS-N RVs, validating the planet candidate originally identified in CARMENES RV data alone. Using HARPS-N, CARMENES and HIRES RVs spanning a total of 25 years, we further refine the planet candidate parameters to $P=24.422\pm0.014$ days, $K=3.19\pm0.27$ m/s, $M$ sin $i = 10.6 \pm 1.2 M_\oplus$, and $a = 0.142 \pm0.005$ au. We do not find any additional planet candidate signals in the data of HD79211 nor do we find any planet candidate signals in HD79210. This system adds to the number of exoplanets detected in binaries with M dwarf members, and serves as a case study for planet formation in stellar binaries.


title: Sketching the Krylov Subspace: Faster Computation of the Entire Ridge Regularization Path

abstract: We propose a fast algorithm for computing the entire ridge regression regularization path in nearly linear time. Our method constructs a basis on which the solution of ridge regression can be computed instantly for any value of the regularization parameter. Consequently, linear models can be tuned via cross-validation or other risk estimation strategies with substantially better efficiency. The algorithm is based on iteratively sketching the Krylov subspace with a binomial decomposition over the regularization path. We provide a convergence analysis with various sketching matrices and show that it improves the state-of-the-art computational complexity. We also provide a technique to adaptively estimate the sketching dimension. This algorithm works for both the over-determined and under-determined problems. We also provide an extension for matrix-valued ridge regression. The numerical results on real medium and large scale ridge regression tasks illustrate the effectiveness of the proposed method compared to standard baselines which require super-linear computational time.


title: SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation

abstract: Named geographic entities (geo-entities for short) are the building blocks of many geographic datasets. Characterizing geo-entities is integral to various application domains, such as geo-intelligence and map comprehension, while a key challenge is to capture the spatial-varying context of an entity. We hypothesize that we shall know the characteristics of a geo-entity by its surrounding entities, similar to knowing word meanings by their linguistic context. Accordingly, we propose a novel spatial language model, SpaBERT, which provides a general-purpose geo-entity representation based on neighboring entities in geospatial data. SpaBERT extends BERT to capture linearized spatial context, while incorporating a spatial coordinate embedding mechanism to preserve spatial relations of entities in the 2-dimensional space. SpaBERT is pretrained with masked language modeling and masked entity prediction tasks to learn spatial dependencies. We apply SpaBERT to two downstream tasks: geo-entity typing and geo-entity linking. Compared with the existing language models that do not use spatial context, SpaBERT shows significant performance improvement on both tasks. We also analyze the entity representation from SpaBERT in various settings and the effect of spatial coordinate embedding.


title: Optimizing Bilingual Neural Transducer with Synthetic Code-switching Text Generation

abstract: Code-switching describes the practice of using more than one language in the same sentence. In this study, we investigate how to optimize a neural transducer based bilingual automatic speech recognition (ASR) model for code-switching speech. Focusing on the scenario where the ASR model is trained without supervised code-switching data, we found that semi-supervised training and synthetic code-switched data can improve the bilingual ASR system on code-switching speech. We analyze how each of the neural transducer's encoders contributes towards code-switching performance by measuring encoder-specific recall values, and evaluate our English/Mandarin system on the ASCEND data set. Our final system achieves 25% mixed error rate (MER) on the ASCEND English/Mandarin code-switching test set -- reducing the MER by 2.1% absolute compared to the previous literature -- while maintaining good accuracy on the monolingual test sets.


title: Gui at MixMT 2022 : English-Hinglish: An MT approach for translation of code mixed data

abstract: Code-mixed machine translation has become an important task in multilingual communities and extending the task of machine translation to code mixed data has become a common task for these languages. In the shared tasks of WMT 2022, we try to tackle the same for both English + Hindi to Hinglish and Hinglish to English. The first task dealt with both Roman and Devanagari script as we had monolingual data in both English and Hindi whereas the second task only had data in Roman script. To our knowledge, we achieved one of the top ROUGE-L and WER scores for the first task of Monolingual to Code-Mixed machine translation. In this paper, we discuss the use of mBART with some special pre-processing and post-processing (transliteration from Devanagari to Roman) for the first task in detail and the experiments that we performed for the second task of translating code-mixed Hinglish to monolingual English.


title: Feature Engineering and Classification Models for Partial Discharge in Power Transformers

abstract: To ensure reliability, power transformers are monitored for partial discharge (PD) events, which are symptoms of transformer failure. Since failures can have catastrophic cascading consequences, it is critical to preempt them as early as possible. Our goal is to classify PDs as corona, floating, particle, or void, to gain an understanding of the failure location. Using phase resolved PD signal data, we create a small set of features, which can be used to classify PDs with high accuracy. This set of features consists of the total magnitude, the maximum magnitude, and the length of the longest empty band. These features represent the entire signal and not just a single phase, so the feature set has a fixed size and is easily comprehensible. With both Random Forest and SVM classification methods, we attain a 99% classification accuracy, which is significantly higher than classification using phase based feature sets such as phase magnitude. Furthermore, we develop a stacking ensemble to combine several classification models, resulting in a superior model that outperforms existing methods in both accuracy and variance.


title: Entailer: Answering Questions with Faithful and Truthful Chains of Reasoning

abstract: Our goal is a question-answering (QA) system that can show how its answers are implied by its own internal beliefs via a systematic chain of reasoning. Such a capability would allow better understanding of why a model produced the answer it did. Our approach is to recursively combine a trained backward-chaining model, capable of generating a set of premises entailing an answer hypothesis, with a verifier that checks that the model itself believes those premises (and the entailment itself) through self-querying. To our knowledge, this is the first system to generate multistep chains that are both faithful (the answer follows from the reasoning) and truthful (the chain reflects the system's own internal beliefs). In evaluation using two different datasets, users judge that a majority (70%+) of generated chains clearly show how an answer follows from a set of facts - substantially better than a high-performance baseline - while preserving answer accuracy. By materializing model beliefs that systematically support an answer, new opportunities arise for understanding the model's system of belief, and diagnosing and correcting its misunderstandings when an answer is wrong.


title: SEIFER: Scalable Edge Inference for Deep Neural Networks

abstract: Edge inference is becoming ever prevalent through its applications from retail to wearable technology. Clusters of networked resource-constrained edge devices are becoming common, yet there is no production-ready orchestration system for deploying deep learning models over such edge networks which adopts the robustness and scalability of the cloud. We present SEIFER, a framework utilizing a standalone Kubernetes cluster to partition a given DNN and place these partitions in a distributed manner across an edge network, with the goal of maximizing inference throughput. The system is node fault-tolerant and automatically updates deployments based on updates to the model's version. We provide a preliminary evaluation of a partitioning and placement algorithm that works within this framework, and show that we can improve the inference pipeline throughput by 200% by utilizing sufficient numbers of resource-constrained nodes. We have implemented SEIFER in open-source software that is publicly available to the research community.


title: Partitioning and Placement of Deep Neural Networks on Distributed Edge Devices to Maximize Inference Throughput

abstract: Edge inference has become more widespread, as its diverse applications range from retail to wearable technology. Clusters of networked resource-constrained edge devices are becoming common, yet no system exists to split a DNN across these clusters while maximizing the inference throughput of the system. We present an algorithm which partitions DNNs and distributes them across a set of edge devices with the goal of minimizing the bottleneck latency and therefore maximizing inference throughput. The system scales well to systems of different node memory capacities and numbers of nodes. We find that we can reduce the bottleneck latency by 10x over a random algorithm and 35% over a greedy joint partitioning-placement algorithm. Furthermore we find empirically that for the set of representative models we tested, the algorithm produces results within 9.2% of the optimal bottleneck latency.


title: Considerations for Visualizing Uncertainty in Clinical Machine Learning Models

abstract: Clinician-facing predictive models are increasingly present in the healthcare setting. Regardless of their success with respect to performance metrics, all models have uncertainty. We investigate how to visually communicate uncertainty in this setting in an actionable, trustworthy way. To this end, we conduct a qualitative study with cardiac critical care clinicians. Our results reveal that clinician trust may be impacted most not by the degree of uncertainty, but rather by how transparent the visualization of what the sources of uncertainty are. Our results show a clear connection between feature interpretability and clinical actionability.


title: Alternative Mean Square Error Estimators and Confidence Intervals for Prediction of Nonlinear Small Area Parameters

abstract: A difficulty in MSE estimation occurs because we do not specify a full distribution for the survey weights. This obfuscates the use of fully parametric bootstrap procedures. To overcome this challenge, we develop a novel MSE estimator. We estimate the leading term in the MSE, which is the MSE of the best predictor (constructed with the true parameters), using the same simulated samples used to construct the basic predictor. We then exploit the asymptotic normal distribution of the parameter estimators to estimate the second term in the MSE, which reflects variability in the estimated parameters. We incorporate a correction for the bias of the estimator of the leading term without the use of computationally intensive double-bootstrap procedures. We further develop calibrated prediction intervals that rely less on normal theory than standard prediction intervals. We empirically demonstrate the validity of the proposed procedures through extensive simulation studies. We apply the methods to predict several functions of sheet and rill erosion for Iowa counties using data from a complex agricultural survey.


title: Surpassing the Standard Quantum Limit using an Optical Spring

abstract: Quantum mechanics places noise limits and sensitivity restrictions on physical measurements. The balance between unwanted backaction and the precision of optical measurements impose a standard quantum limit (SQL) on interferometric systems. In order to realize a sensitivity below the SQL, it is necessary to leverage a back-action evading measurement technique, or else exploit cancellations of any excess noise contributions at the detector. %Many proof of principle experiments have been performed, but only recently has an experiment achieved sensitivity below the SQL. In this work, we extend that initial demonstration and realize sub-SQL measurement sensitivity nearly two times better than previous measurements, and with architecture applicable to interferometric gravitational wave detectors. In fact, this technique is directly applicable to Advanced LIGO, which could observe similar effects with a detuned signal recycling cavity. By exploiting quantum correlations created by an optical spring, we measure a total sensitivity below the SQL by $\textbf{2.8}$ dB, corresponding to a reduction in the noise power by $\textbf{72}\pm\textbf{5.1}$ \% below the quantum limit. Through the use of a detuned optical spring, this noise reduction is tunable, allowing us to choose the desired range of frequencies that fall below the SQL. This result demonstrates access to sensitivities well below the SQL at frequencies ranges applicable to LIGO, with the potential to extend the reach of gravitational wave detectors further into the universe.


title: Low-Resource Multilingual and Zero-Shot Multispeaker TTS

abstract: While neural methods for text-to-speech (TTS) have shown great advances in modeling multiple speakers, even in zero-shot settings, the amount of data needed for those approaches is generally not feasible for the vast majority of the world's over 6,000 spoken languages. In this work, we bring together the tasks of zero-shot voice cloning and multilingual low-resource TTS. Using the language agnostic meta learning (LAML) procedure and modifications to a TTS encoder, we show that it is possible for a system to learn speaking a new language using just 5 minutes of training data while retaining the ability to infer the voice of even unseen speakers in the newly learned language. We show the success of our proposed approach in terms of intelligibility, naturalness and similarity to target speaker using objective metrics as well as human studies and provide our code and trained models open source.


title: Dislocations as natural quantum wires in Diamond

abstract: We study the electronic properties of the glide set of dislocations in diamond from first principles using hybrid exchange correlation functionals and find that the atomic-scale dislocation core states give rise to a prototypical one-dimensional (1D) band structure, i.e. natural quantum wires. The position and character of the core states varies strongly with local structure, where mixed dislocations with dangling bonds exhibit a 1D metallic band with a characteristic 1D density of states ($1/\sqrt{E})$. This 1D Fermi gas is spatially localized to single atomic diameter orbital chain along the dislocation core. When the dangling bonds within the core are reconstructed, the 1D metallic band disappears. In contrast, pure edge dislocations in diamond reveal a 1D semiconductor with a direct band gap of 3.0 eV. These calculations provide a possible explanation to the long standing observation of a blue luminescence band correlated with dislocations in diamond. This opens the door to using dislocations as 1D quantum phases with functional (electronic and optical) properties arising from the atomic-scale core states.


title: Generalized L\"uroth problems, hierarchized I: SBNR -- stably birationalized unramified sheaves and lower retract rationality

abstract: This is the first of a series of papers, where we investigate hierarchies of generalized {L}\"{u}roth problems on the hierarchy of rationality, starting with the obvious hierarchy between the rationality and the ruledness. Our primary goal here was to construct very general necessary conditions for a smooth, not necessary proper, scheme of finite type over the perfect base field $k$ to be "retract $(-i)$-rational". We achieve this goal by constructing "stably birationalized Nisnevich subsheaf" $S_{sb}$ inside any Morel's unramified sheaf $S,$ where $S_{sb}$ coincides with $S$ on proper smooth $k$-schemes of finite type. Such a stably birationalized Nisnevich subsheaf $S_{sb}$ sheds a new light on the familiar irrational examples of Artin-Mumford, Saltman, Colliot-Th\'{e}l\`ene-Ojanguren, Bogomolov, Peyre, Colliot-Th\'{e}l\`ene-Voisin, and many other retract irrational classifying space $BG$ examples presented as counterexamples to the Noether problem of the complex number base field case for a finite group $G.$ In fact, for all of these examples, the game is not over from our hierarchical perspective! A consequence of our construction of $S_{sb}$ is the stably birational invariance of an arbitrary unramified sheaf $S$ on proper smooth $k$-schemes of finite type. This in particular implies that, for any generalized motivic cohomology theory, its naively defined unramified (resp. stably birationalized) gemeralized motivic cohomology theory is stably birational invariant on smooth proper $k$-schemes of finite type (resp. smooth $k$-schemes of finite type). In the course of constructing $S_{sb},$ we have also shown a general local uniformization theorem of the first kind for arbitrary geometric valuations.


title: Multi-frequency Black Hole Imaging for the Next-Generation Event Horizon Telescope

abstract: The Event Horizon Telescope (EHT) has produced images of the plasma flow around the supermassive black holes in Sgr A* and M87* with a resolution comparable to the projected size of their event horizons. Observations with the next-generation Event Horizon Telescope (ngEHT) will have significantly improved Fourier plane coverage and will be conducted at multiple frequency bands (86, 230, and 345 GHz), each with a wide bandwidth. At these frequencies, both Sgr A* and M87* transition from optically thin to optically thick. Resolved spectral index maps in the near-horizon and jet-launching regions of these supermassive black hole sources can constrain properties of the emitting plasma that are degenerate in single-frequency images. In addition, combining information from data obtained at multiple frequencies is a powerful tool for interferometric image reconstruction, since gaps in spatial scales in single-frequency observations can be filled in with information from other frequencies. Here we present a new method of simultaneously reconstructing interferometric images at multiple frequencies along with their spectral index maps. The method is based on existing Regularized Maximum Likelihood (RML) methods commonly used for EHT imaging and is implemented in the eht-imaging Python software library. We show results of this method on simulated ngEHT data sets as well as on real data from the VLBA and ALMA. These examples demonstrate that simultaneous RML multi-frequency image reconstruction produces higher-quality and more scientifically useful results than is possible from combining independent image reconstructions at each frequency.


title: From magnetic order to valence-change crossover in EuPd$_2$(Si$_{1-x}$Ge$_x$)$_2$ using He-gas pressure

abstract: We present results of magnetic susceptibility and thermal expansion measurements performed on high-quality single crystals of EuPd$_2$(Si$_{1-x}$Ge$_x$)$_2$ for 0 $\leq$ x $\leq$ 0.2 and temperatures 2 K $\leq T \leq$ 300 K. Data were taken at ambient pressure and finite He-gas pressure $p$ $\leq$ 0.5 GPa. For x = 0 and ambient pressure we observe a pronounced valence-change crossover centred around $T'_V$ $\approx$ 160 K with a non-magnetic ground state. This valence-change crossover is characterized by an extraordinarily strong pressure dependence of d$T'_V$ /d$p$ = (80 $\pm 10)$ K/GPa. We observe a shift of $T'_V$ to lower temperatures with increasing Ge-concentration, reaching $T'_V$ $\approx$ 90 K for x = 0.1, while still showing a non-magnetic ground state. Remarkably, on further increasing x to 0.2 we find a stable Eu$^{(2+\delta)+}$ valence with long-range antiferromagnetic order below $T_N$ = (47.5 $\pm$ 0.1) K, reflecting a close competition between two energy scales in this system. In fact, by the application of hydrostatic pressure as small as 0.1 GPa, the ground state of this system can be changed from long-range antiferromagnetic order for $p$ $<$ 0.1 GPa to an intermediate-valence state for $p$ $\geq$ 0.1 GPa.


title: EDUKG: a Heterogeneous Sustainable K-12 Educational Knowledge Graph

abstract: Web and artificial intelligence technologies, especially semantic web and knowledge graph (KG), have recently raised significant attention in educational scenarios. Nevertheless, subject-specific KGs for K-12 education still lack sufficiency and sustainability from knowledge and data perspectives. To tackle these issues, we propose EDUKG, a heterogeneous sustainable K-12 Educational Knowledge Graph. We first design an interdisciplinary and fine-grained ontology for uniformly modeling knowledge and resource in K-12 education, where we define 635 classes, 445 object properties, and 1314 datatype properties in total. Guided by this ontology, we propose a flexible methodology for interactively extracting factual knowledge from textbooks. Furthermore, we establish a general mechanism based on our proposed generalized entity linking system for EDUKG's sustainable maintenance, which can dynamically index numerous heterogeneous resources and data with knowledge topics in EDUKG. We further evaluate EDUKG to illustrate its sufficiency, richness, and variability. We publish EDUKG with more than 252 million entities and 3.86 billion triplets. Our code and data repository is now available at https://github.com/THU-KEG/EDUKG.


title: Deep Reinforcement Learning for Stabilization of Large-scale Probabilistic Boolean Networks

abstract: The ability to direct a Probabilistic Boolean Network (PBN) to a desired state is important to applications such as targeted therapeutics in cancer biology. Reinforcement Learning (RL) has been proposed as a framework that solves a discrete-time optimal control problem cast as a Markov Decision Process. We focus on an integrative framework powered by a model-free deep RL method that can address different flavours of the control problem (e.g., with or without control inputs; attractor state or a subset of the state space as the target domain). The method is agnostic to the distribution of probabilities for the next state, hence it does not use the probability transition matrix. The time complexity is linear on the time steps, or interactions between the agent (deep RL) and the environment (PBN), during training. Indeed, we explore the scalability of the deep RL approach to (set) stabilization of large-scale PBNs and demonstrate successful control on large networks, including a metastatic melanoma PBN with 200 nodes.


title: Programming Bare-Metal Accelerators with Heterogeneous Threading Models: A Case Study of Matrix-3000

abstract: As the hardware industry moves towards using specialized heterogeneous many-cores to avoid the effects of the power wall, software developers are finding it hard to deal with the complexity of these systems. This article shares our experience when developing a programming model and its supporting compiler and libraries for Matrix-3000, which is designed for next-generation exascale supercomputers but has a complex memory hierarchy and processor organization. To assist its software development, we developed a software stack from scratch that includes a low-level programming interface and a high-level OpenCL compiler. Our low-level programming model offers native programming support for using the bare-metal accelerators of Matrix-3000, while the high-level model allows programmers to use the OpenCL programming standard. We detail our design choices and highlight the lessons learned from developing systems software to enable the programming of bare-metal accelerators. Our programming models have been deployed to the production environment of an exascale prototype system.


title: Reducing Training Sample Memorization in GANs by Training with Memorization Rejection

abstract: Generative adversarial network (GAN) continues to be a popular research direction due to its high generation quality. It is observed that many state-of-the-art GANs generate samples that are more similar to the training set than a holdout testing set from the same distribution, hinting some training samples are implicitly memorized in these models. This memorization behavior is unfavorable in many applications that demand the generated samples to be sufficiently distinct from known samples. Nevertheless, it is unclear whether it is possible to reduce memorization without compromising the generation quality. In this paper, we propose memorization rejection, a training scheme that rejects generated samples that are near-duplicates of training samples during training. Our scheme is simple, generic and can be directly applied to any GAN architecture. Experiments on multiple datasets and GAN models validate that memorization rejection effectively reduces training sample memorization, and in many cases does not sacrifice the generation quality. Code to reproduce the experiment results can be found at $\texttt{https://github.com/jybai/MRGAN}$.


title: "If sighted people know, I should be able to know:" Privacy Perceptions of Bystanders with Visual Impairments around Camera-based Technology

abstract: Camera-based technology can be privacy-invasive, especially for bystanders who can be captured by the cameras but do not have direct control or access to the devices. The privacy threats become even more significant to bystanders with visual impairments (BVI) since they cannot visually discover the use of cameras nearby and effectively avoid being captured. While some prior research has studied visually impaired people's privacy concerns as direct users of camera-based assistive technologies, no research has explored their unique privacy perceptions and needs as bystanders. We conducted an in-depth interview study with 16 visually impaired participants to understand BVI's privacy concerns, expectations, and needs in different camera usage scenarios. A preliminary survey with 90 visually impaired respondents and 96 sighted controls was conducted to compare BVI and sighted bystanders' general attitudes towards cameras and elicit camera usage scenarios for the interview study. Our research revealed BVI's unique privacy challenges and perceptions around cameras, highlighting their needs for privacy awareness and protection. We summarized design considerations for future privacy-enhancing technologies to fulfill BVI's privacy needs.


title: TCAB: A Large-Scale Text Classification Attack Benchmark

abstract: We introduce the Text Classification Attack Benchmark (TCAB), a dataset for analyzing, understanding, detecting, and labeling adversarial attacks against text classifiers. TCAB includes 1.5 million attack instances, generated by twelve adversarial attacks targeting three classifiers trained on six source datasets for sentiment analysis and abuse detection in English. Unlike standard text classification, text attacks must be understood in the context of the target classifier that is being attacked, and thus features of the target classifier are important as well. TCAB includes all attack instances that are successful in flipping the predicted label; a subset of the attacks are also labeled by human annotators to determine how frequently the primary semantics are preserved. The process of generating attacks is automated, so that TCAB can easily be extended to incorporate new text attacks and better classifiers as they are developed. In addition to the primary tasks of detecting and labeling attacks, TCAB can also be used for attack localization, attack target labeling, and attack characterization. TCAB code and dataset are available at https://react-nlp.github.io/tcab/.


title: Imbalanced Classification in Medical Imaging via Regrouping

abstract: We propose performing imbalanced classification by regrouping majority classes into small classes so that we turn the problem into balanced multiclass classification. This new idea is dramatically different from popular loss reweighting and class resampling methods. Our preliminary result on imbalanced medical image classification shows that this natural idea can substantially boost the classification performance as measured by average precision (approximately area-under-the-precision-recall-curve, or AUPRC), which is more appropriate for evaluating imbalanced classification than other metrics such as balanced accuracy.


title: Sequential Gradient Descent and Quasi-Newton's Method for Change-Point Analysis

abstract: One common approach to detecting change-points is minimizing a cost function over possible numbers and locations of change-points. The framework includes several well-established procedures, such as the penalized likelihood and minimum description length. Such an approach requires finding the cost value repeatedly over different segments of the data set, which can be time-consuming when (i) the data sequence is long and (ii) obtaining the cost value involves solving a non-trivial optimization problem. This paper introduces a new sequential method (SE) that can be coupled with gradient descent (SeGD) and quasi-Newton's method (SeN) to find the cost value effectively. The core idea is to update the cost value using the information from previous steps without re-optimizing the objective function. The new method is applied to change-point detection in generalized linear models and penalized regression. Numerical studies show that the new approach can be orders of magnitude faster than the Pruned Exact Linear Time (PELT) method without sacrificing estimation accuracy.


title: Uncertain Evidence in Probabilistic Models and Stochastic Simulators

abstract: We consider the problem of performing Bayesian inference in probabilistic models where observations are accompanied by uncertainty, referred to as "uncertain evidence." We explore how to interpret uncertain evidence, and by extension the importance of proper interpretation as it pertains to inference about latent variables. We consider a recently-proposed method "distributional evidence" as well as revisit two older methods: Jeffrey's rule and virtual evidence. We devise guidelines on how to account for uncertain evidence and we provide new insights, particularly regarding consistency. To showcase the impact of different interpretations of the same uncertain evidence, we carry out experiments in which one interpretation is defined as "correct." We then compare inference results from each different interpretation illustrating the importance of careful consideration of uncertain evidence.


title: Hawking Mass Monotonicity for Initial Data Sets

abstract: We introduce new systems of PDE on initial data sets $(M,g,k)$ whose solutions model double-null foliations. This allows us to generalize Geroch's monotonicity formula for the Hawking mass under inverse mean curvature flow to initial data sets satisfying the dominant energy condition. We study the existence theory of these systems and give geometric applications.


title: Robust Data-Driven Accelerated Mirror Descent

abstract: Learning-to-optimize is an emerging framework that leverages training data to speed up the solution of certain optimization problems. One such approach is based on the classical mirror descent algorithm, where the mirror map is modelled using input-convex neural networks. In this work, we extend this functional parameterization approach by introducing momentum into the iterations, based on the classical accelerated mirror descent. Our approach combines short-time accelerated convergence with stable long-time behavior. We empirically demonstrate additional robustness with respect to multiple parameters on denoising and deconvolution experiments.


title: Auto-Encoder Neural Network Incorporating X-Ray Fluorescence Fundamental Parameters with Machine Learning

abstract: We consider energy-dispersive X-ray Fluorescence (EDXRF) applications where the fundamental parameters method is impractical such as when instrument parameters are unavailable. For example, on a mining shovel or conveyor belt, rocks are constantly moving (leading to varying angles of incidence and distances) and there may be other factors not accounted for (like dust). Neural networks do not require instrument and fundamental parameters but training neural networks requires XRF spectra labelled with elemental composition, which is often limited because of its expense. We develop a neural network model that learns from limited labelled data and also benefits from domain knowledge by learning to invert a forward model. The forward model uses transition energies and probabilities of all elements and parameterized distributions to approximate other fundamental and instrument parameters. We evaluate the model and baseline models on a rock dataset from a lithium mineral exploration project. Our model works particularly well for some low-Z elements (Li, Mg, Al, and K) as well as some high-Z elements (Sn and Pb) despite these elements being outside the suitable range for common spectrometers to directly measure, likely owing to the ability of neural networks to learn correlations and non-linear relationships.


title: Symplectic gauge group on the Lens Space

abstract: We compute the Lens space index for 4d supersymmetric gauge theories involving symplectic gauge groups. This index can distinguish between different gauge groups from a given algebra and it matches across theories related by supersymmetric dualities. We provide explicit calculations for $\mathcal{N}=4$ SYM and for classes of $\mathcal{N}=2$ and $\mathcal{N}=1$ Lagrangian quivers related by S-duality. In these cases the index matches across the S-dual phases, while models in different S-duality orbits have a different Lens index. We provide analogous computations for a 4d $\mathcal{N}=1$ toric quiver gauge theory corresponding to a $\mathbb{Z}_7$ orbifold of $\mathbb{C}^3$. This $SU(n)^7$ gauge theory becomes interesting in the case of $n=2$ because it is conformally dual to other two models, with symplectic and unitary gauge groups, bifundamentals and antisymmetric tensors. We explicitly check this triality at the level of the Lens space index.


title: FIND: An Unsupervised Implicit 3D Model of Articulated Human Feet

abstract: In this paper we present a high fidelity and articulated 3D human foot model. The model is parameterised by a disentangled latent code in terms of shape, texture and articulated pose. While high fidelity models are typically created with strong supervision such as 3D keypoint correspondences or pre-registration, we focus on the difficult case of little to no annotation. To this end, we make the following contributions: (i) we develop a Foot Implicit Neural Deformation field model, named FIND, capable of tailoring explicit meshes at any resolution i.e. for low or high powered devices; (ii) an approach for training our model in various modes of weak supervision with progressively better disentanglement as more labels, such as pose categories, are provided; (iii) a novel unsupervised part-based loss for fitting our model to 2D images which is better than traditional photometric or silhouette losses; (iv) finally, we release a new dataset of high resolution 3D human foot scans, Foot3D. On this dataset, we show our model outperforms a strong PCA implementation trained on the same data in terms of shape quality and part correspondences, and that our novel unsupervised part-based loss improves inference on images.


title: A Dataset for Plain Language Adaptation of Biomedical Abstracts

abstract: Though exponentially growing health-related literature has been made available to a broad audience online, the language of scientific articles can be difficult for the general public to understand. Therefore, adapting this expert-level language into plain language versions is necessary for the public to reliably comprehend the vast health-related literature. Deep Learning algorithms for automatic adaptation are a possible solution; however, gold standard datasets are needed for proper evaluation. Proposed datasets thus far consist of either pairs of comparable professional- and general public-facing documents or pairs of semantically similar sentences mined from such documents. This leads to a trade-off between imperfect alignments and small test sets. To address this issue, we created the Plain Language Adaptation of Biomedical Abstracts dataset. This dataset is the first manually adapted dataset that is both document- and sentence-aligned. The dataset contains 750 adapted abstracts, totaling 7643 sentence pairs. Along with describing the dataset, we benchmark automatic adaptation on the dataset with state-of-the-art Deep Learning approaches, setting baselines for future research.


title: Short rainbow cycles for families of matchings and triangles

abstract: A generalization of the famous Caccetta--H\"aggkvist conjecture, suggested by Aharoni \cite{ADH2019}, is that any family $\mathcal{F}=(F_1, \ldots,F_n)$ of sets of edges in $K_n$, each of size $k$, has a rainbow cycle of length at most $\lceil \frac{n}{k}\rceil$. In \cite{AharoniGuo, ABCGZ2022} it was shown that asymptotically this can be improved to $O(\log n)$ if all sets are matchings of size 2, or all are triangles. We show that the same is true in the mixed case, i.e., if each $F_i$ is either a matching of size 2 or a triangle. We also study the case that each $F_i$ is a matching of size 2 or a single edge, or each $F_i$ is a triangle or a single edge, and in each of these cases we determine the threshold proportion between the types, beyond which the rainbow girth goes from linear to logarithmic.


title: State-dependence of CO2 Forcing and its Implications for Climate Sensitivity

abstract: When evaluating the effect of CO2 changes on the earth's climate, it is widely assumed that instantaneous radiative forcing from a doubling of a given CO2 concentration (IRF2xCO2) is constant and that variances in climate sensitivity arise from differences in radiative feedbacks, or a dependence of these feedbacks on the climatological base-state. In this paper, we show that the IRF2xCO2 is not constant, but also depends on the climatological base-state, increasing by ~25% for every doubling of CO2, and has increased by ~10% since the pre-industrial era primarily due to stratospheric cooling, implying a proportionate increase in climate sensitivity. This base-state dependence also explains about half of the inter-model spread in IRF2xCO2, a problem that has persisted among climate models for nearly three decades.


title: Deformation cohomology for cyclic groups acting on polynomial rings

abstract: We examine the Hochschild cohomology governing graded deformations for finite cyclic groups acting on polynomial rings. We classify the infinitesimal graded deformations of the skew group algebra $S\rtimes G$ for a cyclic group $G$ acting on a polynomial ring $S$. This gives all graded deformations of the first order. We are particularly interested in the case when the characteristic of the underlying field divides the order of the acting group, which complicates the determination of cohomology.


title: A General Architecture for Client-Agnostic Hybrid Model Editors as a Service

abstract: In this paper, we propose a general architecture for designing language servers for hybrid modeling languages, that is, modeling languages that contain both textual and graphical representations. The architecture consists of a textual language server, a graphical language server, and a client that communicates with the two servers. The servers are implemented using the Language Server Protocol (LSP) and the Graphical Language Server Protocol (GLSP) and are based on a shared abstract syntax of the hybrid language. This means that only static resources need to be common between the graphical and textual language servers. The servers' separation allows each to be developed and maintained independently, while also enabling forward-compatibility with their respective dependencies. We describe a prototype implementation of our architecture in the form of a hybrid editor for the UML-RT language. The evaluation of the architecture via this prototype gives us useful insight into further generalization of the architecture and the way it is used. We then sketch a suitable extension of the architecture to enable support for multiple diagram types and, thus, multiple graphical views.


title: Benchmarking GPU and TPU Performance with Graph Neural Networks

abstract: Many artificial intelligence (AI) devices have been developed to accelerate the training and inference of neural networks models. The most common ones are the Graphics Processing Unit (GPU) and Tensor Processing Unit (TPU). They are highly optimized for dense data representations. However, sparse representations such as graphs are prevalent in many domains, including science. It is therefore important to characterize the performance of available AI accelerators on sparse data. This work analyzes and compares the GPU and TPU performance training a Graph Neural Network (GNN) developed to solve a real-life pattern recognition problem. Characterizing the new class of models acting on sparse data may prove helpful in optimizing the design of deep learning libraries and future AI accelerators.


title: Electrodynamics of superconductors

abstract: Electrodynamics of superconductors is primarily the electrodynamics of the Meissner state, a state characterized by zero magnetic induction of a superconducting fraction of conduction electrons. Simultaneously, the Meissner state is characterized by zero resistivity and zero entropy of these electrons. The latter means that the temperature of an ensemble of superconducting electrons is zero as well. Understanding properties of the Meissner state provides a key to understand and predict these and other equilibrium and non-equilibrium properties of superconductors, e.g., properties of the intermediate and mixed states, flux quantization, resistanceless transport current, etc. The reader will see that all these properties have a single and very simple origin: quantization of the angular momentum of the conduction electrons combined into Cooper pairs, and that the electrodynamics of superconductors and superconductivity as a whole is a magnificent manifestation of the boundless ingenuity of Nature and of the power of Physics laws.


title: The $c$-differential spectrum of $x\mapsto x^{\frac{p^n+1}{2}}$ in finite fields of odd characteristics

abstract: In the paper, we concentrate on the map $x\mapsto x^{\frac{p^n+1}{2}}$ on $\mathbb{F}_{p^n}$ and using combinatorial and number theory techniques, we compute its detailed $c$-differential spectrum for all values of $c\neq 1$ (the spectrum for $c=1$ is known).


title: STAP: Sequencing Task-Agnostic Policies

abstract: Advances in robotic skill acquisition have made it possible to build general-purpose libraries of learned skills for downstream manipulation tasks. However, naively executing these skills one after the other is unlikely to succeed without accounting for dependencies between actions prevalent in long-horizon plans. We present Sequencing Task-Agnostic Policies (STAP), a scalable framework for training manipulation skills and coordinating their geometric dependencies at planning time to solve long-horizon tasks never seen by any skill during training. Given that Q-functions encode a measure of skill feasibility, we formulate an optimization problem to maximize the joint success of all skills sequenced in a plan, which we estimate by the product of their Q-values. Our experiments indicate that this objective function approximates ground truth plan feasibility and, when used as a planning objective, reduces myopic behavior and thereby promotes long-horizon task success. We further demonstrate how STAP can be used for task and motion planning by estimating the geometric feasibility of skill sequences provided by a task planner. We evaluate our approach in simulation and on a real robot. Qualitative results and code are made available at https://sites.google.com/stanford.edu/stap.


title: Markov Capacity for Factor Codes with an Unambiguous Symbol

abstract: In this paper, we first give a necessary and sufficient condition for a factor code with an unambiguous symbol to admit a subshift of finite type restricted to which it is one-to-one and onto. We then give a necessary and sufficient condition for the standard factor code on a spoke graph to admit a subshift of finite type restricted to which it is finite-to-one and onto. We also conjecture that for such a code, this finite-to-one property is equivalent to the existence of a stationary Markov chain that achieves the capacity of the corresponding deterministic channel.


title: Solution of the Schrodinger equation for quasi-one-dimensional materials using helical waves

abstract: We formulate and implement a spectral method for solving the Schrodinger equation, as it applies to quasi-one-dimensional materials and structures. This allows for computation of the electronic structure of important technological materials such as nanotubes (of arbitrary chirality), nanowires, nanoribbons, chiral nanoassemblies, nanosprings and nanocoils, in an accurate, efficient and systematic manner. Our work is motivated by the observation that one of the most successful methods for carrying out electronic structure calculations of bulk/crystalline systems -- the plane-wave method -- is a spectral method based on eigenfunction expansion. Our scheme avoids computationally onerous approximations involving periodic supercells often employed in conventional plane-wave calculations of quasi-one-dimensional materials, and also overcomes several limitations of other discretization strategies, e.g., those based on finite differences and atomic orbitals. We describe the setup of fast transforms to carry out discretization of the governing equations using our basis set, and the use of matrix-free iterative diagonalization to obtain the electronic eigenstates. Miscellaneous computational details, including the choice of eigensolvers, use of a preconditioning scheme, evaluation of oscillatory radial integrals and the imposition of a kinetic energy cutoff are discussed. We have implemented these strategies into a computational package called HelicES (Helical Electronic Structure). We demonstrate the utility of our method in carrying out systematic electronic structure calculations of various quasi-one-dimensional materials through numerous examples involving nanotubes, nanoribbons and nanowires. We also explore the convergence, accuracy and efficiency of our method. We anticipate that our method will find numerous applications in computational nanomechanics and materials science.


title: End-to-end GPU acceleration of low-order-refined preconditioning for high-order finite element discretizations

abstract: In this paper, we present algorithms and implementations for the end-to-end GPU acceleration of matrix-free low-order-refined preconditioning of high-order finite element problems. The methods described here allow for the construction of effective preconditioners for high-order problems with optimal memory usage and computational complexity. The preconditioners are based on the construction of a spectrally equivalent low-order discretization on a refined mesh, which is then amenable to, for example, algebraic multigrid preconditioning. The constants of equivalence are independent of mesh size and polynomial degree. For vector finite element problems in $H({\rm curl})$ and $H({\rm div})$ (e.g. for electromagnetic or radiation diffusion problems) a specially constructed interpolation-histopolation basis is used to ensure fast convergence. Detailed performance studies are carried out to analyze the efficiency of the GPU algorithms. The kernel throughput of each of the main algorithmic components is measured, and the strong and weak parallel scalability of the methods is demonstrated. The different relative weighting and significance of the algorithmic components on GPUs and CPUs is discussed. Results on problems involving adaptively refined nonconforming meshes are shown, and the use of the preconditioners on a large-scale magnetic diffusion problem using all spaces of the finite element de Rham complex is illustrated.


title: Score-based Denoising Diffusion with Non-Isotropic Gaussian Noise Models

abstract: Generative models based on denoising diffusion techniques have led to an unprecedented increase in the quality and diversity of imagery that is now possible to create with neural generative models. However, most contemporary state-of-the-art methods are derived from a standard isotropic Gaussian formulation. In this work we examine the situation where non-isotropic Gaussian distributions are used. We present the key mathematical derivations for creating denoising diffusion models using an underlying non-isotropic Gaussian noise model. We also provide initial experiments with the CIFAR-10 dataset to help verify empirically that this more general modeling approach can also yield high-quality samples.


title: Testing for relics of past strong buckling events in edge-on galaxies: Simulation predictions and data from S$^{4}$G

abstract: The short-lived buckling instability is responsible for the formation of at least some box/peanut (B/P) shaped bulges, which are observed in most massive, $z=0$, barred galaxies. Nevertheless, it has also been suggested that B/P bulges form via the slow trapping of stars onto vertically extended resonant orbits. The key difference between these two scenarios is that when the bar buckles, symmetry about the mid-plane is broken for a period of time. We use a suite of simulations (with and without gas) to show that when the buckling is sufficiently strong, a residual mid-plane asymmetry persists for several Gyrs after the end of the buckling phase, and is visible in simulation images. On the other hand, images of B/P bulges formed through resonant trapping and/or weak buckling remain symmetric about the mid-plane. We develop two related diagnostics to identify and quantify mid-plane asymmetry in simulation images of galaxies that are within 3{\deg} of edge-on orientation, allowing us to test whether the presence of a B/P-shaped bulge can be explained by a past buckling event. We apply our diagnostics to two nearly edge-on galaxies with B/P bulges from the ${\it Spitzer}$ Survey of Stellar Structure in Galaxies, finding no mid-plane asymmetry, implying these galaxies formed their bulges either by resonant trapping or by buckling more than $\sim 5$ Gyr ago. We conclude that the formation of B/P bulges through strong buckling may be a rare event in the past $\sim 5$ Gyr.


title: Uncertainty Estimates of Predictions via a General Bias-Variance Decomposition

abstract: Reliably estimating the uncertainty of a prediction throughout the model lifecycle is crucial in many safety-critical applications. The most common way to measure this uncertainty is via the predicted confidence. While this tends to work well for in-domain samples, these estimates are unreliable under domain drift and restricted to classification. Alternatively, proper scores can be used for most predictive tasks but a bias-variance decomposition for model uncertainty does not exist in the current literature. In this work we introduce a general bias-variance decomposition for proper scores, giving rise to the Bregman Information as the variance term. We discover how exponential families and the classification log-likelihood are special cases and provide novel formulations. Surprisingly, we can express the classification case purely in the logit space. We showcase the practical relevance of this decomposition on several downstream tasks, including model ensembles and confidence regions. Further, we demonstrate how different approximations of the instance-level Bregman Information allow reliable out-of-distribution detection for all degrees of domain drift.


title: Efficient Automatic Machine Learning via Design Graphs

abstract: Despite the success of automated machine learning (AutoML), which aims to find the best design, including the architecture of deep networks and hyper-parameters, conventional AutoML methods are computationally expensive and hardly provide insights into the relations of different model design choices. To tackle the challenges, we propose FALCON, an efficient sample-based method to search for the optimal model design. Our key insight is to model the design space of possible model designs as a design graph, where the nodes represent design choices, and the edges denote design similarities. FALCON features 1) a task-agnostic module, which performs message passing on the design graph via a Graph Neural Network (GNN), and 2) a task-specific module, which conducts label propagation of the known model performance information on the design graph. Both modules are combined to predict the design performances in the design space, navigating the search direction. We conduct extensive experiments on 27 node and graph classification tasks from various application domains, and an image classification task on the CIFAR-10 dataset. We empirically show that FALCON can efficiently obtain the well-performing designs for each task using only 30 explored nodes. Specifically, FALCON has a comparable time cost with the one-shot approaches while achieving an average improvement of 3.3% compared with the best baselines.


title: Distance-to-Set Priors and Constrained Bayesian Inference

abstract: Constrained learning is prevalent in many statistical tasks. Recent work proposes distance-to-set penalties to derive estimators under general constraints that can be specified as sets, but focuses on obtaining point estimates that do not come with corresponding measures of uncertainty. To remedy this, we approach distance-to-set regularization from a Bayesian lens. We consider a class of smooth distance-to-set priors, showing that they yield well-defined posteriors toward quantifying uncertainty for constrained learning problems. We discuss relationships and advantages over prior work on Bayesian constraint relaxation. Moreover, we prove that our approach is optimal in an information geometric-sense for finite penalty parameters $\rho$, and enjoys favorable statistical properties when $\rho\to\infty$. The method is designed to perform effectively within gradient-based MCMC samplers, as illustrated on a suite of simulated and real data applications.


title: Enhancing Tabular Reasoning with Pattern Exploiting Training

abstract: Recent methods based on pre-trained language models have exhibited superior performance over tabular tasks (e.g., tabular NLI), despite showing inherent problems such as not using the right evidence and inconsistent predictions across inputs while reasoning over the tabular data. In this work, we utilize Pattern-Exploiting Training (PET) (i.e., strategic MLM) on pre-trained language models to strengthen these tabular reasoning models' pre-existing knowledge and reasoning abilities. Our upgraded model exhibits a superior understanding of knowledge facts and tabular reasoning compared to current baselines. Additionally, we demonstrate that such models are more effective for underlying downstream tasks of tabular inference on InfoTabs. Furthermore, we show our model's robustness against adversarial sets generated through various character and word level perturbations.


title: The Generalized Green's function Cluster Expansion: A Python package for simulating polarons

abstract: We present an efficient implementation of the Generalized Green's function Cluster Expansion (GGCE), which is a new method for computing the ground-state properties and dynamics of polarons (single electrons coupled to lattice vibrations) in model electron-phonon systems. The GGCE works at arbitrary temperature and is well suited for a variety of electron-phonon couplings, including, but not limited to, site and bond Holstein and Peierls (Su-Schrieffer-Heeger) couplings, and couplings to multiple phonon modes with different energy scales and coupling strengths. Quick calculations can be performed efficiently on a laptop using solvers from NumPy and SciPy, or in parallel at scale using the PETSc sparse linear solver engine.


title: Z-LaVI: Zero-Shot Language Solver Fueled by Visual Imagination

abstract: Large-scale pretrained language models have made significant advances in solving downstream language understanding tasks. However, they generally suffer from reporting bias, the phenomenon describing the lack of explicit commonsense knowledge in written text, e.g., ''an orange is orange''. To overcome this limitation, we develop a novel approach, Z-LaVI, to endow language models with visual imagination capabilities. Specifically, we leverage two complementary types of ''imaginations'': (i) recalling existing images through retrieval and (ii) synthesizing nonexistent images via text-to-image generation. Jointly exploiting the language inputs and the imagination, a pretrained vision-language model (e.g., CLIP) eventually composes a zero-shot solution to the original language tasks. Notably, fueling language models with imagination can effectively leverage visual knowledge to solve plain language tasks. In consequence, Z-LaVI consistently improves the zero-shot performance of existing language models across a diverse set of language tasks.


title: Group Distributionally Robust Reinforcement Learning with Hierarchical Latent Variables

abstract: One key challenge for multi-task Reinforcement learning (RL) in practice is the absence of task indicators. Robust RL has been applied to deal with task ambiguity, but may result in over-conservative policies. To balance the worst-case (robustness) and average performance, we propose Group Distributionally Robust Markov Decision Process (GDR-MDP), a flexible hierarchical MDP formulation that encodes task groups via a latent mixture model. GDR-MDP identifies the optimal policy that maximizes the expected return under the worst-possible qualified belief over task groups within an ambiguity set. We rigorously show that GDR-MDP's hierarchical structure improves distributional robustness by adding regularization to the worst possible outcomes. We then develop deep RL algorithms for GDR-MDP for both value-based and policy-based RL methods. Extensive experiments on Box2D control tasks, MuJoCo benchmarks, and Google football platforms show that our algorithms outperform classic robust training algorithms across diverse environments in terms of robustness under belief uncertainties. Demos are available on our project page (\url{https://sites.google.com/view/gdr-rl/home}).


title: Hadronic light-by-light scattering contribution to the muon $g-2$ from lattice QCD: semi-analytical calculation of the QED kernel

abstract: Hadronic light-by-light scattering is one of the virtual processes that causes the gyromagnetic factor $g$ of the muon to deviate from the value of two predicted by Dirac's theory. This process makes one of the largest contributions to the uncertainty of the Standard Model prediction for the muon $(g-2)$. Lattice QCD allows for a first-principles approach to computing this non-perturbative effect. In order to avoid power-law finite-size artifacts generated by virtual photons in lattice simulations, we follow a coordinate-space approach involving a weighted integral over the vertices of the QCD four-point function of the electromagnetic current carried by the quarks. Here we present in detail the semi-analytical calculation of the QED part of the amplitude, employing position-space perturbation theory in continuous, infinite four-dimensional Euclidean space. We also provide some useful information about a computer code for the numerical implementation of our approach that has been made public at https://github.com/RJHudspith/KQED.


title: A machine learning approach to assessing the presence of substructure in quasar host galaxies using the Hyper Suprime-Cam Subaru Strategic Program

abstract: The conditions under which galactic nuclear regions become active are largely unknown, although it has been hypothesized that secular processes related to galaxy morphology could play a significant role. We investigate this question using optical i-band images of 3096 SDSS quasars and galaxies at 0.3<z<0.6 from the Hyper Suprime-Cam Subaru Strategic Program, which possess a unique combination of area, depth and resolution, allowing the use of residual images, after removal of the quasar and smooth galaxy model, to investigate internal structural features. We employ a variational auto-encoder which is a generative model that acts as a form of dimensionality reduction. We analyze the lower dimensional latent space in search of features which correlate with nuclear activity. We find that the latent space does separate images based on the presence of nuclear activity which appears to be associated with more pronounced components (i.e., arcs, rings and bars) as compared to a matched control sample of inactive galaxies. These results suggest the importance of secular processes, and possibly mergers (by their remnant features) in activating or sustaining black hole growth. Our study highlights the breadth of information available in ground-based imaging taken under optimal seeing conditions and having accurate characterization of the point spread function (PSF) thus demonstrating future science to come from the Rubin Observatory.


title: On the Calibration of Massively Multilingual Language Models

abstract: Massively Multilingual Language Models (MMLMs) have recently gained popularity due to their surprising effectiveness in cross-lingual transfer. While there has been much work in evaluating these models for their performance on a variety of tasks and languages, little attention has been paid on how well calibrated these models are with respect to the confidence in their predictions. We first investigate the calibration of MMLMs in the zero-shot setting and observe a clear case of miscalibration in low-resource languages or those which are typologically diverse from English. Next, we empirically show that calibration methods like temperature scaling and label smoothing do reasonably well towards improving calibration in the zero-shot scenario. We also find that few-shot examples in the language can further help reduce the calibration errors, often substantially. Overall, our work contributes towards building more reliable multilingual models by highlighting the issue of their miscalibration, understanding what language and model specific factors influence it, and pointing out the strategies to improve the same.