title: Horizon symmetries and hairy black holes in AdS

abstract: We investigate whether supertranslation symmetry may appear in a scenario that involves black holes in AdS space. The framework we consider is massive 3D gravity, which admits a rich black hole phase space, including stationary AdS black holes with softly decaying hair. We consider a set of asymptotic conditions that permits such decaying near the boundary, and which, in addition to the local conformal symmetry, is preserved by an extra local current. The corresponding algebra of diffeomorphisms consists of two copies of Virasoro algebra in semi-direct sum with an infinite-dimensional Abelian ideal. We then reorient the analysis to the near horizon region, where infinite-dimensional symmetries also appear. The supertranslation symmetry at the horizon yields an infinite set of non-trivial charges, which we explicitly compute. The zero-mode of these charges correctly reproduces the black hole entropy. In contrast to Einstein gravity, in the higher-derivative theory subleading terms in the near horizon expansion contribute to the near horizon charges. Such terms happen to capture the higher-curvature corrections to the Bekenstein area law.


title: Shore and Non-Block Points in Hausdorff Continua

abstract: We study the shore and non-block points of non-metric continua. We reduce the problem of showing a continuum to have non-block points to that of showing an indecomposable continuum to have non-block points. As a corollary we prove that separable continua have at least two non-block points -- and moreover are irreducible about their set of non-block points.


title: Nonlocal symmetry of CMA generates ASD Ricci-flat metric with no Killing vectors

abstract: The complex Monge-Amp\`ere equation $(CMA)$ in a two-component form is treated as a bi-Hamiltonian system. I present explicitly the first nonlocal symmetry flow in each of the two hierarchies of this system. An invariant solution of $CMA$ with respect to these nonlocal symmetries is constructed which, being a noninvariant solution in the usual sense, does not undergo symmetry reduction in the number of independent variables. I also construct the corresponding 4-dimensional anti-self-dual (ASD) Ricci-flat metric with either Euclidean or neutral signature. It admits no Killing vectors which is one of characteristic features of the famous gravitational instanton $K3$. For the metric with the Euclidean signature, relevant for gravitational instantons, I explicitly calculate the Levi-Civita connection 1-forms and the Riemann curvature tensor.


title: Non-local linear-response functions for thermal transport computed with equilibrium molecular-dynamics simulation

abstract: We establish an approach to compute linear-response functions to elucidate heat waves and non-local thermal transport. The theory is able to describe the response of a system to external heat sources that are nonuniform in space and time. The response functions are computed using equilibrium molecular-dynamics simulations of an Ar crystal modeled using the standard Lennard-Jones potential. It is shown that for low temperatures and short length scales, transport can be partially or even completely ballistic, with the response primarily limited by the group velocity of lattice waves. By contrast, at longer length scales and higher temperatures, the response functions correspond more closely to diffusive transport characteristic of Fourier's law. It is also shown how the effective thermal conductivity can be determined in a partially-ballistic regime. The results demonstrate the known reduction in the effective thermal conductivity observed when system dimensions are smaller than the mean-free path for lattice waves. Finally, we show how determination of the relevant response functions can be used to model heating of a crystal without requiring additional atomic-scale simulations. Differences between computed results and predictions from Fourier's law represent wave-like, partially-ballistic transport.


title: Investigating Pretrained Language Models for Graph-to-Text Generation

abstract: Graph-to-text generation aims to generate fluent texts from graph-based data. In this paper, we investigate two recently proposed pretrained language models (PLMs) and analyze the impact of different task-adaptive pretraining strategies for PLMs in graph-to-text generation. We present a study across three graph domains: meaning representations, Wikipedia knowledge graphs (KGs) and scientific KGs. We show that the PLMs BART and T5 achieve new state-of-the-art results and that task-adaptive pretraining strategies improve their performance even further. In particular, we report new state-of-the-art BLEU scores of 49.72 on LDC2017T10, 59.70 on WebNLG, and 25.66 on AGENDA datasets - a relative improvement of 31.8%, 4.5%, and 42.4%, respectively. In an extensive analysis, we identify possible reasons for the PLMs' success on graph-to-text tasks. We find evidence that their knowledge about true facts helps them perform well even when the input graph representation is reduced to a simple bag of node and edge labels.


title: Improving rigid 3D calibration for robotic surgery

abstract: Autonomy is the frontier of research in robotic surgery and its aim is to improve the quality of surgical procedures in the next future. One fundamental requirement for autonomy is advanced perception capability through vision sensors. In this paper, we propose a novel calibration technique for a surgical scenario with da Vinci robot. Calibration of the camera and the robot is necessary for precise positioning of the tools in order to emulate the high performance surgeons. Our calibration technique is tailored for RGB-D camera. Different tests performed on relevant use cases for surgery prove that we significantly improve precision and accuracy with respect to the state of the art solutions for similar devices on a surgical-size setup. Moreover, our calibration method can be easily extended to standard surgical endoscope to prompt its use in real surgical scenario.


title: On Adversarial Robustness: A Neural Architecture Search perspective

abstract: Adversarial robustness of deep learning models has gained much traction in the last few years. Various attacks and defenses are proposed to improve the adversarial robustness of modern-day deep learning architectures. While all these approaches help improve the robustness, one promising direction for improving adversarial robustness is unexplored, i.e., the complex topology of the neural network architecture. In this work, we address the following question: Can the complex topology of a neural network give adversarial robustness without any form of adversarial training?. We answer this empirically by experimenting with different hand-crafted and NAS-based architectures. Our findings show that, for small-scale attacks, NAS-based architectures are more robust for small-scale datasets and simple tasks than hand-crafted architectures. However, as the size of the dataset or the complexity of task increases, hand-crafted architectures are more robust than NAS-based architectures. Our work is the first large-scale study to understand adversarial robustness purely from an architectural perspective. Our study shows that random sampling in the search space of DARTS (a popular NAS method) with simple ensembling can improve the robustness to PGD attack by nearly~12\%. We show that NAS, which is popular for achieving SoTA accuracy, can provide adversarial accuracy as a free add-on without any form of adversarial training. Our results show that leveraging the search space of NAS methods with methods like ensembles can be an excellent way to achieve adversarial robustness without any form of adversarial training. We also introduce a metric that can be used to calculate the trade-off between clean accuracy and adversarial robustness. Code and pre-trained models will be made available at \url{https://github.com/tdchaitanya/nas-robustness}


title: 5-HT2A mediated plasticity as a target in major depression: a narrative review connecting the dots from neurobiology to cognition and psychology

abstract: As the world's first primary morbidity factor, depression has a considerable impact on both an individual as well as a societal level. despite their discovery several decades ago, classical antidepressants have been shown to provide limited benefits against this condition. However, substances such as ketamine and psychedelics have recently shown promising results and even received the grade of Breakthrough therapy for this indication. The accurate mechanisms of action underlying the efficacy of these substances are still to be defined, but some similarities appear to be shared on different levels across these substances. These include their structural, functional and behavioral plasticity promoting abilities, as well as their capacity to promote Brain-Derived Neurotrophic Factor overexpression, which seems to constitute a key element underlying their immediate and long-lasting action. From this observation, the present review aims to examine and connect the pharmacological pathways involved in these therapies to the neurobiological, cognitive and psychological responses that could be shared by both 5-HT2AR agonists and NMDA antagonists. It is suggested that BDNF overexpression resulting from mTOR activation mediates both structural and functional plasticity, resulting in connectivity changes among high-level cognitive networks such as the Default Mode Network, finally leading to an increased and long-lasting psychological flexibility. Connecting these pieces of evidence could provide insights about their precise mechanisms of action and help researchers to develop biomarkers for antidepressant response. If the hypotheses suggested in this review are verified by further trials, they could also constitute a starting point to developing safer and more efficient antidepressants, as well as provide information about the interactions that exist between different neurotransmitters systems.


title: Sustainable financing of permanent CO2 disposal through a Carbon Takeback Obligation

abstract: Unless there is immediate, unprecedented, reduction in global demand for carbon-intensive energy and products, then capture and permanent storage of billions of tonnes of carbon dioxide (CO2) annually will be needed before mid-century to meet Paris Agreement goals. Yet competition from cheaper, temporary, carbon storage means that permanent disposal remains starved of investment, currently representing about 0.1% of Energy and Industrial Process (EIP) emissions. This stored fraction must reach 100% to stop EIPs causing global warming. Here we show that a cost-effective transition can occur by mandating an increasing stored fraction through a progressive Carbon Takeback Obligation (CTO) on fossil fuel producers and importers. Projected costs of storage to the consumer are lower than pricing carbon emissions in conventional 1.5{\deg}C scenarios until the 2040s, and comparable or lower thereafter. A CTO combined with measures to reduce CO2 production would deliver the lowest-risk pathway to achieving net zero.


title: An experiment to test the discreteness of time

abstract: Time at the Planck scale ($\sim 10^{-44}\,\mathrm{s}$) is an unexplored physical regime. It is widely believed that probing Planck time will remain for long an impossible task. Yet, we propose an experiment to test the discreteness of time at the Planck scale and estimate that it is not far removed from current technological capabilities.


title: Data Poisoning Attacks Against Federated Learning Systems

abstract: Federated learning (FL) is an emerging paradigm for distributed training of large-scale deep neural networks in which participants' data remains on their own devices with only model updates being shared with a central server. However, the distributed nature of FL gives rise to new threats caused by potentially malicious participants. In this paper, we study targeted data poisoning attacks against FL systems in which a malicious subset of the participants aim to poison the global model by sending model updates derived from mislabeled data. We first demonstrate that such data poisoning attacks can cause substantial drops in classification accuracy and recall, even with a small percentage of malicious participants. We additionally show that the attacks can be targeted, i.e., they have a large negative impact only on classes that are under attack. We also study attack longevity in early/late round training, the impact of malicious participant availability, and the relationships between the two. Finally, we propose a defense strategy that can help identify malicious participants in FL to circumvent poisoning attacks, and demonstrate its effectiveness.


title: Meta-Gradient Reinforcement Learning with an Objective Discovered Online

abstract: Deep reinforcement learning includes a broad family of algorithms that parameterise an internal representation, such as a value function or policy, by a deep neural network. Each algorithm optimises its parameters with respect to an objective, such as Q-learning or policy gradient, that defines its semantics. In this work, we propose an algorithm based on meta-gradient descent that discovers its own objective, flexibly parameterised by a deep neural network, solely from interactive experience with its environment. Over time, this allows the agent to learn how to learn increasingly effectively. Furthermore, because the objective is discovered online, it can adapt to changes over time. We demonstrate that the algorithm discovers how to address several important issues in RL, such as bootstrapping, non-stationarity, and off-policy learning. On the Atari Learning Environment, the meta-gradient algorithm adapts over time to learn with greater efficiency, eventually outperforming the median score of a strong actor-critic baseline.


title: Appearance-Preserving 3D Convolution for Video-based Person Re-identification

abstract: Due to the imperfect person detection results and posture changes, temporal appearance misalignment is unavoidable in video-based person re-identification (ReID). In this case, 3D convolution may destroy the appearance representation of person video clips, thus it is harmful to ReID. To address this problem, we propose AppearancePreserving 3D Convolution (AP3D), which is composed of two components: an Appearance-Preserving Module (APM) and a 3D convolution kernel. With APM aligning the adjacent feature maps in pixel level, the following 3D convolution can model temporal information on the premise of maintaining the appearance representation quality. It is easy to combine AP3D with existing 3D ConvNets by simply replacing the original 3D convolution kernels with AP3Ds. Extensive experiments demonstrate the effectiveness of AP3D for video-based ReID and the results on three widely used datasets surpass the state-of-the-arts. Code is available at: https://github.com/guxinqian/AP3D.


title: Polishing the Gold Standard: The Role of Orbital Choice in CCSD(T) Vibrational Frequency Prediction

abstract: While CCSD(T) with spin-restricted Hartree-Fock (RHF) orbitals has long been lauded for its ability to accurately describe closed-shell interactions, the performance of CCSD(T) on open-shell species is much more erratic, especially when using a spin-unrestricted HF (UHF) reference. Previous studies have shown improved treatment of open-shell systems when a non-HF set of molecular orbitals, like Brueckner or Kohn-Sham density functional theory (DFT) orbitals, is used as a reference. Inspired by the success of regularized orbital-optimized second-order M{\o}ller-Plesset perturbation theory ($\kappa$-OOMP2) orbitals as reference orbitals for MP3, we investigate the use of $\kappa$-OOMP2 orbitals and various DFT orbitals as reference orbitals for CCSD(T) calculations of the corrected ground-state harmonic vibrational frequencies of a set of 36 closed-shell (29 neutrals, 6 cations, 1 anion) and 59 open-shell diatomic species (38 neutrals, 15 cations, 6 anions). The use of $\kappa$-OOMP2 orbitals in this context alleviates difficult cases observed for both UHF orbitals and OOMP2 orbitals. Removing 2 multireference systems and 12 systems with ambiguous experimental data leaves a pruned data set. Overall performance on the pruned data set highlights CCSD(T) with a B97 orbital reference (CCSD(T):B97), CCSD(T) with a $\kappa$-OOMP2 orbital reference (CCSD(T):$\kappa$-OOMP2), and CCSD(T) with a B97M-rV orbital reference (CCSD(T):B97M-rV) with RMSDs of 8.48 cm$^{-1}$ and 8.50 cm$^{-1}$, and 8.75 cm$^{-1}$ respectively, outperforming CCSD(T):UHF by nearly a factor of 5. Moreover, the performance on the closed- and open-shell subsets show these methods are able to treat open-shell and closed-shell systems with comparable accuracy and robustness. The use of $\kappa$-OOMP2 orbitals has also proven useful in diagnosing multireference character that can hinder the reliability of CCSD(T).


title: Bootstrap and Amplitudes: A Hike in the Landscape of Quantum Field Theory

abstract: This article is an introduction to two currently very active research programs, the Conformal Bootstrap and Scattering Amplitudes. Rather than attempting full surveys, the emphasis is on common ideas and methods shared by these two seemingly very different programs. In both fields, mathematical and physical constraints are placed directly on the physical observables in order to explore the landscape of possible consistent quantum field theories. We give explicit examples from both programs: the reader can expect to encounter boiling water, ferromagnets, pion scattering, and emergent symmetries on this journey into the landscape of local relativistic quantum field theories. The first part is written for a general physics audience. The second part includes further details, including a new on-shell bottom-up reconstruction of the $\mathbb{CP}^1$ model with the Fubini-Study metric arising from re-summation of the $n$-point interaction terms derived from amplitudes.


title: SHE-MTJ Circuits for Convolutional Neural Networks

abstract: We report the performance characteristics of a notional Convolutional Neural Network based on the previously-proposed Multiply-Accumulate-Activate-Pool set, an MTJ-based spintronic circuit made to compute multiple neural functionalities in parallel. A study of image classification with the MNIST handwritten digits dataset using this network is provided via simulation. The effect of changing the weight representation precision, the severity of device process variation within the MAAP sets and the computational redundancy are provided. The emulated network achieves between 90 and 95\% image classification accuracy at a cost of ~100 nJ per image.


title: Nucleon polarizabilities in covariant baryon chiral perturbation theory with explicit $\Delta$ degrees of freedom

abstract: We compute various nucleon polarizabilities in chiral perturbation theory implementing the $\Delta$-full ($\Delta$-less) approach up to order $\epsilon^3 + q^4$ ($q^4$) in the small-scale (chiral) expansion. The calculation is carried out using the covariant formulation of $\chi$PT by utilizing the extended on-mass shell renormalization scheme. Except for the spin-independent dipole polarizabilities used to fix the values of certain low-energy constants, our results for the nucleon polarizabilities are pure predictions. We compare our calculations with available experimental data and other theoretical results. The importance of the explicit treatment of the $\Delta$ degree of freedom in the effective field theory description of the nucleon polarizabilities is analyzed. We also study the convergence of the $1/m$ expansion and analyze the efficiency of the heavy-baryon approach for the nucleon polarizabilities.


title: Sharp Constants of Approximation Theory. V. An Asymptotic Equality Related to Polynomials with Given Newton Polyhedra

abstract: Let $V\subset\R^m$ be a convex body, symmetric about all coordinate hyperplanes, and let $\PP_{aV},\, a\ge 0$, be a set of all algebraic polynomials whose Newton polyhedra are subsets of $aV$. We prove a limit equality as $a\to \iy$ between the sharp constant in the multivariate Markov-Bernstein-Nikolskii type inequalities for polynomials from $\PP_{aV}$ and the corresponding constant for entire functions of exponential type with the spectrum in $V$.


title: String Fragmentation in Supercooled Confinement and Implications for Dark Matter

abstract: A strongly-coupled sector can feature a supercooled confinement transition in the early universe. We point out that, when fundamental quanta of the strong sector are swept into expanding bubbles of the confined phase, the distance between them is large compared to the confinement scale. We suggest a modelling of the subsequent dynamics and find that the flux linking the fundamental quanta deforms and stretches towards the wall, producing an enhanced number of composite states upon string fragmentation. The composite states are highly boosted in the plasma frame, which leads to additional particle production through the subsequent deep inelastic scattering. We study the consequences for the abundance and energetics of particles in the universe and for bubble-wall Lorentz factors. This opens several new avenues of investigation, which we begin to explore here, showing that the composite dark matter relic density is affected by many orders of magnitude.


title: The Gregory-Laflamme Instability of the Schwarzschild Black String Exterior

abstract: In this paper, a direct rigorous mathematical proof of the Gregory-Laflamme instability for the five-dimensional Schwarzschild black string is presented. Under a choice of ansatz for the perturbation and a gauge choice, the linearised vacuum Einstein equation reduces to an ODE problem for a single function. In this work, a suitable rescaling and change of variables is applied which casts the ODE into a Schr\"odinger eigenvalue equation to which an energy functional is assigned. It is then shown by direct variational methods that the lowest eigenfunction gives rise to an exponentially growing mode solution which has admissible behavior at the future event horizon and spacelike infinity. After the addition of a pure gauge solution, this gives rise to a regular exponentially growing mode solution of the linearised vacuum Einstein equation in harmonic/transverse-traceless gauge.


title: Kronecker Attention Networks

abstract: Attention operators have been applied on both 1-D data like texts and higher-order data such as images and videos. Use of attention operators on high-order data requires flattening of the spatial or spatial-temporal dimensions into a vector, which is assumed to follow a multivariate normal distribution. This not only incurs excessive requirements on computational resources, but also fails to preserve structures in data. In this work, we propose to avoid flattening by assuming the data follow matrix-variate normal distributions. Based on this new view, we develop Kronecker attention operators (KAOs) that operate on high-order tensor data directly. More importantly, the proposed KAOs lead to dramatic reductions in computational resources. Experimental results show that our methods reduce the amount of required computational resources by a factor of hundreds, with larger factors for higher-dimensional and higher-order data. Results also show that networks with KAOs outperform models without attention, while achieving competitive performance as those with original attention operators.


title: An Eyring-Kramers law for slowly oscillating bistable diffusions

abstract: We consider two-dimensional stochastic differential equations, describing the motion of a slowly and periodically forced overdamped particle in a double-well potential, subjected to weak additive noise. We give sharp asymptotics of Eyring-Kramers type for the expected transition time from one potential well to the other one. Our results cover a range of forcing frequencies that are large with respect to the maximal transition rate between potential wells of the unforced system. The main difficulty of the analysis is that the forced system is non-reversible, so that standard methods from potential theory used to obtain Eyring-Kramers laws for reversible diffusions do not apply. Instead, we use results by Landim, Mariani and Seo that extend the potential-theoretic approach to non-reversible systems.


title: Dynamics of Mobile Manipulators using Dual Quaternion Algebra

abstract: This paper presents two approaches to obtain the dynamical equations of mobile manipulators using dual quaternion algebra. The first one is based on a general recursive Newton-Euler formulation and uses twists and wrenches, which are propagated through high-level algebraic operations and works for any type of joints and arbitrary parameterizations. The second approach is based on Gauss's Principle of Least Constraint (GPLC) and includes arbitrary equality constraints. In addition to showing the connections of GPLC with Gibbs-Appell and Kane's equations, we use it to model a nonholonomic mobile manipulator. Our current formulations are more general than their counterparts in the state of the art, although GPLC is more computationally expensive, and simulation results show that they are as accurate as the classic recursive Newton-Euler algorithm.


title: Hierarchical Interaction Networks with Rethinking Mechanism for Document-level Sentiment Analysis

abstract: Document-level Sentiment Analysis (DSA) is more challenging due to vague semantic links and complicate sentiment information. Recent works have been devoted to leveraging text summarization and have achieved promising results. However, these summarization-based methods did not take full advantage of the summary including ignoring the inherent interactions between the summary and document. As a result, they limited the representation to express major points in the document, which is highly indicative of the key sentiment. In this paper, we study how to effectively generate a discriminative representation with explicit subject patterns and sentiment contexts for DSA. A Hierarchical Interaction Networks (HIN) is proposed to explore bidirectional interactions between the summary and document at multiple granularities and learn subject-oriented document representations for sentiment classification. Furthermore, we design a Sentiment-based Rethinking mechanism (SR) by refining the HIN with sentiment label information to learn a more sentiment-aware document representation. We extensively evaluate our proposed models on three public datasets. The experimental results consistently demonstrate the effectiveness of our proposed models and show that HIN-SR outperforms various state-of-the-art methods.


title: Simple all-optical method for in situ detection of ultralow amounts of ammonia

abstract: As a key precursor for nitrogenous compounds and fertilizer, ammonia affects our lives in numerous ways. Rapid and sensitive detection of ammonia is essential, both in environmental monitoring and in process control for industrial production. Here we report a novel and nonperturbative method that allows rapid detection of ammonia at detection levels of only a few thousand molecules, based on the non-contact, all-optical detection of surface-enhanced Raman signals. We show that this simple and affordable approach enables ammonia probing at selected regions of interest with high spatial resolution, making in situ and operando observations possible.


title: Finding optimal Stackelberg production strategies: How to produce in times of war?

abstract: Inspired by a military context, we study a Stackelberg production game where a country's government, the leader, wants to maximize the production of military assets. The leader does so by allocating his resources among a set of production facilities. His opponent, the follower, observes this allocation and tries to destroy the associated production as much as possible by allocating his destructive resources, for example bombs, among these facilities. In this paper, we identify a follower's optimal strategy. For the leader, we show that an optimal production strategy can be found in the class of so-called seried-balanced strategies. We present a linear time algorithm that finds an optimal strategy in this class.


title: Comparator-adaptive Convex Bandits

abstract: We study bandit convex optimization methods that adapt to the norm of the comparator, a topic that has only been studied before for its full-information counterpart. Specifically, we develop convex bandit algorithms with regret bounds that are small whenever the norm of the comparator is small. We first use techniques from the full-information setting to develop comparator-adaptive algorithms for linear bandits. Then, we extend the ideas to convex bandits with Lipschitz or smooth loss functions, using a new single-point gradient estimator and carefully designed surrogate losses.


title: Old and new families of strong Skolem Starters

abstract: In this paper, we give new families of strong Skolem starters for $\mathbb{Z}_{p^n}$ and $\mathbb{Z}_{pq}$, for infinitely many odd primes $p,q\equiv1$ (mod 8) and $n>1$ be an integer.


title: Learning perturbation sets for robust machine learning

abstract: Although much progress has been made towards robust deep learning, a significant gap in robustness remains between real-world perturbations and more narrowly defined sets typically studied in adversarial defenses. In this paper, we aim to bridge this gap by learning perturbation sets from data, in order to characterize real-world effects for robust training and evaluation. Specifically, we use a conditional generator that defines the perturbation set over a constrained region of the latent space. We formulate desirable properties that measure the quality of a learned perturbation set, and theoretically prove that a conditional variational autoencoder naturally satisfies these criteria. Using this framework, our approach can generate a variety of perturbations at different complexities and scales, ranging from baseline spatial transformations, through common image corruptions, to lighting variations. We measure the quality of our learned perturbation sets both quantitatively and qualitatively, finding that our models are capable of producing a diverse set of meaningful perturbations beyond the limited data seen during training. Finally, we leverage our learned perturbation sets to train models which are empirically and certifiably robust to adversarial image corruptions and adversarial lighting variations, while improving generalization on non-adversarial data. All code and configuration files for reproducing the experiments as well as pretrained model weights can be found at https://github.com/locuslab/perturbation_learning.


title: Specification mining and automated task planning for autonomous robots based on a graph-based spatial temporal logic

abstract: We aim to enable an autonomous robot to learn new skills from demo videos and use these newly learned skills to accomplish non-trivial high-level tasks. The goal of developing such autonomous robot involves knowledge representation, specification mining, and automated task planning. For knowledge representation, we use a graph-based spatial temporal logic (GSTL) to capture spatial and temporal information of related skills demonstrated by demo videos. We design a specification mining algorithm to generate a set of parametric GSTL formulas from demo videos by inductively constructing spatial terms and temporal formulas. The resulting parametric GSTL formulas from specification mining serve as a domain theory, which is used in automated task planning for autonomous robots. We propose an automatic task planning based on GSTL where a proposer is used to generate ordered actions, and a verifier is used to generate executable task plans. A table setting example is used throughout the paper to illustrate the main ideas.


title: Single-photon-level sub-Doppler pump-probe spectroscopy of rubidium

abstract: We propose and demonstrate pump-probe spectroscopy of rubidium absorption which reveals the sub-Doppler hyperfine structure of the $^{5}$S$_{1/2} \leftrightarrow$ $^{5}$P$_{3/2}$ (D2) transitions. The counter propagating pump and probe lasers are independently tunable in frequency, with the probe operating at the single-photon-level. The two-dimensional spectrum measured as the laser frequencies are scanned shows fluorescence, Doppler-broadened absorption dips and sub-Doppler features. The detuning between the pump and probe lasers allows compensation of the Doppler shift for all atomic velocities in the room temperature vapor, meaning we observe sub-Doppler features for all atoms in the beam. We detail a theoretical model of the system which incorporates fluorescence, saturation effects and optical pumping and compare this with the measured spectrum, finding a mean absolute percentage error of 4.17\%. In the future this technique could assist in frequency stabilization of lasers, and the single-photon-level probe could be replaced by a single photon source.


title: Towards Evaluating Driver Fatigue with Robust Deep Learning Models

abstract: In this paper, we explore different deep learning based approaches to detect driver fatigue. Drowsy driving results in approximately 72,000 crashes and 44,000 injuries every year in the US and detecting drowsiness and alerting the driver can save many lives. There have been many approaches to detect fatigue, of which eye closedness detection is one. We propose a framework to detect eye closedness in a captured camera frame as a gateway for detecting drowsiness. We explore two different datasets to detect eye closedness. We develop an eye model by using new Eye-blink dataset and a face model by using the Closed Eyes in the Wild (CEW). We also explore different techniques to make the models more robust by adding noise. We achieve 95.84% accuracy on our eye model and 80.01% accuracy on our face model. We also see that we can improve our accuracy on the face model by 6% via adversarial training and data augmentation. We hope that our work will be useful to the field of driver fatigue detection to avoid potential vehicle accidents related to drowsy driving.


title: Shape Prior Deformation for Categorical 6D Object Pose and Size Estimation

abstract: We present a novel learning approach to recover the 6D poses and sizes of unseen object instances from an RGB-D image. To handle the intra-class shape variation, we propose a deep network to reconstruct the 3D object model by explicitly modeling the deformation from a pre-learned categorical shape prior. Additionally, our network infers the dense correspondences between the depth observation of the object instance and the reconstructed 3D model to jointly estimate the 6D object pose and size. We design an autoencoder that trains on a collection of object models and compute the mean latent embedding for each category to learn the categorical shape priors. Extensive experiments on both synthetic and real-world datasets demonstrate that our approach significantly outperforms the state of the art. Our code is available at https://github.com/mentian/object-deformnet.


title: Can a Hurricane Be Managed

abstract: Based on realistic estimates of geophysical conditions it is demonstrated that by practical means; (1) the intensity of a hurricane can be diminished before making landfall; (2) and other circumstances, a potential hurricane might be quenched before achieving critical strength. Under the first strategy, cold deep ocean water cools the hurricane track to weaken it. Analyses are facilitated by derivation of a novel exact solution that models a tropical depression, a mesoscale eddy, and the eye of a hurricane. Under the second strategy, it is shown. the threat of a tropical depression can be diminished, in a timely manner. Estimates of the power needed to perform timely ocean mixing show that this might be accomplished by high-performance submarines, and an exceptional coefficient of performance, O(10^4). The destructive power of a hurricane is functionally related to its maximal wind speed, Vm. It is shown that a 20 percent reduction in maximal wind speed produces a 50 percent reduction in destructive costs. Complementary deliberations show the potential for producing rainfall in relief of drought. Shown also is the opportunity to significantly modify vessel architecture to maximize the desired goals. It is the contention of this paper that a practical framework exists to pursue means by which to reduce the tragedy and devastation caused by hurricanes.


title: Generating functions for monomial characters of wreath products $\mathbb Z/d \mathbb Z \wr \mathfrak S_n$

abstract: Let $\mathbb Z/d\mathbb Z \wr \mathfrak S_n$ denote the wreath product of the cyclic group $\mathbb Z/d\mathbb Z$ with the symmetric group $\mathfrak S_n$. We define generating functions for monomial (induced one-dimensional) characters of $\mathbb Z/d\mathbb Z \wr \mathfrak S_n$ and express these in terms of determinants and permanents. This extends work of Littlewood ({\em The Theory of Group Characters and Representations of Groups}, 1940) and Merris and Watkins ({\em Linear Algebra Appl.}, {\bf 64}, 1985) on generating functions for the monomial characters of $\mathfrak S_n$.


title: Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data

abstract: Photorealistic image generation has reached a new level of quality due to the breakthroughs of generative adversarial networks (GANs). Yet, the dark side of such deepfakes, the malicious use of generated media, raises concerns about visual misinformation. While existing research work on deepfake detection demonstrates high accuracy, it is subject to advances in generation techniques and adversarial iterations on detection countermeasure techniques. Thus, we seek a proactive and sustainable solution on deepfake detection, that is agnostic to the evolution of generative models, by introducing artificial fingerprints into the models. Our approach is simple and effective. We first embed artificial fingerprints into training data, then validate a surprising discovery on the transferability of such fingerprints from training data to generative models, which in turn appears in the generated deepfakes. Experiments show that our fingerprinting solution (1) holds for a variety of cutting-edge generative models, (2) leads to a negligible side effect on generation quality, (3) stays robust against image-level and model-level perturbations, (4) stays hard to be detected by adversaries, and (5) converts deepfake detection and attribution into trivial tasks and outperforms the recent state-of-the-art baselines. Our solution closes the responsibility loop between publishing pre-trained generative model inventions and their possible misuses, which makes it independent of the current arms race. Code and models are available at https://github.com/ningyu1991/ArtificialGANFingerprints .


title: Spectral Simulation of Functional Time Series

abstract: We develop methodology allowing to simulate a stationary functional time series defined by means of its spectral density operators. Our framework is general, in that it encompasses any such stationary functional time series, whether linear or not. The methodology manifests particularly significant computational gains if the spectral density operators are specified by means of their eigendecomposition or as a filtering of white noise. In the special case of linear processes, we determine the analytical expressions for the spectral density operators of functional autoregressive (fractionally integrated) moving average processes, and leverage these as part of our spectral approach, leading to substantial improvements over time-domain simulation methods in some cases. The methods are implemented as an R package (specsimfts) accompanied by several demo files that are easy to modify and can be easily used by researchers aiming to probe the finite-sample performance of their functional time series methodology by means of simulation.


title: PC-PG: Policy Cover Directed Exploration for Provable Policy Gradient Learning

abstract: Direct policy gradient methods for reinforcement learning are a successful approach for a variety of reasons: they are model free, they directly optimize the performance metric of interest, and they allow for richly parameterized policies. Their primary drawback is that, by being local in nature, they fail to adequately explore the environment. In contrast, while model-based approaches and Q-learning directly handle exploration through the use of optimism, their ability to handle model misspecification and function approximation is far less evident. This work introduces the the Policy Cover-Policy Gradient (PC-PG) algorithm, which provably balances the exploration vs. exploitation tradeoff using an ensemble of learned policies (the policy cover). PC-PG enjoys polynomial sample complexity and run time for both tabular MDPs and, more generally, linear MDPs in an infinite dimensional RKHS. Furthermore, PC-PG also has strong guarantees under model misspecification that go beyond the standard worst case $\ell_{\infty}$ assumptions; this includes approximation guarantees for state aggregation under an average case error assumption, along with guarantees under a more general assumption where the approximation error under distribution shift is controlled. We complement the theory with empirical evaluation across a variety of domains in both reward-free and reward-driven settings.


title: On emergent particles and stable neutral plasma balls in SU(2) Yang-Mills thermodynamics

abstract: For a pure SU(2) Yang-Mills theory in 4D we revisit the spatial (3D), ball-like region of radius $r_0$, in its bulk subject to the pressureless, deconfining phase at $T_0=1.32\,T_c$ where $T_c$ denotes the critical temperature for the onset of the deconfining-preconfining phase transition. Such a region possesses of a finite energy density and represents the self-intersection of a figure-eight shaped center-vortex loop if a BPS monopole of core radius $\sim \frac{r_0}{52.4}$, isolated from its antimonopole by repulsion externally invoked through a transient shift of (anti)caloron holonomy (pair creation), is trapped therein. The entire soliton (vortex line plus region of self-intersection of mass $m_0$ containing the monopole) can be considered an excitation of the pressureless and energyless ground state of the confining phase. Correcting an earlier estimate of $r_0$, we show that the vortex-loop self-intersection region associates with the {\sl central part} of a(n) (anti)caloron and that this region carries one unit of electric U(1) charge via the (electric-magnetic dually interpreted) charge of the monopole. The monopole core quantum vibrates at a thermodynamically determined frequency $\omega_0$ and is unresolved. For a deconfining-phase plasma oscillation about the zero-pressure background at $T=T_0$ we compute the lowest frequency $\Omega_0$ within a {\sl neutral} and homogeneous spatial ball (no trapped monopole) in dependence of its radius $R_0$. For $R_0=r_0$ a comparison of $\Omega_0$ with $\omega_0$ reveals that the neutral plasma oscillates much slower than the same plasma driven by the oscillation of a monopole core.


title: How to trust unlabeled data? Instance Credibility Inference for Few-Shot Learning

abstract: Deep learning based models have excelled in many computer vision tasks and appear to surpass humans' performance. However, these models require an avalanche of expensive human labeled training data and many iterations to train their large number of parameters. This severely limits their scalability to the real-world long-tail distributed categories, some of which are with a large number of instances, but with only a few manually annotated. Learning from such extremely limited labeled examples is known as Few-shot learning (FSL). Different to prior arts that leverage meta-learning or data augmentation strategies to alleviate this extremely data-scarce problem, this paper presents a statistical approach, dubbed Instance Credibility Inference (ICI) to exploit the support of unlabeled instances for few-shot visual recognition. Typically, we repurpose the self-taught learning paradigm to predict pseudo-labels of unlabeled instances with an initial classifier trained from the few shot and then select the most confident ones to augment the training set to re-train the classifier. This is achieved by constructing a (Generalized) Linear Model (LM/GLM) with incidental parameters to model the mapping from (un-)labeled features to their (pseudo-)labels, in which the sparsity of the incidental parameters indicates the credibility of the corresponding pseudo-labeled instance. We rank the credibility of pseudo-labeled instances along the regularization path of their corresponding incidental parameters, and the most trustworthy pseudo-labeled examples are preserved as the augmented labeled instances. Theoretically, under mild conditions of restricted eigenvalue, irrepresentability, and large error, our approach is guaranteed to collect all the correctly-predicted instances from the noisy pseudo-labeled set.


title: Existence and improved regularity for a nonlinear system with collapsing ellipticity

abstract: We study a nonlinear system made up of an elliptic equation of blended singular/degenerate type and Poisson's equation with a lowly integrable source. We prove the existence of a weak solution in any space dimension and, chiefly, derive an improved $\mathcal{C}^{1,\text{log-Lip}}$-regularity estimate using tangential analysis methods. The system illustrates a sophisticated version of the proverbial thermistor problem and our results are new even in simpler modelling scenarios.


title: openDD: A Large-Scale Roundabout Drone Dataset

abstract: Analyzing and predicting the traffic scene around the ego vehicle has been one of the key challenges in autonomous driving. Datasets including the trajectories of all road users present in a scene, as well as the underlying road topology are invaluable to analyze the behavior of the different traffic participants. The interaction between the various traffic participants is especially high in intersection types that are not regulated by traffic lights, the most common one being the roundabout. We introduce the openDD dataset, including 84,774 accurately tracked trajectories and HD map data of seven different roundabouts. The openDD dataset is annotated using images taken by a drone in 501 separate flights, totalling in over 62 hours of trajectory data. As of today, openDD is by far the largest publicly available trajectory dataset recorded from a drone perspective, while comparable datasets span 17 hours at most. The data is available, for both commercial and noncommercial use, at: http://www.l3pilot.eu/openDD.


title: Effects of different feeding frequencies on growth, feed utilisation, digestive enzyme activities and plasma biochemistry of gilthead sea bream (Sparus aurata) fed with different fishmeal and fish oil dietary levels

abstract: In the context of Mediterranean aquaculture little attention has been paid to the manipulation of feeding frequency at the on-growing phase. The effects of different feeding frequencies: one meal per day, two meals per day, three meals per day on growth, digestive enzyme activity, feed digestibility and plasma biochemistry were studied in gilthead sea bream (Sparus aurata, L. 1758) fed with high and low fishmeal and fish oil levels. Isonitrogenous and isolipidic extruded diets were fed to triplicate fish groups by a fixed ration over 109 days. No significant effects of feeding frequency on overall performance, feed efficiency and feed digestibility during the on-growing of gilthead sea bream fed high or low fishmeal and fish oil dietary level were observed. Pepsin activity showed an apparent decrease in fish receiving more than one meal a day which was not compensated by an increased production of alkaline proteases particularly in fish fed on low FM. Although there were no effects on growth and feed utilisation at increasing feeding frequency, trypsin decreased significantly with an increasing number of meals only under low FMFO diet. Thus, it seemed that consecutive meals could have amplified the potential trypsin inhibitor effect of the vegetable meal-based diet adopted. Results of the plasma parameters related to nutritional and physiological conditions were not affected by feeding frequency. The higher level of plasma creatinine detected in fish fed a single daily meal with high FMFO level seems to be within physiological values in relation to the higher protein efficiency observed with this diet. According to the results, gilthead sea bream seems able to maximise feed utilisation regardless of the number of meals, and this could be a useful indicator for planning feeding activity at farm level to optimise growth of fish and costs of feeding procedures.


title: Amorphous state of sp$^2$ solid carbon

abstract: Two-mode valence electron configuration of carbon atoms lays the foundation of the unique two-mode amorphous state of the monoatomic carbon solid. From the fundamentals of solid-state physics, sp$^3$ and sp$^2$ amorphous carbons are two different amorphous species characterized by conceptually different short-range orders, namely, groups of tetrahedrally bonded sp3 configured atoms and size-restricted sp$^2$ graphene domains framed with heteroatom necklaces. Molecular character of sp$^2$ amorphics is coherent with the reaction mechanism of the solid amorphicity in due course of the forced fragmentation.


title: Explosive Nucleosynthesis in Near-Chandrasekhar-mass White Dwarf Models for Type Iax Supernovae: Dependence on Model Parameters

abstract: The recently observed diversity of Type Ia supernovae (SNe Ia) has motivated us to conduct the theoretical modeling of SNe Ia for a wide parameter range. In particular, the origin of Type Iax supernovae (SNe Iax) has been obscure. Following our earlier work on the parameter dependence of SN Ia models, we focus on SNe Iax in the present study. For a model of SNe Iax, we adopt the currently leading model of pure turbulent deflagration (PTD) of near-Chandrasekhar mass C+O white dwarfs (WDs). We carry out 2-dimensional hydrodynamical simulations of the propagation of deflagration wave, which leaves a small WD remnant behind and eject nucleosynthesis materials. We show how the explosion properties, such as nucleosynthesis and explosion energy, depend on the model parameters such as central densities and compositions of the WDs (including the hybrid WDs), and turbulent flame prescription and initial flame geometry. We extract the associated observables in our models, and compare with the recently discovered low-mass WDs with unusual surface abundance patterns and the abundance patterns of some SN remnants. We provide the nucleosynthesis yield tables for applications to stellar archaeology and galactic chemical evolution. Our results are compared with the representative models in the literature.


title: A Reduced Complexity Ungerboeck Receiver for Quantized Wideband Massive SC-MIMO

abstract: Employing low resolution analog-to-digital converters in massive multiple-input multiple-output (MIMO) has many advantages in terms of total power consumption, cost and feasibility of such systems. However, such advantages come together with significant challenges in channel estimation and data detection due to the severe quantization noise present. In this study, we propose a novel iterative receiver for quantized uplink single carrier MIMO (SC-MIMO) utilizing an efficient message passing algorithm based on the Bussgang decomposition and Ungerboeck factorization, which avoids the use of a complex whitening filter. A reduced state sequence estimator with bidirectional decision feedback is also derived, achieving remarkable complexity reduction compared to the existing receivers for quantized SC-MIMO in the literature, without any requirement on the sparsity of the transmission channel. Moreover, the linear minimum mean-square-error (LMMSE) channel estimator for SC-MIMO under frequency-selective channel, which do not require any cyclic-prefix overhead, is also derived. We observe that the proposed receiver has significant performance gains with respect to the existing receivers in the literature under imperfect channel state information.


title: Two-dimensional ferromagnetism with long-range interactions in the layered magnetic topological insulator MnBi2Te4

abstract: MnBi2Te4(MBT) is a promising van der Waals layered antiferromagnetic (AF) topological insulator that combines a topologically non-trivial inverted Bi-Te band gap with ferromagnetic (FM) layers of Mn ions. We perform inelastic neutron scattering (INS) on co-aligned single crystals to study the magnetic interactions in MBT. Consistent with previous work, we find that the AF interlayer exchange coupling and uniaxial magnetic anisotropy have comparable strength, which supports metamagnetic transitions that allow access to different magnetic symmetries in applied fields. Modelling of the two-dimensional intralayer FM spin waves requires the introduction of long-range and competing Heisenberg FM and AF interactions, up to at least the seventh nearest-neighbor, and possess anomalous damping, especially near the Brillouin zone boundary. First-principles calculations of insulating MBT find that both interlayer and intralayer magnetic interactions are long-ranged. We discuss the potential roles that bulk $n$-type charger carriers and chemical disorder play in the magnetism of MBT.


title: Vulnerability-Aware Resilient Networks: Software Diversity-based Network Adaptation

abstract: By leveraging the principle of software polyculture to ensure security in a network, we proposed a vulnerability-based software diversity metric to determine how a network topology can be adapted to minimize security vulnerability while maintaining maximum network connectivity. Our proposed software diversity-based adaptation (SDA) scheme estimates a node's software diversity based on the vulnerabilities of software packages installed on other nodes on attack paths reachable to the node and employs it for edge adaptations, such as removing an edge with a neighboring node that exposes high security vulnerability because two connected nodes use the same software packages or a neighboring node may have high software vulnerability or adding an edge with another node with less or no security vulnerability because the two nodes use different software packages or have low vulnerabilities associated with them. To validate the proposed SDA scheme, we conducted extensive experiments comparing the proposed SDA scheme with counterpart baseline schemes in real networks. Our simulation experimental results proved the outperformance of our proposed SDA compared to the existing counterparts and provided insightful findings in terms of the effectiveness and efficiency of the proposed SDA scheme under three real network topologies with vastly different network density.


title: Pulsational Pair-instability Supernovae. II. Neutrino Signals from Pulsations and their Detection by Terrestrial Neutrino Detectors

abstract: A Pulsational Pair-instability supernova (PPISN) evolves from a massive star with a mass $\sim 80$ -- 140 $M_{\odot}$ which develops the electron-positron pair-instability after the hydrostatic He-burning in the core has finished. In [Leung et al., ApJ 887, 72 (2019)] (Paper I) we examined the evolutionary tracks and the pulsational mass loss history of this class of stars. In this paper, we analyze the thermodynamical history to explore the neutrino observables of PPISNe. We compute the neutrino light curves and spectra during pulsation. We study the detailed neutrino emission profiles of these stars. Then, we estimate the expected neutrino detection count for different terrestrial neutrino detectors including, e.g., KamLAND and Super-Kamiokande. Finally, we compare the neutrino pattern of PPISN with other types of supernovae based on a canonical 10 kt detector. The predicted neutrino signals can provide the early warning for the telescopes to trace for the early time optical signals. Implications of neutrino physics on the expected detection are discussed.


title: The Thermodynamics of Rotating Black-Hole Star Clusters

abstract: Rotating star clusters near supermassive black holes are studied using Touma-Tremaine thermodynamics of gravitationally interacting orbital ellipses. A simple numerical procedure for calculating thermodynamic equilibrium states for an arbitrary distribution of stars over masses and semimajor axes is described. Spontaneous symmetry breaking and breakdown of thermodynamics at low positive temperatures are rigorously proven for non-rotating clusters. Rotation is introduced through a second temperature-like parameter. Both axially symmetric and lopsided rotational equilibria are found; the lopsided equilibria precess with the angular velocity that is given by the ratio of the two temperatures. Eccentric stellar disc in the nucleus of Andromeda galaxy may be an example of a lopsided thermodynamic equilibrium of a rotating black hole star cluster. Stellar-mass black holes occupy highly eccentric orbits in broken-symmetry star clusters, and form flattened disc-like configurations in rotating star clusters. They are attracted to orbits that are stationary in the frame of reference rotating with the angular velocity of the cluster. In spherical clusters, stellar-mass black holes' orbits are significantly more eccentric than those of the lighter stars if the temperature is negative, and more circular if the temperature is positive. Finally we note that planets, comets, dark matter particles and other light bodies tend to form a spherically symmetric non-rotating sub-cluster with maximum-entropy eccentricity distribution $\mathscr{P}(e)=2e$, even if their host cluster is rotating and lopsided.


title: Density reconstruction from biased tracers and its application to primordial non-Gaussianity

abstract: Large-scale Fourier modes of the cosmic density field are of great value for learning about cosmology because of their well-understood relationship to fluctuations in the early universe. However, cosmic variance generally limits the statistical precision that can be achieved when constraining model parameters using these modes as measured in galaxy surveys, and moreover, these modes are sometimes inaccessible due to observational systematics or foregrounds. For some applications, both limitations can be circumvented by reconstructing large-scale modes using the correlations they induce between smaller-scale modes of an observed tracer (such as galaxy positions). In this paper, we further develop a formalism for this reconstruction, using a quadratic estimator similar to the one used for lensing of the cosmic microwave background. We incorporate nonlinearities from gravity, nonlinear biasing, and local-type primordial non-Gaussianity, and verify that the estimator gives the expected results when applied to N-body simulations. We then carry out forecasts for several upcoming surveys, demonstrating that, when reconstructed modes are included alongside directly-observed tracer density modes, constraints on local primordial non-Gaussianity are generically tightened by tens of percents compared to standard single-tracer analyses. In certain cases, these improvements arise from cosmic variance cancellation, with reconstructed modes taking the place of modes of a separate tracer, thus enabling an effective "multitracer" approach with single-tracer observations.


title: Certifiably Adversarially Robust Detection of Out-of-Distribution Data

abstract: Deep neural networks are known to be overconfident when applied to out-of-distribution (OOD) inputs which clearly do not belong to any class. This is a problem in safety-critical applications since a reliable assessment of the uncertainty of a classifier is a key property, allowing the system to trigger human intervention or to transfer into a safe state. In this paper, we aim for certifiable worst case guarantees for OOD detection by enforcing not only low confidence at the OOD point but also in an $l_\infty$-ball around it. For this purpose, we use interval bound propagation (IBP) to upper bound the maximal confidence in the $l_\infty$-ball and minimize this upper bound during training time. We show that non-trivial bounds on the confidence for OOD data generalizing beyond the OOD dataset seen at training time are possible. Moreover, in contrast to certified adversarial robustness which typically comes with significant loss in prediction performance, certified guarantees for worst case OOD detection are possible without much loss in accuracy.


title: Domino tilings and flips in dimensions 4 and higher

abstract: In this paper we consider domino tilings of bounded regions in dimension $n \geq 4$. We define the twist of such a tiling, an elements of ${\mathbb{Z}}/(2)$, and prove it is invariant under flips, a simple local move in the space of tilings. We investigate which regions $D$ are regular, i.e. whenever two tilings $t_0$ and $t_1$ of $D \times [0,N]$ have the same twist then $t_0$ and $t_1$ can be joined by a sequence of flips provided some extra vertical space is allowed. We prove that all boxes are regular except $D = [0,2]^3$. Furthermore, given a regular region $D$, we show that there exists a value $M$ (depending only on $D$) such that if $t_0$ and $t_1$ are tilings of equal twist of $D \times [0,N]$ then the corresponding tilings can be joined by a finite sequence of flips in $D \times [0,N+M]$. As a corollary we deduce that, for regular $D$ and large $N$, the set of tilings of $D \times [0,N]$ has two twin giant components under flips, one for each value of the twist.


title: Symmetry and financial Markets

abstract: It is hard to overstate the importance that the concept of symmetry has had in every field of physics, a fact alluded to by the Nobel Prize winner P.W. Anderson, who once wrote that physics is the study of symmetry. Whereas the idea of symmetry is widely used in science in general, very few (if not almost no) applications has found its way into the field of finance. Still, the phenomenon appears relevant in terms of for example the symmetry of strategies that can happen in the decision making to buy or sell financial shares. Game theory is therefore one obvious avenue where to look for symmetry, but as will be shown, also technical analysis and long term economic growth could be phenomena which show the hallmark of a symmetry


title: Accessible Computer Science for K-12 Students with Hearing Impairments

abstract: An inclusive science, technology, engineering and mathematics (STEM) workforce is needed to maintain America's leadership in the scientific enterprise. Increasing the participation of underrepresented groups in STEM, including persons with disabilities, requires national attention to fully engage the nation's citizens in transforming its STEM enterprise. To address this need, a number of initiatives, such as AccessCSforALL, Bootstrap, and CSforAll, are making efforts to make Computer Science inclusive to the 7.4 million K-12 students with disabilities in the U.S. Of special interest to our project are those K-12 students with hearing impairments. American Sign Language (ASL) is the primary means of communication for an estimated 500,000 people in the United States, yet there are limited online resources providing Computer Science instruction in ASL. This paper introduces a new project designed to support Deaf and Hard of Hearing (DHH) K-12 students and sign interpreters in acquiring knowledge of complex Computer Science concepts. We discuss the motivation for the project and an early design of the accessible block-based Computer Science curriculum to engage DHH students in hands-on computing education.


title: Sparsity-Agnostic Lasso Bandit

abstract: We consider a stochastic contextual bandit problem where the dimension $d$ of the feature vectors is potentially large, however, only a sparse subset of features of cardinality $s_0 \ll d$ affect the reward function. Essentially all existing algorithms for sparse bandits require a priori knowledge of the value of the sparsity index $s_0$. This knowledge is almost never available in practice, and misspecification of this parameter can lead to severe deterioration in the performance of existing methods. The main contribution of this paper is to propose an algorithm that does not require prior knowledge of the sparsity index $s_0$ and establish tight regret bounds on its performance under mild conditions. We also comprehensively evaluate our proposed algorithm numerically and show that it consistently outperforms existing methods, even when the correct sparsity index is revealed to them but is kept hidden from our algorithm.


title: 3D CNN-PCA: A Deep-Learning-Based Parameterization for Complex Geomodels

abstract: Geological parameterization enables the representation of geomodels in terms of a relatively small set of variables. Parameterization is therefore very useful in the context of data assimilation and uncertainty quantification. In this study, a deep-learning-based geological parameterization algorithm, CNN-PCA, is developed for complex 3D geomodels. CNN-PCA entails the use of convolutional neural networks as a post-processor for the low-dimensional principal component analysis representation of a geomodel. The 3D treatments presented here differ somewhat from those used in the 2D CNN-PCA procedure. Specifically, we introduce a new supervised-learning-based reconstruction loss, which is used in combination with style loss and hard data loss. The style loss uses features extracted from a 3D CNN pretrained for video classification. The 3D CNN-PCA algorithm is applied for the generation of conditional 3D realizations, defined on $60\times60\times40$ grids, for three geological scenarios (binary and bimodal channelized systems, and a three-facies channel-levee-mud system). CNN-PCA realizations are shown to exhibit geological features that are visually consistent with reference models generated using object-based methods. Statistics of flow responses ($\text{P}_{10}$, $\text{P}_{50}$, $\text{P}_{90}$ percentile results) for test sets of 3D CNN-PCA models are shown to be in consistent agreement with those from reference geomodels. Lastly, CNN-PCA is successfully applied for history matching with ESMDA for the bimodal channelized system.


title: Active Learning under Label Shift

abstract: We address the problem of active learning under label shift: when the class proportions of source and target domains differ. We introduce a "medial distribution" to incorporate a tradeoff between importance weighting and class-balanced sampling and propose their combined usage in active learning. Our method is known as Mediated Active Learning under Label Shift (MALLS). It balances the bias from class-balanced sampling and the variance from importance weighting. We prove sample complexity and generalization guarantees for MALLS which show active learning reduces asymptotic sample complexity even under arbitrary label shift. We empirically demonstrate MALLS scales to high-dimensional datasets and can reduce the sample complexity of active learning by 60% in deep active learning tasks.


title: Co-Attention for Conditioned Image Matching

abstract: We propose a new approach to determine correspondences between image pairs in the wild under large changes in illumination, viewpoint, context, and material. While other approaches find correspondences between pairs of images by treating the images independently, we instead condition on both images to implicitly take account of the differences between them. To achieve this, we introduce (i) a spatial attention mechanism (a co-attention module, CoAM) for conditioning the learned features on both images, and (ii) a distinctiveness score used to choose the best matches at test time. CoAM can be added to standard architectures and trained using self-supervision or supervised data, and achieves a significant performance improvement under hard conditions, e.g. large viewpoint changes. We demonstrate that models using CoAM achieve state of the art or competitive results on a wide range of tasks: local matching, camera localization, 3D reconstruction, and image stylization.


title: Optimized Lepton Universality Tests in $B\to V \ell\bar{\nu}$ decays

abstract: We propose improved Lepton Flavor Universality (LFU) ratios in semileptonic $P\to V \ell \bar{\nu}$ decays, when comparing $\mu$ and $\tau$ modes, that minimize the theoretical form-factor uncertainties. These optimized ratios are obtained with simple cuts or reweighting of the dilepton mass distributions, which imply a minimum loss of signal on the rare tauonic modes while maximizing the cancellation of theoretical uncertainties among the two modes. We illustrate the usefulness of these observables in $B_c\to J/\psi$, $B_c\to \psi(2S)$, $B\to D^\ast$ and $B_s\to D_s^\ast$ transitions, showing that in all cases we can reach $\mathcal{O}(1\%)$ uncertainties on the SM predictions of the improved LFU ratios employing conservatives form-factor uncertainties.


title: Majorana end states in an interacting quantum wire

abstract: We propose and investigate a simple one-dimensional model for a single-channel quantum wire hosting electrons that interact repulsively and are subject to a significant spin-orbit interaction. We show that an external Zeeman magnetic field, applied at the right angle to the Rashba spin-orbit axis, drives the wire into a correlated spin-density wave state with gapped spin and gapless charge excitations. By computing the ground-state degeneracies of the model with either (anti-)periodic or open boundary conditions, we conclude that the correlated spin-density state realizes a gapless symmetry-protected topological phase, as the ground state is unique in the ring geometry while it is two-fold degenerate in the wire with open boundaries. Microscopically the two-fold degeneracy is found to be protected by the conservation of the magnetization parity. Open boundaries induce localized zero-energy (midgap) states which are described, at the special Luther-Emery point of the model, by Majorana fermions. We find that spin densities at the open ends of the wire exhibit unusual long-ranged correlations despite the fact that all correlations in the bulk of the wire decay in a power-law or exponential fashion. Our study exposes the crucial importance of the long-ranged string operator needed to implement the correct commutation relations between spin densities at different points in the wire. Along the way we rederive the low-energy theory of Galilean-invariant electron systems in terms of current operators.


title: On Power Laws in Deep Ensembles

abstract: Ensembles of deep neural networks are known to achieve state-of-the-art performance in uncertainty estimation and lead to accuracy improvement. In this work, we focus on a classification problem and investigate the behavior of both non-calibrated and calibrated negative log-likelihood (CNLL) of a deep ensemble as a function of the ensemble size and the member network size. We indicate the conditions under which CNLL follows a power law w.r.t. ensemble size or member network size, and analyze the dynamics of the parameters of the discovered power laws. Our important practical finding is that one large network may perform worse than an ensemble of several medium-size networks with the same total number of parameters (we call this ensemble a memory split). Using the detected power law-like dependencies, we can predict (1) the possible gain from the ensembling of networks with given structure, (2) the optimal memory split given a memory budget, based on a relatively small number of trained networks. We describe the memory split advantage effect in more details in arXiv:2005.07292


title: Estimation of surface area

abstract: We study the problem of estimating the surface area of the boundary $\partial S$ of a sufficiently smooth set $S\subset\mathbb{R}^d$ when the available information is only a finite subset $\X\subset S$. We propose two estimators. The first makes use of the Devroye--Wise support estimator and is based on Crofton's formula, which, roughly speaking, states that the $(d-1)$-dimensional surface area of a smooth enough set is the mean number of intersections of randomly chosen lines. For that purpose, we propose an estimator of the number of intersections of such lines with support based on the Devroye--Wise support estimators. The second surface area estimator makes use of the $\alpha$-convex hull of $\X$, which is denoted by $C_{\alpha}(\X)$. More precisely, it is the $(d-1)$-dimensional surface area of $C_\alpha(\X)$, as denoted by $|C_\alpha(\X)|_{d-1}$, which is proven to converge to the $(d-1)$-dimensional surface area of $\partial S$. Moreover, $|C_\alpha(\X)|_{d-1}$ can be computed using Crofton's formula. Our results depend on the Hausdorff distance between $S$ and $\X$ for the Devroye--Wise estimator, and the Hausdorff distance between $\partial S$ and $\partial C_{\alpha}(\X)$ for the second estimator.


title: IIB matrix model: Emergent spacetime from the master field

abstract: We argue that the large-$N$ master field of the Lorentzian IIB matrix model can give the points and metric of a classical spacetime.


title: CMB polarization as a tool to constrain the optical properties of the Universe

abstract: We present a novel formalism to describe the $in$ $vacuo$ conversion between polarization states of propagating radiation, also known as generalized Faraday effect (GFE), in a cosmological context. Thinking of GFE as a potential tracer of new, isotropy- and/or parity-violating physics, we apply our formalism to the cosmic microwave background (CMB) polarized anisotropy power spectra, providing a simple framework to easily compute their observed modifications. In so doing, we re-interpret previously known results, namely the $in$ $vacuo$ rotation of the linear polarization plane of CMB photons (or cosmic birefringence) but also point out that GFE could lead to the partial conversion of linear into circular polarization. We notice that GFE can be seen as an effect of light propagating in an anisotropic and/or chiral medium (a "dark crystal") and recast its parameters as the components of an effective "cosmic susceptibility tensor". For a wave number-independent susceptibility tensor, this allows us to set an observational bound on a GFE-induced CMB circularly polarized power spectrum, or $VV$, at $C_{\ell}^{VV} < 2 \times 10^{-5} \mu K^2$ (95 \% C.L.), at its peak $\ell\simeq 370$, which is some 3 orders of magnitude better than presently available direct $VV$ measurements. We argue that, unless dramatic technological improvements will arise in direct $V$-modes measurements, cosmic variance-limited linear polarization surveys expected within this decade should provide, as a byproduct, superior bounds on GFE-induced circular polarization of the CMB.


title: Achieving fair sampling in quantum annealing

abstract: Sampling all ground states of a Hamiltonian with equal probability is a desired feature of a sampling algorithm, but recent studies indicate that common variants of transverse field quantum annealing sample the ground state subspace unfairly. In this note, we present perturbation theory arguments suggesting that this deficiency can be corrected by employing reverse annealing-inspired paths. We confirm that this conclusion holds in simulations of previously studied small instances with degeneracy, as well as larger instances on quantum annealing hardware.


title: Complete & Label: A Domain Adaptation Approach to Semantic Segmentation of LiDAR Point Clouds

abstract: We study an unsupervised domain adaptation problem for the semantic labeling of 3D point clouds, with a particular focus on domain discrepancies induced by different LiDAR sensors. Based on the observation that sparse 3D point clouds are sampled from 3D surfaces, we take a Complete and Label approach to recover the underlying surfaces before passing them to a segmentation network. Specifically, we design a Sparse Voxel Completion Network (SVCN) to complete the 3D surfaces of a sparse point cloud. Unlike semantic labels, to obtain training pairs for SVCN requires no manual labeling. We also introduce local adversarial learning to model the surface prior. The recovered 3D surfaces serve as a canonical domain, from which semantic labels can transfer across different LiDAR sensors. Experiments and ablation studies with our new benchmark for cross-domain semantic labeling of LiDAR data show that the proposed approach provides 8.2-36.6% better performance than previous domain adaptation methods.


title: Do Adversarially Robust ImageNet Models Transfer Better?

abstract: Transfer learning is a widely-used paradigm in deep learning, where models pre-trained on standard datasets can be efficiently adapted to downstream tasks. Typically, better pre-trained models yield better transfer results, suggesting that initial accuracy is a key aspect of transfer learning performance. In this work, we identify another such aspect: we find that adversarially robust models, while less accurate, often perform better than their standard-trained counterparts when used for transfer learning. Specifically, we focus on adversarially robust ImageNet classifiers, and show that they yield improved accuracy on a standard suite of downstream classification tasks. Further analysis uncovers more differences between robust and standard models in the context of transfer learning. Our results are consistent with (and in fact, add to) recent hypotheses stating that robustness leads to improved feature representations. Our code and models are available at https://github.com/Microsoft/robust-models-transfer .


title: Boolean elements in the Bruhat order

abstract: We show that $w\in W$ is boolean if and only if it avoids a set of Billey-Postnikov patterns, which we describe explicitly. Our proof is based on an analysis of inversion sets, and it is in large part type-uniform. We also introduce the notion of linear pattern avoidance, and show that boolean elements are characterized by avoiding just the $3$ linear patterns $s_1 s_2 s_1 \in W(A_2)$, $s_2 s_1 s_3 s_2 \in W(A_3)$, and $s_2 s_1 s_3 s_4 s_2 \in W(D_4)$. We also consider the more general case of $k$-boolean Weyl group elements. We say that $w\in W$ is $k$-boolean if every reduced expression for $w$ contains at most $k$ copies of each generator. We show that the $2$-boolean elements of the symmetric group $S_n$ are characterized by avoiding the patterns $3421,4312,4321,$ and $456123$, and give a rational generating function for the number of $2$-boolean elements of $S_n$.


title: Prediction of the onset of cardiovascular diseases from electronic health records using multi-task gated recurrent units

abstract: In this work, we propose a multi-task recurrent neural network with attention mechanism for predicting cardiovascular events from electronic health records (EHRs) at different time horizons. The proposed approach is compared to a standard clinical risk predictor (QRISK) and machine learning alternatives using 5-year data from a NHS Foundation Trust. The proposed model outperforms standard clinical risk scores in predicting stroke (AUC=0.85) and myocardial infarction (AUC=0.89), considering the largest time horizon. Benefit of using an \gls{mt} setting becomes visible for very short time horizons, which results in an AUC increase between 2-6%. Further, we explored the importance of individual features and attention weights in predicting cardiovascular events. Our results indicate that the recurrent neural network approach benefits from the hospital longitudinal information and demonstrates how machine learning techniques can be applied to secondary care.


title: Nonlinear trident in the high-energy limit: Nonlocality, Coulomb field and resummations

abstract: We study nonlinear trident in laser pulses in the high-energy limit, where the initial electron experiences, in its rest frame, an electromagnetic field strength above Schwinger's critical field. At lower energies the dominant contribution comes from the "two-step" part, but in the high-energy limit the dominant contribution comes instead from the one-step term. We obtain new approximations that explain the relation between the high-energy limit of trident and pair production by a Coulomb field, as well as the role of the Weizs\"acker-Williams approximation and why it does not agree with the high-$\chi$ limit of the locally-constant-field approximation. We also show that the next-to-leading order in the large-$a_0$ expansion is, in the high-energy limit, nonlocal and is numerically very important even for quite large $a_0$. We show that the small-$a_0$ perturbation series has a finite radius of convergence, but using Pad\'e-conformal methods we obtain resummations that go beyond the radius of convergence and have a large numerical overlap with the large-$a_0$ approximation. We use Borel-Pad\'e-conformal methods to resum the small-$\chi$ expansion and obtain a high precision up to very large $\chi$. We also use newer resummation methods based on hypergeometric/Meijer-G and confluent hypergeometric functions.


title: GW190814 as a massive rapidly-rotating neutron star with exotic degrees of freedom

abstract: In the context of the massive secondary object recently observed in the compact-star merger GW190814, we investigate the possibility of producing massive neutron stars from a few different equation of state models that contain exotic degrees of freedom, such as hyperons and quarks. Our work shows that state-of-the-art relativistic mean field models can generate massive stars reaching $\gtrsim 2.05\,\Msun$, while being in good agreement with gravitational-wave events and x-ray pulsar observations, when quark vector interactions and non-standard self-vector interactions are introduced. In particular, we present a new version of the Chiral Mean Field (CMF) model in which a different quark-deconfinement potential allows for stable stars with a pure quark core. When rapid rotation is considered, our models generate stellar masses that approach, and in some cases surpass $2.5\,\Msun$. We find that in such cases fast rotation does not necessarily suppress exotic degrees of freedom due to changes in stellar central density, but require a larger amount of baryons than what is allowed in the non-rotating stars. This is not the case for pure quark stars, which can easily reach $2.5\,\Msun$ and still possess approximately the same amount of baryons as stable non-rotating stars. We also briefly discuss possible origins for fast rotating stars with a large amount of baryons and their stability, showing how the event GW190814 can be associated with a star containing quarks as one of its progenitors.


title: Vehicle Detection of Multi-source Remote Sensing Data Using Active Fine-tuning Network

abstract: Vehicle detection in remote sensing images has attracted increasing interest in recent years. However, its detection ability is limited due to lack of well-annotated samples, especially in densely crowded scenes. Furthermore, since a list of remotely sensed data sources is available, efficient exploitation of useful information from multi-source data for better vehicle detection is challenging. To solve the above issues, a multi-source active fine-tuning vehicle detection (Ms-AFt) framework is proposed, which integrates transfer learning, segmentation, and active classification into a unified framework for auto-labeling and detection. The proposed Ms-AFt employs a fine-tuning network to firstly generate a vehicle training set from an unlabeled dataset. To cope with the diversity of vehicle categories, a multi-source based segmentation branch is then designed to construct additional candidate object sets. The separation of high quality vehicles is realized by a designed attentive classifications network. Finally, all three branches are combined to achieve vehicle detection. Extensive experimental results conducted on two open ISPRS benchmark datasets, namely the Vaihingen village and Potsdam city datasets, demonstrate the superiority and effectiveness of the proposed Ms-AFt for vehicle detection. In addition, the generalization ability of Ms-AFt in dense remote sensing scenes is further verified on stereo aerial imagery of a large camping site.


title: Rational pullbacks of toric foliations

abstract: This article is dedicated to the study of singular codimension $1$ foliations $\mathcal{F}$ on a simplicial complete toric variety $X$ and their pullbacks by dominant rational maps $\varphi:\mathbb{P}^n\dashrightarrow X$. First, we describe the singularities of $\mathcal{F}$ and $\varphi^*\mathcal{F}$ for a generic pair $(\varphi,\mathcal{F})$. Then we show that the first order deformations of $\varphi^*\mathcal{F}$ arising from first order unfoldings are the families of the form $\varphi_\varepsilon^*\mathcal{F}$, where $\varphi_\varepsilon$ is a perturbation of $\varphi$. We also prove that the deformations of the form $\varphi^*\mathcal{F}_\varepsilon$ consist exactly of the families which are tangent to the fibers of $\varphi$. In order to do so, we state some results of independent interest regarding the Kupka singularities of these foliations.


title: Quantifying the global parameter tensions between ACT, SPT and Planck

abstract: The overall cosmological parameter tension between the Atacama Cosmology Telescope 2020 (ACT) and Planck 2018 data within the concordance cosmological model is quantified using the suspiciousness statistic to be 2.6$\sigma$. Between ACT and the South Pole Telescope (SPT) we find a tension of 2.4$\sigma$, and 2.8$\sigma$ between ACT and Planck+SPT combined. While it is unclear whether the tension is caused by statistical fluctuations, systematic effects or new physics, caution should be exercised in combining these cosmic microwave background datasets in the context of the $\Lambda$CDM standard model of the universe.


title: Co-generation of game levels and game-playing agents

abstract: Open-endedness, primarily studied in the context of artificial life, is the ability of systems to generate potentially unbounded ontologies of increasing novelty and complexity. Engineering generative systems displaying at least some degree of this ability is a goal with clear applications to procedural content generation in games. The Paired Open-Ended Trailblazer (POET) algorithm, heretofore explored only in a biped walking domain, is a coevolutionary system that simultaneously generates environments and agents that can solve them. This paper introduces a POET-Inspired Neuroevolutionary System for KreativitY (PINSKY) in games, which co-generates levels for multiple video games and agents that play them. This system leverages the General Video Game Artificial Intelligence (GVGAI) framework to enable co-generation of levels and agents for the 2D Atari-style games Zelda and Solar Fox. Results demonstrate the ability of PINSKY to generate curricula of game levels, opening up a promising new avenue for research at the intersection of procedural content generation and artificial life. At the same time, results in these challenging game domains highlight the limitations of the current algorithm and opportunities for improvement.


title: Constraining Electroweakinos in the Minimal Dirac Gaugino Model

abstract: Supersymmetric models with Dirac instead of Majorana gaugino masses have distinct phenomenological consequences. In this paper, we investigate the electroweakino sector of the Minimal Dirac Gaugino Supersymmetric Standard Model (MDGSSM) with regards to dark matter (DM) and collider constraints. We delineate the parameter space where the lightest neutralino of the MDGSSM is a viable DM candidate, that makes for at least part of the observed relic abundance while evading constraints from DM direct detection, LEP and lowenergy data, and LHC Higgs measurements. The collider phenomenology of the thus emerging scenarios is characterised by the richer electroweakino spectrum as compared to the Minimal Supersymmetric Standard Model (MSSM) -- 6 neutralinos and 3 charginos instead of 4 and 2 in the MSSM, naturally small mass splittings, and the frequent presence of long-lived particles, both charginos and/or neutralinos. Reinterpreting ATLAS and CMS analyses with the help of SModelS and MadAnalysis 5, we discuss the sensitivity of existing LHC searches for new physics to these scenarios and show which cases can be constrained and which escape detection. Finally, we propose a set of benchmark points which can be useful for further studies, designing dedicated experimental analyses and/or investigating the potential of future experiments.


title: Combinatorics of Continuants of Continued Fractions with 3 Limits

abstract: We give combinatorial descriptions of the terms occurring in continuants of general continued fractions that diverge to three limits. Equating these with the usual combinatorial descriptions due to Euler, Sylvester, and Minding induces nontrivial polynomial identities. Special cases and applications to counting sequences are given.


title: EFT Interpretation of XENON1T Electron Recoil Excess: Neutrinos and Dark Matter

abstract: We scrutinize the XENON1T electron recoil excess in the scalar-singlet-extended dark matter effective field theory. We confront it with various astrophysical and laboratory constraints both in a general setup and in the more specific, recently proposed, variant with leptophilic $Z_2$-odd mediators. The latter also provide mass to the light leptons via suppressed $Z_2$ breaking, a structure that is well fitting with the nature of the observed excess and the discrete symmetry leads to non-standard dark-matter interactions. We find that the excess can be explained by neutrino--electron interactions, linked with the neutrino and electron masses, while dark-matter--electron scattering does not lead to statistically significant improvement. We analyze the parameter space preferred by the anomaly and find severe constraints that can only be avoided in certain corners of parameter space. Potentially problematic bounds on electron couplings from Big-Bang Nucleosynthesis can be circumvented via a late phase transition in the new scalar sector.


title: Accelerating 3D Deep Learning with PyTorch3D

abstract: Deep learning has significantly improved 2D image recognition. Extending into 3D may advance many new applications including autonomous vehicles, virtual and augmented reality, authoring 3D content, and even improving 2D recognition. However despite growing interest, 3D deep learning remains relatively underexplored. We believe that some of this disparity is due to the engineering challenges involved in 3D deep learning, such as efficiently processing heterogeneous data and reframing graphics operations to be differentiable. We address these challenges by introducing PyTorch3D, a library of modular, efficient, and differentiable operators for 3D deep learning. It includes a fast, modular differentiable renderer for meshes and point clouds, enabling analysis-by-synthesis approaches. Compared with other differentiable renderers, PyTorch3D is more modular and efficient, allowing users to more easily extend it while also gracefully scaling to large meshes and images. We compare the PyTorch3D operators and renderer with other implementations and demonstrate significant speed and memory improvements. We also use PyTorch3D to improve the state-of-the-art for unsupervised 3D mesh and point cloud prediction from 2D images on ShapeNet. PyTorch3D is open-source and we hope it will help accelerate research in 3D deep learning.


title: Increasing the number of topological nodal lines in semimetals via uniaxial pressure

abstract: The application of pressure has been demonstrated to induce intriguing phase transitions in topological nodal-line semimetals. In this work we analyze how uniaxial pressure affects the topological character of BaSn2 , a Dirac nodal-line semimetal in the absence of spin-orbit coupling. Using calculations based on the density functional theory and a model tight-binding Hamiltonian, we find the emergence of a second nodal line for pressures higher than 4 GPa. We examine the topological features of both phases demonstrating that a nontrivial character is present in both of them. Thus, providing evidence of a topological-to-topological phase transition in which the number of topological nodal lines increases. The orbital overlap increase between Ba dxz and dyz orbitals and Sn pz orbitals and the preservation of crystal symmetries are found to be responsible for the advent of this transition. Furthermore, we pave the way to experimentally test this kind of transition by obtaining a topological relation between the zero-energy modes that arise in each phase when a magnetic field is applied.


title: Radon measures and Lipschitz graphs

abstract: For all $1\leq m\leq n-1$, we investigate the interaction of locally finite measures in $\mathbb{R}^n$ with the family of $m$-dimensional Lipschitz graphs. For instance, we characterize Radon measures $\mu$, which are carried by Lipschitz graphs in the sense that there exist graphs $\Gamma_1,\Gamma_2,\dots$ such that $\mu(\mathbb{R}^n\setminus\bigcup_1^\infty\Gamma_i)=0$, using only countably many evaluations of the measure. This problem in geometric measure theory was classically studied within smaller classes of measures, e.g.~for the restrictions of $m$-dimensional Hausdorff measure $\mathcal{H}^m$ to $E\subseteq \mathbb{R}^n$ with $0<\mathcal{H}^m(E)<\infty$. However, an example of Cs\"{o}rnyei, K\"{a}enm\"{a}ki, Rajala, and Suomala shows that classical methods are insufficient to detect when a general measure charges a Lipschitz graph. To develop a characterization of Lipschitz graph rectifiability for arbitrary Radon measures, we look at the behavior of coarse doubling ratios of the measure on dyadic cubes that intersect conical annuli. This extends a characterization of graph rectifiability for pointwise doubling measures by Naples by mimicking the approach used in the characterization of Radon measures carried by rectifiable curves by Badger and Schul.


title: Implicit Mesh Reconstruction from Unannotated Image Collections

abstract: We present an approach to infer the 3D shape, texture, and camera pose for an object from a single RGB image, using only category-level image collections with foreground masks as supervision. We represent the shape as an image-conditioned implicit function that transforms the surface of a sphere to that of the predicted mesh, while additionally predicting the corresponding texture. To derive supervisory signal for learning, we enforce that: a) our predictions when rendered should explain the available image evidence, and b) the inferred 3D structure should be geometrically consistent with learned pixel to surface mappings. We empirically show that our approach improves over prior work that leverages similar supervision, and in fact performs competitively to methods that use stronger supervision. Finally, as our method enables learning with limited supervision, we qualitatively demonstrate its applicability over a set of about 30 object categories.


title: FeatMatch: Feature-Based Augmentation for Semi-Supervised Learning

abstract: Recent state-of-the-art semi-supervised learning (SSL) methods use a combination of image-based transformations and consistency regularization as core components. Such methods, however, are limited to simple transformations such as traditional data augmentation or convex combinations of two images. In this paper, we propose a novel learned feature-based refinement and augmentation method that produces a varied set of complex transformations. Importantly, these transformations also use information from both within-class and across-class prototypical representations that we extract through clustering. We use features already computed across iterations by storing them in a memory bank, obviating the need for significant extra computation. These transformations, combined with traditional image-based augmentation, are then used as part of the consistency-based regularization loss. We demonstrate that our method is comparable to current state of art for smaller datasets (CIFAR-10 and SVHN) while being able to scale up to larger datasets such as CIFAR-100 and mini-Imagenet where we achieve significant gains over the state of art (\textit{e.g.,} absolute 17.44\% gain on mini-ImageNet). We further test our method on DomainNet, demonstrating better robustness to out-of-domain unlabeled data, and perform rigorous ablations and analysis to validate the method.


title: SketchGraphs: A Large-Scale Dataset for Modeling Relational Geometry in Computer-Aided Design

abstract: Parametric computer-aided design (CAD) is the dominant paradigm in mechanical engineering for physical design. Distinguished by relational geometry, parametric CAD models begin as two-dimensional sketches consisting of geometric primitives (e.g., line segments, arcs) and explicit constraints between them (e.g., coincidence, perpendicularity) that form the basis for three-dimensional construction operations. Training machine learning models to reason about and synthesize parametric CAD designs has the potential to reduce design time and enable new design workflows. Additionally, parametric CAD designs can be viewed as instances of constraint programming and they offer a well-scoped test bed for exploring ideas in program synthesis and induction. To facilitate this research, we introduce SketchGraphs, a collection of 15 million sketches extracted from real-world CAD models coupled with an open-source data processing pipeline. Each sketch is represented as a geometric constraint graph where edges denote designer-imposed geometric relationships between primitives, the nodes of the graph. We demonstrate and establish benchmarks for two use cases of the dataset: generative modeling of sketches and conditional generation of likely constraints given unconstrained geometry.