title: B-Spline basis Hartree-Fock method for arbitrary central potentials: atoms, clusters and electron gas

abstract: An implementation of the Hartree-Fock (HF) method capable of robust convergence for well-behaved arbitrary central potentials is presented. The Hartree-Fock equations are converted to a generalized eigenvalue problem by employing a B-spline basis in a finite-size box. Convergence of the self-consistency iterations for the occupied electron orbitals is achieved by increasing the magnitude of the electron-electron Coulomb interaction gradually to its true value. For the Coulomb central potential, convergence patterns and energies are presented for a selection of atoms and negative ions, and are benchmarked against existing calculations. The present approach is also tested by calculating the ground states for an electron gas confined by a harmonic potential and also by that of uniformly charged sphere (the jellium model of alkali-metal clusters). For the harmonically confined electron-gas problem, comparisons are made with the Thomas-Fermi method and its accurate asymptotic analytical solution, with close agreement found for the electron energy and density for large electron numbers. We test the accuracy and effective completeness of the excited state manifolds by calculating the static dipole polarizabilities at the HF level and using the Random-Phase Approximation. Using the latter is crucial for the electron-gas and cluster models, where the effect of electron screening is very important. Comparisons are made for with experimental data for sodium clusters of up to $\sim $100 atoms.

categories: physics.atom-ph cond-mat.str-el physics.atm-clus quant-ph


title: Continual Neural Mapping: Learning An Implicit Scene Representation from Sequential Observations

abstract: Recent advances have enabled a single neural network to serve as an implicit scene representation, establishing the mapping function between spatial coordinates and scene properties. In this paper, we make a further step towards continual learning of the implicit scene representation directly from sequential observations, namely Continual Neural Mapping. The proposed problem setting bridges the gap between batch-trained implicit neural representations and commonly used streaming data in robotics and vision communities. We introduce an experience replay approach to tackle an exemplary task of continual neural mapping: approximating a continuous signed distance function (SDF) from sequential depth images as a scene geometry representation. We show for the first time that a single network can represent scene geometry over time continually without catastrophic forgetting, while achieving promising trade-offs between accuracy and efficiency.


title: The evolution of lithium in FGK dwarf stars: The Li rotation connection and the Li desert

abstract: We investigate two topics regarding solar mass FGK-type stars, the lithium rotation connection (LRC) and the existence of the "lithium desert". We determine the minimum critical rotation velocity ($v \sin i$) related with the LRC separating slow from rapid stellar rotators, as being 5 km s$^{-1}$. This value also split different stellar properties. For the first time we explore the behaviour of the LRC for some stellar associations with ages between 45 Myr and 120 Myr. This allows us to study the LRC age dependence at the beginning of the general spin down stage for low mass stars, which starts at $\sim$ 30-40 Myr. We find that each stellar group presents a characteristic minimum lithium (Li) depletion connected to a specific large rotation velocity and that this minimum changes with age. For instance, this minimum changes from $\sim$ 50 km s$^{-1}$ to less than 20 km s$^{-1}$ in 200 Myr. Regarding the lithium desert, it was described as a limited region in the A(Li)-$T_{\rm eff}$ map containing no stars. Using $T_{\rm eff}$ from {\em Gaia} DR2 we detect 30 stars inside and/or near the same box defined originally as the Li desert. Due to their intrinsic $T_{\rm eff}$ errors some of these stars may be inside or outside the box, implying a large probability that the box contains several stars. Considering this last fact the "lithium desert" appears to be more a statistical distribution fluctuation than a real problem.


title: What Is the Trait d'Union between Retroactivity and Molecular Communication Performance Limits?

abstract: Information exchange is a critical process in all communication systems, including biological ones. The concept of retroactivity represents the loads that downstream modules apply to their upstream systems in biological circuits. This paper focuses on studying the impact of retroactivity on different biological signaling system models, which present analogies with well-known telecommunication systems. The mathematical analysis is performed both in the high and low molecular counts regime, by mean of the Chemical Master Equation and the Linear Noise Approximation, respectively. The aim is to provide analytical tools to maximize the reliable information exchange for different biomolecular circuit models. Results highlight how, in general, retroactivity harms communication performance. This negative effect can be mitigated by adding to the signaling circuit an independent upstream system that connects with the same pool of downstream systems.


title: Necessary and sufficient stability conditions for integral delay systems

abstract: A Lyapunov-Krasovskii functional with prescribed derivative whose construction does not require the stability of the system is introduced. It leads to the presentation of stability/instability theorems. By evaluating the functional at initial conditions depending on the fundamental matrix we are able to present necessary and sufficient stability conditions expressed exclusively in terms of the delay Lyapunov matrix for integral delay systems. Some examples illustrate and validate the stability conditions.


title: Particle Physics with the Pierre Auger Observatory

abstract: The Pierre Auger Observatory is the largest extensive air shower detector. Based on a hybrid system, this experiment measures the longitudinal shower development and the particles at the ground. This detection system allows the extraction of the p-air cross-section at energies much higher than the ones accessible by current colliders. It is also possible to test hadronic interaction models using correlations between different air shower observables, like the depth of shower maximum and the muon number at the ground and their fluctuations. Thanks to the low energy extension of the Pierre Auger Observatory, the muon deficit in air shower simulations can be addressed over almost three decades at the highest energies.


title: One-sided Frobenius pairs in extriangulated categories

abstract: Let $\mathscr{C}$ be an extriangulated category with a proper class $\xi$ of $\mathbb{E}$-triangles. We introduce the notions of left Frobenius pairs, left ($n$-)cotorsion pairs and left (weak) Auslander-Buchweitz contexts with respect to $\xi$ in $\mathscr{C}$. We show how to construct left cotorsion pais from left $n$-cotorsion pairs, and establish a one-to-one correspondence between left Frobenius pairs and left (weak) Auslander-Buchweitz contexts. We also study the relation between a certain class of cotorsion pairs and that of $n$-cotorsion pairs. These work generalize Ma-Zhao-Huang's results in triangulated categories and partially generalize Becerril-Mendoza-P\'{e}rez-Santiago's results in abelian categories.


title: How Optimal is Greedy Decoding for Extractive Question Answering?

abstract: Fine-tuned language models use greedy decoding to answer reading comprehension questions with relative success. However, this approach does not ensure that the answer is a span in the given passage, nor does it guarantee that it is the most probable one. Does greedy decoding actually perform worse than an algorithm that does adhere to these properties? To study the performance and optimality of greedy decoding, we present exact-extract, a decoding algorithm that efficiently finds the most probable answer span in the context. We compare the performance of T5 with both decoding algorithms on zero-shot and few-shot extractive question answering. When no training examples are available, exact-extract significantly outperforms greedy decoding. However, greedy decoding quickly converges towards the performance of exact-extract with the introduction of a few training examples, becoming more extractive and increasingly likelier to generate the most probable span as the training set grows. We also show that self-supervised training can bias the model towards extractive behavior, increasing performance in the zero-shot setting without resorting to annotated examples. Overall, our results suggest that pretrained language models are so good at adapting to extractive question answering, that it is often enough to fine-tune on a small training set for the greedy algorithm to emulate the optimal decoding strategy.


title: An Optimal Transport Approach to Estimating Causal Effects via Nonlinear Difference-in-Differences

abstract: We propose a nonlinear difference-in-differences method to estimate multivariate counterfactual distributions in classical treatment and control study designs with observational data. Our approach sheds a new light on existing approaches like the changes-in-changes and the classical semiparametric difference-in-differences estimator and generalizes them to settings with multivariate heterogeneity in the outcomes. The main benefit of this extension is that it allows for arbitrary dependence and heterogeneity in the joint outcomes. We demonstrate its utility both on synthetic and real data. In particular, we revisit the classical Card \& Krueger dataset, examining the effect of a minimum wage increase on employment in fast food restaurants; a reanalysis with our method reveals that restaurants tend to substitute full-time with part-time labor after a minimum wage increase at a faster pace. A previous version of this work was entitled "An optimal transport approach to causal inference.


title: Enhancement of photon creation through the pseudo-Hermitian dynamical Casimir effect

abstract: We analyse here the pseudo-Hermitian Dynamical Casimir effect, proposing a non-Hermitian version of the effective Law's Hamiltonian used to describe the phenomenon. We verify that the average number of created photons can be substantially increased, a result which calls the attention to the possibility of engineering the time-dependent non-Hermitian Hamiltonian we have assumed. Given the well-known difficulty in detecting the Casimir photon production, the present result reinforces the importance of pseudo-Hermitian quantum mechanics as a new chapter of quantum theory and an important tool for the amplification of Hermitian processes such as the degree of squeezing of quantum states.


title: Coherent phonon transport and minimum of thermal conductivity in LaMnO$_3$/SrMnO$_3$ superlattices

abstract: In this Letter, we present investigations of thermal transport in (LaMnO$_3$)$_n$/(SrMnO$_3$)$_n$ superlattices (SLs) with SL periods $\Lambda=2n$ between $2$ and $12$ unit cells. The analysis of the experimental data clearly reveals a minimum in the thermal conductivity $\kappa$ at $\Lambda=6$ u.c. Furthermore, we theoretically estimate the phonon mean free path to be about $3\Lambda$ in our SLs. These findings clearly show that, in a wide temperature range of $\pm 100\,$K around room temperature, thermal transport in our manganite SLs is coherent. In addition, we demonstrate that antiferromagnetic magnetic ordering can control the degree of coherency. This opens the challenging perspective for active control of coherent transport in correlated matter.


title: Constraining the orbital eccentricity of inspiralling compact binary systems with Advanced LIGO

abstract: The detection of ~50 coalescing compact binaries with the Advanced LIGO and Virgo detectors has allowed us to test general relativity, constrain merger rates, and look for evidence of tidal effects, compact object spins, higher waveform modes, and black hole ringdowns. An effect that has not yet been confidently detected is binary eccentricity, which might be present in a small fraction of binaries formed dynamically. Here we discuss general limits on eccentricity that can, in-principle, be placed on all types of compact object binaries by a detector operating at the design sensitivity of Advanced LIGO. Using a post-Newtonian model for gravitational-wave phasing valid in the small eccentricity regime, we assess the relative measurement error for eccentricity for a variety of spinning and non-spinning binaries. Errors and correlations involving the mass and spin parameters are also investigated. We find that decreasing the low frequency limit of a detector's observational frequency band is one of the key design factors for increasing the odds of measuring binary eccentricity. We also introduce and analytically explore the eccentric chirp mass parameter, which replaces the chirp mass as the key measurable parameter combination in eccentric gravitational waveform models. The eccentric chirp mass parameter explains a degeneracy between the chirp mass and the eccentricity. This degeneracy leads to a bias in the standard chirp mass parameter. We also investigate the systematic parameter bias that arises when eccentric systems are recovered using circular waveform templates. We use both Fisher matrix and Bayesian-inference-based Markov Chain Monte Carlo (MCMC) methods to investigate these parameter estimation issues, and we find good agreement between the two approaches (for both statistical and systematic errors) in the appropriate signal-to-noise ratio regime. (abridged)


title: m-RevNet: Deep Reversible Neural Networks with Momentum

abstract: In recent years, the connections between deep residual networks and first-order Ordinary Differential Equations (ODEs) have been disclosed. In this work, we further bridge the deep neural architecture design with the second-order ODEs and propose a novel reversible neural network, termed as m-RevNet, that is characterized by inserting momentum update to residual blocks. The reversible property allows us to perform backward pass without access to activation values of the forward pass, greatly relieving the storage burden during training. Furthermore, the theoretical foundation based on second-order ODEs grants m-RevNet with stronger representational power than vanilla residual networks, which potentially explains its performance gains. For certain learning scenarios, we analytically and empirically reveal that our m-RevNet succeeds while standard ResNet fails. Comprehensive experiments on various image classification and semantic segmentation benchmarks demonstrate the superiority of our m-RevNet over ResNet, concerning both memory efficiency and recognition performance.


title: Towers of Babel: Combining Images, Language, and 3D Geometry for Learning Multimodal Vision

abstract: The abundance and richness of Internet photos of landmarks and cities has led to significant progress in 3D vision over the past two decades, including automated 3D reconstructions of the world's landmarks from tourist photos. However, a major source of information available for these 3D-augmented collections---namely language, e.g., from image captions---has been virtually untapped. In this work, we present WikiScenes, a new, large-scale dataset of landmark photo collections that contains descriptive text in the form of captions and hierarchical category names. WikiScenes forms a new testbed for multimodal reasoning involving images, text, and 3D geometry. We demonstrate the utility of WikiScenes for learning semantic concepts over images and 3D models. Our weakly-supervised framework connects images, 3D structure, and semantics---utilizing the strong constraints provided by 3D geometry---to associate semantic concepts to image pixels and 3D points.


title: Experimentally bounding deviations from quantum theory for a photonic three-level system using theory-agnostic tomography

abstract: If one seeks to test quantum theory against many alternatives in a landscape of possible physical theories, then it is crucial to be able to analyze experimental data in a theory-agnostic way. This can be achieved using the framework of Generalized Probabilistic Theories (GPTs). Here, we implement GPT tomography on a three-level system corresponding to a single photon shared among three modes. This scheme achieves a GPT characterization of each of the preparations and measurements implemented in the experiment without requiring any prior characterization of either. Assuming that the sets of realized preparations and measurements are tomographically complete, our analysis identifies the most likely dimension of the GPT vector space describing the three-level system to be nine, in agreement with the value predicted by quantum theory. Relative to this dimension, we infer the scope of GPTs that are consistent with our experimental data by identifying polytopes that provide inner and outer bounds for the state and effect spaces of the true GPT. From these, we are able to determine quantitative bounds on possible deviations from quantum theory. In particular, we bound the degree to which the no-restriction hypothesis might be violated for our three-level system.


title: Dissipative dynamics in the free massive boson limit of the sine-Gordon model

abstract: We study the dissipative dynamics of one-dimensional fermions, described in terms of the sine-Gordon model in its free massive boson or semi-classical limit, while keeping track of forward scattering processes. The system is prepared in the gapped ground state, and then coupled to environment through local currents within the Lindblad formalism. The heating dynamics of the system is followed using bosonization. The single particle density matrix exhibits correlations between the left and right moving particles. While the density matrix of right movers and left movers is translationally invariant, the left-right sector is not, corresponding to a translational symmetry breaking charge density wave state. Asymptotically, the single particle density matrix decays exponentially with exponent proportional to $-\gamma t|x|\Delta^2$ where $\gamma$ and $\Delta$ are the dissipative coupling and the gap, respectively. The charge density wave order parameter decays exponentially in time with an interaction independent decay rate. The second R\'enyi entropy grows linearly with time and is essentially insensitive to the presence of the gap.


title: Improving Ranking Correlation of Supernet with Candidates Enhancement and Progressive Training

abstract: One-shot neural architecture search (NAS) applies weight-sharing supernet to reduce the unaffordable computation overhead of automated architecture designing. However, the weight-sharing technique worsens the ranking consistency of performance due to the interferences between different candidate networks. To address this issue, we propose a candidates enhancement method and progressive training pipeline to improve the ranking correlation of supernet. Specifically, we carefully redesign the sub-networks in the supernet and map the original supernet to a new one of high capacity. In addition, we gradually add narrow branches of supernet to reduce the degree of weight sharing which effectively alleviates the mutual interference between sub-networks. Finally, our method ranks the 1st place in the Supernet Track of CVPR2021 1st Lightweight NAS Challenge.


title: Investigating a New Approach to Quasinormal Modes: Physics-Informed Neural Networks

abstract: Physics-informed neural networks (PINNs) hold the potential for supplementing the existing set of techniques for solving differential equations that emerge in the study of black hole quasinormal modes. The present research investigated them by studying black hole perturbation equations with known analytical solutions and thus could be framed as inverse problems in PINNs. Our main goal was to test the accuracy of PINNs in computing unknown quasinormal frequencies within the differential equations. The black hole perturbation scenarios that we considered included near extremal Schwarzschild-de Sitter and Reissner-Nordstr\"{o}m-de Sitter black holes, and a toy problem resembling them. For these cases, it was shown that PINNs could compute the QNFs with up to 4 digit decimal accuracy for the lowest multipole number, $l$, and lowest mode number, $n$.


title: A Semi-Lagrangian Approach for the Minimal Exposure Path Problem in Wireless Sensor Networks

abstract: A critical metric of the coverage quality in Wireless Sensor Networks (WSNs) is the Minimal Exposure Path (MEP), a path through the environment that least exposes an intruder to the sensor detecting nodes. Many approaches have been proposed in the last decades to solve this optimization problem, ranging from classic (grid-based and Voronoi-based) planners to genetic meta-heuristics. However, most of them are limited to specific sensing models and obstacle-free spaces. Still, none of them guarantee an optimal solution, and the state-of-the-art is expensive in terms of run-time. Therefore, in this paper, we propose a novel method that models the MEP as an Optimal Control problem and solves it by using a Semi-Lagrangian approach. This framework is shown to converge to the optimal MEP while also incorporates different homogeneous and heterogeneous sensor models and geometric constraints (obstacles). Experiments show that our method dominates the state-of-the-art, improving the results by approximately 10% with a relatively lower execution time.


title: Syntax Matters! Syntax-Controlled in Text Style Transfer

abstract: Existing text style transfer (TST) methods rely on style classifiers to disentangle the text's content and style attributes for text style transfer. While the style classifier plays a critical role in existing TST methods, there is no known investigation on its effect on the TST methods. In this paper, we conduct an empirical study on the limitations of the style classifiers used in existing TST methods. We demonstrate that the existing style classifiers cannot learn sentence syntax effectively and ultimately worsen existing TST models' performance. To address this issue, we propose a novel Syntax-Aware Controllable Generation (SACG) model, which includes a syntax-aware style classifier that ensures learned style latent representations effectively capture the syntax information for TST. Through extensive experiments on two popular TST tasks, we show that our proposed method significantly outperforms the state-of-the-art methods. Our case studies have also demonstrated SACG's ability to generate fluent target-style sentences that preserved the original content.


title: Quantized Nonlinear Conductance in Ballistic Metals

abstract: We introduce a non-linear frequency dependent D+1 terminal conductance that characterizes a D dimensional Fermi gas, generalizing the Landauer conductance in D=1. For a 2D ballistic conductor we show that this conductance is quantized and probes the Euler characteristic of the Fermi sea. We critically address the roles of electrical contacts and of Fermi liquid interactions, and we propose experiments on 2D Dirac materials such as graphene using a triple point contact geometry.


title: Lower bounds on Betti numbers

abstract: We survey recent results on bounds for Betti numbers of modules over polynomial rings, with an emphasis on lower bounds. Along the way, we give a gentle introduction to free resolutions and Betti numbers, and discuss some of the reasons why one would study these.


title: HAC Explore: Accelerating Exploration with Hierarchical Reinforcement Learning

abstract: Sparse rewards and long time horizons remain challenging for reinforcement learning algorithms. Exploration bonuses can help in sparse reward settings by encouraging agents to explore the state space, while hierarchical approaches can assist with long-horizon tasks by decomposing lengthy tasks into shorter subtasks. We propose HAC Explore (HACx), a new method that combines these approaches by integrating the exploration bonus method Random Network Distillation (RND) into the hierarchical approach Hierarchical Actor-Critic (HAC). HACx outperforms either component method on its own, as well as an existing approach to combining hierarchy and exploration, in a set of difficult simulated robotics tasks. HACx is the first RL method to solve a sparse reward, continuous-control task that requires over 1,000 actions.


title: Reverse Order Law for Generalized Inverses with Indefinite Hermitian Weights

abstract: In this paper, necessary and sufficient conditions are given for the existence of Moore-Penrose inverse of a product of two matrices in an indefinite inner product space (IIPS) in which reverse order law holds good. Rank equivalence formulas with respect to IIPS are provided and an open problem is given at the end.


title: Galaxy interactions in different environments: An analysis of galaxy pairs from the SDSS

abstract: We analyze the galaxy pairs in a volume limited sample ($M_r \leq -21$) from the SDSS to study the effects of galaxy interactions on the star formation rate and colour of galaxies in different environments. We study the star formation rate and colour of the paired galaxies as a function of projected separation and compare the results with their control samples matched in stellar mass, redshift and local density. We find that the major interactions significantly enhance the star formation rate in paired galaxies and turn them bluer with decreasing pair separation within $30$ kpc. The impact of tidal interactions on star formation rate and colour are more significant in the heavier members of the major pairs. The star formation enhancement in major pairs is significantly higher at the low-density environments, where the influence can extend up to $\sim 100$ kpc. Contrarily, the major pairs at high-density environments show suppression in their star formation. Depending on the embedding environments, the major interactions in the intrinsically brighter galaxy pairs can thus enhance or quench star formation. We find that the minor pairs at both low-density and high-density environments are significantly less star-forming and redder than their control galaxies. It indicates that the minor interactions in intrinsically brighter galaxy pairs always suppress the star formation irrespective of their environment. The lighter members in these minor pairs show a greater susceptibility to suppressed star formation. Our results imply that both the major and minor interactions can contribute to the observed bimodality. We conclude that the galaxy evolution is determined by a complex interplay between the galaxy properties, galaxy interactions, and environment.


title: Distributional Depth-Based Estimation of Object Articulation Models

abstract: We propose a method that efficiently learns distributions over articulation model parameters directly from depth images without the need to know articulation model categories a priori. By contrast, existing methods that learn articulation models from raw observations typically only predict point estimates of the model parameters, which are insufficient to guarantee the safe manipulation of articulated objects. Our core contributions include a novel representation for distributions over rigid body transformations and articulation model parameters based on screw theory, von Mises-Fisher distributions, and Stiefel manifolds. Combining these concepts allows for an efficient, mathematically sound representation that implicitly satisfies the constraints that rigid body transformations and articulations must adhere to. Leveraging this representation, we introduce a novel deep learning based approach, DUST-net, that performs category-independent articulation model estimation while also providing model uncertainties. We evaluate our approach on several benchmarking datasets and real-world objects and compare its performance with two current state-of-the-art methods. Our results demonstrate that DUST-net can successfully learn distributions over articulation models for novel objects across articulation model categories, which generate point estimates with better accuracy than state-of-the-art methods and effectively capture the uncertainty over predicted model parameters due to noisy inputs. Project webpage: https://pearl-utexas.github.io/DUST-net/


title: An Early Look at the Gettr Social Network

abstract: This paper presents the first data-driven analysis of Gettr, a new social network platform launched by former US President Donald Trump's team. Among other things, we find that users on the platform heavily discuss politics, with a focus on the Trump campaign in the US and Bolsonaro's in Brazil. Activity on the platform has steadily been decreasing since its launch, although a core of verified users and early adopters kept posting and become central to it. Finally, although toxicity has been increasing over time, the average level of toxicity is still lower than the one recently observed on other fringe social networks like Gab and 4chan. Overall, we provide a first quantitative look at this new community, observing a lack of organic engagement and activity.


title: DexMV: Imitation Learning for Dexterous Manipulation from Human Videos

abstract: While significant progress has been made on understanding hand-object interactions in computer vision, it is still very challenging for robots to perform complex dexterous manipulation. In this paper, we propose a new platform and pipeline DexMV (Dexterous Manipulation from Videos) for imitation learning. We design a platform with: (i) a simulation system for complex dexterous manipulation tasks with a multi-finger robot hand and (ii) a computer vision system to record large-scale demonstrations of a human hand conducting the same tasks. In our novel pipeline, we extract 3D hand and object poses from videos, and propose a novel demonstration translation method to convert human motion to robot demonstrations. We then apply and benchmark multiple imitation learning algorithms with the demonstrations. We show that the demonstrations can indeed improve robot learning by a large margin and solve the complex tasks which reinforcement learning alone cannot solve. More details can be found in the project page: https://yzqin.github.io/dexmv


title: Semiconductor Epitaxy in Superconducting Templates

abstract: Integration of high quality semiconductor-superconductor devices into scalable and CMOS compatible architectures remains an outstanding challenge, currently hindering their practical implementation. Here, we demonstrate growth of InAs nanowires monolithically integrated on Si inside lateral cavities containing superconducting TiN elements. This technique allows growth of hybrid devices characterized by sharp semiconductor-superconductor interfaces and with alignment along arbitrary crystallographic directions. Electrical characterization at low temperature reveals proximity induced superconductivity in InAs via a transparent interface.


title: Feature Engineering with Regularity Structures

abstract: We investigate the use of models from the theory of regularity structures as features in machine learning tasks. A model is a polynomial function of a space-time signal designed to well-approximate solutions to partial differential equations (PDEs), even in low regularity regimes. Models can be seen as natural multi-dimensional generalisations of signatures of paths; our work therefore aims to extend the recent use of signatures in data science beyond the context of time-ordered data. We provide a flexible definition of a model feature vector associated to a space-time signal, along with two algorithms which illustrate ways in which these features can be combined with linear regression. We apply these algorithms in several numerical experiments designed to learn solutions to PDEs with a given forcing and boundary data. Our experiments include semi-linear parabolic and wave equations with forcing, and Burgers' equation with no forcing. We find an advantage in favour of our algorithms when compared to several alternative methods. Additionally, in the experiment with Burgers' equation, we find non-trivial predictive power when noise is added to the observations.


title: Observation of ultracold atomic bubbles in orbital microgravity

abstract: Significant leaps in the understanding of quantum systems have been driven by the exploration of geometry, topology, dimensionality, and interactions with ultracold atomic ensembles. A system where atoms evolve while confined on an ellipsoidal surface represents a heretofore unexplored geometry and topology. Realizing such an ultracold bubble system (potentially Bose-Einstein condensed) has areas of interest including quantized-vortex flow respecting topological constraints imposed by closed surfaces, new collective modes, and self-interference via free bubble expansion. Large ultracold bubbles, created by inflating smaller condensates, directly tie into Hubble-analog expansion physics. Here, we report observations from the NASA Cold Atom Lab facility aboard the International Space Station of bubbles of ultracold atoms created using a radiofrequency-dressing protocol. We observe a variety of bubble configurations of differing sizes and initial temperature, and explore bubble thermodynamics, demonstrating significant cooling associated with inflation. Additionally, we achieve partial coverings of bubble traps greater than 1 mm in size with ultracold films of inferred few-$\mu$m thickness, and we observe the dynamics of shell structures projected into free-evolving harmonic confinement. The observations are part of the first generation of scientific measurements made with ultracold atoms in space, exploiting the benefits of perpetual free-fall to explore gravity-free evolution of quantum systems that are prohibitively difficult to create on Earth. This work points the way to experiments focused on the nature of the Bose-Einstein condensed bubble, the character of its excitations, and the role of topology in its evolution; it also ushers in an era of orbital microgravity quantum-gas physics.


title: Multi-user Joint Maximum-Likelihood Detection in Uplink NOMA-IoT Networks: Removing the Error Floor

abstract: The Internet of Things (IoT) framework requires a massive number of connection thus demanding spectral efficient solutions such as Non-Orthogonal Multiple Access (NOMA). However, the main drawback of NOMA with successive interference canceler (SIC)-based detectors is the error floor in the uplink. In this paper, a reliable multi-user detection in uplink IoT NOMA is guaranteed by a Joint Maximum-Likelihood (JML) detector (i.e., optimum detection algorithm). We derive a closed-form upper bound of bit error rate (BER) of JML over Rayleigh fading channels for arbitrary number of IoT devices and an adaptive M-ary phase shift keying (M-PSK). Based on the extensive simulations, the derived expressions are validated and it is revealed that the JML improves the error performance in uplink NOMA and removes the error floor. Furthermore, regardless of the number of the IoT devices and modulation order, a full diversity order (i.e., number of receiving antennas) is guaranteed for each device.


title: An optical flow approach to tracking ship track behavior using GOES-R satellite imagery

abstract: Ship emissions can form linear cloud structures, or ship tracks, when atmospheric water vapor condenses on aerosols in the ship exhaust. These structures are of interest because they are observable and traceable examples of marine cloud brightening, a mechanism that has been studied as a potential approach for solar climate intervention. Ship tracks can be observed throughout the diurnal cycle via space-borne assets like the Advanced Baseline Imagers on the National Oceanic and Atmospheric Administration Geostationary Operational Environmental Satellites, the GOES-R series. Due to complex atmospheric dynamics, it can be difficult to track these aerosol perturbations over space and time to precisely characterize how long a single emission source can significantly contribute to indirect radiative forcing. We propose an optical flow approach to estimate the trajectories of ship-emitted aerosols after they begin mixing with low boundary layer clouds using GOES-17 satellite imagery. Most optical flow estimation methods have only been used to estimate large scale atmospheric motion. We demonstrate the ability of our approach to precisely isolate the movement of ship tracks in low-lying clouds from the movement of large swaths of high clouds that often dominate the scene. This efficient approach shows that ship tracks persist as visible, linear features beyond 9 hours and sometimes longer than 24 hours.


title: Generalized Principal Pivot Transform and its Inheritance Properties

abstract: In this paper, some more properties of the generalized principal pivot transform are derived. Necessary and sufficient conditions for the equality between Moore-Penrose inverse of a generalized principal pivot transform and its complementary generalized principal pivot transform are presented. It has been shown that the generalized principal pivot transform preserves the rank of symmetric part of a given square matrix. These results appear to be more generalized than the existing ones. Inheritance property of $P_{\dagger}$-matrix are also characterized for generalized principal pivot transform.


title: Unconditional Scene Graph Generation

abstract: Despite recent advancements in single-domain or single-object image generation, it is still challenging to generate complex scenes containing diverse, multiple objects and their interactions. Scene graphs, composed of nodes as objects and directed-edges as relationships among objects, offer an alternative representation of a scene that is more semantically grounded than images. We hypothesize that a generative model for scene graphs might be able to learn the underlying semantic structure of real-world scenes more effectively than images, and hence, generate realistic novel scenes in the form of scene graphs. In this work, we explore a new task for the unconditional generation of semantic scene graphs. We develop a deep auto-regressive model called SceneGraphGen which can directly learn the probability distribution over labelled and directed graphs using a hierarchical recurrent architecture. The model takes a seed object as input and generates a scene graph in a sequence of steps, each step generating an object node, followed by a sequence of relationship edges connecting to the previous nodes. We show that the scene graphs generated by SceneGraphGen are diverse and follow the semantic patterns of real-world scenes. Additionally, we demonstrate the application of the generated graphs in image synthesis, anomaly detection and scene graph completion.


title: The paradox of the compositionality of natural language: a neural machine translation case study

abstract: Obtaining human-like performance in NLP is often argued to require compositional generalisation. Whether neural networks exhibit this ability is usually studied by training models on highly compositional synthetic data. However, compositionality in natural language is much more complex than the rigid, arithmetic-like version such data adheres to, and artificial compositionality tests thus do not allow us to determine how neural models deal with more realistic forms of compositionality. In this work, we re-instantiate three compositionality tests from the literature and reformulate them for neural machine translation (NMT). Our results highlight that: i) unfavourably, models trained on more data are more compositional; ii) models are sometimes less compositional than expected, but sometimes more, exemplifying that different levels of compositionality are required, and models are not always able to modulate between them correctly; iii) some of the non-compositional behaviours are mistakes, whereas others reflect the natural variation in data. Apart from an empirical study, our work is a call to action: we should rethink the evaluation of compositionality in neural networks and develop benchmarks using real data to evaluate compositionality on natural language, where composing meaning is not as straightforward as doing the math.


title: Geometry of the minimal solutions of a linear Diophantine Equation

abstract: Let $a_1,\ldots,a_n$ and $b_1,\ldots,b_m$ be fixed positive integers, and let ${\mathcal S}$ denote the set of all nonnegative integer solutions of the equation $x_1a_1+\ldots +x_na_n=y_1b_1+\ldots +y_mb_m$. A solution $(x_1,\ldots,x_n,y_1,\ldots,y_m)$ in ${\mathcal S}$ is called $\textit{minimal}$ if it cannot be expressed as the sum of two nonzero solutions in ${\mathcal S}$. For each pair $(i,j)$ with $1\leq i\leq n$ and $1\leq j\leq m$, the solution whose only nonzero coordinates are $x_i=b_j$ and $y_j=a_i$ is called a $\textit{generator}$. Our main result shows that every minimal solution is a convex combination of the generators and the zero-solution. This proves a conjecture of Henk-Weismantel and, independently, Ho\c{s}ten-Sturmfels.


title: Billion-Scale Pretraining with Vision Transformers for Multi-Task Visual Representations

abstract: Large-scale pretraining of visual representations has led to state-of-the-art performance on a range of benchmark computer vision tasks, yet the benefits of these techniques at extreme scale in complex production systems has been relatively unexplored. We consider the case of a popular visual discovery product, where these representations are trained with multi-task learning, from use-case specific visual understanding (e.g. skin tone classification) to general representation learning for all visual content (e.g. embeddings for retrieval). In this work, we describe how we (1) generate a dataset with over a billion images via large weakly-supervised pretraining to improve the performance of these visual representations, and (2) leverage Transformers to replace the traditional convolutional backbone, with insights into both system and performance improvements, especially at 1B+ image scale. To support this backbone model, we detail a systematic approach to deriving weakly-supervised image annotations from heterogenous text signals, demonstrating the benefits of clustering techniques to handle the long-tail distribution of image labels. Through a comprehensive study of offline and online evaluation, we show that large-scale Transformer-based pretraining provides significant benefits to industry computer vision applications. The model is deployed in a production visual shopping system, with 36% improvement in top-1 relevance and 23% improvement in click-through volume. We conduct extensive experiments to better understand the empirical relationships between Transformer-based architectures, dataset scale, and the performance of production vision systems.


title: Multiview Detection with Shadow Transformer (and View-Coherent Data Augmentation)

abstract: Multiview detection incorporates multiple camera views to deal with occlusions, and its central problem is multiview aggregation. Given feature map projections from multiple views onto a common ground plane, the state-of-the-art method addresses this problem via convolution, which applies the same calculation regardless of object locations. However, such translation-invariant behaviors might not be the best choice, as object features undergo various projection distortions according to their positions and cameras. In this paper, we propose a novel multiview detector, MVDeTr, that adopts a newly introduced shadow transformer to aggregate multiview information. Unlike convolutions, shadow transformer attends differently at different positions and cameras to deal with various shadow-like distortions. We propose an effective training scheme that includes a new view-coherent data augmentation method, which applies random augmentations while maintaining multiview consistency. On two multiview detection benchmarks, we report new state-of-the-art accuracy with the proposed system. Code is available at https://github.com/hou-yz/MVDeTr.


title: Towards Interpretable Deep Metric Learning with Structural Matching

abstract: How do the neural networks distinguish two images? It is of critical importance to understand the matching mechanism of deep models for developing reliable intelligent systems for many risky visual applications such as surveillance and access control. However, most existing deep metric learning methods match the images by comparing feature vectors, which ignores the spatial structure of images and thus lacks interpretability. In this paper, we present a deep interpretable metric learning (DIML) method for more transparent embedding learning. Unlike conventional metric learning methods based on feature vector comparison, we propose a structural matching strategy that explicitly aligns the spatial embeddings by computing an optimal matching flow between feature maps of the two images. Our method enables deep models to learn metrics in a more human-friendly way, where the similarity of two images can be decomposed to several part-wise similarities and their contributions to the overall similarity. Our method is model-agnostic, which can be applied to off-the-shelf backbone networks and metric learning methods. We evaluate our method on three major benchmarks of deep metric learning including CUB200-2011, Cars196, and Stanford Online Products, and achieve substantial improvements over popular metric learning methods with better interpretability. Code is available at https://github.com/wl-zhao/DIML


title: On the Effectiveness of Transfer Learning for Code Search

abstract: The Transformer architecture and transfer learning have marked a quantum leap in natural language processing, improving the state of the art across a range of text-based tasks. This paper examines how these advancements can be applied to and improve code search. To this end, we pre-train a BERT-based model on combinations of natural language and source code data and fine-tune it on pairs of StackOverflow question titles and code answers. Our results show that the pre-trained models consistently outperform the models that were not pre-trained. In cases where the model was pre-trained on natural language "and" source code data, it also outperforms an information retrieval baseline based on Lucene. Also, we demonstrated that the combined use of an information retrieval-based approach followed by a Transformer leads to the best results overall, especially when searching into a large search pool. Transfer learning is particularly effective when much pre-training data is available and fine-tuning data is limited. We demonstrate that natural language processing models based on the Transformer architecture can be directly applied to source code analysis tasks, such as code search. With the development of Transformer models designed more specifically for dealing with source code data, we believe the results of source code analysis tasks can be further improved.


title: Page-level Optimization of e-Commerce Item Recommendations

abstract: The item details page (IDP) is a web page on an e-commerce website that provides information on a specific product or item listing. Just below the details of the item on this page, the buyer can usually find recommendations for other relevant items. These are typically in the form of a series of modules or carousels, with each module containing a set of recommended items. The selection and ordering of these item recommendation modules are intended to increase discover-ability of relevant items and encourage greater user engagement, while simultaneously showcasing diversity of inventory and satisfying other business objectives. Item recommendation modules on the IDP are often curated and statically configured for all customers, ignoring opportunities for personalization. In this paper, we present a scalable end-to-end production system to optimize the personalized selection and ordering of item recommendation modules on the IDP in real-time by utilizing deep neural networks. Through extensive offline experimentation and online A/B testing, we show that our proposed system achieves significantly higher click-through and conversion rates compared to other existing methods. In our online A/B test, our framework improved click-through rate by 2.48% and purchase-through rate by 7.34% over a static configuration.


title: PixelSynth: Generating a 3D-Consistent Experience from a Single Image

abstract: Recent advancements in differentiable rendering and 3D reasoning have driven exciting results in novel view synthesis from a single image. Despite realistic results, methods are limited to relatively small view change. In order to synthesize immersive scenes, models must also be able to extrapolate. We present an approach that fuses 3D reasoning with autoregressive modeling to outpaint large view changes in a 3D-consistent manner, enabling scene synthesis. We demonstrate considerable improvement in single image large-angle view synthesis results compared to a variety of methods and possible variants across simulated and real datasets. In addition, we show increased 3D consistency compared to alternative accumulation methods. Project website: https://crockwell.github.io/pixelsynth/


title: On automorphisms of the double cover of a circulant graph

abstract: A graph $X$ is said to be "unstable" if the direct product $X \times K_2$ (also called the canonical double cover of $X$) has automorphisms that do not come from automorphisms of its factors $X$ and $K_2$. It is "nontrivially unstable" if it is unstable, connected, and nonbipartite, and no two distinct vertices of X have exactly the same neighbors. We find three new conditions that each imply a circulant graph is unstable. (These yield infinite families of nontrivially unstable circulant graphs that were not previously known.) We also find all of the nontrivially unstable circulant graphs of order $2p$, where $p$ is any prime number. Our results imply that there does not exist a nontrivially unstable circulant graph of order $n$ if and only if either $n$ is odd, or $n < 8$, or $n = 2p$, for some prime number $p$ that is congruent to $3$ modulo $4$.


title: MicroNet: Improving Image Recognition with Extremely Low FLOPs

abstract: This paper aims at addressing the problem of substantial performance degradation at extremely low computational cost (e.g. 5M FLOPs on ImageNet classification). We found that two factors, sparse connectivity and dynamic activation function, are effective to improve the accuracy. The former avoids the significant reduction of network width, while the latter mitigates the detriment of reduction in network depth. Technically, we propose micro-factorized convolution, which factorizes a convolution matrix into low rank matrices, to integrate sparse connectivity into convolution. We also present a new dynamic activation function, named Dynamic Shift Max, to improve the non-linearity via maxing out multiple dynamic fusions between an input feature map and its circular channel shift. Building upon these two new operators, we arrive at a family of networks, named MicroNet, that achieves significant performance gains over the state of the art in the low FLOP regime. For instance, under the constraint of 12M FLOPs, MicroNet achieves 59.4\% top-1 accuracy on ImageNet classification, outperforming MobileNetV3 by 9.6\%. Source code is at \href{https://github.com/liyunsheng13/micronet}{https://github.com/liyunsheng13/micronet}.


title: Mobile-Former: Bridging MobileNet and Transformer

abstract: We present Mobile-Former, a parallel design of MobileNet and transformer with a two-way bridge in between. This structure leverages the advantages of MobileNet at local processing and transformer at global interaction. And the bridge enables bidirectional fusion of local and global features. Different from recent works on vision transformer, the transformer in Mobile-Former contains very few tokens (e.g. 6 or fewer tokens) that are randomly initialized to learn global priors, resulting in low computational cost. Combining with the proposed light-weight cross attention to model the bridge, Mobile-Former is not only computationally efficient, but also has more representation power. It outperforms MobileNetV3 at low FLOP regime from 25M to 500M FLOPs on ImageNet classification. For instance, Mobile-Former achieves 77.9\% top-1 accuracy at 294M FLOPs, gaining 1.3\% over MobileNetV3 but saving 17\% of computations. When transferring to object detection, Mobile-Former outperforms MobileNetV3 by 8.6 AP in RetinaNet framework. Furthermore, we build an efficient end-to-end detector by replacing backbone, encoder and decoder in DETR with Mobile-Former, which outperforms DETR by 1.1 AP but saves 52\% of computational cost and 36\% of parameters.


title: Gravitational Causality and the Self-Stress of Photons

abstract: We study causality in gravitational systems beyond the classical limit. Using on-shell methods, we consider the one-loop corrections from charged particles to the photon energy-momentum tensor - the self-stress - that controls the quantum interaction between two on-shell photons and one off-shell graviton. The self-stress determines in turn the phase shift and time delay in the scattering of photons against a spectator particle of any spin in the eikonal regime. We show that the sign of the $\beta$-function associated to the running gauge coupling is related to the sign of time delay at small impact parameter. Our results show that, at first post-Minkowskian order, asymptotic causality, where the time delay experienced by any particle must be positive, is respected quantum mechanically. Contrasted with asymptotic causality, we explore a local notion of causality, where the time delay is longer than the one of gravitons, which is seemingly violated by quantum effects.


title: Scale and Weyl Invariance in Einstein-Cartan Gravity

abstract: We show how Einstein-Cartan gravity can accommodate both global scale and local scale (Weyl) invariance. To this end, we construct a wide class of models with nonpropagaing torsion and a nonminimally coupled scalar field. In phenomenological applications the scalar field is associated with the Higgs boson. For global scale invariance, an additional field -- dilaton -- is needed to make the theory phenomenologically viable. In the case of the Weyl symmetry, the dilaton is spurious and the theory reduces to a sub-class of one-field models. In both scenarios of scale invariance, we derive an equivalent metric theory and discuss possible implications for phenomenology.


title: Hierarchical Power Flow Control in Smart Grids: Enhancing Rotor Angle and Frequency Stability with Demand-Side Flexibility

abstract: Large-scale integration of renewables in power systems gives rise to new challenges for keeping synchronization and frequency stability in volatile and uncertain power flow states. To ensure the safety of operation, the system must maintain adequate disturbance rejection capability at the time scales of both rotor angle and system frequency dynamics. This calls for flexibility to be exploited on both the generation and demand sides, compensating volatility and ensuring stability at the two separate time scales. This article proposes a hierarchical power flow control architecture that involves both transmission and distribution networks as well as individual buildings to enhance both small-signal rotor angle stability and frequency stability of the transmission network. The proposed architecture consists of a transmission-level optimizer enhancing system damping ratios, a distribution-level controller following transmission commands and providing frequency support, and a building-level scheduler accounting for quality of service and following the distribution-level targets. We validate the feasibility and performance of the whole control architecture through real-time hardware-in-loop tests involving real-world transmission and distribution network models along with real devices at the Stone Edge Farm Microgrid.

categories: eess.SY cond-mat.dis-nn cs.SY nlin.AO physics.soc-ph


title: On Bloch norm and Bohr phenomenon for harmonic Bloch functions on simply connected domains

abstract: In this article, we introduce the class $\mathcal{B}^{*}_{\mathcal{H},\Omega}(\alpha)$ of harmonic $\alpha$-Bloch-type mappings on $\Omega$ as a generalization of the class $\mathcal{B}_{\mathcal{H},\Omega}(\alpha)$ of harmonic $\alpha$-Bloch mappings on $\Omega$, where $\Omega$ is arbitrary proper simply connected domain in the complex plane. We study several interesting properties of the classes $\mathcal{B}_{\mathcal{H},\Omega}(\alpha)$ and $\mathcal{B}^{*}_{\mathcal{H},\Omega}(\alpha)$ on arbitrary proper simply connected domain $\Omega$ and on the shifted disk $\Omega_{\gamma}$ containing $\mathbb{D}$, where $$ \Omega_{\gamma}:=\bigg\{z\in\mathbb{C} : \bigg|z+\frac{\gamma}{1-\gamma}\bigg|<\frac{1}{1-\gamma}\bigg\ $$ and $0 \leq \gamma <1$. We establish the Landau's theorem for the harmonic Bloch space $\mathcal{B}_{\mathcal{H},\Omega _{\gamma}}(\alpha)$ on the shifted disk $\Omega_{\gamma}$. For $f \in \mathcal{B}_{\mathcal{H},\Omega}(\alpha)$ (respectively $\mathcal{B}^{*}_{\mathcal{H},\Omega}(\alpha)$) of the form $f(z)=h(z) + \overline{g(z)}=\sum_{n=0}^{\infty}a_nz^n + \overline{\sum_{n=1}^{\infty}b_nz^n}$ in $\mathbb{D}$ with Bloch norm $||f||_{\mathcal{H},\Omega, \alpha} \leq 1$ (respectively $||f||^{*}_{\mathcal{H},\Omega, \alpha} \leq 1$), we define the Bloch-Bohr radius for the space $\mathcal{B}_{\mathcal{H},\Omega}(\alpha)$ (respectively $\mathcal{B}^{*}_{\mathcal{H},\Omega}(\alpha)$) to be the largest radius $r_{\Omega,f} \in (0,1)$ such that $\sum_{n=0}^{\infty}(|a_n|+|b_{n}|) r^n\leq 1$ for $r \leq r_{\Omega, \alpha}$ and for all $f \in \mathcal{B}_{\mathcal{H},\Omega}(\alpha)$ (respectively $\mathcal{B}^{*}_{\mathcal{H},\Omega}(\alpha)$). We investigate Bloch-Bohr radius for the classes $\mathcal{B}_{\mathcal{H},\Omega}(\alpha)$ and $\mathcal{B}^{*}_{\mathcal{H},\Omega}(\alpha)$ on simply connected domain $\Omega$ containing $\mathbb{D}$.


title: Dark Sector Production via Proton Bremsstrahlung

abstract: Experiments using proton beams at high luminosity colliders and fixed target facilities provide impressive sensitivity to new light weakly coupled degrees of freedom. With these experiments in mind, we revisit the production of dark vectors and scalars via proton bremsstrahlung, making use of a model that describes the underlying nucleon scattering cross-section in the forward direction due to pomeron exchange. We compare the resulting distributions and rates with those obtained via variants of the Fermi-Weizsacker-Williams approximation, and provide production rate distributions for a range of beam energies, including those relevant for the proposed Forward Physics Facility at the High Luminosity-LHC.


title: Bayesian quantum thermometry based on thermodynamic length

abstract: In this work, we propose a theory of temperature estimation of quantum systems, which is applicable in the regime of non-negligible prior temperature uncertainty and limited measurement data. In this regime the problem of establishing a well-defined measure of estimation precision becomes non-trivial, and furthermore the construction of a suitable criterion for optimal measurement design must be re-examined to account for the prior uncertainty. We propose a fully Bayesian approach to temperature estimation based on the concept of thermodynamic length, which solves both these problems. As an illustration of this framework, we consider thermal spin-$1/2$ particles and investigate the fundamental difference between two cases; on the one hand, when the spins are probing the temperature of a heat reservoir and, on the other, when the spins themselves constitute the sample.


title: Clifford Algebra-valued Segal-Bargmann Transform and Taylor Isomorphism

abstract: Classical Segal-Bargmann theory studies three Hilbert space unitary isomorphisms that describe the wave-particle duality and the configuration space-phase space. In this work, we generalized these concepts to Clifford algebra-valued functions. We establish the unitary isomorphisms among the space of Clifford algebra-valued square-integrable functions on $\mathbb{R}^n$ with respect to a Gaussian measure, the space of monogenic square-integrable functions on $\mathbb{R}^{n+1}$ with respect to another Gaussian measure and the space of Clifford algebra-valued linear functionals on symmetric tensor elements of $\mathbb{R}^n$.


title: On stochastic expansions of empirical distribution function of residuals in autoregression schemes

abstract: We consider a stationary linear AR($p$) model with unknown mean. The autoregression parameters as well as the distribution function (d.f.) $G$ of innovations are unknown. The observations contain gross errors (outliers). The distribution of outliers is unknown and arbitrary, their intensity is $\gamma n^{-1/2}$ with an unknown $\gamma$, $n$ is the sample size. The assential problem in such situation is to test the normality of innovations. Normality, as is known, ensures the optimality properties of widely used least squares procedures. To construct and study a Pearson chi-square type test for normality we estimate the unknown mean and the autoregression parameters. Then, using the estimates, we find the residuals in the autoregression. Based on them, we construct a kind of empirical distribution function (r.e.d.f.) , which is a counterpart of the (inaccessible) e.d.f. of the autoregression innovations. Our Pearson's satatistic is the functional from r.e.d.f. Its asymptotic distributions under the hypothesis and the local alternatives are determined by the asymptotic behavior of r.e.d.f. In the present work, we find and substantiate in details the stochastic expansions of the r.e.d.f. in two situations. In the first one d.f. $ G (x) $ of innovations does not depend on $ n $. We need this result to investigate test statistic under the hypothesis. In the second situation $ G (x) $ depends on $ n $ and has the form of a mixture $ G (x) = A_n (x) = (1-n ^ {- 1/2}) G_0 (x) + n ^ { -1/2} H (x). $ We need this result to study the power of test under the local alternatives.


title: Relativistic limits on quantum operations

abstract: In this essay, we explore the limits imposed by the impossibility of superluminal signalling on the class of physically realisable quantum operations, focusing on the difference in approaches one can take towards this problem in Hilbert space quantum theory and algebraic quantum field theory (AQFT). We review a recent proposal by Fewster and Verch for a generally covariant measurement scheme in AQFT, which we call the FV scheme; along the way, we argue that the framework as set up in its original proposal can be greatly simplified without losing generality or physical motivation. We then discuss the problem, introduced by Sorkin, that naive generalisations of the notion of operation to the relativistic context can lead to signalling between spacelike observers by introducing a third observer. We consider approaches to tackle this problem in Hilbert space quantum theory and argue that these are sometimes ambiguous, since the physical (im)possibility of operations depends in part on the specific spacetime embodiment of the quantum system under consideration, which lies outside the Hilbert space formalism. In the AQFT context, we review and generalise a recent result showing that operations induced by the FV measurement scheme do not enable superluminal signalling. We connect this result to Hilbert space by introducing a concrete model of AQFT, which we call the `hybrid model' as it provides a way to explicitly embed Hilbert space quantum theory into spacetime using the formalism of AQFT. Finally, we show that in this model, under suitable necessary and sufficient conditions, the converse result also holds: every operation that does not enable superluminal signalling can be implemented in the FV framework.

categories: math-ph math.MP physics.hist-ph quant-ph


title: Orthogonally Additive Sums of Powers of Linear Functionals

abstract: Let $E$ be a Banach lattice, $\lambda_1,\lambda_2,\ldots,\lambda_k$ non-zero scalars and $\varphi_1,\varphi_2,\ldots,\varphi_k$ pairwise independent linear functionals on $E$. We show that if $k<m$ then $\sum_{j=1}^k\lambda_j\varphi_j^m$ is orthogonally additive if and only if $\varphi_j$ or $-\varphi_j$ is a lattice homomorphism for each $j$, $1\le j\le k$. Moreover, for each $m\ge 2$, we provide an example to show that this result does not extend to the case where $k=m$.


title: Stirring by Staring: Measurement Induced Chirality

abstract: In quantum mechanics, the observer necessarily plays an active role in the dynamics of the system, making it difficult to probe a system without disturbing it. Here, we leverage this apparent difficulty as a tool for driving an initially trivial system into a chiral phase. In particular, we show that by utilizing a pattern of repeated occupation measurements we can produce chiral edge transport of fermions hopping on a Lieb lattice. The procedure is similar in spirit to the use of periodic driving to induce chiral edge transport in Floquet topological insulators, while also exhibiting novel phenomena due to the non-unitary nature of the quantum measurements. We study in detail the dependence of the procedure on measurement frequency, showing that in the Zeno limit the system can be described by a classical stochastic dynamics, yielding protected transport. As the frequency of measurements is reduced, the charge flow is reduced and vanishes when no measurements are done.


title: Anomaly-free Abelian gauge symmetries with Dirac seesaws

abstract: We perform a systematic analysis of Standard Model extensions with an additional anomaly-free gauge $U(1)$ symmetry, to generate tree-level Dirac neutrino masses. An anomaly-free symmetry demands nontrivial conditions on the charges of the unavoidable new states. An intensive scan was performed, looking for solutions generating neutrino masses by the type-I and type-II tree-level Dirac seesaw mechanism, via operators with dimension 5 and 6, that correspond to active or dark symmetries. Special attention was paid to the cases featuring no extra massless chiral fermions or multicomponent dark matter with unconditional stability.


title: Higher-Order Expansion and Bartlett Correctability of Distributionally Robust Optimization

abstract: Distributionally robust optimization (DRO) is a worst-case framework for stochastic optimization under uncertainty that has drawn fast-growing studies in recent years. When the underlying probability distribution is unknown and observed from data, DRO suggests to compute the worst-case distribution within a so-called uncertainty set that captures the involved statistical uncertainty. In particular, DRO with uncertainty set constructed as a statistical divergence neighborhood ball has been shown to provide a tool for constructing valid confidence intervals for nonparametric functionals, and bears a duality with the empirical likelihood (EL). In this paper, we show how adjusting the ball size of such type of DRO can reduce higher-order coverage errors similar to the Bartlett correction. Our correction, which applies to general von Mises differentiable functionals, is more general than the existing EL literature that only focuses on smooth function models or $M$-estimation. Moreover, we demonstrate a higher-order "self-normalizing" property of DRO regardless of the choice of divergence. Our approach builds on the development of a higher-order expansion of DRO, which is obtained through an asymptotic analysis on a fixed point equation arising from the Karush-Kuhn-Tucker conditions.


title: The influence of thermal effects on the breakup of thin films of nanometric thickness

abstract: We apply a previously developed asymptotic model (J. Fluid. Mech. 915, A133 (2021)) to study instabilities of free surface films of nanometric thickness on thermally conductive substrates in two and three spatial dimensions. While the specific focus is on metal films exposed to laser heating, the model itself applies to any setup involving films on the nanoscale whose material parameters are temperature-dependent. For the particular case of metal films heated from above, an important aspect is that the considered heating is volumetric, since the absorption length of the applied laser pulse is comparable to the film thickness. In such a setup, absorption of thermal energy and film evolution are closely correlated and must be considered self-consistently. The asymptotic model allows for a significant simplification, which is crucial from both modeling and computational points of view, since it allows for asymptotically correct averaging of the temperature over the film thickness. We find that the properties of the thermally conductive substrate -- in particular its thickness and rate of heat loss -- play a critical role in controlling the film temperature and dynamics. The film evolution is simulated using efficient GPU-based simulations which, when combined with the developed asymptotic model, allow for fully nonlinear time-dependent simulations in large three-dimensional computational domains. In addition to uncovering the role of the substrate and its properties in determining the film evolution, one important finding is that, at least for the considered range of material parameters, strong in-plane thermal diffusion in the film results in negligible spatial variations of temperature, and the film evolution is predominantly influenced by temporal variation of film viscosity and surface tension (dictated by average film temperature), as well as thermal conductivity of the substrate.


title: Monotonicity of the principal pivot transform

abstract: We prove that the principal pivot transform (also known as the partial inverse, sweep operator, or exchange operator in various contexts) maps matrices with positive imaginary part to matrices with positive imaginary part. We show that the principal pivot transform is matrix monotone by establishing Hermitian square representations for the imaginary part and the derivative.


title: Synthesis of Static Test Environments for Observing Sequence-like Behaviors in Autonomous Systems

abstract: In this paper, we investigate formal test-case generation for high-level mission objectives, specifically reachability, of autonomous systems. We use Kripke structures to represent the high-level decision-making of the agent under test and the abstraction of the test environment. First, we define the notion of a test specification, focusing on a fragment of linear temporal logic represented by sequence temporal logic formulas. Second, we formulate the problem of test graph synthesis to find a test configuration for which the agent must satisfy the test specification to satisfy its mission objectives. We an algorithm, based on network flows, for synthesizing a test graph by restricting transitions, represented by edge deletions, on the original graph induced by the Kripke structures. The algorithm synthesizes the test graph iteratively using an integer linear program. We prove completeness for our algorithm, and we show that the edge deletions in each iteration maintain feasibility of the integer linear program in the subsequent iteration. We formalize the notion of a minimally constrained test graph in terms of maximum flow, and prove the synthesized test graph to be minimally constrained. We demonstrate our algorithm on a simple graph and on gridworlds.


title: Local tropicalizations of splice type surface singularities

abstract: Splice type surface singularities were introduced by Neumann and Wahl as a generalization of the class of Pham-Brieskorn-Hamm complete intersections of dimension two. Their construction depends on a weighted tree called a splice diagram. In this paper, we study these singularities from the tropical viewpoint. We characterize their local tropicalizations as the cones over the appropriately embedded associated splice diagrams. As a corollary, we reprove some of Neumann and Wahl's earlier results on these singularities by purely tropical methods, and show that splice type surface singularities are Newton non-degenerate complete intersections in the sense of Khovanskii. We also confirm that under suitable coprimality conditions on its weights, the diagram can be uniquely recovered from the local tropicalization. As a corollary of the Newton non-degeneracy property, we obtain an alternative proof of a recent theorem of de Felipe, Gonz\'alez P\'erez and Mourtada, stating that embedded resolutions of any plane curve singularity can be achieved by a single toric morphism, after re-embedding the ambient smooth surface germ in a higher-dimensional smooth space. The paper ends with an appendix by Jonathan Wahl, proving a criterion of regularity of a sequence in a ring of convergent power series, given the regularity of an associated sequence of initial forms.


title: Structure-selective operando x-ray spectroscopy

abstract: The relationship between charge and structure dictates the properties of electrochemical systems. For example, reversible Na-ion intercalation - a low-cost alternative to Li-ion technology - often induces detrimental structural phase transformations coupled with charge compensation reactions. However, little is known about the underpinning charge-structure mechanisms because the reduction-oxidation (redox) reactions within coexisting structural phases have so far eluded direct operando investigation. Here, we distinguish x-ray spectra of individual crystalline phases operando during a redox-induced phase transformation in P2-Na2/3Ni1/3Mn2/3O2 - an archetypal layered oxide for sodium-ion batteries. We measure the resonant elastic scattering on the Bragg reflection corresponding to the P2-phase lattice spacing. These resonant spectra become static midway through the sodium extraction in an operando coin cell, while the overall sodium extraction proceeds as evidenced by the X-ray absorption averaging over all electrochemically active Ni atoms. The stop of redox activity in the P2-structure signifies its inability to host Ni4+ ions. The coincident emergence of the O2- structure reveals the rigid link between the local redox and the long-range order during the phase transformation. The structure-selective x-ray spectroscopy thus opens a powerful avenue for resolving the dynamic chemistry of different structural phases in multi-phase electrochemical systems.


title: CNF Satisfiability in a Subspace and Related Problems

abstract: We introduce the problem of finding a satisfying assignment to a CNF formula that must further belong to a prescribed input subspace. Equivalent formulations of the problem include finding a point outside a union of subspaces (the Union-of-Subspace Avoidance (USA) problem), and finding a common zero of a system of polynomials over $\F_2$ each of which is a product of affine forms. We focus on the case of k-CNF formulas (the k-SUB-SAT problem). Clearly, it is no easier than k-SAT, and might be harder. Indeed, via simple reductions we show NP-hardness for k=2 and W[1]-hardness parameterized by the co-dimension of the subspace. We also prove that the optimization version Max-2-SUB-SAT is NP-hard to approximate better than the trivial 3/4 ratio even on satisfiable instances. On the algorithmic front, we investigate fast exponential algorithms which give non-trivial savings over brute-force algorithms. We give a simple branching algorithm with runtime 1.5^r for 2-SUB-SAT, where $r$ is the subspace dimension and an O^*(1.4312)^n time algorithm where $n$ is the number of variables. For k more than 2, while known algorithms for solving a system of degree $k$ polynomial equations already imply a solution with runtime 2^{r(1-1/2k)}, we explore a more combinatorial approach. For instance, based on the notion of critical variables, we give an algorithm with running time ${n\choose {\le t}} 2^{n-n/k}$, where $n$ is the number of variables and $t$ is the co-dimension of the subspace. This improves upon the running time of the polynomial equations approach for small co-dimension. Our algorithm also achieves polynomial space in contrast to the algebraic approach that uses exponential space.


title: Trajectory tracing in figure skating

abstract: In this work, we model the movement of a figure skater gliding on ice by the Chaplygin sleigh, a classic pedagogical example of a nonholonomic mechanical system. The Chaplygin sleigh is controlled by a movable added mass, modeling the movable center of mass of the figure skater. The position and velocity of the added mass act as controls that can be used to steer the skater in order to produce prescribed patterns. For any piecewise smooth prescribed curve, this model can be used to determine the controls needed to reproduce that curve by approximating the curve with circular arcs. Tracing of the circular arcs is exact in our control procedure, so the accuracy of the method depends solely on the accuracy of approximation of a trajectory by circular arcs. To reproduce the individual elements of a pattern, we employ an optimization algorithm. We conclude by reproducing a classical "double flower" figure skating pattern and compute the resulting controls.


title: Alzheimer's Disease Diagnosis via Deep Factorization Machine Models

abstract: The current state-of-the-art deep neural networks (DNNs) for Alzheimer's Disease diagnosis use different biomarker combinations to classify patients, but do not allow extracting knowledge about the interactions of biomarkers. However, to improve our understanding of the disease, it is paramount to extract such knowledge from the learned model. In this paper, we propose a Deep Factorization Machine model that combines the ability of DNNs to learn complex relationships and the ease of interpretability of a linear model. The proposed model has three parts: (i) an embedding layer to deal with sparse categorical data, (ii) a Factorization Machine to efficiently learn pairwise interactions, and (iii) a DNN to implicitly model higher order interactions. In our experiments on data from the Alzheimer's Disease Neuroimaging Initiative, we demonstrate that our proposed model classifies cognitive normal, mild cognitive impaired, and demented patients more accurately than competing models. In addition, we show that valuable knowledge about the interactions among biomarkers can be obtained.


title: Coherent Perfect Absorption in Tavis-Cummings Models

abstract: We theoretically study the conditions under which two laser fields can undergo Coherent Perfect Absorption (CPA) when shined on a single-mode bi-directional optical cavity coupled with two two- level quantum emitters (natural atoms, artificial atoms, quantum dots, qubits, etc.). In addition to being indirectly coupled through the cavity-mediated field, in our Tavis-Cummings model the two quantum emitters (QEs) are allowed to interact directly via the dipole-dipole interaction (DDI). Under the mean-field approximation and low-excitation assumption, in this work, we particularly focus on the impact of DDI on the existence of CPA in the presence of decoherence mechanisms (spontaneous emission from the QEs and the leakage of photons from the cavity walls). We also present a dressed-state analysis of the problem to discuss the underlying physics related to the allowed polariton state transitions in the Jaynes-Tavis-Cummings ladder. As a key result, we find that in the strong-coupling regime of cavity quantum electrodynamics, the strong DDI and the emitter-cavity detuning can act together to achieve the CPA at two laser frequencies tunable by the inter-atomic separation which are not possible to attain with a single QE in the presence of detuning. Our CPA results are potentially applicable in building quantum memories that are an essential component in long-distance quantum networking.


title: Decision-making with distorted memory: Escaping the trap of past experience

abstract: Snapshots of "best" (or "worst") experience are known to dominate human memory and may thus also have a significant effect on future behaviour. We consider here a model of repeated decision-making where, at every time step, an agent takes one of two choices with probabilities which are functions of the maximum utilities previously experienced. Depending on the utility distributions and the level of noise in the decision process, it is possible for an agent to become "trapped" in one of the choices on the basis of their early experiences. If the utility distributions for the two choices are different, then the agent may even become trapped in the choice which is objectively worse in the sense of expected long-term returns; crucially we extend earlier work to address this case. Using tools from statistical physics and extreme-value theory, we show that for exponential utilities there is an optimal value of noise which maximizes the expected returns in the long run. We also briefly discuss the behaviour for other utility distributions.


title: Quantum tomography of entangled spin-multi-photon states

abstract: We present a novel method for quantum tomography of multi-qubit states. We apply the method to spin-multi-photon states, which we produce by periodic excitation of a semiconductor quantum-dot- confined spin every 1/4 of its coherent precession period. These timed excitations lead to the deterministic generation of strings of entangled photons in a cluster state. We show that our method can be used for characterizing the periodic process map, which produces the photonic cluster. From the measured process map, we quantify the robustness of the entanglement in the cluster. The 3-fold enhanced generation rate over previous demonstrations reduces the spin decoherence between the pulses and thereby increases the entanglement.


title: Optical anisotropies of asymmetric double GaAs (001) Quantum Wells

abstract: In the present work, we were able to identify and characterize a new source of in-plane optical anisotropies (IOAs) occurring in asymmetric DQWs; namely a reduction of the symmetry from $D_{2d}$ to $C_{2v}$ as imposed by asymmetry along the growth direction. We report on reflectance anisotropy spectroscopy (RAS) of double GaAs quantum wells (DQWs) structures coupled by a thin ($<2$ nm) tunneling barrier. Two groups of DQWs systems were studied: one where both QWs have the same thickness (symmetric DQW) and another one where they have different thicknesses (asymmetric DQW). RAS measures the IOAs arising from the intermixing of the heavy- and light- holes in the valence band when the symmetry of the DQW system is lowered from $D_{2d}$ to $C_{2v}$. If the DQW is symmetric, residual IOAs stem from the asymmetry of the QW interfaces; for instance, associated to Ga segregation into the AlGaAs layer during the epitaxial growth process. In the case of an asymmetric DQW with QWs with different thicknesses, the AlGaAs layers (that are sources of anisotropies) are not distributed symmetrically at both sides of the tunneling barrier. Thus, the system losses its inversion symmetry yielding an increase of the RAS strength. The RAS line shapes were compared with reflectance spectra in order to assess the heavy- and light- hole mixing induced by the symmetry breakdown. The energies of the optical transitions were calculated by numerically solving the one-dimensional Schr\"odinger equation using a finite-differences method. Our results are useful for interpretation of the transitions occurring in both, symmetric and asymmetric DQWs.


title: Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-based Hate

abstract: Detecting online hate is a complex task, and low-performing models have harmful consequences when used for sensitive applications such as content moderation. Emoji-based hate is an emerging challenge for automated detection. We present HatemojiCheck, a test suite of 3,930 short-form statements that allows us to evaluate performance on hateful language expressed with emoji. Using the test suite, we expose weaknesses in existing hate detection models. To address these weaknesses, we create the HatemojiBuild dataset using a human-and-model-in-the-loop approach. Models built with these 5,912 adversarial examples perform substantially better at detecting emoji-based hate, while retaining strong performance on text-only hate. Both HatemojiCheck and HatemojiBuild are made publicly available. See our Github Repository (https://github.com/HannahKirk/Hatemoji). HatemojiCheck, HatemojiBuild, and the final Hatemoji Model are also available on HuggingFace (https://huggingface.co/datasets/HannahRoseKirk/).


title: Anomalous dimensions of monopole operators at the transitions between Dirac and topological spin liquids

abstract: Monopole operators are studied in a large family of quantum critical points between Dirac and topological quantum spin liquids (QSLs): chiral and Z$_{2}$ QSLs. These quantum phase transitions are described by conformal field theories (CFTs): quantum electrodynamics in 2+1 dimensions with 2N flavors of two-component massless Dirac fermions and a four-fermion interaction. For the transition to a chiral spin liquid, it is the Gross-Neveu interaction (QED$_{3}$-GN), while for the transitions to Z$_{2}$ QSLs it is a superconducting pairing term with general spin/valley structure (generalized QED$_{3}$-Z$_{2}$GN). Using the state-operator correspondence, we obtain monopole scaling dimensions to sub-leading order in 1/N. For monopoles with a minimal topological charge q=1/2, the scaling dimension is 2N*0.26510 at leading-order, with the quantum correction being 0.118911(7) for the chiral spin liquid, and 0.102846(9) for the simplest Z$_{2}$ case (the expression is also given for a general pairing term). Although these two anomalous dimensions are nearly equal, the underlying quantum fluctuations possess distinct origins. The analogous result in QED$_{3}$ is also obtained and we find a sub-leading contribution of -0.038138(5), which differs slightly from the value first obtained in the literature. The scaling dimension of a QED$_{3}$-GN monopole with minimal charge is very close to the scaling dimensions of other operators predicted to be equal by a conjectured duality between QED$_{3}$-GN with 2N=2 flavors and the CP$^{1}$ model. Additionally, non-minimally charged monopoles on both sides of the duality have similar scaling dimensions. By studying the large-q asymptotics of the scaling dimensions in QED$_{3}$, QED$_{3}$-GN, and QED$_{3}$-Z$_{2}$GN we verify that the constant O(q$^{0}$) coefficient precisely matches the universal non-perturbative prediction for CFTs with a global U(1) symmetry.


title: Galaxy And Mass Assembly (GAMA) Survey: The Merging Potential of Brightest Group Galaxies

abstract: Using a volume-limited sample of 550 groups from the Galaxy And Mass Assembly (GAMA) Galaxy Group Catalogue spanning the halo mass range $12.8 < \log [M_{h}/M] < 14.2$, we investigate the merging potential of central Brightest Group Galaxies (BGGs). We use spectroscopically-confirmed close-companion galaxies as an indication of the potential stellar mass build-up of low-redshift BGGs, $z \leq 0.2$. We identify 17 close-companion galaxies with projected separations $r_{p} < 30$ kpc, relative velocities $\Delta v \leq 300$ km s$^{-1}$, and stellar-mass ratios $M_{BGG}/M_{CC} \leq 4$ relative to the BGG. These close-companion galaxies yield a total pair fraction of $0.03 \pm 0.01$. Overall, we find that BGGs in our sample have the potential to grow in stellar mass due to mergers by $2.2 \pm 1.5\%$ Gyr$^{-1}$. This is lower than the stellar mass growth predicted by current galaxy evolution models.


title: Efficient reduced-rank methods for Gaussian processes with eigenfunction expansions

abstract: In this work we introduce a reduced-rank algorithm for Gaussian process regression. Our numerical scheme converts a Gaussian process on a user-specified interval to its Karhunen-Lo\`eve expansion, the $L^2$-optimal reduced-rank representation. Numerical evaluation of the Karhunen-Lo\`eve expansion is performed once during precomputation and involves computing a numerical eigendecomposition of an integral operator whose kernel is the covariance function of the Gaussian process. The Karhunen-Lo\`eve expansion is independent of observed data and depends only on the covariance kernel and the size of the interval on which the Gaussian process is defined. The scheme of this paper does not require translation invariance of the covariance kernel. We also introduce a class of fast algorithms for Bayesian fitting of hyperparameters, and demonstrate the performance of our algorithms with numerical experiments in one and two dimensions. Extensions to higher dimensions are mathematically straightforward but suffer from the standard curses of high dimensions.


title: Synergy Test for Antibacterial Activity: Towards the Research for a Consensus between the Fractional Inhibitory Concentration (Checkboard Method) and the Increase in Fold Area (Disc Diffusion Method)

abstract: Antibiotic resistance is a topical problem for both humans and animals and has been the subject of special monitoring for two decades. Several recent studies, including ours, have shown that this phenomenon is accentuated by the transfer of certain genetic elements and cross resistance acquisition, the latter or both resulting from the misuse of these antimicrobial drugs. A more careful use of antimicrobials, the search for new antibacterial compounds (including probiotics and phages) are the most recommended alternatives to overcome this situation. However, tests for modulations of antimicrobial activity can also play a major role. The main goal of synergy studies is to assess whether substances with antibacterial properties can improve the effectiveness of existing antimicrobials or give them a second life against resistant germs. Moreover, recent studies have demonstrated the ability of silver nanoparticles and extracts of certain plants to boost the effectiveness of certain antibiotics. such as ampicillin, benzylpenicillin, cefazolin, ciprofloxacin, nitrofurantoin, and kanamycin. Yet, from these studies we found that there was a serious problem with the interpretation of the results when using the disk method with determination of the increase in fold area. Indeed, the use of this method firstly requires the determination of the diameter of inhibition of the antibiotic alone; follow by the determination of the combination of antibiotic + modulating substance (MS) or extract.....


title: Computing Research for the Climate Crisis

abstract: Climate change is an existential threat to the United States and the world. Inevitably, computing will play a key role in mitigation, adaptation, and resilience in response to this threat. The needs span all areas of computing, from devices and architectures (e.g., low-power sensor systems for wildfire monitoring) to algorithms (e.g., predicting impacts and evaluating mitigation), and robotics (e.g., autonomous UAVs for monitoring and actuation) -- as well as every level of the software stack, from data management systems and energy-aware operating systems to hardware/software co-design. The goal of this white paper is to highlight the role of computing research in addressing climate change-induced challenges. To that end, we outline six key impact areas in which these challenges will arise -- energy, environmental justice, transportation, infrastructure, agriculture, and environmental monitoring and forecasting -- then identify specific ways in which computing research can help address the associated problems. These impact areas will create a driving force behind, and enable, cross-cutting, system-level innovation. We further break down this information into four broad areas of computing research: devices & architectures, software, algorithms/AI/robotics, and sociotechnical computing. Additional contributions by: Ilkay Altintas (San Diego Supercomputer Center), Kyri Baker (University of Colorado Boulder), Sujata Banerjee (VMware), Andrew A. Chien (University of Chicago), Thomas Dietterich (Oregon State University), Ian Foster (Argonne National Labs), Carla P. Gomes (Cornell University), Chandra Krintz (University of California, Santa Barbara), Jessica Seddon (World Resources Institute), and Regan Zane (Utah State University).


title: Overview of the HASOC track at FIRE 2020: Hate Speech and Offensive Content Identification in Indo-European Languages

abstract: With the growth of social media, the spread of hate speech is also increasing rapidly. Social media are widely used in many countries. Also Hate Speech is spreading in these countries. This brings a need for multilingual Hate Speech detection algorithms. Much research in this area is dedicated to English at the moment. The HASOC track intends to provide a platform to develop and optimize Hate Speech detection algorithms for Hindi, German and English. The dataset is collected from a Twitter archive and pre-classified by a machine learning system. HASOC has two sub-task for all three languages: task A is a binary classification problem (Hate and Not Offensive) while task B is a fine-grained classification problem for three classes (HATE) Hate speech, OFFENSIVE and PROFANITY. Overall, 252 runs were submitted by 40 teams. The performance of the best classification algorithms for task A are F1 measures of 0.51, 0.53 and 0.52 for English, Hindi, and German, respectively. For task B, the best classification algorithms achieved F1 measures of 0.26, 0.33 and 0.29 for English, Hindi, and German, respectively. This article presents the tasks and the data development as well as the results. The best performing algorithms were mainly variants of the transformer architecture BERT. However, also other systems were applied with good success


title: Data-driven discovery of intrinsic dynamics

abstract: Dynamical models underpin our ability to understand and predict the behavior of natural systems. Whether dynamical models are developed from first-principles derivations or from observational data, they are predicated on our choice of state variables. The choice of state variables is driven by convenience and intuition, and in the data-driven case the observed variables are often chosen to be the state variables. The dimensionality of these variables (and consequently the dynamical models) can be arbitrarily large, obscuring the underlying behavior of the system. In truth, these variables are often highly redundant and the system is driven by a much smaller set of latent intrinsic variables. In this study, we combine the mathematical theory of manifolds with the representational capacity of neural networks to develop a method that learns a system's intrinsic state variables directly from time series data, and also learns predictive models for their dynamics. What distinguishes our method is its ability to reduce data to the intrinsic dimensionality of the nonlinear manifold they live on. This ability is enabled by the concepts of charts and atlases from the theory of manifolds, whereby a manifold is represented by a collection of patches that are sewn together -- a necessary representation to attain intrinsic dimensionality. We demonstrate this approach on several high-dimensional systems with low-dimensional behavior. The resulting framework provides the ability to develop dynamical models of the lowest possible dimension, capturing the essence of a system.


title: Parameter Tuning of Time-Frequency Masking Algorithms for Reverberant Artifact Removal within the Cochlear Implant Stimulus

abstract: Cochlear implant users struggle to understand speech in reverberant environments. To restore speech perception, artifacts dominated by reverberant reflections can be removed from the cochlear implant stimulus. Artifacts can be identified and removed by applying a matrix of gain values, a technique referred to as time-frequency masking. Gain values are determined by an oracle algorithm that uses knowledge of the undistorted signal to minimize retention of the signal components dominated by reverberant reflections. In practice, gain values are estimated from the distorted signal, with the oracle algorithm providing the estimation objective. Different oracle techniques exist for determining gain values, and each technique must be parameterized to set the amount of signal retention. This work assesses which oracle masking strategies and parameterizations lead to the best improvements in speech intelligibility for cochlear implant users in reverberant conditions using online speech intelligibility testing of normal-hearing individuals with vocoding.


title: A Systematic Benchmarking Analysis of Transfer Learning for Medical Image Analysis

abstract: Transfer learning from supervised ImageNet models has been frequently used in medical image analysis. Yet, no large-scale evaluation has been conducted to benchmark the efficacy of newly-developed pre-training techniques for medical image analysis, leaving several important questions unanswered. As the first step in this direction, we conduct a systematic study on the transferability of models pre-trained on iNat2021, the most recent large-scale fine-grained dataset, and 14 top self-supervised ImageNet models on 7 diverse medical tasks in comparison with the supervised ImageNet model. Furthermore, we present a practical approach to bridge the domain gap between natural and medical images by continually (pre-)training supervised ImageNet models on medical images. Our comprehensive evaluation yields new insights: (1) pre-trained models on fine-grained data yield distinctive local representations that are more suitable for medical segmentation tasks, (2) self-supervised ImageNet models learn holistic features more effectively than supervised ImageNet models, and (3) continual pre-training can bridge the domain gap between natural and medical images. We hope that this large-scale open evaluation of transfer learning can direct the future research of deep learning for medical imaging. As open science, all codes and pre-trained models are available on our GitHub page https://github.com/JLiangLab/BenchmarkTransferLearning.