title: A Generative Language Model for Few-shot Aspect-Based Sentiment Analysis

abstract: Sentiment analysis is an important task in natural language processing. In recent works, pre-trained language models are often used to achieve state-of-the-art results, especially when training data is scarce. It is common to fine-tune on the downstream task, usually by adding task-specific layers on top of the model. In this paper, we focus on aspect-based sentiment analysis, which involves extracting aspect term, category, and predicting their corresponding polarities. In particular, we are interested in few-shot settings. We propose to reformulate the extraction and prediction tasks into the sequence generation task, using a generative language model with unidirectional attention (GPT2 is used unless stated otherwise). This way, the model learns to accomplish the tasks via language generation without the need of training task-specific layers. Our evaluation results on the single-task polarity prediction show that our approach outperforms the previous state-of-the-art (based on BERT) on average performance by a large margins in few-shot and full-shot settings. More importantly, our generative approach significantly reduces the model variance caused by low-resource data. We further demonstrate that the proposed generative language model can handle joint and multi-task settings, unlike previous work. We observe that the proposed sequence generation method achieves further improved performances on polarity prediction when the model is trained via joint and multi-task settings. Further evaluation on similar sentiment analysis datasets, SST-2, SST- and OOS intent detection validates the superiority and noise robustness of generative language model in few-shot settings.


title: Bias induced drift and trapping on random combs and the Bethe lattice: Fluctuation regime and first order phase transitions

abstract: We study the competition between field-induced transport and trapping in a disordered medium by studying biased random walks on random combs and the bond-diluted Bethe lattice above the percolation threshold. While it is known that the drift velocity vanishes above a critical threshold, here our focus is on fluctuations, characterized by the variance of the transit times. On the random comb, the variance is calculated exactly for a given realization of disorder using a 'forward transport' limit which prohibits backward movement along the backbone but allows an arbitrary number of excursions into random-length branches. The disorder-averaged variance diverges at an earlier threshold of the bias, implying a regime of anomalous fluctuations, although the velocity is nonzero. Our results are verified numerically using a Monte Carlo procedure that is adapted to account for ultra-slow returns from long branches. On the Bethe lattice, we derive an upper bound for the critical threshold bias for anomalous fluctuations of the mean transit time averaged over disorder realizations. Finally, as for the passage to the vanishing velocity regime, it is shown that the transition to the anomalous fluctuation regime can change from continuous to first order depending on the distribution of branch lengths.


title: A Concurrent Switching Model for Traffic Congestion Control

abstract: We introduce a new conservation-based approach for traffic coordination modeling and control in a network of interconnected roads (NOIR) with switching movement phase rotations at every NOIR junction. For modeling of traffic evolution, we first assume that the movement phase rotation is cyclic at every NOIR junction, but the duration of each movement phase can be arbitrarily commanded by traffic signals. Then, we propose a novel concurrent switching dynamics (CSD) with deterministic transitions among a finite number of states, representing the NOIR movement phases. We define the CSD control as a cyclic receding horizon optimization problem with periodic quadratic cost and constraints. More specifically, the cost is defined so that the traffic density is minimized and the boundary inflow is uniformly distributed over the boundary inlet roads, whereas the cost parameters are periodically changed with time. The constraints are linear and imposed by a trapezoidal fundamental diagram at every NOIR road so that traffic feasibility is assured and traffic over-saturation is avoided. The success of the proposed traffic boundary control is demonstrated by simulation of traffic congestion control in Downtown Phoenix.


title: $\nu$-Analysis: A New Notion of Robustness for Large Systems with Structured Uncertainties

abstract: We present a new, scalable alternative to the structured singular value, which we call $\nu$, provide a convex upper bound, study their properties and compare them to $\ell_1$ robust control. The analysis relies on a novel result on the relationship between robust control of dynamical systems and non-negative constant matrices.


title: Disruption of a Planetary Nitrogen Cycle as Evidence of Extraterrestrial Agriculture

abstract: Agriculture is one of the oldest forms of technology on Earth. The cultivation of plants requires a terrestrial planet with active hydrological and carbon cycles and depends on the availability of nitrogen in soil. The technological innovation of agriculture is the active management of this nitrogen cycle by applying fertilizer to soil, at first through the production of manure excesses but later by the Haber-Bosch industrial process. The use of such fertilizers has increased the atmospheric abundance of nitrogen-containing species such as NH$_3$ and N$_2$O as agricultural productivity intensifies in many parts of the world. Both NH$_3$ and N$_2$O are effective greenhouse gases, and the combined presence of these gases in the atmosphere of a habitable planet could serve as a remotely detectable spectral signature of technology. Here we use a synthetic spectral generator to assess the detectability of NH$_3$ and N$_2$O that would arise from present-day and future global-scale agriculture. We show that present-day Earth abundances of NH$_3$ and N$_2$O would be difficult to detect but hypothetical scenarios involving a planet with 30-100 billion people could show a change in transmittance of about 50-70% compared to pre-agricultural Earth. These calculations suggest the possibility of considering the simultaneous detection of NH$_3$ and N$_2$O in an atmosphere that also contains H$_2$O, O$_2$, and CO$_2$ as a technosignature for extraterrestrial agriculture. The technology of agriculture is one that could be sustainable across geologic timescales, so the spectral signature of such an "ExoFarm" is worth considering in the search for technosignatures.


title: Non-thermal emission from fall-back clouds in the Broad-Line Region of Active Galactic Nuclei

abstract: The spectra of active galactic nuclei exhibit broad-emission lines that presumably originate in the Broad-Line Region (BLR) with gaseous-dusty clouds in a predominantly Keplerian motion around the central black hole. Signatures of both inflow and outflow motion are frequently seen. The dynamical character of BLR is consistent with the scenario that has been branded as the Failed Radiatively Accelerated Dusty Outflow (FRADO; Czerny & Hryniewicz 2011). In this scheme, frequent high-velocity impacts of BLR clouds falling back onto the underlying accretion disk are predicted. The impact velocities depend mainly on the black-hole mass, accretion rate, and metallicity and they range from a few km s$^{-1}$ up to thousands of km s$^{-1}$. Formation of strong shocks due to the collisions can give rise to the production of relativistic particles and associated radiation signatures. In this work, the non-thermal radiation generated in this process is investigated, and the spectral energy distributions for different parameter sets are presented. We find that the non-thermal processes caused by the impacts of clouds can lead to emission in the X-ray and the gamma-ray bands, playing the cloud density and metallicity a key role.


title: Assuming Ionization Equilibrium and the Impact on the Lyman-$\mathrm{\alpha}$ Forest Power Spectrum during the End of Reionization at $8 \geq z \geq 5$

abstract: We explore how the assumption of ionization equilibrium modulates the modeled intergalactic medium (IGM) at the end of the hydrogen Epoch of Reionization using the cosmological radiation hydrodynamic \textsc{Technicolor Dawn} simulation. In neutral and partially-ionized regions where the metagalactic ultraviolet background (UVB) is weak, the ionization timescale $t_\mathrm{ion}\equiv \Gamma^{-1}$ exceeds the Hubble time. Assuming photoionization equilibrium in such regions artificially boosts the ionization rate, accelerating reionization. By contrast, the recombination time $t_\mathrm{rec} < t_\mathrm{ion}$ in photoionized regions, with the result that assuming photoionization equilibrium artificially increases the neutral hydrogen fraction. Using snapshots between $8 \geq z \geq 5$, we compare the predicted Lyman-$\alpha$ forest flux power spectrum with and without the assumption of ionization equilibrium. Small scales ($k > 0.1$ rad s km$^{-1}$) exhibit reduced power from $7 \leq z \leq 5.5$ in the ionization equilibrium case while larger scales are unaffected. This occurs for the same reasons: ionization equilibrium artificially suppresses the neutral fraction in self-shielded gas and boosts ionizations in voids, suppressing small-scale fluctuations in the ionization field. When the volume-averaged neutral fraction drops below $10^{-4}$, the signature of non-equilibrium ionizations on the Lyman-$\alpha$ forest (LAF) disappears. Comparing with recent observations indicates that these non-equilibrium effects are not yet observable in the LAF flux power spectrum.


title: Trace Expansions and Equivariant Traces on an Algebra of Fourier Integral Operators on $\mathbb R^n$

abstract: We consider the operator algebra $\mathscr A$ on $\mathscr S(\mathbb R^n)$ generated by the Shubin type pseudodifferential operators, the Heisenberg-Weyl operators and the lifts of the unitary operators on $\mathbb C^n$ to metaplectic operators. With the help of an auxiliary operator in the Shubin calculus, we find trace expansions for these operators in the spirit of Grubb and Seeley. Moreover, we can define a noncommutative residue generalizing that for the Shubin pseudodifferential operators and obtain a class of localized equivariant traces on the algebra.


title: Aharonov-Bohm oscillations in phosphorene quantum rings: mass anisotropy compensation by confinement potential

abstract: We consider the Aharonov-Bohm (AB) effect on a confined electron ground state in a quantum ring defined electrostatically within the phosphorene monolayer. The strong anisotropy of effective masses in phosphorene quenches ground-state oscillations for a circular ring because of interrupted persistent current circulation around the ring. An elliptic deformation of the confinement potential can compensate for the anisotropy of the effective masses and produce ground-state parity transformations with the AB periodicity. Moreover, a specific ratio of the semiaxes is determined for which the spectrum becomes identical to that of a circular quantum ring and an isotropic effective mass. We identify a generalized angular momentum operator which commutes with the continuum Hamiltonian for the chosen ratio of the semi-axes that closes the avoided crossings of energy levels for states of the same parity and spin. Ground-state oscillations for the two-electron ground state are also discussed.


title: PolyARBerNN: A Neural Network Guided Solver and Optimizer for Bounded Polynomial Inequalities

abstract: Constraints solvers play a significant role in the analysis, synthesis, and formal verification of complex embedded and cyber-physical systems. In this paper, we study the problem of designing a scalable constraints solver for an important class of constraints named polynomial constraint inequalities (also known as non-linear real arithmetic theory). In this paper, we introduce a solver named PolyARBerNN that uses convex polynomials as abstractions for highly nonlinear polynomials. Such abstractions were previously shown to be powerful to prune the search space and restrict the usage of sound and complete solvers to small search spaces. Compared with the previous efforts on using convex abstractions, PolyARBerNN provides three main contributions namely (i) a neural network guided abstraction refinement procedure that helps selecting the right abstraction out of a set of pre-defined abstractions, (ii) a Bernstein polynomial-based search space pruning mechanism that can be used to compute tight estimates of the polynomial maximum and minimum values which can be used as an additional abstraction of the polynomials, and (iii) an optimizer that transforms polynomial objective functions into polynomial constraints (on the gradient of the objective function) whose solutions are guaranteed to be close to the global optima. These enhancements together allowed the PolyARBerNN solver to solve complex instances and scales more favorably compared to the state-of-art non-linear real arithmetic solvers while maintaining the soundness and completeness of the resulting solver. In particular, our test benches show that PolyARBerNN achieved 100X speedup compared with Z3 8.9, Yices 2.6, and NASALib (a solver that uses Bernstein expansion to solve multivariate polynomial constraints) on a variety of standard test benches.


title: Development of a 120-mm Aperture Nb3Sn Dipole Coil with Stress Management

abstract: This paper describes a 120-mm aperture 2-layer dipole coil with stress management (SM) developed at Fermilab based on cos-theta coil geometry. A model of the coil support structure made of plastic was printed using additive manufacturing technology and used for practice coil winding. The real coil support structure was printed using the 316 stainless steel. The results of the SM structure size control and the key coil fabrication steps are reported in the paper. The design of coil SM structure and the coil FEA in the dipole mirror test configurations are presented and discussed.


title: Branch Points for (Almost-)Minimizers of Two-Phase Free Boundary Problems

abstract: We study the existence and structure of branch points in two-phase free boundary problems. More precisely, we construct a family of minimizers to an Alt- Caffarelli-Friedman type functional whose free boundaries contain branch points in the strict interior of the domain. We also give an example showing that branch points in the free boundary of almost-minimizers of the same functional can have very little structure. This last example stands in contrast with recent results of De Philippis- Spolaor-Velichkov on the structure of branch points in the free boundary of stationary solutions.


title: Massive Neutrinos, Dark Sector, and Hydrodynamics: The Sejong Suite

abstract: Improving the understanding of the processes governing small-scale nonlinear clustering is a necessary task for interpreting upcoming high-quality cosmological data, as it will allow one to break degeneracies and obtain tight neutrino mass and warm dark matter constraints from large-scale structure probes. The Sejong Suite, an extensive collection of state-of-the-art high-resolution cosmological hydrodynamical simulations, has been intended with this primary goal in mind. Spanning a large number of cosmological and astrophysical parameters (especially suitable for the dark sector), and organized into three main categories (Grid Suite, Supporting Suite, and Systematics Suite), the release may be useful for a broader variety of cosmological and astrophysical purposes - while primarily developed for Lyman-Alpha (LyA) forest studies. In particular, the overall architecture of the Grid Suite has been designed to achieve an equivalent resolution up to 3x3328^3=110 billion particles in a 100 Mpc/h box, corresponding to a 30 kpc/h mean grid resolution, which ensures convergence on LyA flux statistics closer to the desired 1.0% level that data from surveys such as the Dark Energy Spectroscopic Instrument (DESI) will provide. Here, we briefly highlight the main characteristics, improvements, and novelties of the Sejong Suite, as well as ongoing and future applications.


title: Learning Implicit Priors for Motion Optimization

abstract: In this paper, we focus on the problem of integrating Energy-based Models (EBM) as guiding priors for motion optimization. EBMs are a set of neural networks that can represent expressive probability density distributions in terms of a Gibbs distribution parameterized by a suitable energy function. Due to their implicit nature, they can easily be integrated as optimization factors or as initial sampling distributions in the motion optimization problem, making them good candidates to integrate data-driven priors in the motion optimization problem. In this work, we present a set of required modeling and algorithmic choices to adapt EBMs into motion optimization. We investigate the benefit of including additional regularizers in the learning of the EBMs to use them with gradient-based optimizers and we present a set of EBM architectures to learn generalizable distributions for manipulation tasks. We present multiple cases in which the EBM could be integrated for motion optimization and evaluate the performance of learned EBMs as guiding priors for both simulated and real robot experiments.


title: Panoptic, Instance and Semantic Relations: A Relational Context Encoder to Enhance Panoptic Segmentation

abstract: This paper presents a novel framework to integrate both semantic and instance contexts for panoptic segmentation. In existing works, it is common to use a shared backbone to extract features for both things (countable classes such as vehicles) and stuff (uncountable classes such as roads). This, however, fails to capture the rich relations among them, which can be utilized to enhance visual understanding and segmentation performance. To address this shortcoming, we propose a novel Panoptic, Instance, and Semantic Relations (PISR) module to exploit such contexts. First, we generate panoptic encodings to summarize key features of the semantic classes and predicted instances. A Panoptic Relational Attention (PRA) module is then applied to the encodings and the global feature map from the backbone. It produces a feature map that captures 1) the relations across semantic classes and instances and 2) the relations between these panoptic categories and spatial features. PISR also automatically learns to focus on the more important instances, making it robust to the number of instances used in the relational attention module. Moreover, PISR is a general module that can be applied to any existing panoptic segmentation architecture. Through extensive evaluations on panoptic segmentation benchmarks like Cityscapes, COCO, and ADE20K, we show that PISR attains considerable improvements over existing approaches.


title: Parametric Model Embedding

abstract: Methodologies for reducing the design-space dimensionality in shape optimization have been recently developed based on unsupervised machine learning methods. These methods provide reduced dimensionality representations of the design space, capable of maintaining a certain degree of the original design variability. Nevertheless, they usually do not allow to use directly the original parameterization method, representing a limitation to their widespread application in the industrial field, where the design parameters often pertain to well-established parametric models, e.g. CAD (computer-aided design) models. This work presents how to embed the parametric-model original parameters in a reduced-dimensionality representation of the design space. The method, which takes advantage from the definition of a newly-introduced generalized feature space, is demonstrated, as a proof of concept, for the reparameterization of 2D Bezier curves and 3D free-form deformation design spaces and the consequent solution of simulation-driven design optimization problems of a subsonic airfoil and a naval destroyer in calm water, respectively.


title: ALMA constraints on assembly of Core Accretion planets

abstract: Resolved dust continuum and CO line ALMA imaging, and in some cases detection of H$\alpha$ emission, hint that young massive planets are abundant at wide separations in protoplanetary discs. Here, we show how these observations can probe the runaway phase of planetary growth in the Core Accretion theory. Planets in this phase have the right range of masses to account for the predominantly moderate contrast gaps and rings seen in ALMA observations. However, we find that these planets gain mass and migrate inward very rapidly. As a result, the phase when they could produce gaps with properties similar to those observed is very short, i.e., $t_{\rm gap} \lesssim 0.1$~Myr, independently of the disc viscosity parameter. This would require many tens to hundreds of gas giant planets to be born per ALMA system, violating the available mass budget of solids in realistic discs. This also predicts preponderance of discs with very wide gaps or complete inner disc holes, which is not observed. We show that suppression of both planet accretion and migration by a factor of at least ten is a possible solution to these serious problems. Future population synthesis models of planet formation should aim to address both exoplanetary data of older discless planetary systems and ALMA discs with embedded planets in one framework.


title: Analysis of the Finite-State Ergodic Master Equation

abstract: Mean field games model equilibria in games with a continuum of players as limiting systems of symmetric $n$-player games with weak interaction between the players. We consider a finite-state, infinite-horizon problem with two cost criteria: discounted and ergodic. Under the Lasry--Lions monotonicity condition we characterize the stationary ergodic mean field game equilibrium by a mean field game system of two coupled equations: one for the value and the other for the stationary measure. This system is linked with the ergodic master equation. Several discounted mean field game systems are utilized in order to set up the relevant discounted master equations. We show that the discounted master equations are smooth, uniformly in the discount factor. Taking the discount factor to zero, we achieve the smoothness of the ergodic master equation.


title: Time periodic motion of temperature driven compressible fluids

abstract: We consider the Navier-Stokes-Fourier system describing the motion of a compressible viscous fluid in a container with impermeable boundary subject to time periodic heating and under the action of a time periodic potential force. We show the existence of a time periodic weak solution for arbitrarily large physically admissible data.


title: Experimental demonstration of OSC at IOTA: IOTA Run #3 Report

abstract: Optical Stochastic Cooling (OSC) is an optical-bandwidth extension of Stochastic Cooling that could advance the state-of-the-art cooling rate in beam cooling by three to four orders of magnitude [1-3]. The concept of OSC was first suggested in the early 1990s by Zolotorev, Zholents and Mikhailichenko, and replaced the microwave hardware of SC with optical analogs, such as wigglers and optical amplifiers. A number of variations on the original OSC concept have been proposed, and while a variety of proof-of-principle demonstrations and operational uses have been considered, the concept was not experimentally demonstrated up to now [4-9]. An OSC R&D program has been underway at IOTA for the past several years [4]. Run #3 of the IOTA ring, which began in Nov. 2020 and concluded in Aug. 2021, was focused on the worlds first experimental demonstration of OSC. The experimental program was successful in demonstrating and characterizing the OSC physics with the major outcomes including strong cooling in one, two and three dimensions, validation of the theoretical models of OSC and the demonstration of OSC with a single electron. This report briefly describes the activities and major milestones of the OSC program during Run #3. Detailed descriptions of the OSC theory, conceptual design and hardware elements can be found in reference [4].


title: medXGAN: Visual Explanations for Medical Classifiers through a Generative Latent Space

abstract: Despite the surge of deep learning in the past decade, some users are skeptical to deploy these models in practice due to their black-box nature. Specifically, in the medical space where there are severe potential repercussions, we need to develop methods to gain confidence in the models' decisions. To this end, we propose a novel medical imaging generative adversarial framework, medXGAN (medical eXplanation GAN), to visually explain what a medical classifier focuses on in its binary predictions. By encoding domain knowledge of medical images, we are able to disentangle anatomical structure and pathology, leading to fine-grained visualization through latent interpolation. Furthermore, we optimize the latent space such that interpolation explains how the features contribute to the classifier's output. Our method outperforms baselines such as Gradient-Weighted Class Activation Mapping (Grad-CAM) and Integrated Gradients in localization and explanatory ability. Additionally, a combination of the medXGAN with Integrated Gradients can yield explanations more robust to noise. The code is available at: https://avdravid.github.io/medXGAN_page/.


title: Magnetic order and spin liquid behavior in [Mo3+]^{11+} triangular magnets

abstract: Molecular magnets based on [Mo$_3$]$^{11+}$ units with one unpaired electron per trimer have attracted recent interest due to the identification of quantum spin liquid candidacy in some family members. Here, we present comprehensive measurements on polycrystalline samples of ZnScMo$_3$O$_8$, MgScMo$_3$O$_8$, and Na$_3$Sc$_2$Mo$_5$O$_{16}$ with the same Mo$_3$O$_{13}$ magnetic building blocks. The crystal structures are characterized with x-ray or neutron powder diffraction and the magnetic ground states are determined by performing ac and dc susceptibility, specific heat, neutron powder diffraction, and $\mu$SR measurements. Our work indicates that ZnScMo$_3$O$_8$ and MgScMo$_3$O$_8$ have ferromagnetic Curie-Weiss temperatures of 18.5 K and 11.9 K, ordered ground states with net moments (low-moment ferromagnetism or canted antiferromagnetism), and zero field ordering temperatures of $T_c =$ 6 K and $<$ 2 K respectively. On the other hand, Na$_3$Sc$_2$Mo$_5$O$_{16}$ hosts a dynamical magnetic ground state with no evidence for magnetic ordering or spin freezing down to 20 mK despite an antiferromagnetic Curie-Weiss temperature of -36.2 K, and therefore is a candidate for quantum spin liquid behavior. By comparing the present results to past work on the same family of materials, we construct a phase diagram which illustrates that the magnetic ground states of these Mo-based molecular magnets are very sensitive to small changes in the nearest neighbor Mo-Mo distance.


title: Minimum Quench Energy Of Nb$_3$Sn Wires With High Specific Heat Tape

abstract: A major problem of state-of-the-art Nb$_3$Sn accelerator magnets is their long training due to thermo-mechanical perturbations. Increasing the specific heat, $C_p$, of the Rutherford cable would reduce and/or eliminate training by limiting the coils temperature rise. This paper studies feasibility of increasing the $C_p$ of Rutherford-type cables by using thin composite Cu/$Gd_2$O$_3$ and Cu/$Gd_2$O$_2$S tapes produced by Hyper Tech Research, Inc. The tape can be either wrapped around the cable, placed on the cable wide faces under the insulation, and/or inserted as a core. Wire samples outfitted with these high-$C_p$ ribbons, or tapes, were prepared and tested at FNAL for their Minimum Quench Energy (MQE). At 90%I$_c$ and 15 T, the average gain of MQE of the Nb$_3$Sn wire soldered to the Cu/$Gd_2$O$_2$S 55 micrometer thick ribbon was 2.5, and further increased at larger transport currents.


title: A note on occur-check (extended report)

abstract: We weaken the notion of "not subject to occur-check" (NSTO), on which most known results on avoiding the occur-check in logic programming are based. NSTO means that unification is performed only on such pairs of atoms for which the occur-check never succeeds in any run of a nondeterministic unification algorithm. Here we show that "any run" can be weakened to "some run". We present some related sufficient conditions under which the occur-check may be safely omitted. We show examples for which the proposed approach provides more general results than the approaches based on well-moded and nicely moded programs (this includes cases to which the latter approaches are inapplicable). We additionally present a sufficient condition based on NSTO, working for arbitrary selection rules.


title: Realizing a 1D topological gauge theory in an optically dressed BEC

abstract: Topological gauge theories describe the low-energy properties of certain strongly correlated quantum systems through effective weakly interacting models. A prime example is the Chern-Simons theory of fractional quantum Hall states, where anyonic excitations emerge from the coupling between weakly interacting matter particles and a density-dependent gauge field. Although in traditional solid-state platforms such gauge theories are only convenient theoretical constructions, engineered quantum systems enable their direct implementation and provide a fertile playground to investigate their phenomenology without the need for strong interactions. Here, we report the quantum simulation of a topological gauge theory by realizing a one-dimensional reduction of the Chern-Simons theory (the chiral BF theory) in a Bose-Einstein condensate. Using the local conservation laws of the theory, we eliminate the gauge degrees of freedom in favour of chiral matter interactions, which we engineer by synthesizing optically dressed atomic states with momentum-dependent scattering properties. This allows us to reveal the key properties of the chiral BF theory: the formation of chiral solitons and the emergence of an electric field generated by the system itself. Our results expand the scope of quantum simulation to topological gauge theories and open a route to the implementation of analogous gauge theories in higher dimensions.

categories: cond-mat.quant-gas cond-mat.str-el hep-th nlin.PS quant-ph


title: Self-supervised Vision Transformers for Joint SAR-optical Representation Learning

abstract: Self-supervised learning (SSL) has attracted much interest in remote sensing and earth observation due to its ability to learn task-agnostic representations without human annotation. While most of the existing SSL works in remote sensing utilize ConvNet backbones and focus on a single modality, we explore the potential of vision transformers (ViTs) for joint SAR-optical representation learning. Based on DINO, a state-of-the-art SSL algorithm that distills knowledge from two augmented views of an input image, we combine SAR and optical imagery by concatenating all channels to a unified input. Subsequently, we randomly mask out channels of one modality as a data augmentation strategy. While training, the model gets fed optical-only, SAR-only, and SAR-optical image pairs learning both inner- and intra-modality representations. Experimental results employing the BigEarthNet-MM dataset demonstrate the benefits of both, the ViT backbones and the proposed multimodal SSL algorithm DINO-MM.


title: Modeling and Contractivity of Neural-Synaptic Networks with Hebbian Learning

abstract: This paper is concerned with the modeling and analysis of two of the most commonly used recurrent neural network models (i.e., Hopfield neural network and firing-rate neural network) with dynamic recurrent connections undergoing Hebbian learning rules. To capture the synaptic sparsity of neural circuits we propose a low dimensional formulation. We then characterize certain key dynamical properties. First, we give biologically-inspired forward invariance results. Then, we give sufficient conditions for the non-Euclidean contractivity of the models. Our contraction analysis leads to stability and robustness of time-varying trajectories -- for networks with both excitatory and inhibitory synapses governed by both Hebbian and anti-Hebbian rules. For each model, we propose a contractivity test based upon biologically meaningful quantities, e.g., neural and synaptic decay rate, maximum in-degree, and the maximum synaptic strength. Then, we show that the models satisfy Dale's Principle. Finally, we illustrate the effectiveness of our results via a numerical example.


title: Expanding the Materials Search Space for Multivalent Cathodes

abstract: Multivalent batteries are an energy storage technology with the potential to surpass lithium-ion batteries, however their performance has been limited by the low voltages and poor solid-state ionic mobility of available cathodes. A computational screening approach to identify high-performance multivalent intercalation cathodes among materials that do not contain the working ion of interest has been developed which greatly expands the search space that can be considered for materials discovery. This approach has been applied to magnesium cathodes as a proof of concept and four resulting candidate materials (NASICON V$_2$(PO$_4$)$_3$, birnessite NaMn$_4$O$_8$, tavorite MnPO$_4$F, and spinel MnO$_2$) are discussed in further detail. In examining the ion migration environment and associated Mg$^{2+}$ migration energy in these materials, local energy maxima are found to correspond with pathway positions where Mg$^{2+}$ passes through a plane of anion atoms. While previous works have established the influence of local coordination on multivalent ion mobility, these results suggest that considering both the type of local bonding environment as well as available free volume for the mobile ion along its migration pathway can be significant for improving solid-state mobility.


title: Spin-orbit coupling controlled ground states in the double perovskite iridates A2BIrO6 (A = Ba, Sr; B = Lu, Sc)

abstract: Iridates with the 5$d^4$ electronic configuration have attracted recent interest due to reports of magnetically-ordered ground states despite longstanding expectations that their strong spin-orbit coupling would generate a $J = 0$ electronic ground state for each Ir$^{5+}$ ion. The major focus of prior research has been on the double perovskite iridates Ba$_2$YIrO$_6$ and Sr$_2$YIrO$_6$, where the nature of the ground states (i.e. ordered vs non-magnetic) is still controversial. Here we present neutron powder diffraction, high energy resolution fluorescence detected x-ray absorption spectroscopy (HERFD-XAS), resonant inelastic x-ray scattering (RIXS), magnetic susceptibility, and muon spin relaxation data on the related double perovskite iridates Ba$_2$LuIrO$_6$, Sr$_2$LuIrO$_6$, Ba$_2$ScIrO$_6$, and Sr$_2$ScIrO$_6$ that enable us to gain a general understanding of the electronic and magnetic properties for this family of materials. Our HERFD-XAS and RIXS measurements establish $J = 0$ electronic ground states for the Ir$^{5+}$ ions in all cases, with similar values for Hund's coupling $J_{\rm H}$ and the spin-orbit coupling constant $\lambda_{\rm SOC}$. Our bulk susceptibility and muon spin relaxation data find no evidence for long-range magnetic order or spin freezing, but they do reveal weak magnetic signals that are consistent with extrinsic local moments. Our results indicate that the large $\lambda_{\rm SOC}$ is the key driving force behind the electronic and magnetic ground states realized in the 5$d^4$ double perovskite iridates, which agrees well with conventional wisdom.


title: Synchronous observation of Bell nonlocality and state-dependent Kochen-Specker contextuality

abstract: Bell nonlocality and Kochen-Specker contextuality are two remarkable nonclassical features of quantum theory, related to strong correlations between outcomes of measurements performed on quantum systems. Both phenomena can be witnessed by the violation of certain inequalities, the simplest and most important of which are the Clauser-Horne-Shimony-Holt (CHSH) and the Klyachko-Can-Binicio\v{g}lu-Shumovski (KCBS), for Bell nonlocality and Kochen-Specker contextuality, respectively. It has been shown that, using the most common interpretation of Bell scenarios, quantum systems cannot violate both inequalities concomitantly, thus suggesting a monogamous relation between the two phenomena. In this Letter, we show that the joint consideration of the CHSH and KCBS inequalities naturally calls for the so-called generalized Bell scenarios, which, contrary to the previous results, allows for joint violation of them. A photonic experiment thus tests the synchronous violation of both CHSH and KCBS inequalities. Our results agree with the theoretical predictions, thereby providing experimental proof of the coexistence of Bell nonlocality and Kochen-Specker contextuality in the simplest scenario, and shed new light for further explorations of nonclassical features of quantum systems.


title: Encoding a one-dimensional topological gauge theory in a Raman-coupled Bose-Einstein condensate

abstract: Topological gauge theories provide powerful effective descriptions of certain strongly correlated systems, a prime example being the Chern-Simons gauge theory of fractional quantum Hall states. Engineering topological gauge theories in controlled quantum systems is of both conceptual and practical importance, as it would provide access to systems with exotic excitations such as anyons without the need for strong correlations. Here, we discuss a scheme to engineer the chiral BF theory, a minimal model of a topological gauge theory corresponding to a one-dimensional reduction of the Chern-Simons theory, with ultracold atoms. Using the local conservation laws of the theory, we encode its quantum Hamitonian into an ultracold quantum gas with chiral interactions. Building on a seminal proposal by Edmonds et al. (Phys. Rev. Lett. 110, 085301 (2013)), we show how to implement it in a Raman-coupled Bose-Einstein condensate with imbalanced scattering lengths, as we have recently realized experimentally (Fr\"olian et al., Nature 608, 293 (2022)). We discuss the properties of the chiral condensate from a gauge theory perspective, and assess the validity of the effective quantum description for accessible experimental parameters via numerical simulations. Our approach lays the foundation for realizing topological gauge theories in higher dimensions with Bose-Einstein condensates.

categories: cond-mat.quant-gas cond-mat.str-el hep-th quant-ph


title: Deformation of a magnetic liquid drop and unsteady flow inside and outside it in a non-stationary magnetic field

abstract: Small steady-state deformational oscillations of a drop of a viscous magnetic liquid in a non-stationary uniform magnetic field are theoretically investigated for low Reynolds numbers. The drop is suspended in another viscous magnetic liquid immiscible with the former. The non-stationary magnetic field causes flow inside and outside the drop. The inertia is taken into account by regarding the flow as essentially unsteady. The variation of the magnetic field is so slow that the approximation of quasi-stationary magnetic field may be used.


title: The relative contributions of TWIP and TRIP to strength in fine grained medium-Mn steels

abstract: A medium Mn steel of composition Fe-4.8Mn-2.8Al-1.5Si-0.51C (wt.\%) was processed to obtain two different microstructures representing two different approaches in the hot rolling mill, resulting in equiaxed vs. a mixed equiaxed and lamellar microstructures. Both were found to exhibit a simultaneous TWIP$+$TRIP plasticity enhancing mechanism where deformation twins and $\alpha'$-martensite formed independently of twinning with strain. Interrupted tensile tests were conducted in order to investigate the differences in deformation structures between the two microstructures. A constitutive model was used to find that, surprisingly, twinning contributed relatively little to the strength of the alloy, chiefly due to the fine initial slip lengths that then gave rise to relatively little opportunity for work hardening by grain subdivision. Nevertheless, with lower high-cost alloying additions than equivalent Dual Phase steels (2-3 wt\% Mn) and greater ductility, medium-Mn TWIP$+$TRIP steels still represent an attractive area for future development.


title: Random Similarity Forests

abstract: The wealth of data being gathered about humans and their surroundings drives new machine learning applications in various fields. Consequently, more and more often, classifiers are trained using not only numerical data but also complex data objects. For example, multi-omics analyses attempt to combine numerical descriptions with distributions, time series data, discrete sequences, and graphs. Such integration of data from different domains requires either omitting some of the data, creating separate models for different formats, or simplifying some of the data to adhere to a shared scale and format, all of which can hinder predictive performance. In this paper, we propose a classification method capable of handling datasets with features of arbitrary data types while retaining each feature's characteristic. The proposed algorithm, called Random Similarity Forest, uses multiple domain-specific distance measures to combine the predictive performance of Random Forests with the flexibility of Similarity Forests. We show that Random Similarity Forests are on par with Random Forests on numerical data and outperform them on datasets from complex or mixed data domains. Our results highlight the applicability of Random Similarity Forests to noisy, multi-source datasets that are becoming ubiquitous in high-impact life science projects.


title: Analysis of the ALMA Cycle 8 Distributed Peer Review Process

abstract: In response to the challenges presented by high reviewer workloads in traditional panel reviews and increasing numbers of submitted proposals, ALMA implemented distributed peer review to assess the majority of proposals submitted to the Cycle 8 Main Call. In this paper, we present an analysis of this review process. Over 1000 reviewers participated in the process to review 1497 proposals, making it the largest implementation of distributed peer review to date in astronomy, and marking the first time this process has been used to award the majority of observing time at an observatory. We describe the process to assign proposals to reviewers, analyze the nearly 15,000 ranks and comments submitted by reviewers to identify any trends and systematics, and gather feedback on the process from reviewers and Principal Investigators (PIs) through surveys. Approximately 90% of the proposal assignments were aligned with the expertise of the reviewer, as measured both by the expertise keywords provided by the reviewers and the reviewers' self-assessment of their expertise on their assigned proposals. PIs rated 73% of the individual review comments as helpful, and even though the reviewers had a broad range of experience levels, PIs rated the quality of the comments received from students and senior researchers similarly. The primary concerns raised by PIs were the quality of some reviewer comments and high dispersions in the ranks. The ranks and comments are correlated with various demographics to identify the main areas in which the review process can be improved in future cycles.


title: A Non-Local Quasi-Linear Ground State Representation and Criticality Theory

abstract: We study energy functionals associated with non-local quasi-linear Schr\"odinger operators, and develop a ground state representation. Our main focus is on infinite graphs but we also consider non-local quasi-linear Schr\"odinger operators in the Euclidean space. Using the representation, we develop a criticality theory for quasi-linear Schr\"odinger operators on general weighted graphs, and show characterisations for a Hardy inequality to hold true. As an application, we show a Liouville comparison principle on graphs.


title: Magnetoquantum Oscillations in the Specific Heat of a Topological Kondo Insulator

abstract: Surprisingly, magnetoquantum oscillations (MQO) characteristic of a metal with a Fermi surface have been observed in measurements of the topological Kondo insulator SmB6. As these MQO have only been observed in measurements of magnetic torque (dHvA) and not in measurements of magnetoresistance (SdH), a debate has arisen as to whether the MQO are an extrinsic effect arising from rare-earth impurities, defects, and/or aluminum inclusions or an intrinsic effect revealing the existence of charge-neutral excitations. We report here the first observation of magnetoquantum oscillations in the low-temperature specific heat of SmB6. The observed frequencies and their angular dependence for these flux-grown samples are consistent with previous results based on magnetic torque for SmB6 but the inferred effective masses are significantly larger than previously reported. Such oscillations can only be observed if the MQO are of bulk thermodynamic origin; the measured magnetic-field dependent oscillation amplitude and effective mass allow us to rule out suggestions of an extrinsic, aluminium inclusion-based origin for the MQO.


title: Improving Few-Shot Part Segmentation using Coarse Supervision

abstract: A significant bottleneck in training deep networks for part segmentation is the cost of obtaining detailed annotations. We propose a framework to exploit coarse labels such as figure-ground masks and keypoint locations that are readily available for some categories to improve part segmentation models. A key challenge is that these annotations were collected for different tasks and with different labeling styles and cannot be readily mapped to the part labels. To this end, we propose to jointly learn the dependencies between labeling styles and the part segmentation model, allowing us to utilize supervision from diverse labels. To evaluate our approach we develop a benchmark on the Caltech-UCSD birds and OID Aircraft dataset. Our approach outperforms baselines based on multi-task learning, semi-supervised learning, and competitive methods relying on loss functions manually designed to exploit sparse-supervision.


title: Nonlocal Effect on a Generalized Ohta-Kawasaki Model

abstract: We propose a nonlocal Ohta-Kawasaki model to study the nonlocal effect on the pattern formation of some binary systems with general long-range interactions. While the nonlocal Ohta-Kawasaki model displays similar bubble patterns as the standard Ohta-Kawasaki model, by performing Fourier analysis, we find that the optimal number of bubbles for the nonlocal model may have an upper bound no matter how large the repulsive strength is. The existence of such an upper bound is characterized by the eigenvalues of the nonlocal kernels. Additionally we explore the conditions under which the nonlocal horizon parameter may promote or demote the bubble splitting, and apply the analysis framework to several case studies for various nonlocal operators.


title: The ASEP speed process

abstract: For ASEP with step initial data and a second class particle started at the origin we prove that as time goes to infinity the second class particle almost surely achieves a velocity that is uniformly distributed on $[-1,1]$. This positively resolves Conjecture 1.9 and 1.10 of [Amir, Angel and Valko, "The TASEP speed process", Annals of Probability 39, 1205--1242, 2011] and allows us to construct the ASEP speed process.


title: A conjectural formula for $\lambda_g\mathrm{DR}_g(a,-a)$ is true in Gorenstein quotient

abstract: In this note we prove that a conjectural formula for the class $\lambda_g \mathrm{DR}_g(a,-a)\in R^{2g}(\overline{\mathcal{M}}_{g,2})$ proposed recently by Buryak-Iglesias-Shadrin is true in the Gorenstein quotient of the ring $R^*(\overline{\mathcal{M}}_{g,2})$. As a corollary we prove the strong $\mathrm{DR} \backslash \mathrm{DZ}$ equivalence conjecture for one-point correlators.


title: Accelerated Design and Deployment of Low-Carbon Concrete for Data Centers

abstract: Concrete is the most widely used engineered material in the world with more than 10 billion tons produced annually. Unfortunately, with that scale comes a significant burden in terms of energy, water, and release of greenhouse gases and other pollutants; indeed 8% of worldwide carbon emissions are attributed to the production of cement, a key ingredient in concrete. As such, there is interest in creating concrete formulas that minimize this environmental burden, while satisfying engineering performance requirements including compressive strength. Specifically for computing, concrete is a major ingredient in the construction of data centers. In this work, we use conditional variational autoencoders (CVAEs), a type of semi-supervised generative artificial intelligence (AI) model, to discover concrete formulas with desired properties. Our model is trained just using a small open dataset from the UCI Machine Learning Repository joined with environmental impact data from standard lifecycle analysis. Computational predictions demonstrate CVAEs can design concrete formulas with much lower carbon requirements than existing formulations while meeting design requirements. Next we report laboratory-based compressive strength experiments for five AI-generated formulations, which demonstrate that the formulations exceed design requirements. The resulting formulations were then used by Ozinga Ready Mix -- a concrete supplier -- to generate field-ready concrete formulations, based on local conditions and their expertise in concrete design. Finally, we report on how these formulations were used in the construction of buildings and structures in a Meta data center in DeKalb, IL, USA. Results from field experiments as part of this real-world deployment corroborate the efficacy of AI-generated low-carbon concrete mixes.


title: An answer to an open question in the incremental SVD

abstract: Incremental singular value decomposition (SVD) was proposed by Brand to efficiently compute the SVD of a matrix. The algorithm needs to compute thousands or millions of orthogonal matrices and to multiply them together. However, the multiplications may corrode the orthogonality. Hence many reorthogonalizations are needed in practice. In [Linear Algebra and its Applications 415 (2006) 20-30], Brand asked "It is an open question how often this is necessary to guarantee a certain overall level of numerical precision; it does not change the overall complexity." In this paper, we answer this question and the answer is we can avoid computing the large amount of those orthogonal matrices and hence the reorthogonalizations are not necessary by modifying his algorithm. We prove that the modification does not change the outcomes of the algorithm. Numerical experiments are presented to illustrate the performance of our modification.


title: Near-field radiative heat transfer between irregularly shaped dielectric particles modeled with the discrete system Green's function method

abstract: Near-field radiative heat transfer (NFRHT) between irregularly shaped dielectric particles made of SiO2 and morphology characterized by Gaussian random spheres is studied. Particles are modeled using the discrete system Green's function (DSGF) approach, which is a volume integral numerical method based on fluctuational electrodynamics. This method is applicable to finite, three-dimensional objects, and all system interactions are defined independent of thermal excitation by a generalized system Green's function. The DSGF method is deemed suitable to model NFRHT between irregularly shaped particles after verification against the analytical solution for chains of two and three SiO2 spheres. The NFRHT results reveal that geometric irregularity in particles leads to a reduction of the total conductance from that of comparable perfect spheres at vacuum separation distances smaller than the particle size, a regime in which NFRHT is a surface phenomenon. At vacuum separation distances larger than the particle size, NFRHT becomes a volumetric process, and the total conductance between irregularly shaped particles converges to that of comparable perfect spheres. Spectral analysis reveals, however, that particle irregularity leads to damping and broadening of resonances at all separation distances, thereby highlighting the importance of the DSGF method for spectral engineering in the near field. The reduced spectral coherence when particle size is larger than the vacuum separation distance is attributed to coupling of surface phonon-polaritons within the randomly generated, distorted particle features. For particle size smaller than the vacuum separation distance, resonance broadening and damping is linked with the multiple localized surface phonon modes supported by the composite spherical harmonic morphologies of the Gaussian random spheres.


title: Transfer Learning for Autonomous Chatter Detection in Machining

abstract: Large-amplitude chatter vibrations are one of the most important phenomena in machining processes. It is often detrimental in cutting operations causing a poor surface finish and decreased tool life. Therefore, chatter detection using machine learning has been an active research area over the last decade. Three challenges can be identified in applying machine learning for chatter detection at large in industry: an insufficient understanding of the universality of chatter features across different processes, the need for automating feature extraction, and the existence of limited data for each specific workpiece-machine tool combination. These three challenges can be grouped under the umbrella of transfer learning. This paper studies automating chatter detection by evaluating transfer learning of prominent as well as novel chatter detection methods. We investigate chatter classification accuracy using a variety of features extracted from turning and milling experiments with different cutting configurations. The studied methods include Fast Fourier Transform (FFT), Power Spectral Density (PSD), the Auto-correlation Function (ACF), Wavelet Packet Transform (WPT), and Ensemble Empirical Mode Decomposition (EEMD). We also examine more recent approaches based on Topological Data Analysis (TDA) and similarity measures of time series based on Discrete Time Warping (DTW). We evaluate the transfer learning potential of each approach by training and testing both within and across the turning and milling data sets. Our results show that carefully chosen time-frequency features can lead to high classification accuracies albeit at the cost of requiring manual pre-processing and the tagging of an expert user. On the other hand, we found that the TDA and DTW approaches can provide accuracies and F1 scores on par with the time-frequency methods without the need for manual preprocessing.


title: Chemical state analysis of reactively sputtered zinc vanadium nitride: The Auger parameter as a tool in materials design

abstract: Photoelectron spectroscopy is an important tool for the development of new materials. However, especially for nitride semiconductors, the formation of surface oxides, surface band bending as well as the lack of a suitable charge reference often prevent a robust analysis. Here, we perform a comprehensive chemical state analysis of the Zn-V-N phase space using the Auger parameter concept, which is less sensitive to such uncertainties. Phase-pure Zn2VN3, VN, and Zn3N2 samples are analyzed using XPS/HAXPES after transfer in inert-gas atmosphere. In addition, high-throughput chemical state analysis is performed on combinatorial Zn1-xVxN thin film libraries. The evolution of the Zn Auger parameter in Zn1-xVxN is consistent with previous mapping of the structural and functional properties. Strikingly, the study reveals a narrower stability range of wurtzite Zn1-xVxN than our previous high-throughput XRD screening, highlighting the sensitivity of the measurement approach. The procedures applied here are transferable to many other material systems and could be particularly useful for the high-throughput development of materials with low crystallinity where insights from XRD screenings are limited.


title: On $SL(2,\mathbb{R})$-cocycles over irrational rotations with secondary collisions

abstract: We consider a skew product $F_{A} = (\sigma_{\omega}, A)$ over irrational rotation $\sigma_{\omega}(x) = x + \omega$ of a circle $\mathbb{T}^{1}$. It is supposed that the transformation $A: \mathbb{T}^{1} \to SL(2, \mathbb{R})$ being a $C^{1}$-map has the form $A(x) = R(\varphi(x)) Z(\lambda(x))$, where $R(\varphi)$ is a rotation in $\mathbb{R}^{2}$ over the angle $\varphi$ and $Z(\lambda)= diag\{\lambda, \lambda^{-1}\}$ is a diagonal matrix. Assuming that $\lambda(x) \ge \lambda_{0} > 1$ with a sufficiently large constant $\lambda_{0}$ and the function $\varphi$ be such that $\cos \varphi(x)$ possesses only simple zeroes, we study hyperbolic properties of the cocycle generated by $F_{A}$. We apply the critical set method to show that, under some additional requirements on the derivative of the function $\varphi$, the secondary collisions compensate weakening of the hyperbolicity due to primary collisions and the cocycle generated by $F_{A}$ becomes hyperbolic in contrary to the case when secondary collisions can be partially eliminated.


title: Optimal brokerage contracts in Almgren-Chriss model with multiple clients

abstract: This paper constructs optimal brokerage contracts for multiple (heterogeneous) clients trading a single asset whose price follows the Almgren-Chriss model. The distinctive features of this work are as follows: (i) the reservation values of the clients are determined endogenously, and (ii) the broker is allowed to not offer a contract to some of the potential clients, thus choosing her portfolio of clients strategically. We find a computationally tractable characterization of the optimal portfolios of clients (up to a digital optimization problem, which can be solved efficiently if the number of potential clients is small) and conduct numerical experiments which illustrate how these portfolios, as well as the equilibrium profits of all market participants, depend on the price impact coefficients.


title: Renormalization and a non-adiabatic vacuum choice in a radiation-dominated universe

abstract: Vacuum and particles can be naturally defined in the adiabatic regime of an expanding universe. In general, however, there is no preferred choice of a vacuum state, unless the spacetime background possesses special symmetries. In the absence of symmetries the standard viewpoint is to construct distinguished adiabatic states permitting renormalizability of the stress-energy tensor. We study a special non-adiabatic vacuum for a massive scalar field in a radiation-dominated universe defined by imposing early-times conformal symmetry. We show that this state is consistent with renormalization, despite its ultraviolet behaviour is not the conventional one due to the emergence of oscillatory terms.


title: MPC-Based Emergency Vehicle-Centered Multi-Intersection Traffic Control

abstract: This paper proposes a traffic control scheme to alleviate traffic congestion in a network of interconnected signaled lanes/roads. The proposed scheme is emergency vehicle-centered, meaning that it provides an efficient and timely routing for emergency vehicles. In the proposed scheme, model predictive control is utilized to control inlet traffic flows by means of network gates, as well as configuration of traffic lights across the network. Two schemes are considered in this paper: i) centralized; and ii) decentralized. In the centralized scheme, a central unit controls the entire network. This scheme provides the optimal solution, even though it might not fulfil real-time computation requirements for large networks. In the decentralized scheme, each intersection has its own control unit, which sends local information to an aggregator. The main responsibility of this aggregator is to receive local information from all control units across the network as well as the emergency vehicle, to augment the received information, and to share it with the control units. Since the decision-making in decentralized scheme is local and the aggregator should fulfil the above-mentioned tasks during a traffic cycle which takes a long period of time, the decentralized scheme is suitable for large networks, even though it may provide a sub-optimal solution. Extensive simulation studies are carried out to validate the proposed schemes, and assess their performance. Notably, the obtained results reveal that traveling times of emergency vehicles can be reduced up to ~50% by using the centralized scheme and up to ~30% by using the decentralized scheme, without causing congestion in other lanes.


title: Chaos for rescaled measures on Kac's sphere

abstract: In this article we study a relatively novel way of constructing chaotic sequences of probability measures supported on Kac's sphere, which are obtained as the law of a vector of $N$ i.i.d. variables after it is rescaled to have unit average energy. We show that, as $N$ increases, this sequence is chaotic in the sense of Kac, with respect to the Wasserstein distance, in $L^1$, in the entropic sense, and in the Fisher information sense. For many of these results, we provide explicit rates of polynomial order in $N$. In the process, we improve a quantitative entropic chaos result of Haurey and Mischler by relaxing the finite moment requirement on the densities from order $6$ to $4+\epsilon$.


title: Tissue fluidization by cell-shape-controlled active stresses

abstract: Biological cells can actively tune their intracellular architecture according to their overall shape. Here we explore the rheological implication of such coupling in a minimal model of a dense cellular material where each cell exerts an active mechanical stress along its axis of elongation. Increasing the active stress amplitude leads to several transitions. An initially hexagonal crystal motif is first destabilized into a solid with anisotropic cells. Increasing activity further, we find a re-entrant transition to a regime with finite hexatic order and finite shear modulus, in which cells arrange according to a rhombile pattern with periodically arranged rosette structures. The shear modulus vanishes again at a third threshold beyond which spontaneous tissue flows arise. In this last regime, we observe the emergence of cell shape patterns called topological defects, with flow and stress fields around defects agreeing with those observed in epithelial tissue experiments. We further provide a testable prediction of cell-cell rearrangement hotspots near topological defects. Overall, our work connects seemingly distinct features - e.g. rosettes and topological defects - observed across various types of epithelial tissues.


title: Log canonical thresholds and coregularity

abstract: We prove the ascending chain condition for log canonical thresholds of bounded coregularity.


title: Unified Speech-Text Pre-training for Speech Translation and Recognition

abstract: We describe a method to jointly pre-train speech and text in an encoder-decoder modeling framework for speech translation and recognition. The proposed method incorporates four self-supervised and supervised subtasks for cross modality learning. A self-supervised speech subtask leverages unlabelled speech data, and a (self-)supervised text to text subtask makes use of abundant text training data. Two auxiliary supervised speech tasks are included to unify speech and text modeling space. Our contribution lies in integrating linguistic information from the text corpus into the speech pre-training. Detailed analysis reveals learning interference among subtasks. Two pre-training configurations for speech translation and recognition, respectively, are presented to alleviate subtask interference. Our experiments show the proposed method can effectively fuse speech and text information into one model. It achieves between 1.7 and 2.3 BLEU improvement above the state of the art on the MuST-C speech translation dataset and comparable WERs to wav2vec 2.0 on the Librispeech speech recognition task.


title: Multi-spacecraft Analysis of the Properties of Magnetohydrodynamic Fluctuations in Sub-Alfv\'enic Solar Wind Turbulence at 1 AU

abstract: We present three-dimensional magnetic power spectra in wavevector space to investigate anisotropy and scalings of sub-Alfv\'enic solar wind turbulence at magnetohydrodynamic (MHD) scale using the Magnetospheric Multiscale spacecraft. The magnetic power distributions are organized in a new coordinate determined by wavevectors (k) and background magnetic field ($b_0$) in Fourier space. This study utilizes two approaches to determine wavevectors: singular value decomposition method and timing analysis. The combination of the two methods allows an examination of magnetic field properties in terms of mode compositions without any spatiotemporal hypothesis. Observations show that fluctuations ($\delta B_{\perp1}$) in the direction perpendicular to k and $b_0$ prominently cascade perpendicular to $b_0$, and such anisotropy increases with wavenumber. The reduced power spectra of $\delta B_{\perp1}$ follow Goldreich-Sridhar scalings: $P(k_\perp)\sim k_\perp^{-5/3}$ and $P(k_{||}) \sim k_{||}^{-2}$. In contrast, fluctuations within $kb_0$ plane show isotropic behaviors: perpendicular power distributions are approximately the same as parallel distributions. The reduced power spectra of fluctuations within $kb_0$ plane follow the scalings: $P(k_\perp)\sim k_\perp^{-3/2}$ and $P(k_{||})\sim k_{||}^{-3/2}$. Comparing frequency-wavevector spectra with theoretical dispersion relations of MHD modes, we find that $\delta B_{\perp1}$ are probably associated with Alfven modes. Moreover, for the Alfv\'enic component, the ratio of cascading time to the wave period is found to be a factor of a few, consistent with critical balance in the strong turbulence regime. The magnetic field fluctuations within $kb_0$ plane more likely originate from fast modes based on isotropic behaviors.

categories: astro-ph.SR astro-ph.EP astro-ph.GA physics.space-ph


title: $\{\text{PF}\}^2$ES: Parallel Feasible Pareto Frontier Entropy Search for Multi-Objective Bayesian Optimization

abstract: We present Parallel Feasible Pareto Frontier Entropy Search ($\{\text{PF}\}^2$ES) -- a novel information-theoretic acquisition function for multi-objective Bayesian optimization supporting unknown constraints and batch query. Due to the complexity of characterizing the mutual information between candidate evaluations and (feasible) Pareto frontiers, existing approaches must either employ crude approximations that significantly hamper their performance or rely on expensive inference schemes that substantially increase the optimization's computational overhead. By instead using a variational lower bound, $\{\text{PF}\}^2$ES provides a low-cost and accurate estimate of the mutual information. We benchmark $\{\text{PF}\}^2$ES against other information-theoretic acquisition functions, demonstrating its competitive performance for optimization across synthetic and real-world design problems.


title: NEOWISE Observations Of The Potentially Hazardous Asteroid (99942) Apophis

abstract: Large potentially hazardous asteroids (PHAs) are capable of causing a global catastrophe in the event of a planetary collision. Thus, rapid assessment of such an object's physical characteristics is crucial for determining its potential risk scale. We treated the near-Earth asteroid (99942) Apophis as a newly discovered object during its 2020-2021 close-approach as part of a mock planetary defense exercise. The object was detected by the Near-Earth Object Wide-field Infrared Survey Explorer (NEOWISE), and data collected by the two active bands (3.4 ${\mu}$m and 4.6 ${\mu}$m) were analyzed using thermal and thermophysical modeling. Our results indicate that Apophis is an elongated object with an effective spherical diameter D$_{eff}$ = 340 $\pm$ 70 m, a geometric visual albedo p$_{V}$ = 0.31 $\pm$ 0.09, and a thermal inertia $\Gamma$ $\sim$ 150 - 2850 Jm$^{-2}$s$^{-0.5}$K$^{-1}$ with a best-fit value of 550 Jm$^{-2}$s$^{-0.5}$K$^{-1}$. NEOWISE "discovery" observations reveal that (99942) Apophis is a potentially hazardous asteroid that would likely cause damage at a regional level and not a global one.


title: A Switching Thrust Tracking Controller for Load Constrained Wind Turbines

abstract: Wind turbines are prone to structural degradation, particularly in offshore locations. Based on the structural health condition of the tower, power de-rating strategies can be used to reduce structural loads at the cost of power losses.This paper introduces a novel closed-loop switching control architecture to constrain the thrust in individual turbines. By taking inspiration from developments in the field of reference governors, an existing demanded power tracking controller is extended by a thrust tracking controller. The latter is activated only when a user-defined constraint on fore-aft thrust force is exceeded, which can be set based on the actual damage status of the turbine. Having a down-regulation with monotonic aerodynamic load response, a simple linear thrust tracking controller is proposed. Such a scheme can reduce aerodynamic loads while incurring acceptable losses on power production which, in a wind farm setting, can be compensated for by other turbines. Large eddy simulations demonstrate the performance of the proposed scheme on satisfying thrust constraints.


title: Hadamard and boundary conditions for the Big Bang quantum vacuum

abstract: General relativity predicts final-type singularities inside black holes, as well as a cosmological initial-type singularity. Cosmic censorship protects external observers from black hole singularities, while Penrose's Weyl curvature hypothesis protects the smoothness of the initial (Big Bang) singularity. We discuss a simple realization of the Weyl curvature hypothesis by assuming a very early radiation-dominated universe and analytically extending the expansion factor to negative values of conformal time. We impose time-reversal conditions at the Big Bang to characterize a natural set of preferred vacuum states for quantized matter fields. We implement the prescription of States of Low Energy constructed around the Big Bang obtaining Hadamard states. We also explore the physical implications of these vacua for cosmological dark matter production.


title: Bayesian Parameter Estimation for Dynamical Models in Systems Biology

abstract: Dynamical systems modeling, particularly via systems of ordinary differential equations, has been used to effectively capture the temporal behavior of different biochemical components in signal transduction networks. Despite the recent advances in experimental measurements, including sensor development and '-omics' studies that have helped populate protein-protein interaction networks in great detail, modeling in systems biology lacks systematic methods to estimate kinetic parameters and quantify associated uncertainties. This is because of multiple reasons, including sparse and noisy experimental measurements, lack of detailed molecular mechanisms underlying the reactions, and missing biochemical interactions. Additionally, the inherent nonlinearities with respect to the states and parameters associated with the system of differential equations further compound the challenges of parameter estimation. In this study, we propose a comprehensive framework for Bayesian parameter estimation and complete quantification of the effects of uncertainties in the data and models. We apply these methods to a series of signaling models of increasing mathematical complexity. Systematic analysis of these dynamical systems showed that parameter estimation depends on data sparsity, noise level, and model structure, including the existence of multiple steady states. These results highlight how focused uncertainty quantification can enrich systems biology modeling and enable additional quantitative analyses for parameter estimation.


title: Mass optimization problem with convex cost

abstract: In this paper we consider a mass optimization problem in the case of scalar state function, where instead of imposing a constraint on the total mass of the competitors, we penalize the classical compliance by a convex functional defined on the space of measures. We obtain a characterization of optimal solutions to the problem through a suitable PDE. This generalizes the case considered in the literature of a linear cost and applies to the optimization of a conductor where very low and very high conductivities have both a high cost, and then the study of nonlinear models becomes relevant.


title: Active power control of wind farms: an instantaneous approach on waked conditions

abstract: This paper presents a closed-loop controller for wind farms to provide active power control services using a high-fidelity computational fluid dynamics based wind plant simulator. The proposed design enhances power tracking stability and allows for simple understanding, where each turbine is considered as a pure time-delay system. The paper investigates the control performance with different nominal power distributions in a fully waked condition and limited power availability. Results demonstrate the improvement in power production obtained by closing the control loop, compared to greedy operation. Additionally, power tracking capabilities are enhanced with a nominal power distribution favored by axial-induction, as well as the occurrence of turbine saturation and the distribution of loads.


title: Hadron and light nucleus radii from electron scattering

abstract: Conceptually, radii are amongst the simplest Poincar\'e-invariant properties that can be associated with hadrons and light nuclei. Accurate values of these quantities are necessary so that one may judge the character of putative solutions to the strong interaction problem within the Standard Model. However, limiting their ability to serve in this role, recent measurements and new analyses of older data have revealed uncertainties and imprecisions in the radii of the proton, pion, kaon, and deuteron. In the context of radius measurement using electron + hadron elastic scattering, the past decade has shown that reliable extraction requires complete elimination of bias associated with practitioner-dependent choices of data fitting functions. Different answers to that challenge have been offered; and this perspective describes the statistical Schlessinger point method (SPM), in unifying applications to proton, pion, kaon, and deuteron radii. Grounded in analytic function theory, independent of assumptions about underlying dynamics, free from practitioner-induced bias, and applicable in the same form to diverse systems and observables, the SPM returns an objective expression of the information contained in any data under consideration. Its robust nature and versatility make it suitable for use in many branches of experiment and theory.


title: A Wav2vec2-Based Experimental Study on Self-Supervised Learning Methods to Improve Child Speech Recognition

abstract: Despite recent advancements in deep learning technologies, Child Speech Recognition remains a challenging task. Current Automatic Speech Recognition (ASR) models require substantial amounts of annotated data for training, which is scarce. In this work, we explore using the ASR model, wav2vec2, with different pretraining and finetuning configurations for self-supervised learning (SSL) toward improving automatic child speech recognition. The pretrained wav2vec2 models were finetuned using different amounts of child speech training data, adult speech data, and a combination of both, to discover the optimum amount of data required to finetune the model for the task of child ASR. Our trained model achieves the best Word Error Rate (WER) of 7.42 on the MyST child speech dataset, 2.99 on the PFSTAR dataset and 12.47 on the CMU KIDS dataset as compared to any other previous methods. Our models outperformed the wav2vec2 BASE 960 on child speech which is considered a state-of-the-art ASR model on adult speech by just using 10 hours of child speech data in finetuning. The analysis of different types of training data and their effect on inference is also provided by using a combination of datasets in pretraining, finetuning and inference.


title: On the Dirichlet problem for Lagrangian phase equation with critical and supercritical phase

abstract: In this paper, we solve the Dirichlet problem for Lagrangian phase equation with critical and supercritical phase. A crucial ingredient is the interior $C^2$ estimate. Our result is sharp in the sense that there exist singular solutions in the subcritical phase case.


title: A Survey on Crowdsourcing Applications in Smart Cities

abstract: With the emergence of the Internet of things (IoT), human life is now progressing towards smartification faster than ever before. Thus, smart cities become automated in different aspects such as business, education, economy, medicine, and urban areas. Since smartification requires a variety of dynamic information in different urban dimensions, mobile crowdsourcing has gained importance in smart cities. This chapter systematically reviews the related applications of smart cities that use mobile crowdsourcing for data acquisition. For this purpose, the applications are classified as environmental, urban life, and transportation categories and then investigated in detail. This survey helps in understanding the current situation of smart cities from the viewpoint of crowdsourcing and discusses the future research directions in this field.


title: SATA: Sparsity-Aware Training Accelerator for Spiking Neural Networks

abstract: Spiking Neural Networks (SNNs) have gained huge attention as a potential energy-efficient alternative to conventional Artificial Neural Networks (ANNs) due to their inherent high-sparsity activation. Recently, SNNs with backpropagation through time (BPTT) have achieved a higher accuracy result on image recognition tasks than other SNN training algorithms. Despite the success from the algorithm perspective, prior works neglect the evaluation of the hardware energy overheads of BPTT due to the lack of a hardware evaluation platform for this SNN training algorithm. Moreover, although SNNs have long been seen as an energy-efficient counterpart of ANNs, a quantitative comparison between the training cost of SNNs and ANNs is missing. To address the aforementioned issues, in this work, we introduce SATA (Sparsity-Aware Training Accelerator), a BPTT-based training accelerator for SNNs. The proposed SATA provides a simple and re-configurable systolic-based accelerator architecture, which makes it easy to analyze the training energy for BPTT-based SNN training algorithms. By utilizing the sparsity, SATA increases its computation energy efficiency by $5.58 \times$ compared to the one without using sparsity. Based on SATA, we show quantitative analyses of the energy efficiency of SNN training and compare the training cost of SNNs and ANNs. The results show that, on Eyeriss-like systolic-based architecture, SNNs consume $1.27\times$ more total energy with sparsities when compared to ANNs. We find that such high training energy cost is from time-repetitive convolution operations and data movements during backpropagation. Moreover, to propel the future SNN training algorithm design, we provide several observations on energy efficiency for different SNN-specific training parameters and propose an energy estimation framework for SNN training. Code for our framework is made publicly available.


title: Automated Task Updates of Temporal Logic Specifications for Heterogeneous Robots

abstract: Given a heterogeneous group of robots executing a complex task represented in Linear Temporal Logic, and a new set of tasks for the group, we define the task update problem and propose a framework for automatically updating individual robot tasks given their respective existing tasks and capabilities. Our heuristic, token-based, conflict resolution task allocation algorithm generates a near-optimal assignment for the new task. We demonstrate the scalability of our approach through simulations of multi-robot tasks.


title: A Call for Clarity in Beam Search: How It Works and When It Stops

abstract: Text generation with beam search has proven successful in a wide range of applications. We point out that, though largely overlooked in the literature, the commonly-used implementation of beam decoding (e.g., Hugging Face Transformers and fairseq) uses a first come, first served heuristic: it keeps a set of already completed sequences over time steps and stops when the size of this set reaches the beam size. Based on this finding, we introduce a patience factor, a simple modification to this beam decoding implementation, that generalizes the stopping criterion and provides flexibility to the depth of search. Empirical results demonstrate that adjusting this patience factor improves decoding performance of strong pretrained models on news text summarization and machine translation over diverse language pairs, with a negligible inference slowdown. Our approach only modifies one line of code and can be thus readily incorporated in any implementation. Further, we find that different versions of beam decoding result in large performance differences in summarization, demonstrating the need for clarity in specifying the beam search implementation in research work. Our code will be available upon publication.


title: Transition-Potential Coupled Cluster II: Optimization of the Core Orbital Occupation Number

abstract: The issue of orbital relaxation in computational core-hole spectroscopy, specifically x-ray absorption, has been a major problem for methods such as equation-of-motion coupled cluster with singles and doubles (EOM-CCSD). The transition-potential coupled cluster (TP-CC) method is utilized to address this problem by including an explicit treatment of orbital relaxation via the use of reference orbitals with a fractional core occupation number. The value of the fractional occupation parameter $\lambda$ was optimized for both TP-CCSD and XTP-CCSD methods in an element-specific manner due to the differences in atomic charge and energy scale. Additionally, TP-CCSD calculations using the optimized parameters were performed for the K-edge absorption spectra of gas-phase adenine and thymine. TP-CCSD reproduces the valence region well and requires smaller overall energy shifts in comparison to EOM-CCSD, while also improving on the relative position and intensities of several absorption peaks.


title: ProtoTEx: Explaining Model Decisions with Prototype Tensors

abstract: We present ProtoTEx, a novel white-box NLP classification architecture based on prototype networks. ProtoTEx faithfully explains model decisions based on prototype tensors that encode latent clusters of training examples. At inference time, classification decisions are based on the distances between the input text and the prototype tensors, explained via the training examples most similar to the most influential prototypes. We also describe a novel interleaved training algorithm that effectively handles classes characterized by the absence of indicative features. On a propaganda detection task, ProtoTEx accuracy matches BART-large and exceeds BERT-large with the added benefit of providing faithful explanations. A user study also shows that prototype-based explanations help non-experts to better recognize propaganda in online news.


title: Generalizing Adversarial Explanations with Grad-CAM

abstract: Gradient-weighted Class Activation Mapping (Grad- CAM), is an example-based explanation method that provides a gradient activation heat map as an explanation for Convolution Neural Network (CNN) models. The drawback of this method is that it cannot be used to generalize CNN behaviour. In this paper, we present a novel method that extends Grad-CAM from example-based explanations to a method for explaining global model behaviour. This is achieved by introducing two new metrics, (i) Mean Observed Dissimilarity (MOD) and (ii) Variation in Dissimilarity (VID), for model generalization. These metrics are computed by comparing a Normalized Inverted Structural Similarity Index (NISSIM) metric of the Grad-CAM generated heatmap for samples from the original test set and samples from the adversarial test set. For our experiment, we study adversarial attacks on deep models such as VGG16, ResNet50, and ResNet101, and wide models such as InceptionNetv3 and XceptionNet using Fast Gradient Sign Method (FGSM). We then compute the metrics MOD and VID for the automatic face recognition (AFR) use case with the VGGFace2 dataset. We observe a consistent shift in the region highlighted in the Grad-CAM heatmap, reflecting its participation to the decision making, across all models under adversarial attacks. The proposed method can be used to understand adversarial attacks and explain the behaviour of black box CNN models for image analysis.


title: A Multilingual Perspective Towards the Evaluation of Attribution Methods in Natural Language Inference

abstract: Most evaluations of attribution methods focus on the English language. In this work, we present a multilingual approach for evaluating attribution methods for the Natural Language Inference (NLI) task in terms of faithfulness and plausibility. First, we introduce a novel cross-lingual strategy to measure faithfulness based on word alignments, which eliminates the drawbacks of erasure-based evaluations.We then perform a comprehensive evaluation of attribution methods, considering different output mechanisms and aggregation methods. Finally, we augment the XNLI dataset with highlight-based explanations, providing a multilingual NLI dataset with highlights, to support future exNLP studies. Our results show that attribution methods performing best for plausibility and faithfulness are different.


title: Computing a Sparse Projection into a Box

abstract: We describe a procedure to compute a projection of $w \in \mathbb{R}^n$ into the intersection of the so-called \emph{zero-norm} ball $k \mathbb{B}_0$ of radius $k$, i.e., the set of $k$-sparse vectors, with a box centered at a point of $k \mathbb{B}_0$. The need for such projection arises in the context of certain trust-region methods for nonsmooth regularized optimization. Although the set into which we wish to project is nonconvex, we show that a solution may be found in $O(n \log(n))$ operations. We describe our Julia implementation and illustrate our procedure in the context of two trust-region methods for nonsmooth regularized optimization.


title: On polyharmonic polynomials

abstract: We study the orthogonal projection of homogeneous polynomials onto the space of homogeneous polyharmonic polynomials. To do this we derive the decomposition of homogeneous polynomials in terms of the Kelvin transform of derivatives of the fundamental solution $|x|^{2-n}$ or $\log |x|$. We consider also the vector bases of the space of homogeneous polyharmonic polynomials and study the problem of convergence of orthogonal series.


title: The classification problem for extensions of torsion-free abelian groups, I

abstract: Let $C,A$ be countable abelian groups. In this paper we determine the complexity of classifying extensions $C$ by $A$, in the cases when $C$ is torsion-free and $A$ is a $p$-group, a torsion group with bounded primary components, or a free $R$-module for some subring $R\subseteq \mathbb{Q}$. Precisely, for such $C$ and $A$ we describe in terms of $C$ and $A$ the potential complexity class in the sense of Borel complexity theory of the equivalence relation $\mathcal{R}_{\mathbf{Ext}\left( C,A\right) }$ of isomorphism of extensions of $C$ by $A$. This complements a previous result by the same author, settling the case when $C$ is torsion and $A$ is arbitrary. We establish the main result within the framework of Borel-definable homological algebra, recently introduced in collaboration with Bergfalk and Panagiotopoulos. As a consequence of our main results, we will obtain that if $C$ is torsion-free and $A$ is either a free $R$-module or a torsion group with bounded components, then an extension of $C$ by $A$ splits if and only if it splits on all finite-rank subgroups of $C$. This is a purely algebraic statements obtained with methods from Borel-definable homological algebra.


title: A Simple Approach to Adversarial Robustness in Few-shot Image Classification

abstract: Few-shot image classification, where the goal is to generalize to tasks with limited labeled data, has seen great progress over the years. However, the classifiers are vulnerable to adversarial examples, posing a question regarding their generalization capabilities. Recent works have tried to combine meta-learning approaches with adversarial training to improve the robustness of few-shot classifiers. We show that a simple transfer-learning based approach can be used to train adversarially robust few-shot classifiers. We also present a method for novel classification task based on calibrating the centroid of the few-shot category towards the base classes. We show that standard adversarial training on base categories along with calibrated centroid-based classifier in the novel categories, outperforms or is on-par with state-of-the-art advanced methods on standard benchmarks for few-shot learning. Our method is simple, easy to scale, and with little effort can lead to robust few-shot classifiers. Code is available here: \url{https://github.com/UCDvision/Simple_few_shot.git}


title: Deep Reinforcement Learning Based Semi-Autonomous Control for Robotic Surgery

abstract: In recent decades, the tremendous benefits surgical robots have brought to surgeons and patients have been witnessed. With the dexterous operation and the great precision, surgical robots can offer patients less recovery time and less hospital stay. However, the controls for current surgical robots in practical usage are fully carried out by surgeons via teleoperation. During the surgery process, there exists a lot of repetitive but simple manipulation, which can cause unnecessary fatigue to the surgeons. In this paper, we proposed a deep reinforcement learning-based semi-autonomous control framework for robotic surgery. The user study showed that the framework can reduce the completion time by 19.1% and the travel length by 58.7%.


title: Cosmology with the Laser Interferometer Space Antenna

abstract: The Laser Interferometer Space Antenna (LISA) has two scientific objectives of cosmological focus: to probe the expansion rate of the universe, and to understand stochastic gravitational-wave backgrounds and their implications for early universe and particle physics, from the MeV to the Planck scale. However, the range of potential cosmological applications of gravitational wave observations extends well beyond these two objectives. This publication presents a summary of the state of the art in LISA cosmology, theory and methods, and identifies new opportunities to use gravitational wave observations by LISA to probe the universe.


title: Quantification of high dimensional non-Gaussianities and its implication to Fisher analysis in cosmology

abstract: It is well known that the power spectrum is not able to fully characterize the statistical properties of non-Gaussian density fields. Recently, many different statistics have been proposed to extract information from non-Gaussian cosmological fields that perform better than the power spectrum. The Fisher matrix formalism is commonly used to quantify the accuracy with which a given statistic can constrain the value of the cosmological parameters. However, these calculations typically rely on the assumption that the likelihood of the considered statistic follows a multivariate Gaussian distribution. In this work we follow Sellentin & Heavens (2017) and use two different statistical tests to identify non-Gaussianities in different statistics such as the power spectrum, bispectrum, marked power spectrum, and wavelet scatering transform (WST). We remove the non-Gaussian components of the different statistics and perform Fisher matrix calculations with the \textit{Gaussianized} statistics using Quijote simulations. We show that constraints on the parameters can change by a factor of $\sim 2$ in some cases. We show with simple examples how statistics that do not follow a multivariate Gaussian distribution can achieve artificially tight bounds on the cosmological parameters when using the Fisher matrix formalism. We think that the non-Gaussian tests used in this work represent a powerful tool to quantify the robustness of Fisher matrix calculations and their underlying assumptions. We release the code used to compute the power spectra, bispectra, and WST that can be run on both CPUs and GPUs.


title: Heterogeneous Acceleration Pipeline for Recommendation System Training

abstract: Recommendation models rely on deep learning networks and large embedding tables, resulting in computationally and memory-intensive processes. These models are typically trained using hybrid CPU-GPU or GPU-only configurations. The hybrid mode combines the GPU's neural network acceleration with the CPUs' memory storage and supply for embedding tables but may incur significant CPU-to-GPU transfer time. In contrast, the GPU-only mode utilizes High Bandwidth Memory (HBM) across multiple GPUs for storing embedding tables. However, this approach is expensive and presents scaling concerns. This paper introduces Hotline, a heterogeneous acceleration pipeline that addresses these concerns. Hotline develops a data-aware and model-aware scheduling pipeline by leveraging the insight that only a few embedding entries are frequently accessed (popular). This approach utilizes CPU main memory for non-popular embeddings and GPUs' HBM for popular embeddings. To achieve this, Hotline accelerator fragments a mini-batch into popular and non-popular micro-batches. It gathers the necessary working parameters for non-popular micro-batches from the CPU, while GPUs execute popular micro-batches. The hardware accelerator dynamically coordinates the execution of popular embeddings on GPUs and non-popular embeddings from the CPU's main memory. Real-world datasets and models confirm Hotline's effectiveness, reducing average end-to-end training time by 2.2x compared to Intel-optimized CPU-GPU DLRM baseline.


title: Implementing Online Reinforcement Learning with Temporal Neural Networks

abstract: A Temporal Neural Network (TNN) architecture for implementing efficient online reinforcement learning is proposed and studied via simulation. The proposed T-learning system is composed of a frontend TNN that implements online unsupervised clustering and a backend TNN that implements online reinforcement learning. The reinforcement learning paradigm employs biologically plausible neo-Hebbian three-factor learning rules. As a working example, a prototype implementation of the cart-pole problem (balancing an inverted pendulum) is studied via simulation.


title: GPU Parallel algorithm for the generation of polygonal meshes based on terminal-edge regions

abstract: This paper presents a GPU parallel algorithm to generate a new kind of polygonal meshes obtained from Delaunay triangulations. To generate the polygonal mesh, the algorithm first uses a classification system to label each edge of an input triangulation; second it builds polygons (simple or not) from terminal-edge regions using the label system, and third it transforms each non-simple polygon from the previous phase into simple ones, convex or not convex polygons. We show some preliminary experiments to test the scalability of the algorithm and compare it with the sequential version. We also run a very simple test to show that these meshes can be useful for the virtual element method.


title: A Web-Scale Analysis of the Community Origins of Image Memes

abstract: Where do the most popular online cultural artifacts such as image memes originate? Media narratives suggest that cultural innovations often originate in peripheral communities and then diffuse to the mainstream core; behavioral science suggests that intermediate network positions that bridge between the periphery and the core are especially likely to originate many influential cultural innovations. Research has yet to fully adjudicate between these predictions because prior work focuses on individual platforms such as Twitter; however, any single platform is only a small, incomplete part of the larger online cultural ecosystem. In this paper, we perform the first analysis of the origins and diffusion of image memes at web scale, via a one-month crawl of all indexible online communities that principally share meme images with English text overlays. Our results suggest that communities at the core of the network originate the most highly diffused image memes: the top 10% of communities by network centrality originate the memes that generate 62% of the image meme diffusion events on the web. A zero-inflated negative binomial regression confirms that memes from core communities are more likely to diffuse than those from peripheral communities even when controlling for community size and activity level. However, a replication analysis that follows the traditional approach of testing the same question only within a single large community, Reddit, finds the regression coefficients reversed -- underscoring the importance of engaging in web-scale, cross-community analyses. The ecosystem-level viewpoint of this work positions the web as a highly centralized generator of cultural artifacts such as image memes.