title: Exploring the QGP phase above the deconfinement temperature in $pp$ and $A-A$ collisions at LHC energies

abstract: In the present work we have analyzed the transverse momentum spectra of charged particles in high multiplicity ${\it pp}$ collisions at LHC energies $\sqrt s = $ 5.02 and 13 TeV published by the ALICE Collaboration using the Color String Percolation Model (CSPM). For heavy ions Pb-Pb at $\sqrt {s_{NN}} =$ 2.76 and 5.02 TeV along with Xe-Xe at $\sqrt {s_{NN}} = $ 5.44 TeV have been analyzed. The initial temperature is extracted both in low and high multiplicity events in ${\it pp}$ collisions. For $A-A$ collisions the temperature is obtained as a function of centrality. A universal scaling in the temperature from $pp$ and $A-A$ collisions is obtained when multiplicity is scaled by the transverse interaction area.From the measured energy density $\bm \varepsilon$ and the temperature the dimensionless quantity $\bm \varepsilon/T^{4}$ is obtained. Our results for Pb-Pb and Xe-Xe collisions show a sharp increase in $\bm \varepsilon/T^{4}$ above T $\sim$ 210 MeV and reaching the ideal gas of quarks and gluons value of $\bm \varepsilon/T^{4} \sim$ 16 at temperature $\sim $ 230 MeV. In case of $pp$ collisions only $\bm \varepsilon/T^{4} \sim $ 10 corresponding to $\sim$ 30 degrees of freedom.


title: Partitioned Variational Inference: A Framework for Probabilistic Federated Learning

abstract: The proliferation of computing devices has brought about an opportunity to deploy machine learning models on new problem domains using previously inaccessible data. Traditional algorithms for training such models often require data to be stored on a single machine with compute performed by a single node, making them unsuitable for decentralised training on multiple devices. This deficiency has motivated the development of federated learning algorithms, which allow multiple data owners to train collaboratively and use a shared model whilst keeping local data private. However, many of these algorithms focus on obtaining point estimates of model parameters, rather than probabilistic estimates capable of capturing model uncertainty, which is essential in many applications. Variational inference (VI) has become the method of choice for fitting many modern probabilistic models. In this paper we introduce partitioned variational inference (PVI), a general framework for performing VI in the federated setting. We develop new supporting theory for PVI, demonstrating a number of properties that make it an attractive choice for practitioners; use PVI to unify a wealth of fragmented, yet related literature; and provide empirical results that showcase the effectiveness of PVI in a variety of federated settings.


title: On the influence of stochastic roundoff errors and their bias on the convergence of the gradient descent method with low-precision floating-point computation

abstract: When implementing the gradient descent method in low precision, the employment of stochastic rounding schemes helps to prevent stagnation of convergence caused by the vanishing gradient effect. Unbiased stochastic rounding yields zero bias by preserving small updates with probabilities proportional to their relative magnitudes. This study provides a theoretical explanation for the stagnation of the gradient descent method in low-precision computation. Additionally, we propose two new stochastic rounding schemes that trade the zero bias property with a larger probability to preserve small gradients. Our methods yield a constant rounding bias that, on average, lies in a descent direction. For convex problems, we prove that the proposed rounding methods typically have a beneficial effect on the convergence rate of gradient descent. We validate our theoretical analysis by comparing the performances of various rounding schemes when optimizing a multinomial logistic regression model and when training a simple neural network with an 8-bit floating-point format.


title: Solving optimization problems with Blackwell approachability

abstract: We introduce the Conic Blackwell Algorithm$^+$ (CBA$^+$) regret minimizer, a new parameter- and scale-free regret minimizer for general convex sets. CBA$^+$ is based on Blackwell approachability and attains $O(\sqrt{T})$ regret. We show how to efficiently instantiate CBA$^+$ for many decision sets of interest, including the simplex, $\ell_{p}$ norm balls, and ellipsoidal confidence regions in the simplex. Based on CBA$^+$, we introduce SP-CBA$^+$, a new parameter-free algorithm for solving convex-concave saddle-point problems, which achieves a $O(1/\sqrt{T})$ ergodic rate of convergence. In our simulations, we demonstrate the wide applicability of SP-CBA$^+$ on several standard saddle-point problems, including matrix games, extensive-form games, distributionally robust logistic regression, and Markov decision processes. In each setting, SP-CBA$^+$ achieves state-of-the-art numerical performance, and outperforms classical methods, without the need for any choice of step sizes or other algorithmic parameters.


title: Learning Stochastic Dynamics with Statistics-Informed Neural Network

abstract: We introduce a machine-learning framework named statistics-informed neural network (SINN) for learning stochastic dynamics from data. This new architecture was theoretically inspired by a universal approximation theorem for stochastic systems, which we introduce in this paper, and the projection-operator formalism for stochastic modeling. We devise mechanisms for training the neural network model to reproduce the correct \emph{statistical} behavior of a target stochastic process. Numerical simulation results demonstrate that a well-trained SINN can reliably approximate both Markovian and non-Markovian stochastic dynamics. We demonstrate the applicability of SINN to coarse-graining problems and the modeling of transition dynamics. Furthermore, we show that the obtained reduced-order model can be trained on temporally coarse-grained data and hence is well suited for rare-event simulations.

categories: cs.LG cond-mat.stat-mech cs.AI math.DS physics.comp-ph


title: Bohmian mechanics is not deterministic

abstract: I argue that Bohmian mechanics (or any similar pilot-wave theory) cannot reasonably be claimed to be a deterministic theory. If one assumes the "quantum equilibrium distribution" provided by the wave function of the universe, Bohmian mechanics requires an external random oracle in order to describe the (Kolmogorov-Levin-Chaitin) algorithmic randomness properties of typical outcome sequences of long runs of repeated identical experiments (which provably follow from the Born rule). This oracle lies beyond the scope of Bohmian mechanics (or any deterministic extension thereof), including the impossibility of explaining the randomness property in question from "random" initial conditions. Thus the advantages of Bohmian mechanics over other interpretations of quantum mechanics, if any, must lie at an ontological level, and in its potential to derive the quantum equilibrium distribution and hence the Born rule.


title: Tactile Materials in Practice: Understanding the Experiences of Teachers of the Visually Impaired

abstract: Teachers of the visually impaired (TVIs) regularly present tactile materials (tactile graphics, 3D models, and real objects) to students with vision impairments. Researchers have been increasingly interested in designing tools to support the use of tactile materials, but we still lack an in-depth understanding of how tactile materials are created and used in practice today. To address this gap, we conducted interviews with 21 TVIs and a 3-week diary study with eight of them. We found that tactile materials were regularly used for academic as well as non-academic concepts like tactile literacy, motor ability, and spatial awareness. Real objects and 3D models served as "stepping stones" to tactile graphics and our participants preferred to teach with 3D models, despite finding them difficult to create, obtain, and modify. Use of certain materials also carried social implications; participants selected materials that fostered student independence and allow classroom inclusion. We contribute design considerations, encouraging future work on tactile materials to enable student and TVI co-creation, facilitate rapid prototyping, and promote movement and spatial awareness. To support future research in this area, our paper provides a fundamental understanding of current practices. We bridge these practices to established pedagogical approaches and highlight opportunities for growth regarding this important genre of educational materials.


title: Network analysis approach to Likert-style surveys

abstract: Likert-style surveys are a widely used research instrument to assess respondents' preferences, beliefs, or experiences. In this paper, we propose and demonstrate how network analysis (NA) can be employed to model and evaluate the interconnectedness of items in Likert-style surveys. We explore the advantages of this approach by applying the methodology to the aspects of student experience scale datasets and compare the results to the principal component analysis. We successfully create a meaningful network based on survey item response similarity and use modular analysis of the network to identify larger themes built from the connections of particular aspects. The modular NA of the network of survey items identifies important themes that highlight differences in students' overall experiences. Our network analysis for Likert-style surveys methodology is widely applicable and provides a new way to investigate phenomena assessed by Likert-style surveys.


title: The branched deformations of the special Lagrangian submanifolds

abstract: The branched deformations of immersed compact special Lagrangian submanifolds are studied in this paper. If there exists a nondegenerate $\mathbb{Z}_2$ harmonic 1-form over a special Lagrangian submanifold $L$, we construct a family of immersed special Lagrangian submanifolds $\tilde{L}_t$, that are diffeomorphic to a branched covering of $L$ and $\tilde{L}_t$ convergence to $2L$ as current. This answers a question suggested by Donaldson. Combining with the work of Abouzaid and Imagi, we obtain constraints for the existence of nondegenerate $\mathbb{Z}_2$ harmonic 1-forms.


title: Existence of nondegenerate $\mathbb{Z}_2$ harmonic 1-forms via $\mathbb{Z}_3$ symmetry

abstract: Using $\mathbb{Z}_3$ symmetry, we present a topological condition for the existence of the $\mathbb{Z}_2$ harmonic 1-forms over Riemannian manifold. As a corollary, if $L$ is an oriented link on $S^3$ with determinant zero, then there exists a nondegenerate $\mathbb{Z}_2$ harmonic 1-form over the 3-cyclic branched covering of $L$. Furthermore, we found infinite number of rational homology 3-spheres that admit a nondegenerate $\mathbb{Z}_2$ harmonic 1-form.


title: Noisy Group Testing with Side Information

abstract: Group testing has recently attracted significant attention from the research community due to its applications in diagnostic virology. An instance of the group testing problem includes a ground set of individuals which includes a small subset of infected individuals. The group testing procedure consists of a number of tests, such that each test indicates whether or not a given subset of individuals includes one or more infected individuals. The goal of the group testing procedure is to identify the subset of infected individuals with the minimum number of tests. Motivated by practical scenarios, such as testing for viral diseases, this paper focuses on the following group testing settings: (i) the group testing procedure is noisy, i.e., the outcome of the group testing procedure can be flipped with a certain probability; (ii) there is a certain amount of side information on the distribution of the infected individuals available to the group testing algorithm. The paper makes the following contributions. First, we propose a probabilistic model, referred to as an interaction model, that captures the side information about the probability distribution of the infected individuals. Next, we present a decoding scheme, based on the belief propagation, that leverages the interaction model to improve the decoding accuracy. Our results indicate that the proposed algorithm achieves higher success probability and lower false-negative and false-positive rates when compared to the traditional belief propagation especially in the high noise regime.


title: Improved Spectral Representations of Neutron-Star Equations of State

abstract: Spectral representations have been shown to provide an efficient way to represent the poorly understood high-density portion of the neutron-star equation of state. This paper shows how the efficiency and accuracy of those representations can be improved by a very simple change.


title: ALP induced polarization effects on photons from galaxy clusters

abstract: Many extensions of the Standard Model of particle physics and in particular superstring and superbrane theories predict the existence of axion-like particles (ALPs). ALPs are very elusive, extremely light and interact primarily with photons. In the presence of an external magnetic field two effects show up: (i) photon-ALP oscillations and (ii) a change of the photon polarization state. The astrophysical context represents the best opportunity to get indirect evidence for the ALP existence thanks to various effects that the photon-ALP interaction produces in the sky. Great attention has been paid so far to photon-ALP oscillations, since they modify the transparency of the crossed media at very high energies and so the final spectra of faraway sources exhibit a flux excess and a characteristic oscillatory behavior. Two hints at the ALP existence have hitherto been discovered. But less interest has been attracted by the modification of the photon polarization. In this paper we address it in the X-ray and in the high energy (HE) bands. Specifically, we analyze the photon degree of linear polarization and the polarization angle induced by the photon-ALP interaction for photons generated in the central region of two galaxy clusters: Perseus and Coma. We find a substantial departure from conventional physics in both considered bands. We conclude that the ALP-induced polarization effects are more likely detectable with the proposed missions like COSI (approved to launch), e-ASTROGAM and AMEGO in the HE range. Still, possible ALP-induced effects on photon polarization could also be detected by IXPE (already operative) and by the proposed eXTP, XL-Calibur, NGXP and XPP in the X-ray band.


title: Davydov-Yetter cohomology and relative homological algebra

abstract: Davydov--Yetter (DY) cohomology classifies infinitesimal deformations of the monoidal structure of tensor functors and tensor categories. In this paper we provide new tools for the computation of the DY cohomology for finite tensor categories and exact functors between them. The key point is to realize DY cohomology as relative Ext groups. In particular, we prove that the infinitesimal deformations of a tensor category $\mathcal{C}$ are classified by the 3-rd self-extension group of the tensor unit of the Drinfeld center $\mathcal{Z}(\mathcal{C})$ relative to $\mathcal{C}$. From classical results on relative homological algebra we get a long exact sequence for DY cohomology and a Yoneda product for which we provide an explicit formula. Using the long exact sequence and duality, we obtain a dimension formula for the cohomology groups based solely on relatively projective covers which reduces a problem in homological algebra to a problem in representation theory, e.g. calculating the space of invariants in a certain object of $\mathcal{Z}(\mathcal{C})$. Thanks to the Yoneda product, we also develop a method for computing DY cocycles explicitly which are needed for applications in the deformation theory. We apply these tools to the category of finite-dimensional modules over a finite-dimensional Hopf algebra. We study in detail the examples of the bosonization of exterior algebras $\Lambda\mathbb{C}^k \rtimes \mathbb{C}[\mathbb{Z}_2]$, the Taft algebras and the small quantum group of $\mathfrak{sl}_2$ at a root of unity.


title: Toward More Meaningful Resources for Lower-resourced Languages

abstract: In this position paper, we describe our perspective on how meaningful resources for lower-resourced languages should be developed in connection with the speakers of those languages. We first examine two massively multilingual resources in detail. We explore the contents of the names stored in Wikidata for a few lower-resourced languages and find that many of them are not in fact in the languages they claim to be and require non-trivial effort to correct. We discuss quality issues present in WikiAnn and evaluate whether it is a useful supplement to hand annotated data. We then discuss the importance of creating annotation for lower-resourced languages in a thoughtful and ethical way that includes the languages' speakers as part of the development process. We conclude with recommended guidelines for resource development.


title: Squeezed Knots

abstract: Squeezed knots are those knots that appear as slices of genus-minimizing oriented smooth cobordisms between positive and negative torus knots. We show that this class of knots is large and discuss how to obstruct squeezedness. The most effective obstructions appear to come from quantum knot invariants, notably including refinements of the Rasmussen invariant due to Lipshitz-Sarkar and Sarkar-Scaduto-Stoffregen involving stable cohomology operations on Khovanov homology.


title: Kinematics of Parsec-Scale Jets of Gamma-Ray Bright Blazars at 43 GHz during Ten Years of the VLBA-BU-BLAZAR Program

abstract: We analyze the parsec-scale jet kinematics from 2007 June to 2018 December of a sample of $\gamma$-ray bright blazars monitored roughly monthly with the Very Long Baseline Array at 43 GHz under the VLBA-BU-BLAZAR program. We implement a novel piece-wise linear fitting method to derive the kinematics of 521 distinct emission knots from a total of 3705 total intensity images in 22 quasars, 13 BL Lacertae objects, and 3 radio galaxies. Apparent speeds of these components range from $0.01c$ to $78c$, and 18.6\% of knots (other than the "core") are quasi-stationary. One-fifth of moving knots exhibit non-ballistic motion, with acceleration along the jet within 5 pc of the core (projected) and deceleration farther out. These accelerations occur mainly at locations coincident with quasi-stationary features. We calculate the physical parameters of 273 knots with statistically significant motion, including their Doppler factors, Lorentz factors, and viewing angles. We determine the typical values of these parameters for each jet and the average for each subclass of active galactic nuclei. We investigate the variability of the position angle of each jet over the ten years of monitoring. The fluctuations in position of the quasi-stationary components in radio galaxies tend to be parallel to the jet, while no directional preference is seen in the components of quasars and BL Lacertae objects. We find a connection between $\gamma$-ray states of blazars and their parsec-scale jet properties, with blazars with brighter 43 GHz cores typically reaching higher $\gamma$-ray maxima during flares.


title: Parametric Amplification of an Optomechanical Quantum Interconnect

abstract: Connecting superconducting qubits to optical fiber necessitates the conversion of microwave photons to optical photons. Modern experimental demonstrations exhibit strong coupling between a microwave resonator and an optical cavity mediated through phononic modes in a mechanical oscillator. This paradigmatic transduction experiment is bounded by a theoretical efficiency with constant driving amplitudes on the electromagnetic resonators. By adding a parametric drive to the microwave resonator and optical cavity we discover the converted signal through the quantum transducer is amplified, while maintaining a lower level of the added noise. We propose a theoretical framework for time-dependent control of the driving lasers based on the input-output formalism of quantum optics, and solve analytically the transduction efficiency and added noise when the control signals parametrically drive the system. Our results show better transduction efficiency and lower added noise in varying parameter regimes relevant to current transduction experiments.


title: Bridging Level-K to Nash Equilibrium

abstract: We introduce NLK, a model that connects the Nash equilibrium (NE) and Level-K. It allows a player in a game to believe that her opponent may be either less or as sophisticated as, she is, a view supported in psychology. We apply NLK to data from five published papers on static, dynamic, and auction games. NLK provides different predictions than those of the NE and Level-K; moreover, a simple version of NLK explains the experimental data better in many cases, with the same or lower number of parameters. We discuss extensions to games with more than two players and heterogeneous beliefs.


title: Planarizing Graphs and their Drawings by Vertex Splitting

abstract: The splitting number of a graph $G=(V,E)$ is the minimum number of vertex splits required to turn $G$ into a planar graph, where a vertex split removes a vertex $v \in V$, introduces two new vertices $v_1, v_2$, and distributes the edges formerly incident to $v$ among its two split copies $v_1, v_2$. The splitting number problem is known to be NP-complete. In this paper we shift focus to the splitting number of graph drawings in $\mathbb R^2$, where the new vertices resulting from vertex splits can be re-embedded into the existing drawing of the remaining graph. We first provide a non-uniform fixed-parameter tractable (FPT) algorithm for the splitting number problem (without drawings). Then we show the NP-completeness of the splitting number problem for graph drawings, even for its two subproblems of (1) selecting a minimum subset of vertices to split and (2) for re-embedding a minimum number of copies of a given set of vertices. For the latter problem we present an FPT algorithm parameterized by the number of vertex splits. This algorithm reduces to a bounded outerplanarity case and uses an intricate dynamic program on a sphere-cut decomposition.


title: The Low Energy Spectrum of Trapped Bosons in the Gross-Pitaevskii Regime

abstract: Bogoliubov Theory provides important predictions for the low energy properties of the weakly interacting Bose gas. Recently, Bogoliubov's predictions could be justified rigorously in \cite{BBCS3} for translation invariant systems in the Gross-Pitaveskii regime, where $N$ bosons in $\Lambda = [0;1]^3\subset \mathbb{R}^3$ interact through a potential whose scattering length is of size $ N^{-1}$. In this note, we review recent results from \cite{BSS2}, a joint work with B. Schlein and S. Schraven, which extends the analysis of \cite{BBCS3} to systems of bosons in $\mathbb{R}^3$ that are trapped by an external potential.


title: Factorizer: A Scalable Interpretable Approach to Context Modeling for Medical Image Segmentation

abstract: Convolutional Neural Networks (CNNs) with U-shaped architectures have dominated medical image segmentation, which is crucial for various clinical purposes. However, the inherent locality of convolution makes CNNs fail to fully exploit global context, essential for better recognition of some structures, e.g., brain lesions. Transformers have recently proven promising performance on vision tasks, including semantic segmentation, mainly due to their capability of modeling long-range dependencies. Nevertheless, the quadratic complexity of attention makes existing Transformer-based models use self-attention layers only after somehow reducing the image resolution, which limits the ability to capture global contexts present at higher resolutions. Therefore, this work introduces a family of models, dubbed Factorizer, which leverages the power of low-rank matrix factorization for constructing an end-to-end segmentation model. Specifically, we propose a linearly scalable approach to context modeling, formulating Nonnegative Matrix Factorization (NMF) as a differentiable layer integrated into a U-shaped architecture. The shifted window technique is also utilized in combination with NMF to effectively aggregate local information. Factorizers compete favorably with CNNs and Transformers in terms of accuracy, scalability, and interpretability, achieving state-of-the-art results on the BraTS dataset for brain tumor segmentation and ISLES'22 dataset for stroke lesion segmentation. Highly meaningful NMF components give an additional interpretability advantage to Factorizers over CNNs and Transformers. Moreover, our ablation studies reveal a distinctive feature of Factorizers that enables a significant speed-up in inference for a trained Factorizer without any extra steps and without sacrificing much accuracy. The code and models are publicly available at https://github.com/pashtari/factorizer.


title: Feynman Polytopes and the Tropical Geometry of UV and IR Divergences

abstract: We introduce a class of polytopes that concisely capture the structure of UV and IR divergences of general Feynman integrals in Schwinger parameter space, treating them in a unified way as worldline segments shrinking and expanding at different relative rates. While these polytopes conventionally arise as convex hulls - via Newton polytopes of Symanzik polynomials - we show that they also have a remarkably simple dual description as cut out by linear inequalities defining the facets. It is this dual definition that makes it possible to transparently understand and efficiently compute leading UV and IR divergences for any Feynman integral. In the case of the UV, this provides a transparent geometric understanding of the familiar nested and overlapping divergences. In the IR, the polytope exposes a new perspective on soft/collinear singularities and their intricate generalizations. Tropical geometry furnishes a simple framework for calculating the leading UV/IR divergences of any Feynman integral, associating them with the volumes of certain dual cones. As concrete applications, we generalize Weinberg's theorem to include a characterization of IR divergences, and classify space-time dimensions in which general IR divergences (logarithmic as well as power-law) can occur. We also compute the leading IR divergence of rectangular fishnet diagrams at all loop orders, which turn out to have a surprisingly simple combinatorial description.


title: Embedded Ensembles: Infinite Width Limit and Operating Regimes

abstract: A memory efficient approach to ensembling neural networks is to share most weights among the ensembled models by means of a single reference network. We refer to this strategy as Embedded Ensembling (EE); its particular examples are BatchEnsembles and Monte-Carlo dropout ensembles. In this paper we perform a systematic theoretical and empirical analysis of embedded ensembles with different number of models. Theoretically, we use a Neural-Tangent-Kernel-based approach to derive the wide network limit of the gradient descent dynamics. In this limit, we identify two ensemble regimes - independent and collective - depending on the architecture and initialization strategy of ensemble models. We prove that in the independent regime the embedded ensemble behaves as an ensemble of independent models. We confirm our theoretical prediction with a wide range of experiments with finite networks, and further study empirically various effects such as transition between the two regimes, scaling of ensemble performance with the network width and number of models, and dependence of performance on a number of architecture and hyperparameter choices.


title: Towards Low-distortion Multi-channel Speech Enhancement: The ESPNet-SE Submission to The L3DAS22 Challenge

abstract: This paper describes our submission to the L3DAS22 Challenge Task 1, which consists of speech enhancement with 3D Ambisonic microphones. The core of our approach combines Deep Neural Network (DNN) driven complex spectral mapping with linear beamformers such as the multi-frame multi-channel Wiener filter. Our proposed system has two DNNs and a linear beamformer in between. Both DNNs are trained to perform complex spectral mapping, using a combination of waveform and magnitude spectrum losses. The estimated signal from the first DNN is used to drive a linear beamformer, and the beamforming result, together with this enhanced signal, are used as extra inputs for the second DNN which refines the estimation. Then, from this new estimated signal, the linear beamformer and second DNN are run iteratively. The proposed method was ranked first in the challenge, achieving, on the evaluation set, a ranking metric of 0.984, versus 0.833 of the challenge baseline.


title: Capturing Failures of Large Language Models via Human Cognitive Biases

abstract: Large language models generate complex, open-ended outputs: instead of outputting a class label they write summaries, generate dialogue, or produce working code. In order to asses the reliability of these open-ended generation systems, we aim to identify qualitative categories of erroneous behavior, beyond identifying individual errors. To hypothesize and test for such qualitative errors, we draw inspiration from human cognitive biases -- systematic patterns of deviation from rational judgement. Specifically, we use cognitive biases as motivation to (i) generate hypotheses for problems that models may have, and (ii) develop experiments that elicit these problems. Using code generation as a case study, we find that OpenAI's Codex errs predictably based on how the input prompt is framed, adjusts outputs towards anchors, and is biased towards outputs that mimic frequent training examples. We then use our framework to elicit high-impact errors such as incorrectly deleting files. Our results indicate that experimental methodology from cognitive science can help characterize how machine learning systems behave.


title: Can the clocks tick together despite the noise? Stochastic simulations and analysis

abstract: The suprachiasmatic nucleus (SCN), also known as the circadian master clock, consists of a large population of oscillator neurons. Together, these neurons produce a coherent signal that drives the body's circadian rhythms. What properties of the cell-to-cell communication allow the synchronization of these neurons, despite a wide range of environmental challenges such as fluctuations in photoperiods? To answer that question, we present a mean-field description of globally coupled neurons modeled as Goodwin oscillators with standard Gaussian noise. Provided that the initial conditions of all neurons are independent and identically distributed, any finite number of neurons becomes independent and has the same probability distribution in the mean-field limit, a phenomenon called propagation of chaos. This probability distribution is a solution to a Vlasov-Fokker-Planck type equation, which can be obtained from the stochastic particle model. We study, using the macroscopic description, how the interaction between external noise and intercellular coupling affects the dynamics of the collective rhythm, and we provide a numerical description of the bifurcations resulting from the noise-induced transitions. Our numerical simulations show a noise-induced rhythm generation at low noise intensities, while the SCN clock is arrhythmic in the high noise setting. Notably, coupling induces resonance-like behavior at low noise intensities, and varying coupling strength can cause period locking and variance dissipation even in the presence of noise.


title: Channel capacity of relativistic quantum communication with rapid interaction

abstract: In this work we study nonperturbatively the transmission of classical and quantum information in globally hyperbolic spacetimes, where the communication channel is between two qubit detectors interacting with a quantized massless scalar field via delta-coupling interaction. This interaction approximates very rapid detector-field interaction, effectively occurring at a single instant in time for each detector. We show that when both detectors interact via delta-coupling, one can arrange and tune the detectors so that the channel capacity is (at least) as good as the quantum channel constructed nonperturbatively using \textit{gapless detectors} by Landulfo [PRD 93, 104019]. Furthermore, we prove that this channel capacity is in fact optimal, i.e., both nonperturbative methods give essentially the same channel capacity, thus there is a sense in which the two methods can be regarded as equivalent as far as relativistic quantum communication is concerned.


title: Probing New Gauge Forces with a High-Energy Muon Beam Dump

abstract: We propose a new beam dump experiment at a future TeV-scale muon collider. A beam dump would be an economical and effective way to increase the discovery potential of the collider complex in a complementary regime. In this work we consider vector models such as the dark photon and $L_\mu-L_\tau$ gauge boson as new physics candidates and explore which novel regions of parameter space can be probed with a muon beam dump. We find that for the dark photon model, we gain sensitivity in the moderate mass (MeV - GeV) range at both higher and lower couplings compared to existing and proposed experiments, and gain access to previously untouched areas of parameter space of the $L_\mu-L_\tau$ model.


title: The Combined Effects of Two-Body Relaxation Processes and the Eccentric Kozai-Lidov Mechanism on the EMRI Rate

abstract: Gravitational wave (GW) emissions from extreme-mass-ratio inspirals (EMRIs) are promising sources for low-frequency GW-detectors. They result from a compact object, such as a stellar-mass black-hole (BH), captured by a supermassive black hole (SMBH). Several physical processes have been proposed to form EMRIs. In particular, weak two-body interactions over a long time scale (i.e., relaxation processes) have been proposed as a likely mechanism to drive the BH orbit to high eccentricity. Consequently, it is captured by the SMBH and becomes an EMRI. Here we demonstrate that EMRIs are naturally formed in SMBH binaries. Gravitational perturbations from an SMBH companion, known as the eccentric Kozai-Lidov (EKL) mechanism, combined with relaxation processes, yield a significantly more enhanced rate than any of these processes operating alone. Since EKL is sensitive to the orbital configuration, two-body relaxation can alter the orbital parameters, rendering the system in a more EKL-favorable regime. As SMBH binaries are expected to be prevalent in the Universe, this process predicts a substantially high EMRI rate.


title: The resolved chemical abundance properties within the interstellar medium of star-forming galaxies at $\mathbf{ \textit{z} \approx 1.5}$

abstract: We exploit the unprecedented depth of integral field data from the KMOS Ultra-deep Rotational Velocity Survey (KURVS) to analyse the strong (H$\alpha$) and forbidden ([NII], [SII]) emission line ratios in 22 main-sequence galaxies at $z\approx1.5$. Using the [NII]/H$\alpha$ emission-line ratio we confirm the presence of the stellar mass $-$ gas-phase metallicity relation at this epoch, with galaxies exhibiting on average 0.13$\pm$0.04 dex lower gas-phase metallicity (12+log(O/H)$_{\rm M13}$=8.40$\pm$0.03) for a given stellar mass ($\log_{10}$($M_{\rm *}$[$M_{\odot}$]=10.1$\pm$0.1) than local main-sequence galaxies. We determine the galaxy-integrated [SII] doublet ratio, with a median value of [SII]$\lambda$6716/$\lambda$6731=1.26$\pm$0.14 equivalent to an electron density of log$_{10}$($n_{\rm e}$[cm$^{-3}$])=1.95$\pm$0.12. Utilising CANDELS $HST$ multi-band imaging we define the pixel surface-mass and star-formation rate density in each galaxy and spatially resolve the fundamental metallicity relation at $z\approx1.5$, finding an evolution of 0.05$\pm$0.01 dex compared to the local relation. We quantify the intrinsic gas-phase metallicity gradient within the galaxies using the [NII]/H$\alpha$ calibration, finding a median annuli-based gradient of $\Delta$Z/$\Delta$R=$-$0.015$\pm$0.005 dex kpc$^{-1}$. Finally we examine the azimuthal variations in gas-phase metallicity, which show a negative correlation with the galaxy integrated star-formation rate surface density ($r_{\rm s}$=$-$0.40, $p_{\rm s}$=0.07) but no connection to the galaxies kinematic or morphological properties nor radial variations in stellar mass surface density or star formation rate surface density. This suggests both the radial and azimuthal variations in interstellar medium properties are connected to the galaxy integrated density of recent star formation.


title: The width difference in \bbm\ at order $\alpha_s$ and beyond

abstract: We complete the calculation of the element $\Gamma_{12}^q$ of the decay matrix in $B_q-\bar{B}_q$ mixing, $q=d,s$, to order $\alpha_s$ in the leading power of the Heavy Quark Expansion. To this end we compute one- and two-loop contributions involving two four-quark penguin operators. Furthermore, we present two-loop QCD corrections involving a chromomagnetic operator and either a current-current or four-quark penguin operator. Such contributions are of order $\alpha_s^2$, i.e. next-to-next-to-leading-order. We also present one-loop and two-loop results involving two chromomagnetic operators which are formally of next-to-next-to-leading and next-to-next-to-next-to-leading-order, respectively. With our new corrections we obtain the Standard-Model prediction $\Delta\Gamma_s/\Delta M_s= (5.20\pm 0.69)\cdot 10^{-3}$ if $\Gamma_{12}^s$ is expressed in terms of the $\overline{\rm MS}$ b-quark mass, while we find $\Delta \Gamma_s/\Delta M_s= (4.70\pm 0.96)\cdot 10^{-3}$ instead for the use of the pole mass.


title: Emergent quantum state designs and biunitarity in dual-unitary circuit dynamics

abstract: Recent works have investigated the emergence of a new kind of random matrix behaviour in unitary dynamics following a quantum quench. Starting from a time-evolved state, an ensemble of pure states supported on a small subsystem can be generated by performing projective measurements on the remainder of the system, leading to a projected ensemble. In chaotic quantum systems it was conjectured that such projected ensembles become indistinguishable from the uniform Haar-random ensemble and lead to a quantum state design. Exact results were recently presented by Ho and Choi [Phys. Rev. Lett. 128, 060601 (2022)] for the kicked Ising model at the self-dual point. We provide an alternative construction that can be extended to general chaotic dual-unitary circuits with solvable initial states and measurements, highlighting the role of the underlying dual-unitarity and further showing how dual-unitary circuit models exhibit both exact solvability and random matrix behaviour. Building on results from biunitary connections, we show how complex Hadamard matrices and unitary error bases both lead to solvable measurement schemes.

categories: quant-ph cond-mat.stat-mech cond-mat.str-el nlin.CD


title: Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph

abstract: This paper addresses the unsupervised learning of content-style decomposed representation. We first give a definition of style and then model the content-style representation as a token-level bipartite graph. An unsupervised framework, named Retriever, is proposed to learn such representations. First, a cross-attention module is employed to retrieve permutation invariant (P.I.) information, defined as style, from the input data. Second, a vector quantization (VQ) module is used, together with man-induced constraints, to produce interpretable content tokens. Last, an innovative link attention module serves as the decoder to reconstruct data from the decomposed content and style, with the help of the linking keys. Being modal-agnostic, the proposed Retriever is evaluated in both speech and image domains. The state-of-the-art zero-shot voice conversion performance confirms the disentangling ability of our framework. Top performance is also achieved in the part discovery task for images, verifying the interpretability of our representation. In addition, the vivid part-based style transfer quality demonstrates the potential of Retriever to support various fascinating generative tasks. Project page at https://ydcustc.github.io/retriever-demo/.


title: Impact of cosmic rays on the global 21-cm signal during cosmic dawn

abstract: It is extremely important to understand the processes through which the thermal state of the inter-galactic medium (IGM) evolved in the early universe in order to study the evolution of HI 21-cm signal during cosmic dawn. Here, we consider the heating of the IGM due to cosmic ray protons generated by the supernovae from both early Pop III and Pop II stars. The low energy cosmic ray protons from Pop III supernovae can escape from minihalos and heat the IGM via collision and ionization of hydrogen. Furthermore, high energy protons generated in Pop II supernovae can escape the hosting halos and heat the IGM via magnetosonic Alfv\'en waves. We show that the heating due to these cosmic ray particles can significantly impact the IGM temperature and hence the global 21-cm signal at $z\sim 14-18$. The depth, location, and duration of the 21-cm absorption profile are highly dependent on the efficiencies of cosmic ray heating. In particular, the EDGES signal can be well fitted by the cosmic ray heating along with the Lyman-$\alpha$ coupling, and the dark matter-baryon interaction that we consider to achieve a `colder IGM background'. Further, we argue that the properties of cosmic rays and the nature of first generation of stars could be constrained by accurately measuring the global 21-cm absorption signal during the cosmic dawn.


title: Parthenon -- a performance portable block-structured adaptive mesh refinement framework

abstract: On the path to exascale the landscape of computer device architectures and corresponding programming models has become much more diverse. While various low-level performance portable programming models are available, support at the application level lacks behind. To address this issue, we present the performance portable block-structured adaptive mesh refinement (AMR) framework Parthenon, derived from the well-tested and widely used Athena++ astrophysical magnetohydrodynamics code, but generalized to serve as the foundation for a variety of downstream multi-physics codes. Parthenon adopts the Kokkos programming model, and provides various levels of abstractions from multi-dimensional variables, to packages defining and separating components, to launching of parallel compute kernels. Parthenon allocates all data in device memory to reduce data movement, supports the logical packing of variables and mesh blocks to reduce kernel launch overhead, and employs one-sided, asynchronous MPI calls to reduce communication overhead in multi-node simulations. Using a hydrodynamics miniapp, we demonstrate weak and strong scaling on various architectures including AMD and NVIDIA GPUs, Intel and AMD x86 CPUs, IBM Power9 CPUs, as well as Fujitsu A64FX CPUs. At the largest scale on Frontier (the first TOP500 exascale machine), the miniapp reaches a total of $1.7\times10^{13}$ zone-cycles/s on 9,216 nodes (73,728 logical GPUs) at ~92% weak scaling parallel efficiency (starting from a single node). In combination with being an open, collaborative project, this makes Parthenon an ideal framework to target exascale simulations in which the downstream developers can focus on their specific application rather than on the complexity of handling massively-parallel, device-accelerated AMR.


title: Neutrino flavor oscillations in a rotating spacetime

abstract: We study neutrino oscillations in a rotating spacetime under the weak gravity limit for the trajectories of neutrinos which are constrained in the equatorial plane. Using the asymptotic form of the Kerr metric, we show that the rotation of the gravitational source non-trivially modifies the neutrino phase. We find that the oscillation probabilities deviate significantly from the corresponding results in the Schwarzschild spacetime when neutrinos are produced near the black hole (still in the weak-gravity limit) with non-zero angular momentum and detected on the same side, i.e., the non-lensed neutrino. Moreover, for a given gravitational body and geometric parameters, there exists a distance scale for every energy scale (and vice versa), after which the rotational contribution in the neutrino phase becomes significant. Using the sun-sized gravitational body in the numerical analysis of the one-sided neutrino propagation, we show that even a small rotation of the gravitational object can significantly change the survival or appearance events of a neutrino flavor registered by the detector, which is located on the earth. These effects are expected to be prominent for cosmological/astrophysical scenarios where neutrinos travel past by many (rotating) gravitational bodies and for large distances. Thus rotational effects of all such bodies must be incorporated in analyzing oscillations data.


title: R2-D2: Roman and Rubin -- From Data to Discovery

abstract: The NASA Nancy Grace Roman Space Telescope (Roman) and the Vera C. Rubin Observatory Legacy Survey of Space and Time (Rubin), will transform our view of the wide-field sky, with similar sensitivities, but complementary in wavelength, spatial resolution, and time domain coverage. Here we present findings from the AURA Roman+Rubin Synergy Working group, charged by the STScI and NOIRLab Directors to identify frontier science questions in General Astrophysics, beyond the well-covered areas of Dark Energy and Cosmology, that can be uniquely addressed with Roman and Rubin synergies in observing strategy, data products and archiving, joint analysis, and community engagement. This analysis was conducted with input from the community in the form of brief (1-2 paragraph) "science pitches" (see Appendix), and testimony from "outside experts" (included as co-authors). We identify a rich and broad landscape of potential discoveries catalyzed by the combination of exceptional quality and quantity of Roman and Rubin data, and summarize implementation requirements that would facilitate this bounty of additional science with coordination of survey fields, joint coverage of the Galactic plane, bulge, and ecliptic, expansion of General Investigator and Target of Opportunity observing modes, co-location of Roman and Rubin data, and timely distribution of data, transient alerts, catalogs, value-added joint analysis products, and simulations to the broad astronomical community.

categories: astro-ph.IM astro-ph.EP astro-ph.GA astro-ph.HE astro-ph.SR


title: Oolong: Investigating What Makes Transfer Learning Hard with Controlled Studies

abstract: When we transfer a pretrained language model to a new language, there are many axes of variation that change at once. To disentangle the impact of different factors like syntactic similarity and vocabulary similarity, we propose a set of controlled transfer studies: we systematically transform the language of the GLUE benchmark, altering one axis of crosslingual variation at a time, and then measure the resulting drops in a pretrained model's downstream performance. We find that models can largely recover from syntactic-style shifts, but cannot recover from vocabulary misalignment and embedding matrix re-initialization, even with continued pretraining on 15 million tokens. %On the other hand, transferring to a dataset with an unaligned vocabulary is extremely hard to recover from in the low-data regime. Moreover, good-quality tokenizers in the transfer language do not make vocabulary alignment easier. Our experiments provide insights into the factors of cross-lingual transfer that researchers should most focus on when designing language transfer scenarios.


title: Gauge dependence of the quark gap equation: an exploratory study

abstract: We study the gauge dependence of the quark propagator in quantum chromodynamics by solving the gap equation with a nonperturbative quark-gluon vertex which is constrained by longitudinal and transverse Slavnov-Taylor identities, the discrete charge conjugation and parity symmetries and which is free of kinematic singularities in the limit of equal incoming and outgoing quark momenta. We employ gluon propagators in renormalizable $R_\xi$ gauges obtained in lattice QCD studies. We report the dependence of the nonperturbative quark propagator on the gauge parameter, in particular we observe an increase, proportional to the gauge-fixing parameter, of the mass function in the infrared domain, whereas the wave renormalization decreases within the range $0 \leq \xi \leq 1$ considered here. The chiral quark condensate reveals a mild gauge dependence in the region of $\xi$ investigated. We comment on how to build and improve upon this exploratory study in future in conjunction with generalized gauge covariance relations for QCD.


title: The Hubble PanCET program: Emission spectrum of hot Jupiter HAT-P-41b

abstract: We present the most complete emission spectrum for inflated hot Jupiter HAT-P-41b combining new HST WFC/G141 spectrum from the Hubble Panchromatic Comparative Exoplanet Treasury (PanCET) program with archival Spitzer eclipse observations. We found a near blackbody-like emission spectrum which is best fitted with an isothermal temperature-pressure (TP) profile that agrees well with the dayside heat redistribution scenario assuming zero Bond albedo. The non-inverted TP profile is consistent with the non-detection of NUV/optical absorbers in the transit spectra. We do not find any evidence for significant H$^-$ opacity nor a metal-rich atmosphere. HAT-P-41b is an ideal target that sits in the transitioning parameter space between hot and ultra-hot Jupiters, and future JWST observations will help us to better constrain the thermal structure and chemical composition.


title: Magnetic-field Induced Topological Transitions and Thermal Conductivity in a Generalized Kitaev Model

abstract: Recent experiments on Kitaev spin liquid candidate materials reported non-monotonic behavior of thermal conductivity as a function of magnetic field, which lead to conflicting interpretations of its origin. Motivated by this development, we study the magnetic field dependence of thermal conductivity of a generalized Kitaev model, which allows the phase transitions between different flux sectors as a function of the magnetic field. The thermal conductivity due to Majorana fermions shows dip-bump structures as the magnetic field increases, which is caused by either the transitions between different flux sectors of Kitaev spin liquids or the topological transitions that change the Majorana Chern number within the same flux sector. It is shown that the change of Chern number is closely related to the four-Majorana-fermion interaction induced by the magnetic field. The non-monotonic behavior in thermal conductivity emerges at finite temperature, and it becomes weaker when temperature decreases towards zero. Our model provides a generic mechanism for the Kitaev spin liquids to develop non-monotonic magnetic-field dependence of thermal conductivity while the detailed comparison to realistic materials remains an open question for future investigation.


title: AutoIP: A United Framework to Integrate Physics into Gaussian Processes

abstract: Physical modeling is critical for many modern science and engineering applications. From a data science or machine learning perspective, where more domain-agnostic, data-driven models are pervasive, physical knowledge -- often expressed as differential equations -- is valuable in that it is complementary to data, and it can potentially help overcome issues such as data sparsity, noise, and inaccuracy. In this work, we propose a simple, yet powerful and general framework -- AutoIP, for Automatically Incorporating Physics -- that can integrate all kinds of differential equations into Gaussian Processes (GPs) to enhance prediction accuracy and uncertainty quantification. These equations can be linear or nonlinear, spatial, temporal, or spatio-temporal, complete or incomplete with unknown source terms, and so on. Based on kernel differentiation, we construct a GP prior to sample the values of the target function, equation-related derivatives, and latent source functions, which are all jointly from a multivariate Gaussian distribution. The sampled values are fed to two likelihoods: one to fit the observations, and the other to conform to the equation. We use the whitening method to evade the strong dependency between the sampled function values and kernel parameters, and we develop a stochastic variational learning algorithm. AutoIP shows improvement upon vanilla GPs in both simulation and several real-world applications, even using rough, incomplete equations.


title: New Limits on Leptophilic Axionlike Particles and Majorons from ArgoNeuT

abstract: Axionlike particles are among the most studied extensions of the standard model. In this Letter we study the bounds that the ArgoNeuT experiment can put on the parameter space of two specific scenarios: leptophilic axionlike particles and Majorons. We find that such bounds are currently the most constraining ones in the (0.2 - 1.7) GeV mass range.


title: Property (T) in random quotients of hyperbolic groups at densities above 1/3

abstract: We study random quotients of a fixed non-elementary hyperbolic group in the Gromov density model. Let $G=\langle S\;\vert\; T\rangle $ be a finite presentation of a non-elementary hyperbolic group, and let $Ann_{l,\omega }(G)$ be the set of elements of norm between $l-\omega(l)$ and $l$ in $G$. A random quotient at density $d$ and length $\omega$-near $l$ is defined by killing a uniformly randomly chosen set of $\vert S_{l}(G)\vert ^{d}$ words in $Ann_{l,\omega (l)}(G)$, where $\omega (l) =o_{l}(l)$. We prove that for any d>1/3, such a quotient has Property (T) with probability tending to $1$ as $l$ tends to infinity. This result answers a question of Gromov--Ollivier and strengthens a theorem of \.{Z}uk (c.f Kotowski--Kotowski).


title: Privacy-preserving machine learning with tensor networks

abstract: Tensor networks, widely used for providing efficient representations of low-energy states of local quantum many-body systems, have been recently proposed as machine learning architectures which could present advantages with respect to traditional ones. In this work we show that tensor network architectures have especially prospective properties for privacy-preserving machine learning, which is important in tasks such as the processing of medical records. First, we describe a new privacy vulnerability that is present in feedforward neural networks, illustrating it in synthetic and real-world datasets. Then, we develop well-defined conditions to guarantee robustness to such vulnerability, which involve the characterization of models equivalent under gauge symmetry. We rigorously prove that such conditions are satisfied by tensor-network architectures. In doing so, we define a novel canonical form for matrix product states, which has a high degree of regularity and fixes the residual gauge that is left in the canonical forms based on singular value decompositions. We supplement the analytical findings with practical examples where matrix product states are trained on datasets of medical records, which show large reductions on the probability of an attacker extracting information about the training dataset from the model's parameters. Given the growing expertise in training tensor-network architectures, these results imply that one may not have to be forced to make a choice between accuracy in prediction and ensuring the privacy of the information processed.

categories: cs.CR cond-mat.stat-mech cs.AI cs.LG quant-ph


title: Electron-phonon coupling in copper intercalated Bi$_{2}$Se$_{3}$

abstract: We report charge and heat transport studies in copper-intercalated topological insulator Bi$_2$Se$_3$ hybrid devices. Measured conductivity shows impact of quantum corrections, electron-electron and electron-phonon interactions. Our shot noise measurements reveal that heat flux displays a crossover between $T^2$ and $T^4$ with the increase of temperature. The results can be explained by a model of inelastic electron scattering on disorder, increasing the role of transverse acoustic phonons in the electron-phonon coupling process.


title: Monte Carlo simulations of multiple populations in globular clusters: constraints on the initial size of the second generation from binary stars

abstract: We present the result of a survey of Monte Carlo simulations of globular clusters hosting two generations of stars including a large (f_b=50%) fraction of primordial binaries in both populations. The dynamical evolution of the two stellar populations is followed for a Hubble time taking into account the effect of the tidal field, two-body relaxation, stellar evolution and three/four-bodies interactions. The fraction of surviving binaries, once accounted for the observational bias and uncertainties, is compared with the available radial velocity time-series performed in real globular clusters, and it is used to constrain the initial spatial concentration of the second generation. The fraction of second generation binaries appears to depend only on the ratio between the total cluster mass and the initial size of the second generation which determines the average velocity dispersion across the extent of this stellar population. In spite of the various uncertainties, we find that the observed fraction can be obtained only assuming a strong initial concentration of the second generation (r_h,S~ 0.1 (M/10^6 M_s) pc). The evolution of the first generation binary fraction is more sensitive to the tidal field strength (with a non negligible effect of the cluster orbital eccentricity) since the tidal field has a direct impact on the first generation structural properties.


title: Evolving-to-Learn Reinforcement Learning Tasks with Spiking Neural Networks

abstract: Inspired by the natural nervous system, synaptic plasticity rules are applied to train spiking neural networks with local information, making them suitable for online learning on neuromorphic hardware. However, when such rules are implemented to learn different new tasks, they usually require a significant amount of work on task-dependent fine-tuning. This paper aims to make this process easier by employing an evolutionary algorithm that evolves suitable synaptic plasticity rules for the task at hand. More specifically, we provide a set of various local signals, a set of mathematical operators, and a global reward signal, after which a Cartesian genetic programming process finds an optimal learning rule from these components. Using this approach, we find learning rules that successfully solve an XOR and cart-pole task, and discover new learning rules that outperform the baseline rules from literature.


title: The oriented chromatic number of random graphs of bounded degree

abstract: The chromatic number of the random graph $\mathcal{G}(n,p)$ has long been studied and has inspired several landmark results. In the case where $p = d/n$, Achlioptas and Naor showed the chromatic number is asymptotically concentrated at $k_d$ or $k_d+1$, where $k_d$ is the smallest integer such that $d < 2k_d\log k_d$. Kemkes et al. later proved the same result holds for $\mathcal{G}(n,d)$, the random $d$-regular graph. We consider the oriented chromatic number of the directed models $\vec{\mathcal{G}}(n,p)$ and $\vec{\mathcal{G}}(n,d)$, improving the best known upper bound from $O(d^2 2^d)$ to $O(\sqrt{e}^d)$.


title: The space of Hardy-weights for quasilinear equations: Maz'ya-type characterization and sufficient conditions for existence of minimizers

abstract: Let $p \in (1,\infty)$ and $\Omega \subset \mathbb{R}^N$ be a domain. Let $ A: =(a_{ij}) \in L^{\infty}_{\text{loc}}(\Omega; \mathbb{R}^{N\times N})$ be a symmetric and locally uniformly positive definite matrix. Set $|\xi|_A^2:= \displaystyle \sum_{i,j=1}^N a_{ij}(x) \xi_i \xi_j$, $\xi \in \mathbb{R}^N$, and let $V$ be a given potential in a certain local Morrey space. We assume that the energy functional $$Q_{p,A,V}(\phi):=\displaystyle \int_{\Omega} [|\nabla \phi|_A^p + V|\phi|^p] {\rm dx} $$ is nonnegative in $W^{1,p}(\Omega)\cap C_c(\Omega)$. We introduce a generalized notion of $Q_{p,A,V}$-capacity and characterize the space of all Hardy-weights for the functional $Q_{p,A,V}$, extending Maz'ya's well known characterization of the space of Hardy-weights for the $p$-Laplacian. In addition, we provide various sufficient conditions on the potential $V$ and the Hardy-weight $g$ such that the best constant of the corresponding variational problem is attained in an appropriate Beppo-Levi space.


title: Bounding threshold dimension: realizing graphic Boolean functions as the AND of majority gates

abstract: A graph $G$ on $n$ vertices is a \emph{threshold graph} if there exist real numbers $a_1,a_2, \ldots, a_n$ and $b$ such that the zero-one solutions of the linear inequality $\sum \limits_{i=1}^n a_i x_i \leq b$ are the characteristic vectors of the cliques of $G$. Introduced in [Chv{\'a}tal and Hammer, Annals of Discrete Mathematics, 1977], the \emph{threshold dimension} of a graph $G$, denoted by $\dimth(G)$, is the minimum number of threshold graphs whose intersection yields $G$. Given a graph $G$ on $n$ vertices, in line with Chv{\'a}tal and Hammer, $f_G\colon \{0,1\}^n \rightarrow \{0,1\}$ is the Boolean function that has the property that $f_G(x) = 1$ if and only if $x$ is the characteristic vector of a clique in $G$. A Boolean function $f$ for which there exists a graph $G$ such that $f=f_G$ is called a \emph{graphic} Boolean function. It follows that for a graph $G$, $\dimth(G)$ is precisely the minimum number of \emph{majority} gates whose AND (or conjunction) realizes the graphic Boolean function $f_G$. The fact that there exist Boolean functions which can be realized as the AND of only exponentially many majority gates motivates us to study threshold dimension of graphs. We give tight or nearly tight upper bounds for the threshold dimension of a graph in terms of its treewidth, maximum degree, degeneracy, number of vertices, size of a minimum vertex cover, etc. We also study threshold dimension of random graphs and graphs with high girth.


title: Towards Better Meta-Initialization with Task Augmentation for Kindergarten-aged Speech Recognition

abstract: Children's automatic speech recognition (ASR) is always difficult due to, in part, the data scarcity problem, especially for kindergarten-aged kids. When data are scarce, the model might overfit to the training data, and hence good starting points for training are essential. Recently, meta-learning was proposed to learn model initialization (MI) for ASR tasks of different languages. This method leads to good performance when the model is adapted to an unseen language. However, MI is vulnerable to overfitting on training tasks (learner overfitting). It is also unknown whether MI generalizes to other low-resource tasks. In this paper, we validate the effectiveness of MI in children's ASR and attempt to alleviate the problem of learner overfitting. To achieve model-agnostic meta-learning (MAML), we regard children's speech at each age as a different task. In terms of learner overfitting, we propose a task-level augmentation method by simulating new ages using frequency warping techniques. Detailed experiments are conducted to show the impact of task augmentation on each age for kindergarten-aged speech. As a result, our approach achieves a relative word error rate (WER) improvement of 51% over the baseline system with no augmentation or initialization.


title: Measurement of the Drell-Yan forward-backward asymmetry at high dilepton masses in proton-proton collisions at $\sqrt{s} =$ 13 TeV

abstract: A measurement of the forward-backward asymmetry of pairs of oppositely charged leptons (dimuons and dielectrons) produced by the Drell-Yan process in proton-proton collisions is presented. The data sample corresponds to an integrated luminosity of 138 fb$^{-1}$ collected with the CMS detector at the LHC at a center-of-mass energy of 13 TeV. The asymmetry is measured as a function of lepton pair mass for masses larger than 170 GeV and compared with standard model predictions. An inclusive measurement across both channels and the full mass range yields an asymmetry of 0.612 $\pm$ 0.005 (stat) $\pm$ 0.007 (syst). As a test of lepton flavor universality, the difference between the dimuon and dielectron asymmetries is measured as well. No statistically significant deviations from standard model predictions are observed. The measurements are used to set limits on the presence of additional gauge bosons. For a Z' boson in the sequential standard model the observed (expected) 95% confidence level lower limit on the Z' mass is 4.4 (3.7) TeV.


title: Cutting Some Slack for SGD with Adaptive Polyak Stepsizes

abstract: Tuning the step size of stochastic gradient descent is tedious and error prone. This has motivated the development of methods that automatically adapt the step size using readily available information. In this paper, we consider the family of SPS (Stochastic gradient with a Polyak Stepsize) adaptive methods. These are methods that make use of gradient and loss value at the sampled points to adaptively adjust the step size. We first show that SPS and its recent variants can all be seen as extensions of the Passive-Aggressive methods applied to nonlinear problems. We use this insight to develop new variants of the SPS method that are better suited to nonlinear models. Our new variants are based on introducing a slack variable into the interpolation equations. This single slack variable tracks the loss function across iterations and is used in setting a stable step size. We provide extensive numerical results supporting our new methods and a convergence theory.


title: A Dynamic Low-Rank Fast Gaussian Transform

abstract: The \emph{Fast Gaussian Transform} (FGT) enables subquadratic-time multiplication of an $n\times n$ Gaussian kernel matrix $\mathsf{K}_{i,j}= \exp ( - \| x_i - x_j \|_2^2 ) $ with an arbitrary vector $h \in \mathbb{R}^n$, where $x_1,\dots, x_n \in \mathbb{R}^d$ are a set of \emph{fixed} source points. This kernel plays a central role in machine learning and random feature maps. Nevertheless, in most modern data analysis applications, datasets are dynamically changing (yet often have low rank), and recomputing the FGT from scratch in (kernel-based) algorithms incurs a major computational overhead ($\gtrsim n$ time for a single source update $\in \mathbb{R}^d$). These applications motivate a \emph{dynamic FGT} algorithm, which maintains a dynamic set of sources under \emph{kernel-density estimation} (KDE) queries in \emph{sublinear time} while retaining Mat-Vec multiplication accuracy and speed. Assuming the dynamic data-points $x_i$ lie in a (possibly changing) $k$-dimensional subspace ($k\leq d$), our main result is an efficient dynamic FGT algorithm, supporting the following operations in $\log^{O(k)}(n/\varepsilon)$ time: (1) Adding or deleting a source point, and (2) Estimating the ``kernel-density'' of a query point with respect to sources with $\varepsilon$ additive accuracy. The core of the algorithm is a dynamic data structure for maintaining the \emph{projected} ``interaction rank'' between source and target boxes, decoupled into finite truncation of Taylor and Hermite expansions.


title: Spectroscopy Signatures of Electron Correlations in a Trilayer Graphene/hBN Moir\'e Superlattice

abstract: ABC-stacked trilayer graphene/hBN moir\'e superlattice (TLG/hBN) has emerged as a playground for correlated electron physics. We report spectroscopy measurements of dual-gated TLG/hBN using Fourier transformed infrared photocurrent spectroscopy. We observed a strong optical transition between moir\'e mini-bands that narrows continuously as a bandgap is opened by gating, indicating a reduction of the single particle bandwidth. At half-filling of the valence flat band, a broad absorption peak emerges at ~18 meV, indicating direct optical excitation across an emerging Mott gap. Similar photocurrent spectra are observed in two other correlated insulating states at quarter- and half-filling of the first conduction band. Our findings provide key parameters of the Hubbard model for the understanding of electron correlation in TLG/hBN.


title: The evolution of turbulent galactic discs: gravitational instability, feedback and accretion

abstract: We study the driving of turbulence in star-froming disc galaxies of different masses at different epochs, using an analytic "bathtub" model. The disc of gas and stars is assumed to be in marginal Toomre instability. Turbulence is assumed to be sustained via an energy balance between its dissipation and three simultaneous energy sources. These are stellar feedback, inward transport due to disc instability and clumpy accretion via streams. The transport rate is computed with two different formalisms, with similar results. To achieve the energy balance, the disc self-regulates either the mass fraction in clumps or the turbulent viscous torque parameter. In this version of the model, the efficiency by which the stream kinetic energy is converted into turbulence is a free parameter, $\xi_a$. We find that the contributions of the three energy sources are in the same ball park, within a factor of $\sim\!2$ in all discs at all times. In haloes that evolve to a mass $\leq 10^{12}\,\Msun$ by $z=0$ ($\leq 10^{11.5}\,\Msun$ at $z\!\sim\!2$), feedback is the main driver throughout their lifetimes. Above this mass, the main driver is either transport or accretion for very low or very high values of $\xi_a$, respectively. For an assumed $\xi_a(t)$ that declines in time, galaxies in halos with present-day mass $>\!10^{12}$ M$_\odot$ make a transition from accretion to transport dominance at intermediate redshifts, $z\! \sim\!3$, when their mass was $\geq\!10^{11.5}\,\Msun$. The predicted relation between star-formation rate and gas velocity dispersion is consistent with observations.


title: A Classical Bulk-Boundary Correspondence

abstract: In this article, we use the language of $\mathbb{P}_0$-factorization algebras to articulate a classical bulk-boundary correspondence between 1) the observables of a Poisson Batalin-Vilkovisky (BV) theory on a manifold $N$ and 2) the observables of the associated universal bulk-boundary system on $N\times \mathbb{R}_{\geq 0}$. The archetypal such example is the Poisson BV theory on $\mathbb{R}$ encoding the algebra of functions on a Poisson manifold, whose associated bulk-boundary system on the upper half-plane is the Poisson sigma model. In this way, we obtain a generalization and partial justification of the basic insight that led Kontsevich to his deformation quantization of Poisson manifolds. The proof of these results relies significantly on the operadic homotopy theory of $\mathbb{P}_0$-algebras.


title: Queue-Aware STAR-RIS Assisted NOMA Communication Systems

abstract: In this paper, the queue-aware simultaneously transmitting and reflecting reconfigurable intelligent surfaces (STAR-RIS) assisted non-orthogonal multiple access (NOMA) communication system is investigated to ensure the system stability, where the long-term stability-oriented problem is reformulated to maximize the per-slot queue-weighted sum rate (QWSR) of users based on the Lyapunov drift theory. By jointly optimizing the NOMA decoding order, the active beamforming coefficients at the BS, and the passive transmission and reflection coefficients at the STAR-RIS, three STAR-RIS operating protocols are considered, namely energy splitting (ES), mode switching (MS), and time switching (TS). For ES, the blocked coordinate descent and the successive convex approximation methods are invoked to handle the highly-coupled and non-convex problem. For MS, the proposed algorithm is further extended to a penalty-based two-loop algorithm to solve the binary amplitude constrained problem. For TS, the formulated problem is decomposed into two subproblems, each of which can be solved in a similar manner to ES. Simulation results show that: i) our proposed STAR-RIS assisted NOMA communication achieves better performance than the conventional schemes; ii) the reformulated QWSR maximization problem confirms the system stability; and iii) TS achieves superior performance with respect to both the QWSR and the average queue length.


title: Trade-offs between Group Fairness Metrics in Societal Resource Allocation

abstract: We consider social resource allocations that deliver an array of scarce supports to a diverse population. Such allocations pervade social service delivery, such as provision of homeless services, assignment of refugees to cities, among others. At issue is whether allocations are fair across sociodemographic groups and intersectional identities. Our paper shows that necessary trade-offs exist for fairness in the context of scarcity; many reasonable definitions of equitable outcomes cannot hold simultaneously except under stringent conditions. For example, defining fairness in terms of improvement over a baseline inherently conflicts with defining fairness in terms of loss compared with the best possible outcome. Moreover, we demonstrate that the fairness trade-offs stem from heterogeneity across groups in intervention responses. Administrative records on homeless service delivery offer a real-world example. Building on prior work, we measure utilities for each household as the probability of reentry into homeless services if given three homeless services. Heterogeneity in utility distributions (conditional on received services) for several sociodemographic groups (e.g. single women with children versus without children) generates divergence across fairness metrics. We argue that such heterogeneity, and thus, fairness trade-offs pervade many social policy contexts.


title: Robustness test of the spacegroupMining model for determining space groups from atomic pair distribution function data

abstract: Machine learning models based on convolutional neural networks have been used for predicting space groups of crystal structures from their atomic pair distribution function (PDF). However, the PDFs used to train the model are calculated using a fixed set of parameters that reflect specific experimental conditions, and the accuracy of the model when given PDFs generated with different choices of these parameters is unknown. In this paper, we report that the results of the top-1 accuracy and top-6 accuracy are robust when applied to PDFs of different choices of experimental parameters $r_\text{max}$, $Q_\text{max}$, $Q_\text{damp}$ and atomic displacement parameters.


title: Automatically Mitigating Vulnerabilities in Binary Programs via Partially Recompilable Decompilation

abstract: Vulnerabilities are challenging to locate and repair, especially when source code is unavailable and binary patching is required. Manual methods are time-consuming, require significant expertise, and do not scale to the rate at which new vulnerabilities are discovered. Automated methods are an attractive alternative, and we propose Partially Recompilable Decompilation (PRD). PRD lifts suspect binary functions to source, available for analysis, revision, or review, and creates a patched binary using source- and binary-level techniques. Although decompilation and recompilation do not typically work on an entire binary, our approach succeeds because it is limited to a few functions, like those identified by our binary fault localization. We evaluate these assumptions and find that, without any grammar or compilation restrictions, 70-89% of individual functions are successfully decompiled and recompiled with sufficient type recovery. In comparison, only 1.7% of the full C-binaries succeed. When decompilation succeeds, PRD produces test-equivalent binaries 92.9% of the time. In addition, we evaluate PRD in two contexts: a fully automated process incorporating source-level Automated Program Repair (APR) methods; human-edited source-level repairs. When evaluated on DARPA Cyber Grand Challenge (CGC) binaries, we find that PRD-enabled APR tools, operating only on binaries, performs as well as, and sometimes better than full-source tools, collectively mitigating 85 of the 148 scenarios, a success rate consistent with these same tools operating with access to the entire source code. PRD achieves similar success rates as the winning CGC entries, sometimes finding higher-quality mitigations than those produced by top CGC teams. For generality, our evaluation includes two independently developed APR tools and C++, Rode0day, and real-world binaries.


title: Time Efficient Training of Progressive Generative Adversarial Network using Depthwise Separable Convolution and Super Resolution Generative Adversarial Network

abstract: Generative Adversarial Networks have been employed successfully to generate high-resolution augmented images of size 1024^2. Although the augmented images generated are unprecedented, the training time of the model is exceptionally high. Conventional GAN requires training of both Discriminator as well as the Generator. In Progressive GAN, which is the current state-of-the-art GAN for image augmentation, instead of training the GAN all at once, a new concept of progressing growing of Discriminator and Generator simultaneously, was proposed. Although the lower stages such as 4x4 and 8x8 train rather quickly, the later stages consume a tremendous amount of time which could take days to finish the model training. In our paper, we propose a novel pipeline that combines Progressive GAN with slight modifications and Super Resolution GAN. Super Resolution GAN up samples low-resolution images to high-resolution images which can prove to be a useful resource to reduce the training time exponentially.


title: Squeezed Ground States in a Spin-1 Bose-Einstein Condensate

abstract: We generate spin squeezed ground states in an atomic spin-1 Bose-Einstein condensate tuned nearthe quantum critical point between the polar and ferromagnetic quantum phases of the interactingspin ensemble. In contrast to typical non-equilibrium methods for preparing atomic squeezed statesby quenching through a quantum phase transition, squeezed ground states are time-stationary andremain squeezed for the lifetime of the condensate. A squeezed ground state with a metrologicalimprovement up to 6-8 dB and a constant squeezing angle maintained over 2 s is demonstrated.


title: Crises and Political Polarization: Towards a Better Understanding of the Timing and Impact of Shocks and Media

abstract: We investigate how crises alter societies by analyzing the timing and channels of change using a longitudinal multi-wave survey of a representative sample of Americans throughout 2020. This methodology allows us to overcome some of the limitations of previous studies and uncover novel insights: (1) individuals with a negative personal experience during a crisis become more pro-welfare spending, in particular for policies they perceive will benefit them personally, and they become less trusting of institutions; (2) indirect shocks or the mere exposure to the crisis doesn't have a similar effect; (3) policy preferences and institutional trust can change quickly after a negative experience; and (4) consuming partisan media can mitigate or exacerbate these effects by distorting perceptions of reality. In an experiment, we find that exposing individuals to the same information can recalibrate distorted perceptions with lasting effects. Using a machine learning model to test for heterogeneous treatment effects, we find a negative personal experience did not make individuals more responsive to the information treatment, suggesting that lived and perceived experiences play an equally important role in changing preferences during a crisis.


title: Basic Elements for Simulations of Standard Model Physics with Quantum Annealers: Multigrid and Clock States

abstract: We explore the potential of D-Wave's quantum annealers for computing some of the basic components required for quantum simulations of Standard Model physics. By implementing a basic multigrid (including "zooming") and specializing Feynman-clock algorithms, D-Wave's Advantage is used to study harmonic and anharmonic oscillators relevant for lattice scalar field theories and effective field theories, the time evolution of a single plaquette of SU(3) Yang-Mills lattice gauge field theory, and the dynamics of flavor entanglement in four neutrino systems.


title: Kinetic-scale current sheets in near-Sun solar wind: properties, scale-dependent features and reconnection onset

abstract: We present statistical analysis of 11,200 proton kinetic-scale current sheets (CS) observed by Parker Solar Probe during 10 days around the first perihelion. The CS thickness $\lambda$ is in the range from a few to 200 km with the typical value around 30 km, while current densities are in the range from 0.1 to 10\;$\mu {\rm A/m^2}$ with the typical value around 0.7\;$\mu {\rm A/m^2}$. These CSs are resolved thanks to magnetic field measurements at 73--290 Samples/s resolution. In terms of proton inertial length $\lambda_{p}$, the CS thickness $\lambda$ is in the range from about $0.1$ to $10\lambda_{p}$ with the typical value around 2$\lambda_{p}$. The magnetic field magnitude does not substantially vary across the CSs and, accordingly, the current density is dominated by the magnetic field-aligned component. The CSs are typically asymmetric with statistically different magnetic field magnitudes at the CS boundaries. The current density is larger for smaller-scale CSs, $J_0\approx 0.15 \cdot (\lambda/100\;{\rm km})^{-0.76}$ $\mu {\rm A/m^2}$, but does not statistically exceed the Alfv\'en current density $J_A$ corresponding to the ion-electron drift of local Alfv\'{e}n speed. The CSs exhibit remarkable scale-dependent current density and magnetic shear angles, $J_0/J_{A}\approx 0.17\cdot (\lambda/\lambda_{p})^{-0.67}$ and $\Delta \theta\approx 21^{\circ}\cdot (\lambda/\lambda_{p})^{0.32}$. Based on these observations and comparison to recent studies at 1 AU, we conclude that proton kinetic-scale CSs in the near-Sun solar wind are produced by turbulence cascade and they are automatically in the parameter range, where reconnection is not suppressed by the diamagnetic mechanism, due to their geometry dictated by turbulence cascade.


title: Differentially-Private Publication of Origin-Destination Matrices with Intermediate Stops

abstract: Conventional origin-destination (OD) matrices record the count of trips between pairs of start and end locations, and have been extensively used in transportation, traffic planning, etc. More recently, due to use case scenarios such as COVID-19 pandemic spread modeling, it is increasingly important to also record intermediate points along an individual's path, rather than only the trip start and end points. This can be achieved by using a multi-dimensional frequency matrix over a data space partitioning at the desired level of granularity. However, serious privacy constraints occur when releasing OD matrix data, and especially when adding multiple intermediate points, which makes individual trajectories more distinguishable to an attacker. To address this threat, we propose a technique for privacy-preserving publication of multi-dimensional OD matrices that achieves differential privacy (DP), the de-facto standard in private data release. We propose a family of approaches that factor in important data properties such as data density and homogeneity in order to build OD matrices that provide provable protection guarantees while preserving query accuracy. Extensive experiments on real and synthetic datasets show that the proposed approaches clearly outperform existing state-of-the-art.


title: Physics Opportunities with PROSPECT-II

abstract: The PROSPECT experiment has substantially addressed the original 'Reactor Antineutrino Anomaly' by performing a high-resolution spectrum measurement from an enriched compact reactor core and a reactor model-independent sterile neutrino oscillation search based on the unique spectral distortions the existence of eV$^2$-scale sterile neutrinos would impart. But as the field has evolved, the current short-baseline (SBL) landscape supports many complex phenomenological interpretations, establishing a need for complementary experimental approaches to resolve the situation. While the global suite of SBL reactor experiments, including PROSPECT, have probed much of the sterile neutrino parameter space, there remains a large region above 1 eV$^2$ that remains unaddressed. Recent results from BEST confirm the Gallium Anomaly, increasing its significance to $\sim 5\sigma$, with sterile neutrinos providing a possible explanation of this anomaly. Separately, the MicroBooNE exclusion of electron-like signatures causing the MiniBooNE low-energy excess does not eliminate the possibility of sterile neutrinos as an explanation. Focusing specifically on the future use of reactors as a neutrino source for beyond-the-standard-model physics and applications, higher-precision spectral measurements still have a role to play. These recent results have created a confusing landscape which requires new data to disentangle the seemingly contradictory measurements. To directly probe $\overline{\nu}_{e}$ disappearance from high $\Delta m^2$ sterile neutrinos, the PROSPECT collaboration proposes to build an upgraded and improved detector, PROSPECT-II. It features an evolutionary detector design which can be constructed and deployed within one year and have impactful physics with as little as one calendar year of data.


title: On some high-dimensional limits of matricial stochastic processes seen from a quantum probability perspective

abstract: We generalize the result of block-wise convergence of the Brownian motion on the unitary group $U(nm)$ towards a quantum L\'evy process on the unitary dual group $U\langle n\rangle$ when $m\rightarrow\infty$, obtained by the author in a previous paper, by showing that the Brownian motions on the orthogonal group $O(nm)$ and the symplectic group $Sp(nm)$ also converge block-wise to this same quantum L\'evy process.


title: Derived categories of families of Fano threefolds

abstract: We construct $S$-linear semiorthogonal decompositions of derived categories of smooth Fano threefold fibrations $X/S$ with relative Picard rank $1$ and rational geometric fibers and discuss how the structure of components of these decompositions is related to rationality properties of $X/S$.


title: Flexible multivariate spatio-temporal Hawkes process models of terrorism

abstract: We develop flexible multivariate spatio-temporal Hawkes process models to analyze patterns of terrorism. Previous applications of point process methods to political violence data mainly utilize temporal Hawkes process models, neglecting spatial variation in these attack patterns. This limits what can be learned from these models as any effective counter-terrorism strategy requires knowledge on both when and where attacks are likely to occur. Even the existing work on spatio-temporal Hawkes processes imposes restrictions on the triggering function that are not well-suited for terrorism data. Therefore, we generalize the structure of the spatio-temporal triggering function considerably, allowing for nonseprability, nonstatitionarity, and cross-triggering (i.e., across the groups). To demonstrate the utility of our models, we analyze two samples of real-world terrorism data: Afghanistan (2002-2013) for univariate analysis and Nigeria (2009-2017) for bivariate analysis. Jointly, these two studies demonstrate that our models outperform standard Hawkes process models, besting widely-used alternatives in overall model fit and revealing spatio-temporal patterns that are, by construction, masked in these models (e.g., increasing dispersion in cross-triggering over time).


title: Multiple multi-sample testing under arbitrary covariance dependency

abstract: Modern high-throughput biomedical devices routinely produce data on a large scale, and the analysis of high-dimensional datasets has become commonplace in biomedical studies. However, given thousands or tens of thousands of measured variables in these datasets, extracting meaningful features poses a challenge. In this article, we propose a procedure to evaluate the strength of the associations between a nominal (categorical) response variable and multiple features simultaneously. Specifically, we propose a framework of large-scale multiple testing under arbitrary correlation dependency among test statistics. First, marginal multinomial regressions are performed for each feature individually. Second, we use an approach of multiple marginal models for each baseline-category pair to establish asymptotic joint normality of the stacked vector of the marginal multinomial regression coefficients. Third, we estimate the (limiting) covariance matrix between the estimated coefficients from all marginal models. Finally, our approach approximates the realized false discovery proportion of a thresholding procedure for the marginal p-values, for each baseline-category pair. The proposed approach offers a sensible trade-off between the expected numbers of true and false rejections. Furthermore, we demonstrate a practical application of the method on hyperspectral imaging data. This dataset is obtained by a matrix-assisted laser desorption/ionization (MALDI) instrument. MALDI demonstrates tremendous potential for clinical diagnosis, particularly for cancer research. In our application, the nominal response categories represent cancer subtypes.


title: Bayesian Deep Learning for Graphs

abstract: The adaptive processing of structured data is a long-standing research topic in machine learning that investigates how to automatically learn a mapping from a structured input to outputs of various nature. Recently, there has been an increasing interest in the adaptive processing of graphs, which led to the development of different neural network-based methodologies. In this thesis, we take a different route and develop a Bayesian Deep Learning framework for graph learning. The dissertation begins with a review of the principles over which most of the methods in the field are built, followed by a study on graph classification reproducibility issues. We then proceed to bridge the basic ideas of deep learning for graphs with the Bayesian world, by building our deep architectures in an incremental fashion. This framework allows us to consider graphs with discrete and continuous edge features, producing unsupervised embeddings rich enough to reach the state of the art on several classification tasks. Our approach is also amenable to a Bayesian nonparametric extension that automatizes the choice of almost all model's hyper-parameters. Two real-world applications demonstrate the efficacy of deep learning for graphs. The first concerns the prediction of information-theoretic quantities for molecular simulations with supervised neural models. After that, we exploit our Bayesian models to solve a malware-classification task while being robust to intra-procedural code obfuscation techniques. We conclude the dissertation with an attempt to blend the best of the neural and Bayesian worlds together. The resulting hybrid model is able to predict multimodal distributions conditioned on input graphs, with the consequent ability to model stochasticity and uncertainty better than most works. Overall, we aim to provide a Bayesian perspective into the articulated research field of deep learning for graphs.


title: openFEAT: Improving Speaker Identification by Open-set Few-shot Embedding Adaptation with Transformer

abstract: Household speaker identification with few enrollment utterances is an important yet challenging problem, especially when household members share similar voice characteristics and room acoustics. A common embedding space learned from a large number of speakers is not universally applicable for the optimal identification of every speaker in a household. In this work, we first formulate household speaker identification as a few-shot open-set recognition task and then propose a novel embedding adaptation framework to adapt speaker representations from the given universal embedding space to a household-specific embedding space using a set-to-set function, yielding better household speaker identification performance. With our algorithm, Open-set Few-shot Embedding Adaptation with Transformer (openFEAT), we observe that the speaker identification equal error rate (IEER) on simulated households with 2 to 7 hard-to-discriminate speakers is reduced by 23% to 31% relative.


title: DoCoGen: Domain Counterfactual Generation for Low Resource Domain Adaptation

abstract: Natural language processing (NLP) algorithms have become very successful, but they still struggle when applied to out-of-distribution examples. In this paper we propose a controllable generation approach in order to deal with this domain adaptation (DA) challenge. Given an input text example, our DoCoGen algorithm generates a domain-counterfactual textual example (D-con) - that is similar to the original in all aspects, including the task label, but its domain is changed to a desired one. Importantly, DoCoGen is trained using only unlabeled examples from multiple domains - no NLP task labels or parallel pairs of textual examples and their domain-counterfactuals are required. We show that DoCoGen can generate coherent counterfactuals consisting of multiple sentences. We use the D-cons generated by DoCoGen to augment a sentiment classifier and a multi-label intent classifier in 20 and 78 DA setups, respectively, where source-domain labeled data is scarce. Our model outperforms strong baselines and improves the accuracy of a state-of-the-art unsupervised DA algorithm.


title: Atomic-scale imaging of emergent order at a magnetic-field-induced Lifshitz transition

abstract: The phenomenology and radical changes seen in materials properties traversing a quantum phase transition has captivated condensed matter research over past decades. Strong electronic correlations lead to novel electronic ground states, including magnetic order, nematicity and unconventional superconductivity. Providing a microscopic model for these requires detailed knowledge of the electronic structure in the vicinity of the Fermi energy, promising a complete understanding of the physics of the quantum critical point. Here, we demonstrate such a measurement at the surface of Sr$_3$Ru$_2$O$_7$. Our results show that, even in zero field, the electronic structure is strongly $C_2$ symmetric and that a magnetic-field drives both a Lifshitz transition and induces a charge-stripe order. We track the changes of the electronic structure as a function of field via quasi-particle interference imaging at ultralow temperatures. Our results provide a complete microscopic picture of the field-induced changes of the electronic structure across the Lifshitz transition.


title: Bayesian Model Averaging of Chain Event Graphs for Robust Explanatory Modelling

abstract: Chain Event Graphs (CEGs) are a widely applicable class of probabilistic graphical model that can represent context-specific independence statements and asymmetric unfoldings of events in an easily interpretable way. Existing model selection literature on CEGs has largely focused on obtaining the maximum a posteriori (MAP) CEG. However, MAP selection is well-known to ignore model uncertainty. Here, we explore the use of Bayesian model averaging over this class. We demonstrate how this approach can quantify model uncertainty and leads to more robust inference by identifying shared features across multiple high-scoring models. Because the space of possible CEGs is huge, scoring models exhaustively for model averaging in all but small problems is prohibitive. However, we provide a simple modification of an existing model selection algorithm, that samples the model space, to illustrate the efficacy of Bayesian model averaging compared to more standard MAP modelling.


title: Equilibration and "Thermalization'' in the Adapted Caldeira-Leggett model

abstract: I explore the processes of equilibration exhibited by the Adapted Caldeira-Leggett (ACL) model, a small unitary "toy model" developed for numerical studies of quantum decoherence between an SHO and an environment. I demonstrate how dephasing allows equilibration to occur in a wide variety of situations. While the finite model size and other "unphysical" aspects prevent the notions of temperature and thermalization from being generally applicable, certain primitive aspects of thermalization can be realized for particular parameter values. I link the observed behaviors to intrinsic properties of the global energy eigenstates, and argue that the phenomena I observe contain elements which might be key ingredients that lead to ergodic behavior in larger more realistic systems. The motivations for this work range from curiosity about phenomena observed in earlier calculations with the ACL model, to much larger questions related to the nature of equilibrium, thermalization and the emergence of physical laws.


title: An Automorphism group of a rational surface: Not too big not too small

abstract: This article concerns the realization problem of subgroups of Coxeter groups. We construct a subgroup $G$ of the Coxeter group $W_{15}$ such that $G$ is realized as automorphism groups of a rational surface $X$ and $G \cong Aut(X)^* \cong D_3 \times \mathbb{Z}$. We also show that there is an element $\omega$ in $W_{14}$ is not realizable.