title: Boosting Active Learning via Improving Test Performance

abstract: Central to active learning (AL) is what data should be selected for annotation. Existing works attempt to select highly uncertain or informative data for annotation. Nevertheless, it remains unclear how selected data impacts the test performance of the task model used in AL. In this work, we explore such an impact by theoretically proving that selecting unlabeled data of higher gradient norm leads to a lower upper-bound of test loss, resulting in better test performance. However, due to the lack of label information, directly computing gradient norm for unlabeled data is infeasible. To address this challenge, we propose two schemes, namely expected-gradnorm and entropy-gradnorm. The former computes the gradient norm by constructing an expected empirical loss while the latter constructs an unsupervised loss with entropy. Furthermore, we integrate the two schemes in a universal AL framework. We evaluate our method on classical image classification and semantic segmentation tasks. To demonstrate its competency in domain applications and its robustness to noise, we also validate our method on a cellular imaging analysis task, namely cryo-Electron Tomography subtomogram classification. Results demonstrate that our method achieves superior performance against the state of the art. Our source code is available at https://github.com/xulabs/aitom/blob/master/doc/projects/al_gradnorm.md.


title: Full Model Estimation for Non-Parametric Multivariate Finite Mixture Models

abstract: This paper addresses the problem of full model estimation for non-parametric finite mixture models. It presents an approach for selecting the number of components and the subset of discriminative variables (i.e., the subset of variables having different distributions among the mixture components). The proposed approach considers a discretization of each variable into B bins and a penalization of the resulting log-likelihood. Considering that the number of bins tends to infinity as the sample size tends to infinity, we prove that our estimator of the model (number of components and subset of relevant variables for clustering) is consistent under a suitable choice of the penalty term. Interest of our proposal is illustrated on simulated and benchmark data.


title: Regularisation by fractional noise for one-dimensional differential equations with distributional drift

abstract: We study existence and uniqueness of solutions to the equation $dX_t=b(X_t)dt + dB_t$, where $b$ is a distribution in some Besov space and $B$ is a fractional Brownian motion with Hurst parameter $H\leqslant 1/2$. First, the equation is understood as a nonlinear Young equation. This involves a nonlinear Young integral constructed in the space of functions with finite $p$-variation, which is well suited when $b$ is a measure. Depending on $H$, a condition on the Besov regularity of $b$ is given so that solutions to the equation exist. The construction is deterministic, and $B$ can be replaced by a deterministic path $w$ with a sufficiently smooth local time. Using this construction we prove the existence of weak solutions (in the probabilistic sense). We also prove that solutions coincide with limits of strong solutions obtained by regularisation of $b$. This is used to establish pathwise uniqueness and existence of a strong solution. In particular when $b$ is a finite measure, weak solutions exist for $H<\sqrt{2}-1$, while pathwise uniqueness and strong existence hold when $H\leqslant 1/4$. The proofs involve fine properties of the local time of the fractional Brownian motion, as well as new regularising properties of this process which are established using the stochastic sewing Lemma.


title: Learning-based personal speech enhancement for teleconferencing by exploiting spatial-spectral features

abstract: Teleconferencing is becoming essential during the COVID-19 pandemic. However, in real-world applications, speech quality can deteriorate due to, for example, background interference, noise, or reverberation. To solve this problem, target speech extraction from the mixture signals can be performed with the aid of the user's vocal features. Various features are accounted for in this study's proposed system, including speaker embeddings derived from user enrollment and a novel long-short-term spatial coherence feature pertaining to the target speaker activity. As a learning-based approach, a target speech sifting network was employed to extract the relevant features. The network trained with LSTSC in the proposed approach is robust to microphone array geometries and the number of microphones. Furthermore, the proposed enhancement system was compared with a baseline system with speaker embeddings and interchannel phase difference. The results demonstrated the superior performance of the proposed system over the baseline in enhancement performance and robustness.


title: Federated Two-stage Learning with Sign-based Voting

abstract: Federated learning is a distributed machine learning mechanism where local devices collaboratively train a shared global model under the orchestration of a central server, while keeping all private data decentralized. In the system, model parameters and its updates are transmitted instead of raw data, and thus the communication bottleneck has become a key challenge. Besides, recent larger and deeper machine learning models also pose more difficulties in deploying them in a federated environment. In this paper, we design a federated two-stage learning framework that augments prototypical federated learning with a cut layer on devices and uses sign-based stochastic gradient descent with the majority vote method on model updates. Cut layer on devices learns informative and low-dimension representations of raw data locally, which helps reduce global model parameters and prevents data leakage. Sign-based SGD with the majority vote method for model updates also helps alleviate communication limitations. Empirically, we show that our system is an efficient and privacy preserving federated learning scheme and suits for general application scenarios.


title: Mapping the metal-insulator phase diagram by algebraically fast-forwarding dynamics on a cloud quantum computer

abstract: Dynamical mean-field theory (DMFT) maps the local Green's function of the Hubbard model to that of the Anderson impurity model and thus gives an approximate solution of the Hubbard model from the solution of simpler quantum impurity model. Quantum and hybrid quantum-classical algorithms have been proposed to efficiently solve impurity models by preparing and evolving the ground state under the impurity Hamiltonian on a quantum computer that is assumed to have the scalability and accuracy far beyond the current state-of-the-art quantum hardware. As a proof of principle demonstration targeting the Anderson impurity model we close the DMFT loop with current noisy hardware. With a highly optimized fast-forwarding quantum circuit and a noise resilient spectral analysis we observe a Mott phase transition. Based on a Cartan decomposition, our algorithm gives a fixed depth, fast-forwarding, quantum circuit that can evolve the initial state over arbitrarily long times without time-discretization errors typical of other product decomposition formulas such as Trotter decomposition. By exploiting the structure of the fast-forwarding circuits we reduce the gate count (to 77 CNOTs after optimization), simulate the dynamics, and extract frequencies from the Anderson impurity model on noisy quantum hardware. We then demonstrate the Mott transition by mapping the full metal-insulator phase-diagram. Near the Mott phase transition, our method maintains accuracy where Trotter error would otherwise dominate due to the long-time evolution required to resolve quasiparticle resonance frequency extremely close to zero. This work presents the first computation of the Mott phase transition using noisy digital quantum hardware, made viable by a highly optimized computation in terms of gate depth, simulation error, and runtime on quantum hardware.


title: Optab: Public code for generating gas opacity tables for radiation hydrodynamics simulations

abstract: We have developed a public code, Optab, that outputs Rosseland, Planck, and two-temperature Planck mean gas opacity tables for radiation hydrodynamics simulations in astrophysics. The code is developed for modern high-performance computing, being written in Fortran 90 and using Message Passing Interface and Hierarchical Data Format, Version 5. The purpose of this work is to provide a platform on which users can generate opacity tables for their own research purposes. Therefore, the code has been designed so that a user can easily modify, change, or add opacity sources in addition to those already implemented, which include bremsstrahlung, photoionization, Rayleigh scattering, line absorption, and collision-induced absorption. In this paper, we provide details of the opacity calculations in our code and present validation tests to evaluate the performance of our code.

categories: astro-ph.IM astro-ph.EP astro-ph.HE astro-ph.SR


title: Emerging Jets Displaced into the Future

abstract: We examine the potential of future long-lived particle experiments to probe dark QCD models that feature Emerging Jets. The core of this analysis focuses on the transverse detectors AL3X, ANUBIS, CODEX-b, and MATHUSLA as they cover the most relevant parameter space, though the highly forward experiments MAPP, FORMOSA, and FASER are also explored. Geometric coverage of the detectors is calculated and used to determine the number of signal events and kinematic distribution measured for a collection of different benchmark models. This is used to map out the discovery potential of the Emerging Jets parameter space. Although all experiments demonstrate some reach, AL3X, ANUBIS, and MATHUSLA stand out as the most promising for exploring the dark QCD Emerging Jets parameter space.


title: Acceleration of amyloid fibril formation by multichannel sonochemical reactor

abstract: Formation of amyloid fibrils of various amyloidogenic proteins is dramatically enhanced by ultrasound irradiation. For applying this phenomenon to the study of protein aggregation science and diagnosis of neurodegenerative diseases, a multichannel ultrasound irradiation system with individually adjustable ultrasound-irradiation conditions is necessary. Here, we develop a sonochemical reaction system, where an ultrasonic transducer is placed in each well of a 96-well microplate to perform ultrasonic irradiation of sample solutions under various conditions with high reproducibility, and applied it for studying amyloid-fibril formation of amyloid $\beta$, $\alpha$-synuclein, $\beta$2-microglobulin, and lysozyme. The results clearly show that our instrument is superior to conventional shaking method in terms of degree of acceleration and reproducibility of fibril formation reaction. The acceleration degree is controllable by controlling the driving voltage applied to each transducer. We have thus succeeded in developing a useful tool for the study of amyloid fibril formation in various proteins.


title: VUT: Versatile UI Transformer for Multi-Modal Multi-Task User Interface Modeling

abstract: User interface modeling is inherently multimodal, which involves several distinct types of data: images, structures and language. The tasks are also diverse, including object detection, language generation and grounding. In this paper, we present VUT, a Versatile UI Transformer that takes multimodal input and simultaneously accomplishes 5 distinct tasks with the same model. Our model consists of a multimodal Transformer encoder that jointly encodes UI images and structures, and performs UI object detection when the UI structures are absent in the input. Our model also consists of an auto-regressive Transformer model that encodes the language input and decodes output, for both question-answering and command grounding with respect to the UI. Our experiments show that for most of the tasks, when trained jointly for multi-tasks, VUT substantially reduces the number of models and footprints needed for performing multiple tasks, while achieving accuracy exceeding or on par with baseline models trained for each individual task.


title: Sample and Threshold Differential Privacy: Histograms and applications

abstract: Federated analytics seeks to compute accurate statistics from data distributed across users' devices while providing a suitable privacy guarantee and being practically feasible to implement and scale. In this paper, we show how a strong $(\epsilon, \delta)$-Differential Privacy (DP) guarantee can be achieved for the fundamental problem of histogram generation in a federated setting, via a highly practical sampling-based procedure that does not add noise to disclosed data. Given the ubiquity of sampling in practice, we thus obtain a DP guarantee almost for free, avoid over-estimating histogram counts, and allow easy reasoning about how privacy guarantees may obscure minorities and outliers. Using such histograms, related problems such as heavy hitters and quantiles can be answered with provable error and privacy guarantees. Experimental results show that our sample-and-threshold approach is accurate and scalable.


title: Unrolling PALM for sparse semi-blind source separation

abstract: Sparse Blind Source Separation (BSS) has become a well established tool for a wide range of applications - for instance, in astrophysics and remote sensing. Classical sparse BSS methods, such as the Proximal Alternating Linearized Minimization (PALM) algorithm, nevertheless often suffer from a difficult hyperparameter choice, which undermines their results. To bypass this pitfall, we propose in this work to build on the thriving field of algorithm unfolding/unrolling. Unrolling PALM enables to leverage the data-driven knowledge stemming from realistic simulations or ground-truth data by learning both PALM hyperparameters and variables. In contrast to most existing unrolled algorithms, which assume a fixed known dictionary during the training and testing phases, this article further emphasizes on the ability to deal with variable mixing matrices (a.k.a. dictionaries). The proposed Learned PALM (LPALM) algorithm thus enables to perform semi-blind source separation, which is key to increase the generalization of the learnt model in real-world applications. We illustrate the relevance of LPALM in astrophysical multispectral imaging: the algorithm not only needs up to $10^4-10^5$ times fewer iterations than PALM, but also improves the separation quality, while avoiding the cumbersome hyperparameter and initialization choice of PALM. We further show that LPALM outperforms other unrolled source separation methods in the semi-blind setting.


title: Causal Knowledge Guided Societal Event Forecasting

abstract: Data-driven societal event forecasting methods exploit relevant historical information to predict future events. These methods rely on historical labeled data and cannot accurately predict events when data are limited or of poor quality. Studying causal effects between events goes beyond correlation analysis and can contribute to a more robust prediction of events. However, incorporating causality analysis in data-driven event forecasting is challenging due to several factors: (i) Events occur in a complex and dynamic social environment. Many unobserved variables, i.e., hidden confounders, affect both potential causes and outcomes. (ii) Given spatiotemporal non-independent and identically distributed (non-IID) data, modeling hidden confounders for accurate causal effect estimation is not trivial. In this work, we introduce a deep learning framework that integrates causal effect estimation into event forecasting. We first study the problem of Individual Treatment Effect (ITE) estimation from observational event data with spatiotemporal attributes and present a novel causal inference model to estimate ITEs. We then incorporate the learned event-related causal information into event prediction as prior knowledge. Two robust learning modules, including a feature reweighting module and an approximate constraint loss, are introduced to enable prior knowledge injection. We evaluate the proposed causal inference model on real-world event datasets and validate the effectiveness of proposed robust learning modules in event prediction by feeding learned causal information into different deep learning methods. Experimental results demonstrate the strengths of the proposed causal inference model for ITE estimation in societal events and showcase the beneficial properties of robust learning modules in societal event forecasting.


title: Counting lattice paths by crossings and major index II: tracking descents via two-rowed arrays

abstract: We present refined enumeration formulas for lattice paths in $\mathbb{Z}^2$ with two kinds of steps, by keeping track of the number of descents (i.e., turns in a given direction), the major index (i.e., the sum of the positions of the descents), and the number of crossings. One formula considers crossings between a path and a fixed line; the other considers crossings between two paths. Building on the first paper of the series, which used lattice path bijections to give the enumeration with respect to major index and crossings, we obtain a refinement that keeps track of the number of descents. The proof is based on new bijections which rely on certain two-rowed arrays that were introduced by Krattenthaler.


title: Thermal Conductivity measurements of macroscopic frozen Salt Ice analogs of Jovian Icy moons in support of the planned JUICE mission

abstract: The study of thermal properties of frozen salt solutions representative of ice layers in Jovian moons is crucial to support the JUpiter ICy moons Explorer (JUICE) (ESA) and Europa Clipper (NASA) missions, which will be launched in the upcoming years to make detailed observations of the giant gaseous planet Jupiter and three of its largest moons (Ganymede, Europa, and Callisto), due to the scarcity of experimental measurements. Therefore, we have conducted a set of experiments to measure and study the thermal conductivity of macroscopic frozen salt solutions of particular interest in these regions, including sodium chloride (NaCl), magnesium sulphate (MgSO$_4$), sodium sulphate (Na$_2$SO$_4$), and magnesium chloride (MgCl$_2$). Measurements were performed at atmospheric pressure and temperatures from 0 to -70$^{\circ}$C in a climatic chamber. Temperature and calorimetry were measured during the course of the experiments. An interesting side effect of these measurements is that they served to spot phase changes in the frozen salt solutions, even for very low salt concentrations. A small sample of the liquid salt-water solution was set aside for the calorimetry measurements. These experiments and the measurements of thermal conductivity and calorimetry will be valuable to constrain the chemical composition, physical state, and temperature of the icy crusts of Ganymede, Europa, and Callisto.


title: Controlling Outlier Contamination In Multimessenger Time-domain Searches For Supermasssive Binary Black Holes

abstract: Time-domain datasets of many varieties can be prone to statistical outliers that result from instrumental or astrophysical anomalies. These can impair searches for signals within the time series and lead to biased parameter estimation. Versatile outlier mitigation methods tuned toward multimessenger time-domain searches for supermassive binary black holes have yet to be fully explored. In an effort to perform robust outlier isolation with low computational costs, we propose a Gibbs sampling scheme. This provides structural simplicity to outlier modeling and isolation, as it requires minimal modifications to adapt to time-domain modeling scenarios with pulsar-timing array or photometric data. We robustly diagnose outliers present in simulated pulsar-timing datasets, and then further apply our methods to pulsar J$1909$$-$$3744$ from the NANOGrav 9-yr Dataset. We also explore the periodic binary-AGN candidate PG$1302$$-$$102$ using datasets from the Catalina Real-time Transient Survey, All-Sky Automated Survey for Supernovae, and the Lincoln Near-Earth Asteroid Research. We present our findings and outline future work that could improve outlier modeling and isolation for multimessenger time-domain searches.


title: Low-energy excitations and magnetic anisotropy of the layered van der Waals antiferromagnet Ni$_2$P$_2$S$_6$

abstract: The quasi-two-dimensional antiferromagnet Ni$_2$P$_2$S$_6$ belongs to the family of magnetic van der Waals compounds that provides a rich material base for the realization of fundamental models of quantum magnetism in low dimensions. Here, we report high-frequency/high-magnetic field electron spin resonance measurements on single crystals of Ni$_2$P$_2$S$_6$. The results enable one to reliably determine the positive, "easy"-plane type of the single ion anisotropy of the Ni$^{2+}$ ions with the upper limit of its magnitude $\lesssim 0.7$ meV. The resonance response reveals strongly anisotropic spin fluctuations setting in shortly above the N\'eel temperature $T_{\rm N} = 158$ K and extending in the antiferromagnetically ordered state down to low temperatures. There, a low-energy magnon excitation gapped from the ground state by only $\sim 1$ meV was found. This magnon mode may explain unusual low temperature relaxation processes observed in a latest nuclear magnetic resonance experiments and together with the estimate of the single ion anisotropy they should enable setting up a realistic spin model for an accurate description of magnetic properties of Ni$_2$P$_2$S$_6$.


title: A Framework for Fairness: A Systematic Review of Existing Fair AI Solutions

abstract: In a world of daily emerging scientific inquisition and discovery, the prolific launch of machine learning across industries comes to little surprise for those familiar with the potential of ML. Neither so should the congruent expansion of ethics-focused research that emerged as a response to issues of bias and unfairness that stemmed from those very same applications. Fairness research, which focuses on techniques to combat algorithmic bias, is now more supported than ever before. A large portion of fairness research has gone to producing tools that machine learning practitioners can use to audit for bias while designing their algorithms. Nonetheless, there is a lack of application of these fairness solutions in practice. This systematic review provides an in-depth summary of the algorithmic bias issues that have been defined and the fairness solution space that has been proposed. Moreover, this review provides an in-depth breakdown of the caveats to the solution space that have arisen since their release and a taxonomy of needs that have been proposed by machine learning practitioners, fairness researchers, and institutional stakeholders. These needs have been organized and addressed to the parties most influential to their implementation, which includes fairness researchers, organizations that produce ML algorithms, and the machine learning practitioners themselves. These findings can be used in the future to bridge the gap between practitioners and fairness experts and inform the creation of usable fair ML toolkits.


title: The resilience of the Etherington-Hubble relation

abstract: The Etherington reciprocity theorem, or distance duality relation (DDR), relates the mutual scaling of cosmic distances in any metric theory of gravity where photons are massless and propagate on null geodesics. In this paper, we make use of the DDR to build a consistency check based on its degeneracy with the Hubble constant, $H_0$. We parameterise the DDR using the form $\eta(z) = 1+ \epsilon z$, thus only allowing small deviations from its standard value. We use a combination of late time observational data to provide the first joint constraints on the Hubble parameter and $\epsilon$ with percentage accuracy: $H_0 = 68.6 \pm 2.5$ kms$^{-1}$Mpc$^{-1}$ and $\epsilon = 0.001^{+0.023}_{-0.026}$. We build our consistency check using these constraints and compare them with the results obtained in extended cosmological models using cosmic microwave background data. We find that extensions to $\Lambda$CDM involving massive neutrinos and/or additional dark radiation are in perfect agreement with the DDR, while models with non-zero spatial curvature show a preference for DDR violation, i.e., $\epsilon \ne 0 $ at the level of $\sim 1.5 \sigma$. Most importantly, we find a mild 2$\sigma$ discrepancy between the validity of the DDR and the latest publicly available Cepheid-calibrated SNIa constraint on $H_0$. We discuss the potential consequences of this for both the Etherington reciprocity theorem and the $H_0$ tension.


title: Sampling from Discrete Energy-Based Models with Quality/Efficiency Trade-offs

abstract: Energy-Based Models (EBMs) allow for extremely flexible specifications of probability distributions. However, they do not provide a mechanism for obtaining exact samples from these distributions. Monte Carlo techniques can aid us in obtaining samples if some proposal distribution that we can easily sample from is available. For instance, rejection sampling can provide exact samples but is often difficult or impossible to apply due to the need to find a proposal distribution that upper-bounds the target distribution everywhere. Approximate Markov chain Monte Carlo sampling techniques like Metropolis-Hastings are usually easier to design, exploiting a local proposal distribution that performs local edits on an evolving sample. However, these techniques can be inefficient due to the local nature of the proposal distribution and do not provide an estimate of the quality of their samples. In this work, we propose a new approximate sampling technique, Quasi Rejection Sampling (QRS), that allows for a trade-off between sampling efficiency and sampling quality, while providing explicit convergence bounds and diagnostics. QRS capitalizes on the availability of high-quality global proposal distributions obtained from deep learning models. We demonstrate the effectiveness of QRS sampling for discrete EBMs over text for the tasks of controlled text generation with distributional constraints and paraphrase generation. We show that we can sample from such EBMs with arbitrary precision at the cost of sampling efficiency.


title: Spin anomalous-Hall unidirectional magnetoresistance

abstract: We predict a spin anomalous-Hall unidirectional magnetoresistance (AH-UMR) in conducting bilayers composed of a ferromagnetic layer and a nonmagnetic layer, which does $\textit{not}$ rely on the spin Hall effect in the normal metal layer$-$in stark contrast to the well-studied unidirectional spin-Hall magnetoresistance$-$but, instead, arises from the spin anomalous Hall effect in the ferromagnetic layer. Physically, it is the charge-spin conversion induced by the spin anomalous Hall effect that conspires with the structural inversion asymmetry to generate a net nonequilibrium spin density in the ferromagnetic layer, which, in turn, modulates the resistance of the bilayer when the direction of the applied current or the magnetization is reversed. The dependences of the spin AH-UMR effect on materials and geometric parameters are analyzed and compared with other nonlinear magnetoresistances. In particular, we show that, in magnetic bilayers where spin anomalous Hall and spin Hall effects are comparable, the overall UMR may undergo a sign change when the thickness of either layer is varied, suggesting a scheme to quantify the spin Hall or spin anomalous Hall angle via a nonlinear transport measurement.


title: Hadronic vacuum polarization contributions to the muon $g$-2 in the space-like region

abstract: We present simple analytic expressions to compute the hadronic vacuum polarization contribution to the muon $g$-2 in the space-like region up to next-to-next-to-leading order. These results can be employed in lattice QCD calculations of this contribution as well as in space-like determinations based on scattering data, like that expected from the proposed MUonE experiment at CERN.


title: Pruning Pretrained Encoders with a Multitask Objective

abstract: The sizes of pretrained language models make them challenging and expensive to use when there are multiple desired downstream tasks. In this work, we adopt recent strategies for model pruning during finetuning to explore the question of whether it is possible to prune a single encoder so that it can be used for multiple tasks. We allocate a fixed parameter budget and compare pruning a single model with a multitask objective against the best ensemble of single-task models. We find that under two pruning strategies (element-wise and rank pruning), the approach with the multitask objective outperforms training models separately when averaged across all tasks, and it is competitive on each individual one. Additional analysis finds that using a multitask objective during pruning can also be an effective method for reducing model sizes for low-resource tasks.


title: [CII] map of the molecular ring and arms of the spiral galaxy NGC 7331

abstract: We present the [CII] 157.7 micron map of galaxy NGC 7331 obtained with FIFI-LS on SOFIA. This map extends an existent Herschel/PACS observation of the central strip of the galaxy to encompass the entire molecular ring and much of the disk, including multiple spiral arms with intense far-IR emission. We also present Herschel archival data of the [NII] 205 micron line which covers a substantial part of the [CII] SOFIA observations and allows us to estimate the neutral fraction of the [CII] emission along the ring and disk of the galaxy. We find that the neutral fraction rises with the distance from the center. In addition, by tracing the azimuthal variation of the neutral fraction, we are able to see how our observing perspective affects this measurement. The high inclination of NGC 7331 allows us to glimpse the internal walls of the molecular ring. There, young bright stars emit UV radiation causing more [CII] emission to be produced in the ionized gas. On the outer walls, opaque dust shrouds the rest of the ring, making the neutral medium the dominant source of [CII] emission. Through spatial analysis comparing the [CII] emission to tracers of gas heating, we are able to investigate how the photoelectric heating efficiency varies throughout NGC 7331 and extend global measurements of the [CII] deficit to local environments. Since the origin of [CII] emission has typically been studied in face-on galaxies, our results shed a new light on the interpretation of [CII] emission especially when studying distant galaxies with unknown inclination.


title: Synchronous Unsupervised STDP Learning with Stochastic STT-MRAM Switching

abstract: The use of analog resistance states for storing weights in neuromorphic systems is impeded by fabrication imprecision and device stochasticity that limit the precision of synapse weights. This challenge can be resolved by emulating analog behavior with the stochastic switching of the binary states of spin-transfer torque magnetoresistive random-access memory (STT-MRAM). However, previous approaches based on STT-MRAM operate in an asynchronous manner that is difficult to implement experimentally. This paper proposes a synchronous spiking neural network system with clocked circuits that perform unsupervised learning leveraging the stochastic switching of STT-MRAM. The proposed system enables a single-layer network to achieve 90% inference accuracy on the MNIST dataset.


title: Non-Majorana modes in diluted spin chains proximitized to a superconductor

abstract: Spin chains proximitized with superconducting condensates have emerged as one of the most promising platforms for the realization of Majorana modes. Here, we craft diluted spin chains atom-by-atom following seminal theoretical proposal suggesting indirect coupling mechanisms as a viable route to trigger topological superconductivity. Starting from single adatoms hosting deep Shiba states, we use the highly anisotropic Fermi surface of the substrate to create spin chains characterized by different magnetic configurations along distinct crystallographic directions. By scrutinizing a large set of parameters we reveal the ubiquitous emergence of boundary modes. Although mimicking signatures of Majorana modes, the end modes are identified as topologically trivial Shiba states. Our work demonstrates that zero-energy modes in spin chains proximitized to superconductors are not necessarily a link to Majorana modes while simultaneously identifying new experimental platforms, driving mechanisms, and test protocols for the determination of topologically non-trivial superconducting phases.


title: The $\ell^p$-Gaussian-Grothendieck problem with vector spins

abstract: We study the vector spin generalization of the $\ell^p$-Gaussian-Grothendieck problem. In other words, given integer $\kappa\geq 1$, we investigate the asymptotic behaviour of the ground state energy associated with the Sherrington-Kirkpatrick Hamiltonian indexed by vector spin configurations in the unit $\ell^p$-ball. The ranges $1\leq p\leq 2$ and $2<p<\infty$ exhibit significantly different behaviours. When $1\leq p\leq 2$, the vector spin generalization of the $\ell^p$-Gaussian-Grothendieck problem agrees with its scalar counterpart. In particular, its re-scaled limit is proportional to some norm of a standard Gaussian random variable. On the other hand, for $2<p<\infty$ the re-scaled limit of the $\ell^p$-Gaussian-Grothendieck problem with vector spins is given by a Parisi-type variational formula.


title: Inflationary flavor oscillations and the cosmic spectroscopy

abstract: Inflationary scenarios motivated by high-energy physics generically contain a plethora of degrees of freedom beyond the primordial curvature perturbation. The latter interacts in a simple way with what we name "inflationary flavor eigenstates", which differ, in general, from freely propagating "mass eigenstates". We show that the mixing between these misaligned states results in new striking behaviors in the squeezed limit of the curvature perturbation three-point function, depending not only on the mass spectrum but also on the "mixing angles" of the theory. These results bring about a new perspective on the cosmological collider program: contrary to a widespread belief, the primordial signal needs not be dominated by the lightest extra degree of freedom. Instead, we show that it may display either modulated oscillations, a broken power law, or a transition from oscillations to a power law, thus offering a detailed cosmic spectroscopy of the particle content of inflation.


title: Observing the Sun as a star: Design and early results from the NEID solar feed

abstract: Efforts with extreme-precision radial velocity (EPRV) instruments to detect small-amplitude planets are largely limited, on many timescales, by the effects of stellar variability and instrumental systematics. One avenue for investigating these effects is the use of small solar telescopes which direct disk-integrated sunlight to these EPRV instruments, observing the Sun at high cadence over months or years. We have designed and built a solar feed system to carry out "Sun-as-a-star" observations with NEID, a very high precision Doppler spectrometer recently commissioned at the WIYN 3.5m Telescope at Kitt Peak National Observatory. The NEID solar feed has been taking observations nearly every day since December 2020; data is publicly available at the NASA Exoplanet Science Institute (NExScI) NEID Solar Archive: \url{https://neid.ipac.caltech.edu/search_solar.php}. In this paper, we present the design of the NEID solar feed and explanations behind our design intent. We also present early radial velocity (RV) results which demonstrate NEID's RV stability on the Sun over 4 months of commissioning: 0.66~m/s RMS under good sky conditions and improving to 0.41~m/s RMS under best conditions.


title: Oscillatory Reconnection of a 2D X-point in a hot coronal plasma

abstract: Oscillatory reconnection (a relaxation mechanism with periodic changes in connectivity) has been proposed as a potential physical mechanism underpinning several periodic phenomena in the solar atmosphere including, but not limited to, quasi-periodic pulsations (QPPs). Despite its importance, however, the mechanism has never been studied within a hot, coronal plasma. We investigate oscillatory reconnection in a one million Kelvin plasma by solving the fully-compressive, resistive MHD equations for a 2D magnetic X-point under coronal conditions using the PLUTO code. We report on the resulting oscillatory reconnection including its periodicity and decay rate. We observe a more complicated oscillating profile for the current density compared to that found for a cold plasma, due to mode-conversion at the equipartition layer. We also consider, for the first time, the effect of adding anisotropic thermal conduction to the oscillatory reconnection mechanism, and we find this simplifies the spectrum of the oscillation profile and increases the decay rate. Crucially, the addition of thermal conduction does not prevent the oscillatory reconnection mechanism from manifesting. Finally, we reveal a relationship between the equilibrium magnetic field strength, decay rate, and period of oscillatory reconnection, which opens the tantalising possibility of utilizing oscillatory reconnection as a seismological tool.


title: On persistence of a Nicholson-type system with multiple delays and nonlinear harvesting

abstract: An N-dimensional generalization of Nicholson's equation is analyzed. We consider a model including multiple delays, nonlinear coefficients and a nonlinear harvesting term. Inspired by previous results in this subject, we obtain sufficient conditions to guarantee strong and uniform persistence. Furthermore, under extra suitable hypotheses we prove the existence of T-periodic solutions and, reversing the prior conditions in a convenient manner, we show that the zero is a global attractor.


title: Bundles over Connected Sums

abstract: A principal bundle over the connected sum of two manifolds need not be diffeomorphic or even homotopy equivalent to a non-trivial connected sum of manifolds. We show however that the homology of the total space of a bundle formed a pullback of a bundle over one of the summands is the same as if it had that bundle as a summon. An application appears in a paper by Ho, Jeffrey, Selick, Xia in the Special Issue of the Quarterly Journal of Mathematics in honour of Sir Michael Atiyah. Examples are given, including one where the total space of the pullback is not homotopy equivalent to a connected some with that as a summand and some in which it is. Finally, we describe the homology of the total space of a principal $U(1)$ bundle over a $6$-manifold of the type described in Wall's classification. It is a connected sum of an even number of copies of $S^3\times S^4$ with a $7$-manifold whose homology is $Z/k$ in degree $4$ (and $Z$ in degrees $0$ and $7$, and zero in all other degrees.


title: Formalizing Higher-Order Termination in Coq

abstract: We describe a formalization of higher-order rewriting theory and formally prove that an AFS is strongly normalizing if it can be interpreted in a well-founded domain. To do so, we use Coq, which is a proof assistant based on dependent type theory. Using this formalization, one can implement several termination techniques, like the interpretation method or dependency pairs, and prove their correctness. Those implementations can then be extracted to OCaml, which results in a verified termination checker.


title: Lecture notes on inflation and primordial black holes

abstract: These lecture notes are based on those presented at the Theoretical Aspects of Astroparticle Physics, Cosmology and Gravitation School at the Galileo Galilee Institute in Florence in 2021, https://agenda.infn.it/event/24368/. They aim to provide a pedagogical introduction and basic working knowledge of single-field inflation including the ultra-slow-roll regime, where the perturbations grow exponentially. This rapid growth is connected to the formation of primordial black holes (PBHs), a special dark matter candidate and probe of the initial conditions of the early universe. Although there are many textbooks and introductory texts about inflation, to the best of our knowledge there is no comparable introduction to ultra-slow-roll inflation. Furthermore, given their recent surge in popularity, there are numerous research articles and reviews on primordial black holes, however these notes aim to be more accessible for graduate students and those brand new to the topic. Some problems and solutions to primordial black hole-related calculations are also included. The reader of these lecture notes should come away being able to calculate the present-day abundance of primordial black holes produced from the density fluctuations left over at the end of single-field inflation with an ultra-slow-roll phase, and understand how this abundance compares with current observational constraints.


title: Discourse-Aware Soft Prompting for Text Generation

abstract: Current efficient fine-tuning methods (e.g., adapters, prefix-tuning, etc.) have optimized conditional text generation via training a small set of extra parameters of the neural language model, while freezing the rest for efficiency. While showing strong performance on some generation tasks, they don't generalize across all generation tasks. We show that soft-prompt based conditional text generation can be improved with simple and efficient methods that simulate modeling the discourse structure of human written text. We investigate two design choices: First, we apply \textit{hierarchical blocking} on the prefix parameters to simulate a higher-level discourse structure of human written text. Second, we apply \textit{attention sparsity} on the prefix parameters at different layers of the network and learn sparse transformations on the softmax-function. We show that structured design of prefix parameters yields more coherent, faithful and relevant generations than the baseline prefix-tuning on all generation tasks.


title: Gravitational Focusing of Wave Dark Matter

abstract: A massive astrophysical object deforms a local distribution of dark matter, resulting in a local overdensity of dark matter. This phenomenon is often referred to as gravitational focusing. In the solar system, the gravitational focusing due to the Sun induces modulations of dark matter signals on terrestrial experiments. We consider the gravitational focusing of a light bosonic dark matter with a mass of less than about 10 eV. The wave nature of such dark matter candidates leads to unique signatures both in the local overdensity and in the spectrum, both of which can be experimentally relevant. We provide a formalism that captures both the gravitational focusing and the stochasticity of wave dark matter, paying particular attention to the similarity and difference to particle dark matter. Distinctive patterns in the density contrast and spectrum are observed when the de Broglie wavelength of dark matter becomes comparable or less than the size of the system and/or when the velocity dispersion of dark matter is sufficiently small. While gravitational focusing effects generally remain at a few percent level for a relaxed halo dark matter component, they could be much larger for dark matter substructures. With a few well-motivated dark matter substructures, we investigate how each substructure responds to the gravitational potential of the Sun. The limit at which wave dark matter behaves similar to particle dark matter is also discussed.


title: Attacks on Wireless Coexistence: Exploiting Cross-Technology Performance Features for Inter-Chip Privilege Escalation

abstract: Modern mobile devices feature multiple wireless technologies, such as Bluetooth, Wi-Fi, and LTE. Each of them is implemented within a separate wireless chip, sometimes packaged as combo chips. However, these chips share components and resources, such as the same antenna or wireless spectrum. Wireless coexistence interfaces enable them to schedule packets without collisions despite shared resources, essential to maximizing networking performance. Today's hardwired coexistence interfaces hinder clear security boundaries and separation between chips and chip components. This paper shows practical coexistence attacks on Broadcom, Cypress, and Silicon Labs chips deployed in billions of devices. For example, we demonstrate that a Bluetooth chip can directly extract network passwords and manipulate traffic on a Wi-Fi chip. Coexistence attacks enable a novel type of lateral privilege escalation across chip boundaries. We responsibly disclosed the vulnerabilities to the vendors. Yet, only partial fixes were released for existing hardware since wireless chips would need to be redesigned from the ground up to prevent the presented attacks on coexistence.


title: Measurement of Single Event Effect cross section induced by monoenergetic protons on a 130 nm ASIC

abstract: Designing integrated circuits in radiation environments such as the High Luminosity LHC (HL-LHC) is challenging. Integrated circuits will be exposed to radiation-induced Single Event Effects (SEE). In deep sub-micron technology devices, the impact of SEEs can be mitigated by triple modular redundancy. The triplication of the most sensitive data is used to recover most of the data corruption induced by interacting particles. One type of SEE, called single event upset (SEU), is studied in this paper. The SEU cross-section and the performance of the triplication are estimated using an ASIC prototype exposed to a beam of protons. The SEU cross-section is measured, and a systematic difference between $1\rightarrow{0}$ and $0\rightarrow{1}$ bit flip rates is observed. The efficiency of the mitigation method is investigated.


title: Deep Forest: Neural Network reconstruction of intergalactic medium temperature

abstract: We explore the use of Deep Learning to infer the temperature of the intergalactic medium from the transmitted flux in the high redshift Lyman-alpha forest. We train Neural Networks on sets of simulated spectra from redshift z=2-3 outputs of cosmological hydrodynamic simulations, including high temperature regions added in post-processing to approximate bubbles heated by Helium-II reionization. We evaluate how well the trained networks are able to reconstruct the temperature from the effect of Doppler broadening in the simulated input Lyman-alpha forest absorption spectra. We find that for spectra with high resolution (10 km/s pixel) and moderate signal to noise (20-50), the neural network is able to reconstruct the IGM temperature smoothed on scales of 6 Mpc/h quite well. Concentrating on discontinuities we find that high temperature regions of width 25 Mpc/h and temperature 20,000 K can be fairly easily detected and characterized. We show an example where multiple sightlines are combined to yield tomographic images of hot bubbles. Deep Learning techniques may be useful in this way to help us understand the complex temperature structure of the intergalactic medium around the time of Helium reionization.


title: SymmetryGAN: Symmetry Discovery with Deep Learning

abstract: What are the symmetries of a dataset? Whereas the symmetries of an individual data element can be characterized by its invariance under various transformations, the symmetries of an ensemble of data elements are ambiguous due to Jacobian factors introduced while changing coordinates. In this paper, we provide a rigorous statistical definition of the symmetries of a dataset, which involves inertial reference densities, in analogy to inertial frames in classical mechanics. We then propose SymmetryGAN as a novel and powerful approach to automatically discover symmetries using a deep learning method based on generative adversarial networks (GANs). When applied to Gaussian examples, SymmetryGAN shows excellent empirical performance, in agreement with expectations from the analytic loss landscape. SymmetryGAN is then applied to simulated dijet events from the Large Hadron Collider (LHC) to demonstrate the potential utility of this method in high energy collider physics applications. Going beyond symmetry discovery, we consider procedures to infer the underlying symmetry group from empirical data.


title: Extraordinary strain hardening from dislocation loops in defect-free Al nanocubes

abstract: The interaction of crystalline defects leads to strain hardening in bulk metals. Metals with high stacking fault energy (SFE), such as aluminum, tend to have low strain hardening rates due to an inability to form stacking faults and deformation twins. Here, we use in situ SEM mechanical compressions to find that colloidally synthesized defect-free 114 nm Al nanocubes combine a high linear strain hardening rate of 4.1 GPa with a high strength of 1.1 GPa. These nanocubes have a 3 nm self-passivating oxide layer that has a large influence on mechanical behavior and the accumulation of dislocation structures. Post-compression TEM imaging reveals stable prismatic dislocation loops and the absence of stacking faults. MD simulations relate the formation of dislocation loops and strain hardening to the surface oxide. These results indicate that slight modifications to surface and interfacial properties can induce enormous changes to mechanical properties in high SFE metals.


title: A Quantum Complexity Lowerbound from Differential Geometry

abstract: The Bishop-Gromov bound -- a cousin of the focusing lemmas that Hawking and Penrose used to prove their black hole singularity theorems -- is a differential geometry result that upperbounds the rate of growth of volume of geodesic balls in terms of the Ricci curvature. In this paper, I apply the Bishop-Gromov bound to Nielsen's complexity geometry to prove lowerbounds on the quantum complexity of a typical unitary. For a broad class of penalty schedules, the typical complexity is shown to be exponentially large in the number of qubits. This technique gives results that are tighter than all known lowerbounds in the literature, as well as establishing lowerbounds for a much broader class of complexity geometry metrics than has hitherto been bounded. For some metrics, I prove these lowerbounds are tight. This method realizes the original vision of Nielsen, which was to apply the tools of differential geometry to study quantum complexity.


title: Beyond the Longest Letter-duplicated Subsequence Problem

abstract: Given a sequence $S$ of length $n$, a letter-duplicated subsequence is a subsequence of $S$ in the form of $x_1^{d_1}x_2^{d_2}\cdots x_k^{d_k}$ with $x_i\in\Sigma$, $x_j\neq x_{j+1}$ and $d_i\geq 2$ for all $i$ in $[k]$ and $j$ in $[k-1]$. A linear time algorithm for computing the longest letter-duplicated subsequence (LLDS) of $S$ can be easily obtained. In this paper, we focus on two variants of this problem. We first consider the constrained version when $\Sigma$ is unbounded, each letter appears in $S$ at least 6 times and all the letters in $\Sigma$ must appear in the solution. We show that the problem is NP-hard (a further twist indicates that the problem does not admit any polynomial time approximation). The reduction is from possibly the simplest version of SAT that is NP-complete, $(\leq 2,1,\leq 3)$-SAT, where each variable appears at most twice positively and exact once negatively, and each clause contains at most three literals and some clauses must contain exactly two literals. (We hope that this technique will serve as a general tool to help us proving the NP-hardness for some more tricky sequence problems involving only one sequence -- much harder than with at least two input sequences, which we apply successfully at the end of the paper on some extra variations of the LLDS problem.) We then show that when each letter appears in $S$ at most 3 times, then the problem admits a factor $1.5-O(\frac{1}{n})$ approximation. Finally, we consider the weighted version, where the weight of a block $x_i^{d_i} (d_i\geq 2)$ could be any positive function which might not grow with $d_i$. We give a non-trivial $O(n^2)$ time dynamic programming algorithm for this version, i.e., computing an LD-subsequence of $S$ whose weight is maximized.


title: Interacting Fractons in 2+1-Dimensional Quantum Field Theory

abstract: We analyze, in perturbation theory, a theory of weakly interacting fractons and non-relativistic fermions in a 2+1 dimensional Quantum Field Theory. In particular we compute the 1-loop corrections to the self energies and interaction vertex, and calculate the associated 1-loop Renormalization Group flows of the coupling constants. Surprisingly, we find that the fracton-fermion coupling does not flow due to an emergent coordinate-dependent symmetry of the effective Lagrangian, making this model a well-defined quantum field theory. We provide additional discussions on the regularization and renormalization of interacting fractonic theories, as well as both qualitative and quantitative remarks regarding the theory at finite temperature and finite chemical potential.


title: Neural Belief Propagation for Scene Graph Generation

abstract: Scene graph generation aims to interpret an input image by explicitly modelling the potential objects and their relationships, which is predominantly solved by the message passing neural network models in previous methods. Currently, such approximation models generally assume the output variables are totally independent and thus ignore the informative structural higher-order interactions. This could lead to the inconsistent interpretations for an input image. In this paper, we propose a novel neural belief propagation method to generate the resulting scene graph. It employs a structural Bethe approximation rather than the mean field approximation to infer the associated marginals. To find a better bias-variance trade-off, the proposed model not only incorporates pairwise interactions but also higher order interactions into the associated scoring function. It achieves the state-of-the-art performance on various popular scene graph generation benchmarks.


title: Cosmology and modified gravitational wave propagation from binary black hole population models

abstract: A joint hierarchical Bayesian analysis of the binary black hole (BBH) mass function, merger rate evolution and cosmological parameters can be used to extract information on both the cosmological and population parameters. We extend this technique to include the effect of modified gravitational wave (GW) propagation. We discuss the constraints on the parameter $\Xi_0$ that describes this phenomenon (with $\Xi_0=1$ in General Relativity, GR) using the data from the GWTC-3 catalog. We find the constraints $\Xi_0 = 1.2^{+0.7}_{-0.7}$ with a flat prior on $\Xi_0$, and $\Xi_0 = 1.0^{+0.4}_{-0.8}$ with a prior uniform in $\log\Xi_0$ ($68\%$ C.L., maximum posterior and HDI), which only rely on the presence of a feature in the BBH mass distribution around $\sim 30-45 M_{\odot}$, and are robust to whether or not the event GW190521 is considered an outlier of the population. We then study in more detail the effects of modified GW propagation on population and cosmological analyses for LIGO/Virgo at design sensitivity. For a given data-taking period, the relative error $\Delta\Xi_0/\Xi_0$ has a significant dependence on the fiducial value of $\Xi_0$, since the latter has a strong influence on the detection rate. For five years of data, the accuracy ranges from $\sim 10\%$ on $\Xi_0$ when $\Xi_0=1$ to $\Delta\Xi_0/\Xi_0\sim 20\%$ for $\Xi_0=1.8$ - a large deviation from GR, still consistent with current limits and predicted by viable cosmological models. For the Hubble parameter, we forecast an accuracy of $\Delta H_0/H_0 \sim 20\%$, and an accuracy on $H(z)$ of $\sim7\%$ at a pivot redshift $z_*\sim 0.8$. We finally show that, if Nature is described by a modified gravity theory with a large deviation from the GR value $\Xi_0=1$, such as $\Xi_0=1.8$, analysing the data assuming GR produces a significant bias in the inferred values of the mass scales, Hubble constant, and BBH merger rate.


title: Learning soft interventions in complex equilibrium systems

abstract: Complex systems often contain feedback loops that can be described as cyclic causal models. Intervening in such systems may lead to counterintuitive effects, which cannot be inferred directly from the graph structure. After establishing a framework for differentiable soft interventions based on Lie groups, we take advantage of modern automatic differentiation techniques and their application to implicit functions in order to optimize interventions in cyclic causal models. We illustrate the use of this framework by investigating scenarios of transition to sustainable economies.


title: Unifying baryogenesis with dark matter production

abstract: We here propose a mechanism that predicts, at early times, both baryon asymmetry and dark matter origin and that recovers the spontaneous baryogenesis during the reheating. Working with $U(1)$-invariant quark $Q$ and lepton $L$ effective fields, with an interacting term that couples the evolution of Universe's environment field $\psi$, we require a spontaneous symmetry breaking and get a pseudo Nambu-Goldstone boson $\theta$. The pseudo Nambu-Goldstone boson speeds the Universe up during inflation, playing the role of inflaton, enabling baryogenesis to occur. Thus, in a quasi-static approximation over $\psi$, we impressively find both baryon and dark matter quasi-particle production rates, unifying \emph{de facto} the two scenarios. Moreover, we outline particle mixing and demonstrate dark matter takes over baryons. Presupposing that $\theta$ field energy density dominates as baryogenesis stops and employing recent limits on reheating temperature, we get numerical bounds over dark matter constituent, showing that the most likely dark matter boson would be consistent with MeV-scale mass candidates. Finally, we briefly underline our predictions are suitable to explain the the low-energy electron recoil event excess between $1$ and $7$~keV found by the \texttt{XENON1T} collaboration.


title: Quantum Algorithms for Ground-State Preparation and Green's Function Calculation

abstract: We propose quantum algorithms for projective ground-state preparation and calculations of the many-body Green's functions directly in frequency domain. The algorithms are based on the linear combination of unitary (LCU) operations and essentially only use quantum resources. To prepare the ground state, we construct the operator ${\exp}(-\tau \hat{H}^2)$ using Hubbard-Stratonovich transformation by LCU and apply it on an easy-to-prepare initial state. Our projective state preparation procedure saturates the near-optimal scaling, $\mathcal{O}(\frac{1}{\gamma\Delta} \log \frac{1}{\gamma\eta})$, of other currently known algorithms, in terms of the spectral-gap lower bound $\Delta$, the additive error $\eta$ in the state vector, and the overlap lower bound $\gamma$ between the initial state and the exact ground state. It is straightforward to combine our algorithm with spectral-gap amplification technique to achieve quadratically improved scaling $\mathcal{O}(1/\sqrt{\Delta})$ for ground-state preparation of frustration-free Hamiltonians, which we demonstrate with numerical results of the $q$-deformed XXZ chain. To compute the Green's functions, including the single-particle and other response functions, we act on the prepared ground state with the retarded resolvent operator $R(\omega + i\Gamma; \hat{H})$ in the LCU form derived from the Fourier-Laplace integral transform (FIT). Our resolvent algorithm has $\mathcal{O}(\frac{1}{\Gamma^2} \log\frac{1}{\Gamma\epsilon})$ complexity scaling for the frequency resolution $\Gamma$ of the response functions and the targeted error $\epsilon$, while classical algorithms for FIT usually have polynomial scaling over the error $\epsilon$. To illustrate the complexity scaling of our algorithms, we provide numerical results for their application to the paradigmatic Fermi-Hubbard model on a one-dimensional lattice with different numbers of sites.


title: The height of record-biased trees

abstract: Given a permutation $\sigma$, its corresponding binary search tree is obtained by recursively inserting the values $\sigma(1),\ldots,\sigma(n)$ into a binary tree so that the label of each node is larger than the labels of its left subtree and smaller than the labels of its right subtree. In 1986, Devroye proved that the height of such trees when $\sigma$ is a random uniform permutation is of order $(c^*+o_\mathbb{P}(1))\log n$ as $n$ tends to infinity, where $c^*$ is the only solution to $c\log(2e/c)=1$ with $c\geq2$. In this paper, we study the height of binary search trees drawn from the record-biased model of permutations, introduced by Auger, Bouvel, Nicaud, and Pivoteau in 2016. The record-biased distribution is the probability measure on the set of permutations whose weight is proportional to $\theta^{\mathrm{record}(\sigma)}$, where $\mathrm{record}(\sigma)=|\{i\in[n]:\forall j<i,\sigma(i)>\sigma(j)\}|$. We show that the height of a binary search tree built from a record-biased permutation of size $n$ with parameter $\theta$ is of order $(1+o_\mathbb{P}(1))\max\{c^*\log n,\,\theta\log(1+n/\theta)\}$, hence giving a full characterization of the first order asymptotic behaviour of the height of such trees.


title: Discrete spectrum of zero order pseudodifferential operators

abstract: For a class of zero order pseudodifferential operators we find the asymptotics of eigenvalues converging to a non-isolated tip of the essential spectrum.


title: MTV: Visual Analytics for Detecting, Investigating, and Annotating Anomalies in Multivariate Time Series

abstract: Detecting anomalies in time-varying multivariate data is crucial in various industries for the predictive maintenance of equipment. Numerous machine learning (ML) algorithms have been proposed to support automated anomaly identification. However, a significant amount of human knowledge is still required to interpret, analyze, and calibrate the results of automated analysis. This paper investigates current practices used to detect and investigate anomalies in time series data in industrial contexts and identifies corresponding needs. Through iterative design and working with nine experts from two industry domains (aerospace and energy), we characterize six design elements required for a successful visualization system that supports effective detection, investigation, and annotation of time series anomalies. We summarize an ideal human-AI collaboration workflow that streamlines the process and supports efficient and collaborative analysis. We introduce MTV (Multivariate Time Series Visualization), a visual analytics system to support such workflow. The system incorporates a set of novel visualization and interaction designs to support multi-faceted time series exploration, efficient in-situ anomaly annotation, and insight communication. Two user studies, one with 6 spacecraft experts (with routine anomaly analysis tasks) and one with 25 general end-users (without such tasks), are conducted to demonstrate the effectiveness and usefulness of MTV.


title: Deterministic particle flows for constraining stochastic nonlinear systems

abstract: Devising optimal interventions for constraining stochastic systems is a challenging endeavour that has to confront the interplay between randomness and nonlinearity. Existing methods for identifying the necessary dynamical adjustments resort either to space discretising solutions of ensuing partial differential equations, or to iterative stochastic path sampling schemes. Yet, both approaches become computationally demanding for increasing system dimension. Here, we propose a generally applicable and practically feasible non-iterative methodology for obtaining optimal dynamical interventions for diffusive nonlinear systems. We estimate the necessary controls from an interacting particle approximation to the logarithmic gradient of two forward probability flows evolved following deterministic particle dynamics. Applied to several biologically inspired models, we show that our method provides the necessary optimal controls in settings with terminal-, transient-, or generalised collective-state constraints and arbitrary system dynamics.

categories: cond-mat.stat-mech math.OC physics.data-an stat.ME


title: Magnetic energy spectrum produced by turbulent dynamo: effect of time irreversibility

abstract: We consider the kinematic stage of evolution of magnetic field advected by turbulent hydrodynamic flow. We use a generalization of the Kazantsev-Kraichnan model to investigate time irreversible flows. In the viscous range of scales, the infinite-time limit of the spectrum is a power law but its slope is more flat than that predicted by Kazantsev model. This result agrees with numerical simulations. The rate of magnetic energy growth is slower than that in the time-symmetric case. We show that for high magnetic Prandtl turbulent plasma, the formation of the power-law spectrum shape takes very long time and may never happen because of the nonlinearity. We propose another ansatz to describe the spectrum shape at finite time.


title: What does a cosmological experiment really measure? Covariant posterior decomposition with normalizing flows

abstract: We present methods to rigorously extract parameter combinations that are constrained by data from posterior distributions. The standard approach uses linear methods that apply to Gaussian distributions. We show the limitations of the linear methods for current surveys, and develop non-linear methods that can be used with non-Gaussian distributions, and are independent of the parameter basis. These are made possible by the use of machine-learning models, normalizing flows, to learn posterior distributions from their samples. These models allow us to obtain the local covariance of the posterior at all positions in parameter space and use its inverse, the Fisher matrix, as a local metric over parameter space. The posterior distribution can then be non-linearly decomposed into the leading constrained parameter combinations via parallel transport in the metric space. We test our methods on two non-Gaussian, benchmark examples, and then apply them to the parameter posteriors of the Dark Energy Survey and Planck CMB lensing. We illustrate how our method automatically learns the survey-specific, best constrained effective amplitude parameter $S_8$ for cosmic shear alone, cosmic shear and galaxy clustering, and CMB lensing. We also identify constrained parameter combinations in the full parameter space, and as an application we estimate the Hubble constant, $H_0$, from large-structure data alone.


title: Non-Gaussian generalization of the Kazantsev-Kraichnan model

abstract: We consider a natural generalization of the Kazantsev-Kraichnan model for small-scale turbulent dynamo. This generalization takes account of statistical time asymmetry of a turbulent flow, and, thus, allows to describe velocity fields with energy cascade. For three-dimensional velocity field, generalized Kazantsev equation is derived, and evolution of the second order magnetic field correlator is investigated for large but finite magnetic Prandtl numbers. It is shown that as $Pr_m \to \infty$, the growth increment tends to the limit known from the T-exponential (Lagrangian deformation) method. Magnetic field generation is shown to be weaker than that in the Gaussian velocity field for any direction of the energy cascade, and depends essentially on the Prandtl number.


title: Heat equations and wavelets on Mumford curves

abstract: A general class of heat operators over non-archimedean local fields acting on $L_2$-function spaces on affinoid domains in the local field are developed. $L_2$-spaces and integral operators invariant under the action of a non-archimedean Schottky group are constructed in order to have nice function spaces and operators on Mumford curves. General wavelets are constructed which, together with functions coming from certain graph Laplacian eigenvectors, diagonalise these operators. The corresponding Cauchy problems for the heat equations with these operators are solved in the affirmative, and properties of wavelet eigenvalues and the spectral gaps of the operators on Mumford curves are studied.


title: Effect of Emitters on Quantum State Transfer in Coupled Cavity Arrays

abstract: Over the last decade, conditions for perfect state transfer in quantum spin chains have been discovered, and their experimental realizations addressed. In this paper, we consider an extension of such studies to quantum state transfer in a coupled cavity array including the effects of atoms in the cavities which can absorb and emit photons as they propagate down the array. Our model is equivalent to previously examined spin chains in the one-excitation sector and in the absence of emitters. We introduce a Monte Carlo approach to the inverse eigenvalue problem which allows the determination of the inter-cavity and cavity-emitter couplings resulting in near-perfect quantum state transfer fidelity, and examine the time dependent polariton wave function through exact diagonalization of the resulting Tavis-Cummings-Hubbard Hamiltonian. The effect of inhomogeneous emitter locations is also evaluated.


title: Delocalization of interacting directed polymers on a periodic substrate: Localization length and critical exponents from non-Hermitian spectra

abstract: We study a classical model of thermally fluctuating polymers confined to two dimensions, experiencing a grooved periodic potential, and subject to pulling forces both along and transverse to the grooves. The equilibrium polymer conformations are described by a mapping to a quantum system with a non-Hermitian Hamiltonian and with fermionic statistics generated by noncrossing interactions among polymers. Using molecular dynamics simulations and analytical calculations, we identify a localized and a delocalized phase of the polymer conformations, separated by a delocalization transition which corresponds (in the quantum description) to the breakdown of a band insulator when driven by an imaginary vector potential. We calculate the average tilt of the many-body system, at arbitrary shear values and filling density of polymer chains, in terms of the complex-valued non-Hermitian band structure. We find the critical shear value, the localization length, and the critical exponent by which the shear modulus diverges in terms of the branch points (exceptional points) in the band structure at which the bandgap closes. We also investigate the combined effects of non-Hermitian delocalization and localization due to both periodicity and disorder, uncovering preliminary evidence that while disorder favours localization at high values, it encourages delocalization at lower values.


title: A Puzzle-Based Dataset for Natural Language Inference

abstract: We provide here a dataset for tasks related to natural language understanding and natural language inference. The dataset contains logical puzzles in natural language from three domains: comparing puzzles, knighs and knaves, and zebra puzzles. Each puzzle is associated with the entire set of atomic questions that can be generated based on the relations and individuals occurring in the text. For each question we provide the correct answer: entailment, contradiction or ambiguity. The answer's correctness is verified against theorem provers. Good puzzles have two properties: (i) each piece of information is necessary and (ii) no unnecessary information is provided. These properties make puzzles interesting candidates for machine comprehension tasks.


title: Compressible Navier--Stokes system with transport noise

abstract: We consider the barotropic Navier--Stokes system driven by a physically well-motivated transport noise in both continuity as well as momentum equation. We focus on three different situations: (i) the noise is smooth in time and the equations are understood as in the sense of the classical weak deterministic theory, (ii) the noise is rough in time and we interpret the equations in the framework of rough paths with unbounded rough drivers and (iii) we have a Brownian noise of Stratonovich type and study the existence of martingale solutions. The first situation serves as an approximation for (ii) and (iii), while (ii) and (iii) are motivated by recent results on the incompressible Navier--Stokes system concerning the physical modeling as well as regularization by noise.


title: More Control for Free! Image Synthesis with Semantic Diffusion Guidance

abstract: Controllable image synthesis models allow creation of diverse images based on text instructions or guidance from a reference image. Recently, denoising diffusion probabilistic models have been shown to generate more realistic imagery than prior methods, and have been successfully demonstrated in unconditional and class-conditional settings. We investigate fine-grained, continuous control of this model class, and introduce a novel unified framework for semantic diffusion guidance, which allows either language or image guidance, or both. Guidance is injected into a pretrained unconditional diffusion model using the gradient of image-text or image matching scores, without re-training the diffusion model. We explore CLIP-based language guidance as well as both content and style-based image guidance in a unified framework. Our text-guided synthesis approach can be applied to datasets without associated text annotations. We conduct experiments on FFHQ and LSUN datasets, and show results on fine-grained text-guided image synthesis, synthesis of images related to a style or content reference image, and examples with both textual and image guidance.


title: A Simple and Efficient Sampling-based Algorithm for General Reachability Analysis

abstract: In this work, we analyze an efficient sampling-based algorithm for general-purpose reachability analysis, which remains a notoriously challenging problem with applications ranging from neural network verification to safety analysis of dynamical systems. By sampling inputs, evaluating their images in the true reachable set, and taking their $\epsilon$-padded convex hull as a set estimator, this algorithm applies to general problem settings and is simple to implement. Our main contribution is the derivation of asymptotic and finite-sample accuracy guarantees using random set theory. This analysis informs algorithmic design to obtain an $\epsilon$-close reachable set approximation with high probability, provides insights into which reachability problems are most challenging, and motivates safety-critical applications of the technique. On a neural network verification task, we show that this approach is more accurate and significantly faster than prior work. Informed by our analysis, we also design a robust model predictive controller that we demonstrate in hardware experiments.


title: On Causally Disentangled Representations

abstract: Representation learners that disentangle factors of variation have already proven to be important in addressing various real world concerns such as fairness and interpretability. Initially consisting of unsupervised models with independence assumptions, more recently, weak supervision and correlated features have been explored, but without a causal view of the generative process. In contrast, we work under the regime of a causal generative process where generative factors are either independent or can be potentially confounded by a set of observed or unobserved confounders. We present an analysis of disentangled representations through the notion of disentangled causal process. We motivate the need for new metrics and datasets to study causal disentanglement and propose two evaluation metrics and a dataset. We show that our metrics capture the desiderata of disentangled causal process. Finally, we perform an empirical study on state of the art disentangled representation learners using our metrics and dataset to evaluate them from causal perspective.


title: Transport in the emergent Bose liquid: Bad metal, strange metal, and weak insulator, all in one system

abstract: Non-saturating high-temperature resistivity ("bad metal"), T-linear low-temperature resistivity ("strange metal"), and a crossover to activation-free growth of the resistivity in the low-temperature limit ("weak insulator") are among the most exotic behaviors widely observed in many strongly correlated materials for decades that defy the standard Fermi liquid description of solids. Here we investigate these puzzling behaviors by computing temperature-dependent optical conductivity of an emergent Bose liquid and find that it reproduces all the unexplained features of the experiments, including a featureless continuum and a well-known mid-infrared peak. Amazingly and with physically intuitive mechanisms, the corresponding doping- and temperature-dependent resistivity displays the bad metal and strange metal simultaneously and sometimes weak insulating behaviors as well. The unification of all these non-Fermi liquid behaviors in a single model suggests that a new quantum state of matter, namely the emergent Bose liquid, will guide the development of the next generation of solid state physics.


title: Deep Learning based Framework for Automatic Diagnosis of Glaucoma based on analysis of Focal Notching in the Optic Nerve Head

abstract: Automatic evaluation of the retinal fundus image is emerging as one of the most important tools for early detection and treatment of progressive eye diseases like Glaucoma. Glaucoma results to a progressive degeneration of vision and is characterized by the deformation of the shape of optic cup and the degeneration of the blood vessels resulting in the formation of a notch along the neuroretinal rim. In this paper, we propose a deep learning-based pipeline for automatic segmentation of optic disc (OD) and optic cup (OC) regions from Digital Fundus Images (DFIs), thereby extracting distinct features necessary for prediction of Glaucoma. This methodology has utilized focal notch analysis of neuroretinal rim along with cup-to-disc ratio values as classifying parameters to enhance the accuracy of Computer-aided design (CAD) systems in analyzing glaucoma. Support Vector-based Machine Learning algorithm is used for classification, which classifies DFIs as Glaucomatous or Normal based on the extracted features. The proposed pipeline was evaluated on the freely available DRISHTI-GS dataset with a resultant accuracy of 93.33% for detecting Glaucoma from DFIs.


title: Label, Verify, Correct: A Simple Few Shot Object Detection Method

abstract: The objective of this paper is few-shot object detection (FSOD) -- the task of expanding an object detector for a new category given only a few instances for training. We introduce a simple pseudo-labelling method to source high-quality pseudo-annotations from the training set, for each new category, vastly increasing the number of training instances and reducing class imbalance; our method finds previously unlabelled instances. Na\"ively training with model predictions yields sub-optimal performance; we present two novel methods to improve the precision of the pseudo-labelling process: first, we introduce a verification technique to remove candidate detections with incorrect class labels; second, we train a specialised model to correct poor quality bounding boxes. After these two novel steps, we obtain a large set of high-quality pseudo-annotations that allow our final detector to be trained end-to-end. Additionally, we demonstrate our method maintains base class performance, and the utility of simple augmentations in FSOD. While benchmarking on PASCAL VOC and MS-COCO, our method achieves state-of-the-art or second-best performance compared to existing approaches across all number of shots.


title: ECO-spotting: looking for extremely compact objects with bosonic fields

abstract: Black holes are thought to describe the geometry of massive, dark compact objects in the universe. To further support and quantify this long-held belief requires knowledge of possible, if exotic alternatives. Here, we wish to understand how compact can self-gravitating solutions be. We discuss theories with a well-posed initial value problem, consisting in either a single self-interacting scalar, vector or both. We focus on spherically symmetric solutions, investigating the influence of self-interacting potentials into the compactness of the solutions, in particular those that allow for flat-spacetime solutions. We are able to connect such stars to hairy black hole solutions, which emerge as a zero-mass black hole. We show that such stars can have light rings, but their compactness is never parametrically close to that of black holes. The challenge of finding black hole mimickers to investigate full numerical-relativity binary setups remains open.


title: The Co-Designed Post-Pandemic University: A Participatory and Continual Learning Approach for the Future of Work

abstract: The pandemic has shattered the traditional enclosures of learning. The post-pandemic university (PPU) will no longer be contained within the 4 walls of a lecture theatre, and finish once students have left the premises. The use of online services has now blended home and university life, and the PPU needs to reflect this. Our proposal of a continuous learning model will take advantage of the newfound omnipresence of learning, while being dynamic enough to continually adapt to the ever-evolving virus situation. Universities restricting themselves to fixed subject themes that are then forgotten once completed, will miss out on the "fresh start" presented by the virus.


title: Specificity-Preserving Federated Learning for MR Image Reconstruction

abstract: Federated learning (FL) can be used to improve data privacy and efficiency in magnetic resonance (MR) image reconstruction by enabling multiple institutions to collaborate without needing to aggregate local data. However, the domain shift caused by different MR imaging protocols can substantially degrade the performance of FL models. Recent FL techniques tend to solve this by enhancing the generalization of the global model, but they ignore the domain-specific features, which may contain important information about the device properties and be useful for local reconstruction. In this paper, we propose a specificity-preserving FL algorithm for MR image reconstruction (FedMRI). The core idea is to divide the MR reconstruction model into two parts: a globally shared encoder to obtain a generalized representation at the global level, and a client-specific decoder to preserve the domain-specific properties of each client, which is important for collaborative reconstruction when the clients have unique distribution. Such scheme is then executed in the frequency space and the image space respectively, allowing exploration of generalized representation and client-specific properties simultaneously in different spaces. Moreover, to further boost the convergence of the globally shared encoder when a domain shift is present, a weighted contrastive regularization is introduced to directly correct any deviation between the client and server during optimization. Extensive experiments demonstrate that our FedMRI's reconstructed results are the closest to the ground-truth for multi-institutional data, and that it outperforms state-of-the-art FL methods.


title: Using Machine Learning to Predict Air Quality Index in New Delhi

abstract: Air quality has a significant impact on human health. Degradation in air quality leads to a wide range of health issues, especially in children. The ability to predict air quality enables the government and other concerned organizations to take necessary steps to shield the most vulnerable, from being exposed to the air with hazardous quality. Traditional approaches to this task have very limited success because of a lack of access of such methods to sufficient longitudinal data. In this paper, we use a Support Vector Regression (SVR) model to forecast the levels of various pollutants and the air quality index, using archive pollution data made publicly available by Central Pollution Control Board and the US Embassy in New Delhi. Among the tested methods, a Radial Basis Function (RBF) kernel produced the best results with SVR. According to our experiments, using the whole range of available variables produced better results than using features selected by principal component analysis. The model predicts levels of various pollutants, like, sulfur dioxide, carbon monoxide, nitrogen dioxide, particulate matter 2.5, and ground-level ozone, as well as the Air Quality Index (AQI), at an accuracy of 93.4 percent.


title: PyTorch Connectomics: A Scalable and Flexible Segmentation Framework for EM Connectomics

abstract: We present PyTorch Connectomics (PyTC), an open-source deep-learning framework for the semantic and instance segmentation of volumetric microscopy images, built upon PyTorch. We demonstrate the effectiveness of PyTC in the field of connectomics, which aims to segment and reconstruct neurons, synapses, and other organelles like mitochondria at nanometer resolution for understanding neuronal communication, metabolism, and development in animal brains. PyTC is a scalable and flexible toolbox that tackles datasets at different scales and supports multi-task and semi-supervised learning to better exploit expensive expert annotations and the vast amount of unlabeled data during training. Those functionalities can be easily realized in PyTC by changing the configuration options without coding and adapted to other 2D and 3D segmentation tasks for different tissues and imaging modalities. Quantitatively, our framework achieves the best performance in the CREMI challenge for synaptic cleft segmentation (outperforms existing best result by relatively 6.1$\%$) and competitive performance on mitochondria and neuronal nuclei segmentation. Code and tutorials are publicly available at https://connectomics.readthedocs.io.


title: Information Prebuilt Recurrent Reconstruction Network for Video Super-Resolution

abstract: The video super-resolution (VSR) method based on the recurrent convolutional network has strong temporal modeling capability for video sequences. However, the temporal receptive field of different recurrent units in the unidirectional recurrent network is unbalanced. Earlier reconstruction frames receive less spatio-temporal information, resulting in fuzziness or artifacts. Although the bidirectional recurrent network can alleviate this problem, it requires more memory space and fails to perform many tasks with low latency requirements. To solve the above problems, we propose an end-to-end information prebuilt recurrent reconstruction network (IPRRN), consisting of an information prebuilt network (IPNet) and a recurrent reconstruction network (RRNet). By integrating sufficient information from the front of the video to build the hidden state needed for the initially recurrent unit to help restore the earlier frames, the information prebuilt network balances the input information difference at different time steps. In addition, we demonstrate an efficient recurrent reconstruction network, which outperforms the existing unidirectional recurrent schemes in all aspects. Many experiments have verified the effectiveness of the network we propose, which can effectively achieve better quantitative and qualitative evaluation performance compared to the existing state-of-the-art methods.


title: Enhancing Multi-Scale Implicit Learning in Image Super-Resolution with Integrated Positional Encoding

abstract: Is the center position fully capable of representing a pixel? There is nothing wrong to represent pixels with their centers in a discrete image representation, but it makes more sense to consider each pixel as the aggregation of signals from a local area in an image super-resolution (SR) context. Despite the great capability of coordinate-based implicit representation in the field of arbitrary-scale image SR, this area's nature of pixels is not fully considered. To this end, we propose integrated positional encoding (IPE), extending traditional positional encoding by aggregating frequency information over the pixel area. We apply IPE to the state-of-the-art arbitrary-scale image super-resolution method: local implicit image function (LIIF), presenting IPE-LIIF. We show the effectiveness of IPE-LIIF by quantitative and qualitative evaluations, and further demonstrate the generalization ability of IPE to larger image scales and multiple implicit-based methods. Code will be released.


title: Right fractional Sobolev space via Riemann$-$Liouville derivatives on time scales and an application to fractional boundary value problem on time scales

abstract: Using the concept of fractional derivatives of Riemann$-$Liouville on time scales, we first introduce right fractional Sobolev spaces and characterize them. Then, we prove the equivalence of some norms in the introduced spaces, and obtain their completeness, reflexivity, separability and some imbeddings. Finally, as an application, we propose a recent method to study the existence of weak solutions of fractional boundary value problems on time scales by using variational method and critical point theory, and by constructing an appropriate variational setting, we obtain two existence results of the problem.


title: Edge-Enhanced Dual Discriminator Generative Adversarial Network for Fast MRI with Parallel Imaging Using Multi-view Information

abstract: In clinical medicine, magnetic resonance imaging (MRI) is one of the most important tools for diagnosis, triage, prognosis, and treatment planning. However, MRI suffers from an inherent slow data acquisition process because data is collected sequentially in k-space. In recent years, most MRI reconstruction methods proposed in the literature focus on holistic image reconstruction rather than enhancing the edge information. This work steps aside this general trend by elaborating on the enhancement of edge information. Specifically, we introduce a novel parallel imaging coupled dual discriminator generative adversarial network (PIDD-GAN) for fast multi-channel MRI reconstruction by incorporating multi-view information. The dual discriminator design aims to improve the edge information in MRI reconstruction. One discriminator is used for holistic image reconstruction, whereas the other one is responsible for enhancing edge information. An improved U-Net with local and global residual learning is proposed for the generator. Frequency channel attention blocks (FCA Blocks) are embedded in the generator for incorporating attention mechanisms. Content loss is introduced to train the generator for better reconstruction quality. We performed comprehensive experiments on Calgary-Campinas public brain MR dataset and compared our method with state-of-the-art MRI reconstruction methods. Ablation studies of residual learning were conducted on the MICCAI13 dataset to validate the proposed modules. Results show that our PIDD-GAN provides high-quality reconstructed MR images, with well-preserved edge information. The time of single-image reconstruction is below 5ms, which meets the demand of faster processing.


title: On the identification of the riskiest directional components from multivariate heavy-tailed data

abstract: In univariate data, there exist standard procedures for identifying dominating features that produce the largest observations. However, in the multivariate setting, the situation is quite different. This paper aims to provide tools and algorithms for detecting dominating directional components in multivariate data. We study general heavy-tailed multivariate random vectors in dimension $d\geq 2$ and present consistent estimators which can be used to evaluate why the data is heavy-tailed. This is done by identifying the set of the riskiest directional components. The results are of particular interest in insurance when setting reinsurance policies and in finance when hedging a portfolio of multiple assets.


title: Learning Representations with Contrastive Self-Supervised Learning for Histopathology Applications

abstract: Unsupervised learning has made substantial progress over the last few years, especially by means of contrastive self-supervised learning. The dominating dataset for benchmarking self-supervised learning has been ImageNet, for which recent methods are approaching the performance achieved by fully supervised training. The ImageNet dataset is however largely object-centric, and it is not clear yet what potential those methods have on widely different datasets and tasks that are not object-centric, such as in digital pathology. While self-supervised learning has started to be explored within this area with encouraging results, there is reason to look closer at how this setting differs from natural images and ImageNet. In this paper we make an in-depth analysis of contrastive learning for histopathology, pin-pointing how the contrastive objective will behave differently due to the characteristics of histopathology data. We bring forward a number of considerations, such as view generation for the contrastive objective and hyper-parameter tuning. In a large battery of experiments, we analyze how the downstream performance in tissue classification will be affected by these considerations. The results point to how contrastive learning can reduce the annotation effort within digital pathology, but that the specific dataset characteristics need to be considered. To take full advantage of the contrastive learning objective, different calibrations of view generation and hyper-parameters are required. Our results pave the way for realizing the full potential of self-supervised learning for histopathology applications.


title: Self-Supervised Transformers for fMRI representation

abstract: We present TFF, which is a Transformer framework for the analysis of functional Magnetic Resonance Imaging (fMRI) data. TFF employs a two-phase training approach. First, self-supervised training is applied to a collection of fMRI scans, where the model is trained to reconstruct 3D volume data. Second, the pre-trained model is fine-tuned on specific tasks, utilizing ground truth labels. Our results show state-of-the-art performance on a variety of fMRI tasks, including age and gender prediction, as well as schizophrenia recognition. Our code for the training, network architecture, and results is attached as supplementary material.


title: Duality, decay rates and local-field models in macroscopic QED

abstract: Any treatment of magnetic interactions between atoms, molecules and optical media must start at the form of the interaction energy. This forms the base on which predictions about any number of magnetic atom-light properties stands -- spontaneous decay rates and forces included. As is well-known, the Heaviside-Larmor duality symmetry of Maxwell's equations, where electric and magnetic quantities are exchanges, is broken by the usual form of the magnetic interaction energy. We argue that this symmetry can be restored by including general local-field effects, and that local fields should be treated as a necessity for correctly translating between the microscopic world of the dipole and the macroscopic world of the measured fields. This may additionally aid in resolving a long standing debate over the form of the force on a dipole in a medium. Finally, we compute the magnetic dipole decay rate in a magneto-dielectric with local-field effects taken into account, and show that macroscopic quantum electrodynamics can be made to be dual symmetric at an operator level, instead of only for expectation values.


title: Impact of Massive Binary Star and Cosmic Evolution on Gravitational Wave Observations II: Double Compact Object Rates and Properties

abstract: Making the most of the rapidly increasing population of gravitational-wave detections of black hole (BH) and neutron star (NS) mergers requires comparing observations with population synthesis predictions. In this work we investigate the combined impact from the key uncertainties in population synthesis modelling of the isolated binary evolution channel: the physical processes in massive binary-star evolution and the star formation history as a function of metallicity, $Z$, and redshift $z, \mathcal{S}(Z,z)$. Considering these uncertainties we create 560 different publicly available model realizations and calculate the rate and distribution characteristics of detectable BHBH, BHNS, and NSNS mergers. We find that our stellar evolution and $\mathcal{S}(Z,z)$ variations can impact the predicted intrinsic and detectable merger rates by factors $10^2$-$10^4$. We find that BHBH rates are dominantly impacted by $\mathcal{S}(Z,z)$ variations, NSNS rates by stellar evolution variations and BHNS rates by both. We then consider the combined impact from all uncertainties considered in this work on the detectable mass distribution shapes (chirp mass, individual masses and mass ratio). We find that the BHNS mass distributions are predominantly impacted by massive binary-star evolution changes. For BHBH and NSNS we find that both uncertainties are important. We also find that the shape of the delay time and birth metallicity distributions are typically dominated by the choice of $\mathcal{S}(Z,z)$ for BHBH, BHNS and NSNS. We identify several examples of robust features in the mass distributions predicted by all 560 models, such that we expect more than 95% of BHBH detections to contain a BH $\gtrsim 8\,\rm{M}_{\odot}$ and have mass ratios $\lesssim 4$. Our work demonstrates that it is essential to consider a wide range of allowed models to study double compact object merger rates and properties.