title: Role of magnetic fields in the formation of direct collapse black holes

abstract: Direct collapse black holes (DCBHs) are the leading candidates for the origin of the first supermassive black holes. However, the role of magnetic fields during their formation is still unclear as none of the previous studies has been evolved long enough to assess their impact during the accretion phase. Here, we report the results from a suite of 3D cosmological magneto-hydrodynamic (MHD) simulations which are evolved for 1.6 Myrs comparable to the expected lifetime of supermassive stars (SMSs). Our findings suggest that magnetic fields are rapidly amplified by strong accretion shocks irrespective of the initial magnetic field strength and reach the saturation state. They stabilize the accretion disks and significantly reduce fragmentation by enhancing the Jeans mass in comparison with pure hydrodynamical runs. Although the initial clump masses are larger in MHD runs, the rapid coalescence of clumps in non-MHD cases due to the higher degree of fragmentation results in similar masses. Overall, the central clumps have masses of $\rm 10^5~M_{\odot}$ and the mean mass accretion rates of $\rm \sim 0.1 ~M_{\odot}/yr$ are similar in both MHD and non-MHD cases. The multiplicity of SMSs is significantly reduced in MHD simulations. Such strongly amplified magnetic fields are expected to launch Jets and outflows which may be detected with upcoming radio telescopes.


title: Nonlinear Fokker-Planck equations with fractional Laplacian and McKean-Vlasov SDEs with L\'evy-Noise

abstract: This work is concerned with the existence of mild solutions to non-linear Fokker-Planck equations with fractional Laplace operator $(-\Delta)^s$ for $s\in\left(\frac12,1\right)$. The uniqueness of Schwartz distributional solutions is also proved under suitable assumptions on diffusion and drift terms. As applications, weak existence and uniqueness of solutions to McKean-Vlasov equations with L\'evy-Noise, as well as the Markov property for their laws are proved.


title: Contrastive Training Improves Zero-Shot Classification of Semi-structured Documents

abstract: We investigate semi-structured document classification in a zero-shot setting. Classification of semi-structured documents is more challenging than that of standard unstructured documents, as positional, layout, and style information play a vital role in interpreting such documents. The standard classification setting where categories are fixed during both training and testing falls short in dynamic environments where new document categories could potentially emerge. We focus exclusively on the zero-shot setting where inference is done on new unseen classes. To address this task, we propose a matching-based approach that relies on a pairwise contrastive objective for both pretraining and fine-tuning. Our results show a significant boost in Macro F$_1$ from the proposed pretraining step in both supervised and unsupervised zero-shot settings.


title: An Experimental Study on Private Aggregation of Teacher Ensemble Learning for End-to-End Speech Recognition

abstract: Differential privacy (DP) is one data protection avenue to safeguard user information used for training deep models by imposing noisy distortion on privacy data. Such a noise perturbation often results in a severe performance degradation in automatic speech recognition (ASR) in order to meet a privacy budget $\varepsilon$. Private aggregation of teacher ensemble (PATE) utilizes ensemble probabilities to improve ASR accuracy when dealing with the noise effects controlled by small values of $\varepsilon$. We extend PATE learning to work with dynamic patterns, namely speech utterances, and perform a first experimental demonstration that it prevents acoustic data leakage in ASR training. We evaluate three end-to-end deep models, including LAS, hybrid CTC/attention, and RNN transducer, on the open-source LibriSpeech and TIMIT corpora. PATE learning-enhanced ASR models outperform the benchmark DP-SGD mechanisms, especially under strict DP budgets, giving relative word error rate reductions between 26.2% and 27.5% for an RNN transducer model evaluated with LibriSpeech. We also introduce a DP-preserving ASR solution for pretraining on public speech corpora.


title: Two-weight inequalities for multilinear maximal functions in Orlicz spaces

abstract: In this note, we provide various two-weight norm estimates of the multi-linear fractional maximal function and weighted maximal function between different Orlicz spaces. More precisely, we obtain Sawyer-type characterizations and norm estimates for these operators.


title: Neural Shape Deformation Priors

abstract: We present Neural Shape Deformation Priors, a novel method for shape manipulation that predicts mesh deformations of non-rigid objects from user-provided handle movements. State-of-the-art methods cast this problem as an optimization task, where the input source mesh is iteratively deformed to minimize an objective function according to hand-crafted regularizers such as ARAP. In this work, we learn the deformation behavior based on the underlying geometric properties of a shape, while leveraging a large-scale dataset containing a diverse set of non-rigid deformations. Specifically, given a source mesh and desired target locations of handles that describe the partial surface deformation, we predict a continuous deformation field that is defined in 3D space to describe the space deformation. To this end, we introduce transformer-based deformation networks that represent a shape deformation as a composition of local surface deformations. It learns a set of local latent codes anchored in 3D space, from which we can learn a set of continuous deformation functions for local surfaces. Our method can be applied to challenging deformations and generalizes well to unseen deformations. We validate our approach in experiments using the DeformingThing4D dataset, and compare to both classic optimization-based and recent neural network-based methods.


title: Scaling of Radial Basis Functions

abstract: This paper studies the influence of scaling on the behavior of Radial Basis Function interpolation. It focuses on certain central aspects, but does not try to be exhaustive. The most important questions are: How does the error of a kernel-based interpolant vary with the scale of the kernel chosen? How does the standard error bound vary? And since fixed functions may be in spaces that allow scalings, like global Sobolev spaces, is there a scale of the space that matches the function best? The last question is answered in the affirmative for Sobolev spaces, but the required scale may be hard to estimate. Scalability of functions turns out to be restricted for spaces generated by analytic kernels, unless the functions are band-limited. In contrast to other papers, polynomials and polyharmonics are included as flat limits when checking scales experimentally, with an independent computation. The numerical results show that the hunt for near-flat scales is questionable, if users include the flat limit cases right from the start. When there are not enough data to evaluate errors directly, the scale of the standard error bound can be varied, up to replacing the norm of the unknown function by the norm of the interpolant. This follows the behavior of the actual error qualitatively well, but is only of limited value for estimating error-optimal scales. For kernels and functions with unlimited smoothness, the given interpolation data are proven to be insufficient for determining useful scales.


title: Zero-Order One-Point Estimate with Distributed Stochastic Gradient-Tracking Technique

abstract: In this work, we consider a distributed multi-agent stochastic optimization problem, where each agent holds a local objective function that is smooth and convex, and that is subject to a stochastic process. The goal is for all agents to collaborate to find a common solution that optimizes the sum of these local functions. With the practical assumption that agents can only obtain noisy numerical function queries at exactly one point at a time, we extend the distributed stochastic gradient-tracking method to the bandit setting where we don't have an estimate of the gradient, and we introduce a zero-order (ZO) one-point estimate (1P-DSGT). We analyze the convergence of this novel technique for smooth and convex objectives using stochastic approximation tools, and we prove that it converges almost surely to the optimum. We then study the convergence rate for when the objectives are additionally strongly convex. We obtain a rate of $O(\frac{1}{\sqrt{k}})$ after a sufficient number of iterations $k > K_2$ which is usually optimal for techniques utilizing one-point estimators. We also provide a regret bound of $O(\sqrt{k})$, which is exceptionally good compared to the aforementioned techniques. We further illustrate the usefulness of the proposed technique using numerical experiments.


title: Multilingual BERT has an accent: Evaluating English influences on fluency in multilingual models

abstract: While multilingual language models can improve NLP performance on low-resource languages by leveraging higher-resource languages, they also reduce average performance on all languages (the 'curse of multilinguality'). Here we show another problem with multilingual models: grammatical structures in higher-resource languages bleed into lower-resource languages, a phenomenon we call grammatical structure bias. We show this bias via a novel method for comparing the fluency of multilingual models to the fluency of monolingual Spanish and Greek models: testing their preference for two carefully-chosen variable grammatical structures (optional pronoun-drop in Spanish and optional Subject-Verb ordering in Greek). We find that multilingual BERT is biased toward the English-like setting (explicit pronouns and Subject-Verb-Object ordering) as compared to our monolingual control language model. With our case studies, we hope to bring to light the fine-grained ways in which multilingual models can be biased,and encourage more linguistically-aware fluency evaluation.


title: Time-resolved Hanbury Brown-Twiss interferometry of on-chip biphoton frequency combs using Vernier phase modulation

abstract: Biphoton frequency combs (BFCs) are promising quantum sources for large-scale and high-dimensional quantum information and networking systems. In this context, the spectral purity of individual frequency bins will be critical for realizing quantum networking protocols like teleportation and entanglement swapping. Measurement of the temporal auto-correlation function of the unheralded signal or idler photons comprising the BFC is a key tool for characterizing their spectral purity and in turn verifying the utility of the biphoton state for networking protocols. Yet the experimentally obtainable precision for measuring BFC correlation functions is often severely limited by detector jitter. The fine temporal features in the correlation function$-$not only of practical value in quantum information, but also of fundamental interest in the study of quantum optics$-$are lost as a result and have remained unexplored. We propose a scheme to circumvent this challenge through electro-optic phase modulation, experimentally demonstrating time-resolved Hanbury Brown-Twiss characterization of BFCs generated from an integrated 40.5 GHz Si$_3$N$_4$ microring, up to a 3$\times$3-dimensional two-qutrit Hilbert space. Through slight detuning of the electro-optic drive frequency from the comb's free spectral range, our approach leverages Vernier principles to magnify temporal features which would otherwise be averaged out by detector jitter. We demonstrate our approach under both continuous-wave and pulsed pumping regimes, finding excellent agreement with theory. Importantly, our method reveals not only the collective statistics of the contributing frequency bins but also their temporal shapes$-$features lost in standard fully integrated auto-correlation measurements.


title: Tuning orbital-selective phase transitions in a two-dimensional Hund's correlated system

abstract: Hund's rule coupling ($\textit{J}$) has attracted much attention recently for its role in the description of the novel quantum phases of multi orbital materials. Depending on the orbital occupancy, $\textit{J}$ can lead to various intriguing phases. However, experimental confirmation of the orbital occupancy dependency has been difficult as controlling the orbital degrees of freedom normally accompanies chemical inhomogeneities. Here, we demonstrate a method to investigate the role of orbital occupancy in $\textit{J}$ related phenomena without inducing inhomogeneities. By growing SrRuO$_3$ monolayers on various substrates with symmetry-preserving interlayers, we gradually tune the crystal field splitting and thus the orbital degeneracy of the Ru $\textit{t$_2$$_g$}$ orbitals. It effectively varies the orbital occupancies of two-dimensional (2D) ruthenates. Via in-situ angle-resolved photoemission spectroscopy, we observe a progressive metal-insulator transition (MIT). It is found that the MIT occurs with orbital differentiation: concurrent opening of a band insulating gap in the $\textit{d$_x$$_y$}$ band and a Mott gap in the $\textit{d$_x$$_z$$_/$$_y$$_z$}$ bands. Our study provides an effective experimental method for investigation of orbital-selective phenomena in multi-orbital materials.


title: Differentiability of quadratic forward-backward SDEs with rough drift

abstract: In this paper, we consider quadratic forward-backward SDEs (QFBSDEs), for {which} the drift in the forward equation does not satisfy the standard globally Lipschitz condition and the driver of the backward system {possesses} nonlinearity of type $f(|y|)|z|^2,$ where $f$ is any locally integrable function. We prove both the Malliavin and classical derivative of the QFBSDE and provide representations of these processes. We study a numerical approximation of this system in the sense of \cite{ImkDosReis} in which the authors assume that the drift is Lipschitz and the driver of the BSDE is quadratic in the traditional sense (i.e., $f$ is a positive constant). We show that the rate of convergence is the same as in \cite{ImkDosReis}


title: A Formal Assisted Approach for Modeling and Testing Security Attacks in IoT Edge Devices

abstract: With the rapid growth in the number of IoT devices being added to the network, a major concern that arises is the security of these systems. As these devices are resource constrained, safety measures are difficult to implement on the edge. We propose a novel approach for the detection of IoT device attacks based on the use of formal modeling and mutation testing. Namely, we model the behavior of small IoT devices such as motion sensors and RFID reader as state machines with timeouts. We also model basic IoT attacks; namely, battery draining, sleep deprivation, data falsification, replay, and man in the middle attacks, as special mutants of these specifications. We also consider tests for detecting actual physical device manipulation. Mutation testing is then used to derive tests that distinguish these attacks from the original specifications. The behavior of these mutants is tested in real environment by running the tests on them. Our experiments show that derived the number of attack mutants and tests is small and thus these tests can be executed many times with limited overhead on the physical device. Consequently, our approach is not deterred by related high costs of traditional mutation testing. In addition, we also show that tests derived by our method which cover all IoT attacks do not provide good coverage of mutants derived using traditional mutation code-based operators and this indicates the need of using our method. A framework that implements our approach is presented along with some other relevant case studies.


title: Coherence and contextuality in a Mach-Zehnder interferometer

abstract: We analyse nonclassical resources in interference phenomena using generalized noncontextuality inequalities and basis-independent coherence witnesses. We use recently proposed inequalities that witness both resources within the same framework. We also propose, in view of previous contextual advantage results, a systematic way of applying these tools to characterize advantage provided by coherence and contextuality in quantum information protocols. We instantiate this methodology for the task of quantum interrogation, famously introduced by the paradigmatic bomb-testing interferometric experiment, showing contextual quantum advantage for such a task.


title: Convergence of a Decoupled Splitting Scheme for the Cahn-Hilliard-Navier-Stokes System

abstract: This paper is devoted to the analysis of an energy-stable discontinuous Galerkin algorithm for solving the Cahn-Hilliard-Navier-Stokes equations within a decoupled splitting framework. We show that the proposed scheme is uniquely solvable and mass conservative. The energy dissipation and the $L^\infty$ stability of the order parameter are obtained under a CFL condition. Optimal a priori error estimates in the broken gradient norm and in the $L^2$ norm are derived. The stability proofs and error analysis are based on induction arguments and do not require any regularization of the potential function.


title: Semantic Segmentation under Adverse Conditions: A Weather and Nighttime-aware Synthetic Data-based Approach

abstract: Recent semantic segmentation models perform well under standard weather conditions and sufficient illumination but struggle with adverse weather conditions and nighttime. Collecting and annotating training data under these conditions is expensive, time-consuming, error-prone, and not always practical. Usually, synthetic data is used as a feasible data source to increase the amount of training data. However, just directly using synthetic data may actually harm the model's performance under normal weather conditions while getting only small gains in adverse situations. Therefore, we present a novel architecture specifically designed for using synthetic training data for domain adaptation. We propose a simple yet powerful addition to DeepLabV3+ by using weather and time-of-the-day supervisors trained with multi-task learning, making it both weather and nighttime aware, which improves its mIoU accuracy by $14$ percentage points on the ACDC dataset while maintaining a score of $75\%$ mIoU on the Cityscapes dataset. Our code is available at https://github.com/lsmcolab/Semantic-Segmentation-under-Adverse-Conditions.


title: Density and correlation in a random sequential adsorption model

abstract: We consider a random sequential adsorption process on the one-dimensional lattice with nearest-neighbor exclusion. In this model, each site $s \in \mathbb{Z}$ starts empty and we will try to occupy it in time $t_s$, where $(t_s)_{s\in\mathbb{Z}}$ is a sequence of independent random variables uniformly distributed on the interval $[0,1]$. The site will be occupied if both of its neighbors are vacant. We provide a method to calculate the density of occupied sites up to the time $t$, as well as the pair correlation function.


title: Controlling Photon Entanglement with Mechanical Rotation

abstract: Understanding quantum mechanics within curved spacetime is a key stepping stone towards understanding the nature of spacetime itself. Whilst various theoretical models have been developed, it is significantly more challenging to carry out actual experiments that probe quantum mechanics in curved spacetime. By adding Sagnac interferometers into the arms of a Hong-Ou-Mandel (HOM) interferometer that is placed on a mechanically rotating platform, we show that non-inertial motion modifies the symmetry of an entangled biphoton state. As the platform rotation speed is increased, we observe that HOM interference dips transform into HOM interference peaks. This indicates that the photons pass from perfectly indistinguishable (bosonic behaviour), to perfectly distinguishable (fermionic behavior), therefore demonstrating a mechanism for how spacetime can affect quantum systems. The work is increasingly relevant in the real world as we move towards global satellite quantum communications, and paves the way for further fundamental research that could test the influence of non-inertial motion (and equivalently curved spacetime) on quantum entanglement.


title: A lower-tail limit in the weak noise theory

abstract: We consider the variational problem associated with the Freidlin--Wentzell Large Deviation Principle of the Stochastic Heat Equation (SHE). The logarithm of the minimizer of the variational problem gives the most probable shape of the solution of the Kardar--Parisi--Zhang equation conditioned on achieving certain unlikely values. Taking the SHE with the delta initial condition and conditioning the value of its solution at the origin at a later time, under suitable scaling, we prove that the logarithm of the minimizer converges to an explicit function as we tune the value of the conditioning to $ 0 $. Our result confirms the physics prediction Kolokolov and Korshunov (2009), Meerson, Katzav, and Vilenkin (2016), Kamenev, Meerson, and Sasorov (2016).


title: EllipsoNet: Deep-learning-enabled optical ellipsometry for complex thin films

abstract: Optical spectroscopy is indispensable for research and development in nanoscience and nanotechnology, microelectronics, energy, and advanced manufacturing. Advanced optical spectroscopy tools often require both specifically designed high-end instrumentation and intricate data analysis techniques. Beyond the common analytical tools, deep learning methods are well suited for interpreting high-dimensional and complicated spectroscopy data. They offer great opportunities to extract subtle and deep information about optical properties of materials with simpler optical setups, which would otherwise require sophisticated instrumentation. In this work, we propose a computational ellipsometry approach based on a conventional tabletop optical microscope and a deep learning model called EllipsoNet. Without any prior knowledge about the multilayer substrates, EllipsoNet can predict the complex refractive indices of thin films on top of these nontrivial substrates from experimentally measured optical reflectance spectra with high accuracies. This task was not feasible previously with traditional reflectometry or ellipsometry methods. Fundamental physical principles, such as the Kramers-Kronig relations, are spontaneously learned by the model without any further training. This approach enables in-operando optical characterization of functional materials within complex photonic structures or optoelectronic devices.


title: On Landau's Eigenvalue Theorem for Line-of-Sight MIMO Channels

abstract: An alternative derivation is provided for the degrees of freedom (DOF) formula on line-of-sight (LOS) channels via Landau's eigenvalue theorem for bandlimited signals. Compared to other approaches, Landau's theorem provides a general framework to compute the DOF in arbitrary environments, this framework is herein specialized to LOS propagation. The development shows how the spatially bandlimited nature of the channel relates to its geometry under the paraxial approximation that applies to most LOS settings of interest.


title: SEE-Few: Seed, Expand and Entail for Few-shot Named Entity Recognition

abstract: Few-shot named entity recognition (NER) aims at identifying named entities based on only few labeled instances. Current few-shot NER methods focus on leveraging existing datasets in the rich-resource domains which might fail in a training-from-scratch setting where no source-domain data is used. To tackle training-from-scratch setting, it is crucial to make full use of the annotation information (the boundaries and entity types). Therefore, in this paper, we propose a novel multi-task (Seed, Expand and Entail) learning framework, SEE-Few, for Few-shot NER without using source domain data. The seeding and expanding modules are responsible for providing as accurate candidate spans as possible for the entailing module. The entailing module reformulates span classification as a textual entailment task, leveraging both the contextual clues and entity type information. All the three modules share the same text encoder and are jointly learned. Experimental results on four benchmark datasets under the training-from-scratch setting show that the proposed method outperformed state-of-the-art few-shot NER methods with a large margin. Our code is available at https://github.com/unveiled-the-red-hat/SEE-Few.


title: Habitat-Matterport 3D Semantics Dataset

abstract: We present the Habitat-Matterport 3D Semantics (HM3DSEM) dataset. HM3DSEM is the largest dataset of 3D real-world spaces with densely annotated semantics that is currently available to the academic community. It consists of 142,646 object instance annotations across 216 3D spaces and 3,100 rooms within those spaces. The scale, quality, and diversity of object annotations far exceed those of prior datasets. A key difference setting apart HM3DSEM from other datasets is the use of texture information to annotate pixel-accurate object boundaries. We demonstrate the effectiveness of HM3DSEM dataset for the Object Goal Navigation task using different methods. Policies trained using HM3DSEM perform outperform those trained on prior datasets. Introduction of HM3DSEM in the Habitat ObjectNav Challenge lead to an increase in participation from 400 submissions in 2021 to 1022 submissions in 2022.


title: The IID Prophet Inequality with Limited Flexibility

abstract: In online sales, sellers usually offer each potential buyer a posted price in a take-it-or-leave fashion. Buyers can sometimes see posted prices faced by other buyers, and changing the price frequently could be considered unfair. The literature on posted price mechanisms and prophet inequality problems has studied the two extremes of pricing policies, the fixed price policy and fully dynamic pricing. The former is suboptimal in revenue but is perceived as fairer than the latter. This work examines the middle situation, where there are at most $k$ distinct prices over the selling horizon. Using the framework of prophet inequalities with independent and identically distributed random variables, we propose a new prophet inequality for strategies that use at most $k$ thresholds. We present asymptotic results in $k$ and results for small values of $k$. For $k=2$ prices, we show an improvement of at least $11\%$ over the best fixed-price solution. Moreover, $k=5$ prices suffice to guarantee almost $99\%$ of the approximation factor obtained by a fully dynamic policy that uses an arbitrary number of prices. From a technical standpoint, we use an infinite-dimensional linear program in our analysis; this formulation could be of independent interest to other online selection problems.


title: Oflib: Facilitating Operations with and on Optical Flow Fields in Python

abstract: We present a robust theoretical framework for the characterisation and manipulation of optical flow, i.e 2D vector fields, in the context of their use in motion estimation algorithms and beyond. The definition of two frames of reference guides the mathematical derivation of flow field application, inversion, evaluation, and composition operations. This structured approach is then used as the foundation for an implementation in Python 3, with the fully differentiable PyTorch version oflibpytorch supporting back-propagation as required for deep learning. We verify the flow composition method empirically and provide a working example for its application to optical flow ground truth in synthetic training data creation. All code is publicly available.


title: Thermally-generated spin current in the topological insulator Bi$_2$Se$_3$

abstract: We complete measurements of interconversions among the full triad of thermal gradients, charge currents, and spin currents in the topological insulator Bi$_2$Se$_3$ by quantifying the efficiency with which thermal gradients can generate transverse spin currents. We accomplish this by comparing the spin Nernst magneto-thermopower to the spin Hall magnesistance for bilayers of Bi$_2$Se$_3$/CoFeB. We find that Bi$_2$Se$_3$ does generate substantial thermally-driven spin currents. A lower bound for the ratio of spin current to thermal gradient is $J_s/\nabla_x T$ = (4.9 $\pm$ 0.9) $\times$ 10$^{6}$ ($\hbar/2e$) A m$^{-2}$ / K $\mu$m$^{-1}$, and a lower bound for the magnitude of the spin Nernst ratio is $-$0.61 $\pm$ 0.11. The spin Nernst ratio for Bi$_2$Se$_3$ is the largest among all materials measured to date, 2-3 times larger compared to previous measurements for the heavy metals Pt and W.


title: Searching for Conformity Across Cosmic Time with Local Group and Local Volume Star Formation Histories

abstract: Conformity denotes the correlation of properties between pairs of galaxies as a function of separation. Correlations between properties such as star formation rate (SFR), stellar mass, and specific star formation rate (sSFR) have implications for the impact of environment upon galaxy formation and evolution. Conformity between primary galaxies and satellites within the same dark matter halo has been well documented in simulations and observations. However, the existence of conformity at greater distances - known as two-halo conformity - remains uncertain. We investigate whether galaxies in the Local Volume to a distance of 4 Mpc show conformity by examining SFR, sSFR, stellar mass, and quenched fraction as a function of physical separation. Making use of the star formation histories of these galaxies, we then extend this analysis back in time to offer the first probe of conformity inside our past light cone. At the present day, we find that the stellar mass or sSFR of a galaxy correlates with the median SFR of neighboring galaxies at a separation of 2 to 3 Mpc. At a lookback time of 1 Gyr, we find a correlation with the quenched fraction of neighboring galaxies, again at 2 to 3 Mpc separation. These signals of conformity likely arise from the differences between the recent star formation histories of Local Group dwarf galaxies and those outside the Local Group. As current and future missions including JWST, Rubin, and Roman expand the sample of Local Volume galaxies, tests of conformity using star formation histories will provide an important tool for exploring spatio-temporal correlations between galaxies.


title: APSNet: Attention Based Point Cloud Sampling

abstract: Processing large point clouds is a challenging task. Therefore, the data is often downsampled to a smaller size such that it can be stored, transmitted and processed more efficiently without incurring significant performance degradation. Traditional task-agnostic sampling methods, such as farthest point sampling (FPS), do not consider downstream tasks when sampling point clouds, and thus non-informative points to the tasks are often sampled. This paper explores a task-oriented sampling for 3D point clouds, and aims to sample a subset of points that are tailored specifically to a downstream task of interest. Similar to FPS, we assume that point to be sampled next should depend heavily on the points that have already been sampled. We thus formulate point cloud sampling as a sequential generation process, and develop an attention-based point cloud sampling network (APSNet) to tackle this problem. At each time step, APSNet attends to all the points in a cloud by utilizing the history of previously sampled points, and samples the most informative one. Both supervised learning and knowledge distillation-based self-supervised learning of APSNet are proposed. Moreover, joint training of APSNet over multiple sample sizes is investigated, leading to a single APSNet that can generate arbitrary length of samples with prominent performances. Extensive experiments demonstrate the superior performance of APSNet against state-of-the-arts in various downstream tasks, including 3D point cloud classification, reconstruction, and registration.


title: Discovered Policy Optimisation

abstract: Tremendous progress has been made in reinforcement learning (RL) over the past decade. Most of these advancements came through the continual development of new algorithms, which were designed using a combination of mathematical derivations, intuitions, and experimentation. Such an approach of creating algorithms manually is limited by human understanding and ingenuity. In contrast, meta-learning provides a toolkit for automatic machine learning method optimisation, potentially addressing this flaw. However, black-box approaches which attempt to discover RL algorithms with minimal prior structure have thus far not outperformed existing hand-crafted algorithms. Mirror Learning, which includes RL algorithms, such as PPO, offers a potential middle-ground starting point: while every method in this framework comes with theoretical guarantees, components that differentiate them are subject to design. In this paper we explore the Mirror Learning space by meta-learning a "drift" function. We refer to the immediate result as Learnt Policy Optimisation (LPO). By analysing LPO we gain original insights into policy optimisation which we use to formulate a novel, closed-form RL algorithm, Discovered Policy Optimisation (DPO). Our experiments in Brax environments confirm state-of-the-art performance of LPO and DPO, as well as their transfer to unseen settings.


title: A Kirby color for Khovanov homology

abstract: We construct a Kirby color in the setting of Khovanov homology: an ind-object of the annular Bar-Natan category that is equipped with a natural handle slide isomorphism. Using functoriality and cabling properties of Khovanov homology, we define a Kirby-colored Khovanov homology that is invariant under the handle slide Kirby move, up to isomorphism. Via the Manolescu--Neithalath 2-handle formula, Kirby-colored Khovanov homology agrees with the $\mathfrak{gl}_{2}$ skein lasagna module, hence is an invariant of $4$-dimensional $2$-handlebodies.


title: Magnetotransport of single crystal Sm$_2$Ir$_2$O$_7$ across the pressure-induced quantum-critical phase boundary

abstract: Rare-earth pyrochlore iridates host two interlocking magnetic sublattices of corner-sharing tetrahedra and can harbour a unique combination of frustrated moments, exotic excitations and highly correlated electrons. They are also the first systems predicted to display both topological Weyl semimetal and axion insulator phases. We have measured the transport and magnetotransport properties of single-crystal Sm$_2$Ir$_2$O$_7$ up to and beyond the pressure-induced quantum critical point for all-in-all-out (AIAO) Ir order at $p_{{\rm c}}$ = 63 kbar previously identified by resonant X-ray scattering and close to which Weyl semimetallic behavior has been previously predicted. Our findings overturn the accepted expectation that the suppression of AIAO order should lead to metallic conduction persisting down to zero temperature. Instead, the resistivity-minimum temperature, which tracks the decrease in the AIAO ordering temperature for pressures up to 30~kbar, begins to increase under further application of pressure, pointing to the presence of a second as-yet unidentified mechanism leading to non-metallic behavior. The magnetotransport does track the suppression of Ir magnetism, however, with a strong hysteresis observed only within the AIAO phase boundary, similar to that found for Ho$_2$Ir$_2$O$_7$ and attributed to plastic deformation of Ir domains. Around $p_{{\rm c}}$ we find the emergence of a new type of electronic phase, characterized by a negative magnetoresistance with small hysteresis at the lowest temperatures, and hysteresis-free positive magnetoresistance above approximately 5 K. The temperature dependence of our low-temperature transport data are found to be best described by a model consistent with a Weyl semimetal across the entire pressure range.


title: A 2D forest fire process beyond the critical time

abstract: We study forest fire processes in two dimensions. On a given planar lattice, vertices independently switch from vacant to occupied at rate $1$ (initially they are all vacant), and any connected component "is burnt" (its vertices become instantaneously vacant) as soon as its cardinality crosses a (typically large) threshold $N$, the parameter of the model. Our analysis provides a detailed description, as $N \to \infty$, of the process near and beyond the critical time $t_c$ (at which an infinite cluster would arise in the absence of fires). In particular we prove a somewhat counterintuitive result: there exists $\delta > 0$ such that with high probability, the origin does not burn before time $t_c + \delta$. This provides a negative answer to Open Problem 4.1 of van den Berg and Brouwer [Comm. Math. Phys., 2006]. Informally speaking, the result can be explained in terms of the emergence of fire lanes, whose total density is negligible (as $N \to \infty$), but which nevertheless are sufficiently robust with respect to recoveries. We expect that such a behavior also holds for the classical Drossel-Schwabl model. A large part of this paper is devoted to analyzing recoveries during the interval $[t_c, t_c + \delta]$. These recoveries do have a "microscopic" effect, but it turns out that their combined influence on macroscopic scales (and in fact on relevant "mesoscopic" scales) vanishes as $N \to \infty$. In order to prove this, we use key ideas of Kiss, Manolescu and Sidoravicius [Ann. Probab., 2015], introducing a suitable induction argument to extend and strengthen their results. We then use it to prove that a deconcentration result in our earlier joint work with Kiss on volume-frozen percolation also holds for the forest fire process. As we explain, significant additional difficulties arise here, since recoveries destroy the nice spatial Markov property of frozen percolation.


title: A Kernel-Based View of Language Model Fine-Tuning

abstract: It has become standard to solve NLP tasks by fine-tuning pre-trained language models (LMs), especially in low-data settings. There is minimal theoretical understanding of empirical success, e.g., why fine-tuning a model with $10^8$ or more parameters on a couple dozen training points does not result in overfitting. We investigate whether the Neural Tangent Kernel (NTK) - which originated as a model to study the gradient descent dynamics of infinitely wide networks with suitable random initialization - describes fine-tuning of pre-trained LMs. This study was inspired by the decent performance of NTK for computer vision tasks (Wei et al., 2022). We extend the NTK formalism to Adam and use Tensor Programs (Yang, 2020) to characterize conditions under which the NTK lens may describe fine-tuning updates to pre-trained language models. Extensive experiments on 14 NLP tasks validate our theory and show that formulating the downstream task as a masked word prediction problem through prompting often induces kernel-based dynamics during fine-tuning. Finally, we use this kernel view to propose an explanation for the success of parameter-efficient subspace-based fine-tuning methods.


title: Simulating single-photon detector array sensors for depth imaging

abstract: Single-Photon Avalanche Detector (SPAD) arrays are a rapidly emerging technology. These multi-pixel sensors have single-photon sensitivities and pico-second temporal resolutions thus they can rapidly generate depth images with millimeter precision. Such sensors are a key enabling technology for future autonomous systems as they provide guidance and situational awareness. However, to fully exploit the capabilities of SPAD array sensors, it is crucial to establish the quality of depth images they are able to generate in a wide range of scenarios. Given a particular optical system and a finite image acquisition time, what is the best-case depth resolution and what are realistic images generated by SPAD arrays? In this work, we establish a robust yet simple numerical procedure that rapidly establishes the fundamental limits to depth imaging with SPAD arrays under real world conditions. Our approach accurately generates realistic depth images in a wide range of scenarios, allowing the performance of an optical depth imaging system to be established without the need for costly and laborious field testing. This procedure has applications in object detection and tracking for autonomous systems and could be easily extended to systems for underwater imaging or for imaging around corners.


title: Zero Energy Self-Similar Solutions Describing Singularity Formation In The Nonlinear Schrodinger Equation In Dimension N=3

abstract: In dimension N=3 the cubic nonlinear Schrodinger equation has solutions which become singular, i.e. at a spatial point they blow up to infinity in finite time. In 1972 Zakharov famously investigated finite time singularity formation in the cubic nonlinear Schrodinger equation as a model for spatial collapse of Langmuir waves in plasma, the most abundant form of observed matter in the universe. Zakharov assumed that (NLS) blow up of solutions is self-similar and radially symmetric, and that singularity formation can be modeled by a solution of an associated self-similar, complex ordinary differential equation~(ODE). A parameter a>0 appears in the ODE, and the dependent variable, Q, satisfies (Q(0),Q'(0))=(Q_{0},0), where Q(0)>0. A fundamentally important step towards putting the Zakharov model on a firm mathematical footing is to prove, when N=3, whether values a>0 and Q_{0}>0 exist such that Q also satisfies the physically important `zero-energy' integral constraint. Since 1972 this has remained an open problem. Here, we resolve this issue by proving that for every a>0 and Q(0)>0, Q satisfies the the `zero-energy' integral constraint.


title: Indefinite Halmos, Egervary and Sz.-Nagy Dilations

abstract: Let $\mathcal{M}$ be an indefinite inner product module over a *-ring of characteristic 2. We show that every self-adjoint operator on $\mathcal{M}$ admits Halmos, Egervary and Sz.-Nagy dilations.


title: A nonparametric relative treatment effect for direct comparisons of censored paired survival outcomes

abstract: A very classical problem in statistics is to test the stochastic superiority of one distribution to another. However, many existing approaches are developed for independent samples and, moreover, do not take censored data into account. We develop a new estimand-driven method to compare the effectiveness of two treatments in the context of right-censored survival data with matched pairs. With the help of competing risks techniques, the so-called relative treatment effect is estimated. It quantifies the probability that the individual undergoing the first treatment survives the matched individual undergoing the second treatment. Hypothesis tests and confidence intervals are based on a studentized version of the estimator, where resampling-based inference is established by means of a randomization method. In a simulation study, we found that the developed test exhibits good power, when compared to competitors which are actually testing the simpler null hypothesis of the equality of both marginal survival functions. Finally, we apply the methodology to a well-known benchmark data set from a trial with patients suffering from with diabetic retinopathy.


title: Entity Disambiguation with Entity Definitions

abstract: Local models have recently attained astounding performances in Entity Disambiguation (ED), with generative and extractive formulations being the most promising research directions. However, previous works limited their studies to using, as the textual representation of each candidate, only its Wikipedia title. Although certainly effective, this strategy presents a few critical issues, especially when titles are not sufficiently informative or distinguishable from one another. In this paper, we address this limitation and investigate to what extent more expressive textual representations can mitigate it. We thoroughly evaluate our approach against standard benchmarks in ED and find extractive formulations to be particularly well-suited to these representations: we report a new state of the art on 2 out of 6 benchmarks we consider and strongly improve the generalization capability over unseen patterns. We release our code, data and model checkpoints at https://github.com/SapienzaNLP/extend.


title: Decoding the double trouble: A mathematical modelling of co-infection dynamics of SARS-CoV-2 and influenza-like illness

abstract: After the detection of coronavirus disease 2019 (Covid-19), caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in Wuhan, Hubei Province, China in late December, the cases of Covid-19 have spiralled out around the globe. Due to the clinical similarity of Covid-19 with other flulike syndromes, patients are assayed for other pathogens of influenza like illness. There have been reported cases of co-infection amongst patients with Covid-19. Bacteria for example Streptococcus pneumoniae, Staphylococcus aureus, Klebsiella pneumoniae, Mycoplasma pneumoniae, Chlamydia pneumonia, Legionella pneumophila etc and viruses such as influenza, coronavirus, rhinovirus/enterovirus, parainfluenza, metapneumovirus, influenza B virus etc are identified as co-pathogens. In our current effort, we develop and analysed a compartmental based Ordinary Differential Equation (ODE) type mathematical model to understand the co-infection dynamics of Covid-19 and other influenza type illness. In this work we have incorporated the saturated treatment rate to take account of the impact of limited treatment resources to control the possible Covid-19 cases. As results, we formulate the basic reproduction number of the model system. Finally, we have performed numerical simulations of the co-infection model to examine the solutions in different zones of parameter space.


title: Regret Bounds for Risk-Sensitive Reinforcement Learning

abstract: In safety-critical applications of reinforcement learning such as healthcare and robotics, it is often desirable to optimize risk-sensitive objectives that account for tail outcomes rather than expected reward. We prove the first regret bounds for reinforcement learning under a general class of risk-sensitive objectives including the popular CVaR objective. Our theory is based on a novel characterization of the CVaR objective as well as a novel optimistic MDP construction.


title: Fractal thermodynamics and ninionic statistics of coherent rotational states: realization via imaginary angular rotation in imaginary time formalism

abstract: We suggest the existence of systems in which the statistics of a particle changes with the quantum level it occupies. The occupation numbers in thermal equilibrium depend on a continuous statistical parameter that interpolates between bosonic or fermionic and ghost-like statistical distributions. We call such particle states ``ninions'': they are different from anyons and can exist in 3+1 dimensions. We suggest that ninions can be associated with coherent angular momentum states. In the Euclidean imaginary-time formalism, the ninionic statistics can be implemented via the rotwisted boundary conditions, which are associated with the rigid global rotation of the system with an imaginary angular frequency. The imaginary rotation is characterized by a PT-symmetric non-Hermitian Hamiltonian and possesses a well-defined thermodynamic limit. The physics of ninions in thermal equilibrium is accessible for numerical simulations on Euclidean lattices. We provide a no-go theorem on the absence of analytical continuation between real and imaginary rotations in the thermodynamic limit. The ground state of ninions shares similarity with the $\theta$-vacuum in QCD. The ninions can produce negative pressure and energy, similar to the Casimir effect and the cosmological dark energy. In the thermodynamic limit, the dependence of thermal energy of free ninions on the statistical parameter is a fractal.


title: Optimizing fermionic encodings for both Hamiltonian and hardware

abstract: In this work we present a method for generating a fermionic encoding tailored to a set of target fermionic operators and to a target hardware connectivity. Our method uses brute force search, over the space of all encodings which map from Majorana monomials to Pauli operators, to find an encoding which optimizes a target cost function. In contrast to earlier works in this direction, our method searches over an extremely broad class of encodings which subsumes all known second quantized encodings that constitute algebra homomorphisms. In order to search over this class, we give a clear mathematical explanation of how precisely it is characterized, and how to translate this characterization into constructive search criteria. A benefit of searching over this class is that our method is able to supply fairly general optimality guarantees on solutions. A second benefit is that our method is, in principal, capable of finding more efficient representations of fermionic systems when the set of fermionic operators under consideration are faithfully represented by a smaller quotient algebra. Given the high algorithmic cost of performing the search, we adapt our method to handle translationally invariant systems that can be described by a small unit cell that is less costly. We demonstrate our method on various pairings of target fermionic operators and hardware connectivities. We additionally show how our method can be extended to find error detecting fermionic encodings in this class.


title: A new approach to the Lvov-Kaplansky conjecture through gradings

abstract: In this paper we consider images of (ordinary) noncommutative polynomials on matrix algebras endowed with a graded structure. We give necessary and sufficient conditions to verify that some multilinear polynomial is a central polynomial, or a trace zero polynomial, and we use this approach to present an equivalent statement to the Lvov-Kaplansky conjecture.


title: Influence of chemistry and structure on interfacial segregation in NbMoTaW with high-throughput atomistic simulations

abstract: Refractory multi-principal element alloys exhibiting promising mechanical properties such as excellent strength retention at elevated temperatures have been attracting increasing attention. Although their inherent chemical complexity is considered a defining feature, a challenge arises in predicting local chemical ordering, particularly in grain boundary regions with enhanced structural disorder. In this study, we use atomistic simulations of a large group of bicrystal models to sample a wide variety of interfacial sites (grain boundary) in NbMoTaW and explore emergent trends in interfacial segregation and the underlying structural and chemical driving factors. Sampling hundreds of bicrystals along the [001] symmetric tilt axis and analyzing more than one hundred and thirty thousand grain boundary sites with a variety of local atomic environments, we uncover segregation trends in NbMoTaW. While Nb is the dominant segregant, more notable are the segregation patterns that deviate from expected behavior and mark situations where local structural and chemical driving forces lead to interesting segregation events. For example, incomplete depletion of Ta in low-angle boundaries results from chemical pinning due to favorable local compositional environments associated with chemical short-range ordering. Finally, machine learning models capturing and comparing the structural and chemical features of interfacial sites are developed to weigh their relative importance and contributions to segregation tendency, revealing a significant increase in predictive capability when including local chemical information. Overall, this work, highlighting the complex interplay between local grain boundary structure and chemical short-range ordering, suggest tunable segregation and chemical ordering by tailoring grain boundary structure in multi-principal element alloys.


title: Adjoint optimization of polarization-splitting grating couplers

abstract: We have designed a polarization-splitting grating coupler (PSGC) in silicon-oninsulator (SOI) that has 1.2 dB peak loss in numerical simulations, which is the best simulated performance of PSGCs without a bottom reflector to the best of our knowledge. Adjoint method-based shape optimization enables us to explore complex geometries that are intractable with conventional design approaches. Physics-based process-independent knowledge of PSGCs is extracted from the adjoint optimization and can be transferred to other platforms with a minimum of effort.


title: Behavior in time of solutions of a Keller--Segel system with flux limitation and source term

abstract: In this paper we consider radially symmetric solutions of the following parabolic--elliptic cross-diffusion system \begin{equation*} \begin{cases} u_t = \Delta u - \nabla \cdot (u f(|\nabla v|^2 )\nabla v) + g(u), & \\[2mm] 0= \Delta v -m(t)+ u , \quad \int_{\Omega}v \,dx=0, & \\[2mm] u(x,0)= u_0(x), & \end{cases} \end{equation*} in $\Omega \times (0,\infty)$, with $\Omega$ a ball in $\mathbb{R}^N$, $N\geq 3$, under homogeneous Neumann boundary conditions, where $g(u)= \lambda u - \mu u^k$ , $\lambda >0, \ \mu >0$, and $ k >1$, $f(|\nabla v|^2 )= k_f(1+ |\nabla v|^2)^{-\alpha}$, $\alpha>0$, which describes gradient-dependent limitation of cross diffusion fluxes. The function $m(t)$ is the time dependent spatial mean of $u(x,t)$ i.e. $m(t) := \frac 1 {|\Omega|} \int_{\Omega} u(x,t) \,dx$. Under smallness conditions on $\alpha$ and $k$, we prove that the solution $u(x,t)$ blows up in $L^{\infty}$-norm at finite time $T_{max}$ and for some $p>1$ it blows up also in $L^p$-norm. In addition a lower bound of blow-up time is derived. Finally, under largeness conditions on $\alpha$ or $k$, we prove that the solution is global and bounded in time.


title: The Unreasonable Effectiveness of Fully-Connected Layers for Low-Data Regimes

abstract: Convolutional neural networks were the standard for solving many computer vision tasks until recently, when Transformers of MLP-based architectures have started to show competitive performance. These architectures typically have a vast number of weights and need to be trained on massive datasets; hence, they are not suitable for their use in low-data regimes. In this work, we propose a simple yet effective framework to improve generalization from small amounts of data. We augment modern CNNs with fully-connected (FC) layers and show the massive impact this architectural change has in low-data regimes. We further present an online joint knowledge-distillation method to utilize the extra FC layers at train time but avoid them during test time. This allows us to improve the generalization of a CNN-based model without any increase in the number of weights at test time. We perform classification experiments for a large range of network backbones and several standard datasets on supervised learning and active learning. Our experiments significantly outperform the networks without fully-connected layers, reaching a relative improvement of up to $16\%$ validation accuracy in the supervised setting without adding any extra parameters during inference.


title: Lensing of gravitational waves: efficient wave-optics methods and validation with symmetric lenses

abstract: Gravitational wave (GW) astronomy offers the potential to probe the wave-optics regime of gravitational lensing. Wave optics (WO) effects are relevant at low frequencies, when the wavelength is comparable to the characteristic lensing time delay multiplied by the speed of light, and are thus often negligible for electromagnetic signals. Accurate predictions require computing the conditionally convergent diffraction integral, which involves highly oscillatory integrands and is numerically difficult. We develop and implement several methods to compute lensing predictions in the WO regime valid for general gravitational lenses. First, we derive approximations for high and low frequencies, obtaining explicit expressions for several analytic lens models. Next, we discuss two numerical methods suitable in the intermediate frequency range: 1) Regularized contour flow yields accurate answers in a fraction of a second for a broad range of frequencies. 2) Complex deformation is slower, but requires no knowledge of solutions to the geometric lens equation. Both methods are independent and complement each other. We verify sub-percent accuracy for several lens models, which should be sufficient for applications to GW astronomy in the near future. Apart from modelling lensed GWs, our method will also be applicable to the study of plasma lensing of radio waves and tests of gravity.


title: Observability of the very-high-energy emission from GRB 221009A

abstract: The LHAASO Collaboration detected the gamma ray burst GRB 221009A at energies above $500 \, {\rm GeV}$ with a tail extending up to $18 \, \rm TeV$, whose spectral analysis has presently been performed up to $7 \, \rm TeV$ for the lower energy instrument LHAASO-WCDA only, with no indication of a cutoff. Soon thereafter, Carpet-2 at Baksan Neutrino Observatory reported the observation of an air shower consistent with being caused by a photon of energy $251 \, {\rm TeV}$ from the same GRB. Given the source redshift $z=0.151$, the expected attenuation due to the extragalactic background light is very severe so that these detections have proven very hard to explain. In this Letter, we show that the existence of axion-like-particles (ALPs) with mass $m_a \simeq (10^{-11}-10^{-7}) \, {\rm eV}$ and two-photon coupling $g_{a \gamma \gamma} \simeq (3-5) \times 10^{-12} \, {\rm GeV}^{- 1}$ strongly reduce the optical depth of TeV photons, thus explaining the observations. Our ALPs meet all available constraints, are consistent with two previous hints at their existence and are good candidates for cold dark matter. Moreover, we show that Lorentz Invariance Violation (LIV) can explain the Carpet-2 result but not the LHAASO observations.


title: The Typical Behavior of Bandit Algorithms

abstract: We establish strong laws of large numbers and central limit theorems for the regret of two of the most popular bandit algorithms: Thompson sampling and UCB. Here, our characterizations of the regret distribution complement the characterizations of the tail of the regret distribution recently developed by Fan and Glynn (2021) (arXiv:2109.13595). The tail characterizations there are associated with atypical bandit behavior on trajectories where the optimal arm mean is under-estimated, leading to mis-identification of the optimal arm and large regret. In contrast, our SLLN's and CLT's here describe the typical behavior and fluctuation of regret on trajectories where the optimal arm mean is properly estimated. We find that Thompson sampling and UCB satisfy the same SLLN and CLT, with the asymptotics of both the SLLN and the (mean) centering sequence in the CLT matching the asymptotics of expected regret. Both the mean and variance in the CLT grow at $\log(T)$ rates with the time horizon $T$. Asymptotically as $T \to \infty$, the variability in the number of plays of each sub-optimal arm depends only on the rewards received for that arm, which indicates that each sub-optimal arm contributes independently to the overall CLT variance.


title: Even Lighter Particle Dark Matter

abstract: We report on recent progress in the search for dark matter particles with masses from 1 MeV to 1 GeV. Several dark matter candidates in this mass range are expected to generate measurable electronic-recoil signals in direct-detection experiments. We focus on dark matter particles scattering with electrons in semiconductor detectors since they have fundamentally the highest sensitivity due to their low ionization threshold. Charge-coupled device (CCD) silicon detectors are the leading technology, with significant progress expected in the coming years. We present the status of the CCD program and briefly report on other efforts.


title: Understanding or Manipulation: Rethinking Online Performance Gains of Modern Recommender Systems

abstract: Recommender systems are expected to be assistants that help human users find relevant information automatically without explicit queries. As recommender systems evolve, increasingly sophisticated learning techniques are applied and have achieved better performance in terms of user engagement metrics such as clicks and browsing time. The increase in the measured performance, however, can have two possible attributions: a better understanding of user preferences, and a more proactive ability to utilize human bounded rationality to seduce user over-consumption. A natural following question is whether current recommendation algorithms are manipulating user preferences. If so, can we measure the manipulation level? In this paper, we present a general framework for benchmarking the degree of manipulations of recommendation algorithms, in both slate recommendation and sequential recommendation scenarios. The framework consists of four stages, initial preference calculation, training data collection, algorithm training and interaction, and metrics calculation that involves two proposed metrics. We benchmark some representative recommendation algorithms in both synthetic and real-world datasets under the proposed framework. We have observed that a high online click-through rate does not necessarily mean a better understanding of user initial preference, but ends in prompting users to choose more documents they initially did not favor. Moreover, we find that the training data have notable impacts on the manipulation degrees, and algorithms with more powerful modeling abilities are more sensitive to such impacts. The experiments also verified the usefulness of the proposed metrics for measuring the degree of manipulations. We advocate that future recommendation algorithm studies should be treated as an optimization problem with constrained user preference manipulations.


title: CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memory

abstract: We propose CLIP-Fields, an implicit scene model that can be used for a variety of tasks, such as segmentation, instance identification, semantic search over space, and view localization. CLIP-Fields learns a mapping from spatial locations to semantic embedding vectors. Importantly, we show that this mapping can be trained with supervision coming only from web-image and web-text trained models such as CLIP, Detic, and Sentence-BERT; and thus uses no direct human supervision. When compared to baselines like Mask-RCNN, our method outperforms on few-shot instance identification or semantic segmentation on the HM3D dataset with only a fraction of the examples. Finally, we show that using CLIP-Fields as a scene memory, robots can perform semantic navigation in real-world environments. Our code and demonstration videos are available here: https://mahis.life/clip-fields


title: Social Influence Dialogue Systems: A Survey of Datasets and Models For Social Influence Tasks

abstract: Dialogue systems capable of social influence such as persuasion, negotiation, and therapy, are essential for extending the use of technology to numerous realistic scenarios. However, existing research primarily focuses on either task-oriented or open-domain scenarios, a categorization that has been inadequate for capturing influence skills systematically. There exists no formal definition or category for dialogue systems with these skills and data-driven efforts in this direction are highly limited. In this work, we formally define and introduce the category of social influence dialogue systems that influence users' cognitive and emotional responses, leading to changes in thoughts, opinions, and behaviors through natural conversations. We present a survey of various tasks, datasets, and methods, compiling the progress across seven diverse domains. We discuss the commonalities and differences between the examined systems, identify limitations, and recommend future directions. This study serves as a comprehensive reference for social influence dialogue systems to inspire more dedicated research and discussion in this emerging area.


title: HiFECap: Monocular High-Fidelity and Expressive Capture of Human Performances

abstract: Monocular 3D human performance capture is indispensable for many applications in computer graphics and vision for enabling immersive experiences. However, detailed capture of humans requires tracking of multiple aspects, including the skeletal pose, the dynamic surface, which includes clothing, hand gestures as well as facial expressions. No existing monocular method allows joint tracking of all these components. To this end, we propose HiFECap, a new neural human performance capture approach, which simultaneously captures human pose, clothing, facial expression, and hands just from a single RGB video. We demonstrate that our proposed network architecture, the carefully designed training strategy, and the tight integration of parametric face and hand models to a template mesh enable the capture of all these individual aspects. Importantly, our method also captures high-frequency details, such as deforming wrinkles on the clothes, better than the previous works. Furthermore, we show that HiFECap outperforms the state-of-the-art human performance capture approaches qualitatively and quantitatively while for the first time capturing all aspects of the human.


title: Point Transformer V2: Grouped Vector Attention and Partition-based Pooling

abstract: As a pioneering work exploring transformer architecture for 3D point cloud understanding, Point Transformer achieves impressive results on multiple highly competitive benchmarks. In this work, we analyze the limitations of the Point Transformer and propose our powerful and efficient Point Transformer V2 model with novel designs that overcome the limitations of previous work. In particular, we first propose group vector attention, which is more effective than the previous version of vector attention. Inheriting the advantages of both learnable weight encoding and multi-head attention, we present a highly effective implementation of grouped vector attention with a novel grouped weight encoding layer. We also strengthen the position information for attention by an additional position encoding multiplier. Furthermore, we design novel and lightweight partition-based pooling methods which enable better spatial alignment and more efficient sampling. Extensive experiments show that our model achieves better performance than its predecessor and achieves state-of-the-art on several challenging 3D point cloud understanding benchmarks, including 3D point cloud segmentation on ScanNet v2 and S3DIS and 3D point cloud classification on ModelNet40. Our code will be available at https://github.com/Gofinge/PointTransformerV2.


title: Human Body Measurement Estimation with Adversarial Augmentation

abstract: We present a Body Measurement network (BMnet) for estimating 3D anthropomorphic measurements of the human body shape from silhouette images. Training of BMnet is performed on data from real human subjects, and augmented with a novel adversarial body simulator (ABS) that finds and synthesizes challenging body shapes. ABS is based on the skinned multiperson linear (SMPL) body model, and aims to maximize BMnet measurement prediction error with respect to latent SMPL shape parameters. ABS is fully differentiable with respect to these parameters, and trained end-to-end via backpropagation with BMnet in the loop. Experiments show that ABS effectively discovers adversarial examples, such as bodies with extreme body mass indices (BMI), consistent with the rarity of extreme-BMI bodies in BMnet's training set. Thus ABS is able to reveal gaps in training data and potential failures in predicting under-represented body shapes. Results show that training BMnet with ABS improves measurement prediction accuracy on real bodies by up to 10%, when compared to no augmentation or random body shape sampling. Furthermore, our method significantly outperforms SOTA measurement estimation methods by as much as 3x. Finally, we release BodyM, the first challenging, large-scale dataset of photo silhouettes and body measurements of real human subjects, to further promote research in this area. Project website: https://adversarialbodysim.github.io


title: Understanding Embodied Reference with Touch-Line Transformer

abstract: We study embodied reference understanding, the task of locating referents using embodied gestural signals and language references. Human studies have revealed that objects referred to or pointed to do not lie on the elbow-wrist line, a common misconception; instead, they lie on the so-called virtual touch line. However, existing human pose representations fail to incorporate the virtual touch line. To tackle this problem, we devise the touch-line transformer: It takes as input tokenized visual and textual features and simultaneously predicts the referent's bounding box and a touch-line vector. Leveraging this touch-line prior, we further devise a geometric consistency loss that encourages the co-linearity between referents and touch lines. Using the touch-line as gestural information improves model performances significantly. Experiments on the YouRefIt dataset show our method achieves a +25.0% accuracy improvement under the 0.75 IoU criterion, closing 63.6% of the gap between model and human performances. Furthermore, we computationally verify prior human studies by showing that computational models more accurately locate referents when using the virtual touch line than when using the elbow-wrist line.


title: A generic diffusion-based approach for 3D human pose prediction in the wild

abstract: Predicting 3D human poses in real-world scenarios, also known as human pose forecasting, is inevitably subject to noisy inputs arising from inaccurate 3D pose estimations and occlusions. To address these challenges, we propose a diffusion-based approach that can predict given noisy observations. We frame the prediction task as a denoising problem, where both observation and prediction are considered as a single sequence containing missing elements (whether in the observation or prediction horizon). All missing elements are treated as noise and denoised with our conditional diffusion model. To better handle long-term forecasting horizon, we present a temporal cascaded diffusion model. We demonstrate the benefits of our approach on four publicly available datasets (Human3.6M, HumanEva-I, AMASS, and 3DPW), outperforming the state-of-the-art. Additionally, we show that our framework is generic enough to improve any 3D pose prediction model as a pre-processing step to repair their inputs and a post-processing step to refine their outputs. The code is available online: \url{https://github.com/vita-epfl/DePOSit}.


title: General relativistic simulations of collapsing binary neutron star mergers with Monte-Carlo neutrino transport

abstract: Recent gravitational wave observations of neutron star-neutron star and neutron star-black hole binaries appear to indicate that massive neutron stars may not be too uncommon in merging systems. In this manuscript, we present a first set of evolution of massive neutron star binaries using Monte-Carlo radiation transport for the evolution of neutrinos. We study a range of systems, from nearly symmetric binaries that collapse to a black hole before forming a disk or ejecting material, to more asymmetric binaries in which tidal disruption of the lower mass star leads to the production of more interesting post-merger remnants. For the latter type of systems, we additionally study the impact of viscosity on the properties of the outflows, and compare our results to two recent simulations of identical binaries performed with the WhiskyTHC code. We find agreement on the black hole properties, disk mass, and mass and velocity of the outflows within expected numerical uncertainties, and some minor but noticeable differences in the evolution of the electron fraction when using a subgrid viscosity model, with viscosity playing a more minor role in our simulations. The method used to account for r-process heating in the determination of the outflow properties appears to have a larger impact on our result than those differences between numerical codes. We also use the simulation with the most ejected material to verify that our newly implemented Lagrangian tracers provide a reasonable sampling of the matter outflows as they leave the computational grid. We note that, given the lack of production of hot outflows in these mergers, the main role of neutrinos in these systems is to set the composition of the post-merger remnant. One of the main potential use of our simulations is thus as improved initial conditions for longer evolutions of such remnants.


title: iMedBot: A Web-based Intelligent Agent for Healthcare Related Prediction and Deep Learning

abstract: Background: Breast cancer is a multifactorial disease, genetic and environmental factors will affect its incidence probability. Breast cancer metastasis is one of the main cause of breast cancer related deaths reported by the American Cancer Society (ACS). Method: the iMedBot is a web application that we developed using the python Flask web framework and deployed on Amazon Web Services. It contains a frontend and a backend. The backend is supported by a python program we developed using the python Keras and scikit-learn packages, which can be used to learn deep feedforward neural network (DFNN) models. Result: the iMedBot can provide two main services: 1. it can predict 5-, 10-, or 15-year breast cancer metastasis based on a set of clinical information provided by a user. The prediction is done by using a set of DFNN models that were pretrained, and 2. It can train DFNN models for a user using user-provided dataset. The model trained will be evaluated using AUC and both the AUC value and the AUC ROC curve will be provided. Conclusion: The iMedBot web application provides a user-friendly interface for user-agent interaction in conducting personalized prediction and model training. It is an initial attempt to convert results of deep learning research into an online tool that may stir further research interests in this direction. Keywords: Deep learning, Breast Cancer, Web application, Model training.


title: Interpretable AI for relating brain structural and functional connectomes

abstract: One of the central problems in neuroscience is understanding how brain structure relates to function. Naively one can relate the direct connections of white matter fiber tracts between brain regions of interest (ROIs) to the increased co-activation in the same pair of ROIs, but the link between structural and functional connectomes (SCs and FCs) has proven to be much more complex. To learn a realistic generative model characterizing population variation in SCs, FCs, and the SC-FC coupling, we develop a graph auto-encoder that we refer to as Staf-GATE. We trained Staf-GATE with data from the Human Connectome Project (HCP) and show state-of-the-art performance in predicting FC and joint generation of SC and FC. In addition, as a crucial component of the proposed approach, we provide a masking-based algorithm to extract interpretable inferences about SC-FC coupling. Our interpretation methods identified important SC subnetworks for FC coupling and relating SC and FC with sex.


title: Performance Deterioration of Deep Learning Models after Clinical Deployment: A Case Study with Auto-segmentation for Definitive Prostate Cancer Radiotherapy

abstract: We evaluated the temporal performance of a deep learning (DL) based artificial intelligence (AI) model for auto segmentation in prostate radiotherapy, seeking to correlate its efficacy with changes in clinical landscapes. Our study involved 1328 prostate cancer patients who underwent definitive radiotherapy from January 2006 to August 2022 at the University of Texas Southwestern Medical Center. We trained a UNet based segmentation model on data from 2006 to 2011 and tested it on data from 2012 to 2022 to simulate real world clinical deployment. We measured the model performance using the Dice similarity coefficient (DSC), visualized the trends in contour quality using exponentially weighted moving average (EMA) curves. Additionally, we performed Wilcoxon Rank Sum Test to analyze the differences in DSC distributions across distinct periods, and multiple linear regression to investigate the impact of various clinical factors. The model exhibited peak performance in the initial phase (from 2012 to 2014) for segmenting the prostate, rectum, and bladder. However, we observed a notable decline in performance for the prostate and rectum after 2015, while bladder contour quality remained stable. Key factors that impacted the prostate contour quality included physician contouring styles, the use of various hydrogel spacer, CT scan slice thickness, MRI-guided contouring, and using intravenous (IV) contrast. Rectum contour quality was influenced by factors such as slice thickness, physician contouring styles, and the use of various hydrogel spacers. The bladder contour quality was primarily affected by using IV contrast. This study highlights the challenges in maintaining AI model performance consistency in a dynamic clinical setting. It underscores the need for continuous monitoring and updating of AI models to ensure their ongoing effectiveness and relevance in patient care.


title: Semi-supervised detection of structural damage using Variational Autoencoder and a One-Class Support Vector Machine

abstract: In recent years, Artificial Neural Networks (ANNs) have been introduced in Structural Health Monitoring (SHM) systems. A semi-supervised method with a data-driven approach allows the ANN training on data acquired from an undamaged structural condition to detect structural damages. In standard approaches, after the training stage, a decision rule is manually defined to detect anomalous data. However, this process could be made automatic using machine learning methods, whom performances are maximised using hyperparameter optimization techniques. The paper proposes a semi-supervised method with a data-driven approach to detect structural anomalies. The methodology consists of: (i) a Variational Autoencoder (VAE) to approximate undamaged data distribution and (ii) a One-Class Support Vector Machine (OC-SVM) to discriminate different health conditions using damage sensitive features extracted from VAE's signal reconstruction. The method is applied to a scale steel structure that was tested in nine damage's scenarios by IASC-ASCE Structural Health Monitoring Task Group.


title: Transformers generalize differently from information stored in context vs in weights

abstract: Transformer models can use two fundamentally different kinds of information: information stored in weights during training, and information provided ``in-context'' at inference time. In this work, we show that transformers exhibit different inductive biases in how they represent and generalize from the information in these two sources. In particular, we characterize whether they generalize via parsimonious rules (rule-based generalization) or via direct comparison with observed examples (exemplar-based generalization). This is of important practical consequence, as it informs whether to encode information in weights or in context, depending on how we want models to use that information. In transformers trained on controlled stimuli, we find that generalization from weights is more rule-based whereas generalization from context is largely exemplar-based. In contrast, we find that in transformers pre-trained on natural language, in-context learning is significantly rule-based, with larger models showing more rule-basedness. We hypothesise that rule-based generalization from in-context information might be an emergent consequence of large-scale training on language, which has sparse rule-like structure. Using controlled stimuli, we verify that transformers pretrained on data containing sparse rule-like structure exhibit more rule-based generalization.


title: Towards Consistency and Complementarity: A Multiview Graph Information Bottleneck Approach

abstract: The empirical studies of Graph Neural Networks (GNNs) broadly take the original node feature and adjacency relationship as singleview input, ignoring the rich information of multiple graph views. To circumvent this issue, the multiview graph analysis framework has been developed to fuse graph information across views. How to model and integrate shared (i.e. consistency) and view-specific (i.e. complementarity) information is a key issue in multiview graph analysis. In this paper, we propose a novel Multiview Variational Graph Information Bottleneck (MVGIB) principle to maximize the agreement for common representations and the disagreement for view-specific representations. Under this principle, we formulate the common and view-specific information bottleneck objectives across multiviews by using constraints from mutual information. However, these objectives are hard to directly optimize since the mutual information is computationally intractable. To tackle this challenge, we derive variational lower and upper bounds of mutual information terms, and then instead optimize variational bounds to find the approximate solutions for the information objectives. Extensive experiments on graph benchmark datasets demonstrate the superior effectiveness of the proposed method.


title: Application of Deep Learning on Single-Cell RNA-sequencing Data Analysis: A Review

abstract: Single-cell RNA-sequencing (scRNA-seq) has become a routinely used technique to quantify the gene expression profile of thousands of single cells simultaneously. Analysis of scRNA-seq data plays an important role in the study of cell states and phenotypes, and has helped elucidate biological processes, such as those occurring during development of complex organisms and improved our understanding of disease states, such as cancer, diabetes, and COVID, among others. Deep learning, a recent advance of artificial intelligence that has been used to address many problems involving large datasets, has also emerged as a promising tool for scRNA-seq data analysis, as it has a capacity to extract informative, compact features from noisy, heterogeneous, and high-dimensional scRNA-seq data to improve downstream analysis. The present review aims at surveying recently developed deep learning techniques in scRNA-seq data analysis, identifying key steps within the scRNA-seq data analysis pipeline that have been advanced by deep learning, and explaining the benefits of deep learning over more conventional analysis tools. Finally, we summarize the challenges in current deep learning approaches faced within scRNA-seq data and discuss potential directions for improvements in deep algorithms for scRNA-seq data analysis.


title: Spectral Evolution of Ultraluminous X-ray Pulsar NGC 300 ULX-1

abstract: We report on results from a one-year soft X-ray observing campaign of the ultraluminous X-ray pulsar NGC 300 ULX-1 by the Neutron star Interior Composition Explorer (NICER) during 2018--2019. Our analysis also made use of data from Swift/XRT and XMM-Newton in order to model and remove contamination from the nearby eclipsing X-ray binary NGC 300 X-1. We constructed and fitted a series of 5-day averaged NICER spectra of NGC 300 ULX-1 in the 0.4--4.0 keV range to evaluate the long-term spectral evolution of the source, and found that an absorbed power-law model provided the best fit overall. Over the course of our observations, the source flux (0.4--4.0 keV; absorbed) dimmed from $2\times10^{-12}$ to below $10^{-13}{\rm\,erg\,s^{-1}\,cm^{-2}}$ and the spectrum softened, with the photon index going from $\Gamma\approx1.6$ to $\Gamma\approx2.6$. We interpret the spectral softening as reprocessed emission from the accretion disk edge coming into view while the pulsar was obscured by the possibly precessing disk. Some spectral fits were significantly improved by the inclusion of a disk blackbody component, and we surmise that this could be due to the pulsar emerging in between obscuration episodes by partial covering absorbers. We posit that we observed a low-flux state of the system (due to line-of-sight absorption) punctuated by the occasional appearance of the pulsar, indicating short-term source variability nested in longer-term accretion disk precession timescales.


title: Ironing the folds: The phase space chevrons of a GSE-like merger as a dark matter subhalo detector

abstract: Recent work uncovered features in the phase space of the Milky Way's stellar halo which may be attributed to the last major merger. When stellar material from a satellite is accreted onto its host, it phase mixes and appears finely substructured in phase space. For a high-eccentricity merger, this substructure most clearly manifests as numerous wrapping chevrons in $(v_r, r)$ space, corresponding to stripes in $(E, \theta_r)$ space. We introduce the idea of using this substructure as an alternative subhalo detector to cold stellar streams. We simulate an N-body merger akin to the GSE and assess the impact of subhaloes on these chevrons. We examine how their deformation depends on the mass, pericentre, and number of subhaloes. To quantify the impact of perturbers, we utilise the appearance of chevrons in $(E, \theta_r)$ space to introduce a new quantity -- the ironing parameter. We show that: (1) a single flyby of a massive ($\sim 10^{10}$ M$_{\odot}$) subhalo with pericentre comparable to, or within, the shell's apocentre smooths out the substructure, (2) a single flyby of a low mass ($\lesssim 10^8$ M$_{\odot}$) has negligible effect, (3) multiple flybys of subhalos derived from a subhalo mass function between $10^7-10^{10}$ M$_{\odot}$ cause significant damage if deep within the potential, (4) the effects of known perturbers (e.g. Sagittarius) should be detectable and offer constraints on their initial mass. The sensitivity to the populations of subhaloes suggests that we should be able to place an upper limit on the Milky Way's subhalo mass function.


title: Electroweak Asymmetric Early Universe via a Scalar Condensate

abstract: Finite temperature effects in the Standard Model tend to restore the electroweak symmetry in the early universe, but new fields coupled to the higgs field may as well reverse this tendency, leading to the so-called electroweak symmetry non-restoration (EW SNR) scenario. Previous works on EW SNR often assume that the reversal is due to the thermal fluctuations of new fields with negative quartic couplings to the higgs, and they tend to find that a large number of new fields are required. We observe that EW SNR can be minimally realized if the field(s) coupled to the higgs field develop(s) a stable condensate. We show that one complex scalar field with a sufficiently large global-charge asymmetry can develop a condensate as an outcome of thermalization and keep the electroweak symmetry broken up to temperatures well above the electroweak scale. In addition to providing a minimal benchmark model, our work hints on a class of models involving scalar condensates that yield electroweak symmetry non-restoration in the early universe.


title: Entanglement transitions with free fermions

abstract: We use Majorana operators to study entanglement dynamics under random free fermion unitary evolution and projective measurements in one dimension. For certain choices of unitary evolution, namely those which swap neighboring Majorana operators, and measurements of neighboring Majorana bilinears, one can map the evolution to the statistical model of completely packed loops with crossings (CPLC) and study the corresponding phase diagram. We generalize this model using the language of fermionic Gaussian states to a general free fermion unitary evolution acting on neighboring Majorana operators, and numerically compute its phase diagram. We find that both the Goldstone and area law phases persist in this new phase diagram, but with a shifted phase boundary. One important qualitative aspect of the new phase boundary is that even for the case of commuting measurements, the Goldstone phase persists up to a finite non-zero measurement rate. This is in contrast with the CPLC, in which non-commuting measurements are necessary for realizing the Goldstone phase. We also numerically compute the correlation length critical exponent at the transition, which we find to be near to that of the CPLC, and give a tentative symmetry based explanation for some differences in the phase transition line between the CPLC and generalized models.


title: A general relativistic extension to mesh-free methods for hydrodynamics

abstract: The detection of gravitational waves has opened a new era for astronomy, allowing for the combined use of gravitational wave and electromagnetic emissions to directly probe the physics of compact objects, still poorly understood. So far, the theoretical modelling of these sources has mainly relied on standard numerical techniques as grid-based methods or smoothed particle hydrodynamics, with only a few recent attempts at using new techniques as moving-mesh schemes. Here, we introduce a general relativistic extension to the mesh-less hydrodynamic schemes in the code GIZMO, which benefits from the use of Riemann solvers and at the same time perfectly conserves angular momentum thanks to a generalised leap-frog integration scheme. We benchmark our implementation against many standard tests for relativistic hydrodynamics, either in one or three dimensions, and also test the ability to preserve the equilibrium solution of a Tolman-Oppenheimer-Volkoff compact star. In all the presented tests, the code performs extremely well, at a level at least comparable to other numerical techniques.


title: Cold gas mass measurements for the era of large optical spectroscopic surveys

abstract: Gas plays an important role in many processes in galaxy formation and evolution, but quantifying the importance of gas has been hindered by the challenge to measure gas masses for large samples of galaxies. Datasets of direct atomic and molecular gas measurements are sufficient to establish simple scaling relations, but often not large enough to quantify three-parameter relations, or second order dependencies. As an alternative approach, we derive here indirect cold gas measurements from optical emission lines using photoionization models for galaxies in the SDSS main galaxy sample and the PHANGS-MUSE survey. We calibrate the gas surface density measurements using xCOLD GASS and PHANGS-ALMA molecular gas measurements to ensure our measurements are reliable. We demonstrate the importance of taking into account the scale-dependence of the relation between optical depth ($\tau_V$) and gas surface density ($\Sigma_{gas}$) and provide a general prescription to estimate $\Sigma_{gas}$ from $\tau_V$, metallicity and the dust-to-metal ratio, at any arbitrary physical resolution. To demonstrate that the indirect cold gas masses are accurate enough to quantify the role of gas in galaxy evolution, we study the mass-metallicity relation (MZR) of SDSS galaxies and show that as a third parameter, gas mass is better than SFR at reducing the scatter of the relation, as predicted by models and simulations.


title: BICEP / Keck XVI: Characterizing Dust Polarization through Correlations with Neutral Hydrogen

abstract: We characterize Galactic dust filaments by correlating BICEP/Keck and Planck data with polarization templates based on neutral hydrogen (H I) observations. Dust polarization is important for both our understanding of astrophysical processes in the interstellar medium (ISM) and the search for primordial gravitational waves in the cosmic microwave background (CMB). In the diffuse ISM, H I is strongly correlated with the dust and partly organized into filaments that are aligned with the local magnetic field. We analyze the deep BICEP/Keck data at 95, 150, and 220 GHz, over the low-column-density region of sky where BICEP/Keck has set the best limits on primordial gravitational waves. We separate the H I emission into distinct velocity components and detect dust polarization correlated with the local Galactic H I but not with the H I associated with Magellanic Stream I. We present a robust, multifrequency detection of polarized dust emission correlated with the filamentary H I morphology template down to 95 GHz. For assessing its utility for foreground cleaning, we report that the H I morphology template correlates in B modes at a $\sim$10-65$\%$ level over the multipole range $20 < \ell < 200$ with the BICEP/Keck maps, which contain contributions from dust, CMB, and noise components. We measure the spectral index of the filamentary dust component spectral energy distribution to be $\beta = 1.54 \pm 0.13$. We find no evidence for decorrelation in this region between the filaments and the rest of the dust field or from the inclusion of dust associated with the intermediate velocity H I. Finally, we explore the morphological parameter space in the H I-based filamentary model.


title: Starburst Nuclei as Light Dark Matter Laboratories

abstract: Starburst galaxies are well-motivated astrophysical emitters of high-energy gamma-rays. They are well-known cosmic-ray "reservoirs", thanks to their large magnetic fields which confine high-energy protons for $\sim 10^5$ years. Over such long times, cosmic-ray transport can be significantly affected by scatterings with sub-GeV dark matter. Here we point out that this scattering distorts the cosmic-ray spectrum, and the distortion can be indirectly observed by measuring the gamma-rays produced by cosmic-rays via hadronic collisions. Present gamma-ray data show no sign of such a distortion, leading to stringent bounds on the cross section between protons and dark matter. These are highly complementary with current bounds and have large room for improvement with the future gamma-ray measurements in the 0.1-10 TeV range from the Cherenkov Telescope Array, which can strengthen the limits by as much as two orders of magnitude.


title: Neural Importance Sampling for Rapid and Reliable Gravitational-Wave Inference

abstract: We combine amortized neural posterior estimation with importance sampling for fast and accurate gravitational-wave inference. We first generate a rapid proposal for the Bayesian posterior using neural networks, and then attach importance weights based on the underlying likelihood and prior. This provides (1) a corrected posterior free from network inaccuracies, (2) a performance diagnostic (the sample efficiency) for assessing the proposal and identifying failure cases, and (3) an unbiased estimate of the Bayesian evidence. By establishing this independent verification and correction mechanism we address some of the most frequent criticisms against deep learning for scientific inference. We carry out a large study analyzing 42 binary black hole mergers observed by LIGO and Virgo with the SEOBNRv4PHM and IMRPhenomXPHM waveform models. This shows a median sample efficiency of $\approx 10\%$ (two orders-of-magnitude better than standard samplers) as well as a ten-fold reduction in the statistical uncertainty in the log evidence. Given these advantages, we expect a significant impact on gravitational-wave inference, and for this approach to serve as a paradigm for harnessing deep learning methods in scientific applications.


title: Gravitational Multipoles in General Stationary Spacetimes

abstract: The Geroch-Hansen and Thorne (ACMC) formalisms give rigorous and equivalent definitions for gravitational multipoles in stationary vacuum spacetimes. However, despite their ubiquitous use in gravitational physics, it has not been shown that these formalisms can be generalized to non-vacuum stationary solutions, except in a few special cases. This paper shows how the Geroch-Hansen formalism can be generalized to arbitrary non-vacuum stationary spacetimes for metrics that are sufficiently smooth at infinity. The key is the construction of an improved twist vector, which is well-defined under a mild topological condition on the spacetime (which is automatically satisfied for black holes). Ambiguities in the construction of this improved twist vector are discussed and fixed by imposing natural gauge fixing conditions, which also immediately lead to the equivalence between the Geroch-Hansen and Thorne formalisms for such arbitrary stationary spacetimes.


title: The first r-process enhanced star confirmed to be a member of the Galactic bulge

abstract: Aims. Stars with strong enhancements of r-process elements are rare and tend to be metal-poor, with generally [Fe/H] <-2 dex and found in the halo. In this work we aim to investigate a candidate r-process enriched bulge star with a relatively high metallicity of -0.65 dex, and compare it with a previously published r-rich candidate star in the bulge. Methods. We reconsider the abundance analysis of a high-resolution optical spectrum of the red-giant star 2MASS J18082459-2548444 and determine its europium (Eu) and molybdenum (Mo) abundance, using stellar parameters from five different previous studies. Applying 2MASS photometry, Gaia astrometry and kinematics, we estimate distance, orbits, and population membership of 2MASS J18082459-2548444 and a previously reported r-enriched star 2MASS J18174532-3353235. Results. We find that 2MASS J18082459-2548444 is a relatively metal rich enriched r-process star that is enhanced in Eu and Mo but not substantially enhanced in s-process elements. It has a high probability of membership in the Galactic bulge based on its distance and orbit. We find that both stars show r-process enhancement with elevated [Eu/Fe]-values, even though 2MASS J18174532-3353235 is 1 dex lower in metallicity. Additionally, we find that 2MASS J18174532-3353235 plausibly has a halo or thick disc origin. Conclusions. We conclude that 2MASS J18082459-2548444 represents the first example of a confirmed r-process enhanced star confined to the inner bulge, possibly a relic from a period of enrichment associated with the formation of the bar.