title: Characterizing planetary systems with SPIRou: a temperate sub-Neptune exoplanet orbiting the nearby fully-convective star GJ 1289 and a candidate around GJ 3378

abstract: We report the discovery of two new exoplanet systems around fully convective stars, found from the radial-velocity (RV) variations of their host stars measured with the nIR spectropolarimeter CFHT/SPIRou over multiple years. GJ 3378 b is a planet with minimum mass of $5.26^{+0.94}_{-0.97}$ Mearth in an eccentric 24.73-day orbit around an M4V star of 0.26 Msun. GJ 1289 b has a minimum mass of $6.27\pm1.25$ Mearth in a 111.74-day orbit, in a circular orbit around an M4.5V star of mass 0.21 Msun. Both stars are in the solar neighbourhood, at respectively 7.73 and 8.86 pc. The low-amplitude RV signals are detected after line-by-line post-processing treatment. These potential sub-Neptune class planets around cool stars may have temperate atmospheres and be interesting nearby systems for further studies. We also recovered the large-scale magnetic field of both stars, found to be mostly axisymmetric and dipolar, and with a polar strength of 20-30 G and 200-240 G for GJ 3378 (in 2019-21) and GJ 1289 (in 2022-23), respectively. The rotation periods measured with the magnetic field differ from the orbital periods, and in general, stellar activity is not seen in the studied nIR RV time series of both stars. GJ 3378 b detection is not confirmed by optical RVs and is therefore considered a candidate at this point.


title: Finite monodromy of some two-parameter families of exponential sums

abstract: We determine the set of polynomials $f(x)\in k[x]$, where $k$ is a finite field, such that the local system on $\mathbb G_m^2$ which parametrizes the family of exponential sums $(s,t)\mapsto\sum_{x\in k}\psi(sf(x)+tx)$ has finite monodromy, in two cases: when $f(x)=x^d+\lambda x^e$ is a binomial and when $f(x)=(x-\alpha)^d(x-\beta)^e$ is of Belyi type.


title: Magnetic Field Tolerant Superconducting Spiral Resonators for Circuit QED

abstract: We present spiral resonators of thin film niobium (Nb) that exhibit large geometric inductance, high critical magnetic fields and high single photon quality factors. These low loss geometric inductors can be a compelling alternative to kinetic inductors to create high-impedance superconducting devices for applications that require magnetic fields. By varying the spiral pitch, we realize resonators with characteristic impedances ranging from 3.25-7.09 k{\Omega}. We measure the temperature and magnetic field dependent losses and find that the high-impedance resonators maintain an intrinsic quality factor above {\sim} 10^5 for parallel magnetic fields of up to 1 T. These properties make spiral Nb resonators a promising candidate for quantum devices that require circuit elements with high impedance and magnetic field resilience.


title: Green's function approach to interacting lattice polaritons and optical nonlinearities in subwavelength arrays of quantum emitters

abstract: Sub-wavelength arrays of quantum emitters offer an efficient free-space approach to coherent light-matter interfacing, using ultracold atoms or two-dimensional solid-state quantum materials. The combination of collectively suppressed photon-losses and emerging optical nonlinearities due to strong photon-coupling to mesoscopic numbers of emitters holds promise for generating nonclassical light and engineering effective interactions between freely propagating photons. While most studies have thus far relied on numerical simulations, we describe here a diagrammatic Green's function approach that permits analytical investigations of nonlinear processes. We illustrate the method by deriving a simple expression for the scattering matrix that describes photon-photon interactions in an extended two-dimensional array of quantum emitters, and reproduces the results of numerical simulations of coherently driven arrays. The approach yields intuitive insights into the nonlinear response of the system and offers a promising framework for a systematic development of a theory for interacting photons and many-body effects on collective radiance in two-dimensional arrays of quantum emitters.


title: Investigating the Star-forming Sites in the Outer Galactic Arm

abstract: We aim to investigate the global star formation scenario in star-forming sites AFGL 5157, [FSR2007] 0807 (hereafter FSR0807), [HKS2019] E70 (hereafter E70), [KPS2012] MWSC 0620 (hereafter KPS0620), and IRAS 05331+3115 in the outer galactic arm. The distribution of young stellar objects in these sites coincides with a higher extinction and H2 column density, which agrees with the notion that star formation occurs inside the dense molecular cloud cores. We have found two molecular structures at different velocities in this direction; one contains AFGL 5157 and FSR0807, and the other contains E70, [KPS2012] MWSC 0620, and IRAS 05331+3115. All these clusters in our target region are in different evolutionary stages and might form stars through different mechanisms. The E70 cluster seems to be the oldest in our sample; AFGL 5157 and FSR0807 formed later, and KPS0620 and IRAS 05331+3115 are the youngest sites. AFGL 5157 and FSR0807 are physically connected and have cold filamentary structures and dense hub regions. Additionally, the near-infrared photometric analysis shows signatures of massive star formation in these sites. KPS0620 also seems to have cold filamentary structures with the central hub but lacks signatures of massive stars. Our analysis suggests molecular gas flow and the hub filamentary star formation scenario in these regions. IRAS 05331+3115 is a single clump of molecular gas favoring low-mass star formation. Our study suggests that the selected area is a menagerie of star-forming sites where the formation of the stars happens through different processes.


title: A Rao-Blackwellized Particle Filter for Superelliptical Extended Target Tracking

abstract: In this work, we propose a new method to track extended targets of different shapes such as ellipses, rectangles and rhombi. We provide an analytical framework to express these shapes as superelliptical contours and propose a Bayesian filtering scheme that can handle measurements from the contour of the object. The method utilizes the Rao-Blackwellized particle filtering algorithm with novel sensor-object geometry constraints. The success of the algorithm is demonstrated using both simulations and real-data experiments, and the algorithm has been demonstrated to be of high performance in various challenging scenarios.


title: Enhancing ACPF Analysis: Integrating Newton-Raphson Method with Gradient Descent and Computational Graphs

abstract: This paper presents a new method for enhancing Alternating Current Power Flow (ACPF) analysis. The method integrates the Newton-Raphson (NR) method with Enhanced-Gradient Descent (GD) and computational graphs. The integration of renewable energy sources in power systems introduces variability and unpredictability, and this method addresses these challenges. It leverages the robustness of NR for accurate approximations and the flexibility of GD for handling variable conditions, all without requiring Jacobian matrix inversion. Furthermore, computational graphs provide a structured and visual framework that simplifies and systematizes the application of these methods. The goal of this fusion is to overcome the limitations of traditional ACPF methods and improve the resilience, adaptability, and efficiency of modern power grid analyses. We validate the effectiveness of our advanced algorithm through comprehensive testing on established IEEE benchmark systems. Our findings demonstrate that our approach not only speeds up the convergence process but also ensures consistent performance across diverse system states, representing a significant advancement in power flow computation.


title: BEACON: Benchmark for Comprehensive RNA Tasks and Language Models

abstract: RNA plays a pivotal role in translating genetic instructions into functional outcomes, underscoring its importance in biological processes and disease mechanisms. Despite the emergence of numerous deep learning approaches for RNA, particularly universal RNA language models, there remains a significant lack of standardized benchmarks to assess the effectiveness of these methods. In this study, we introduce the first comprehensive RNA benchmark BEACON (\textbf{BE}nchm\textbf{A}rk for \textbf{CO}mprehensive R\textbf{N}A Task and Language Models). First, BEACON comprises 13 distinct tasks derived from extensive previous work covering structural analysis, functional studies, and engineering applications, enabling a comprehensive assessment of the performance of methods on various RNA understanding tasks. Second, we examine a range of models, including traditional approaches like CNNs, as well as advanced RNA foundation models based on language models, offering valuable insights into the task-specific performances of these models. Third, we investigate the vital RNA language model components from the tokenizer and positional encoding aspects. Notably, our findings emphasize the superiority of single nucleotide tokenization and the effectiveness of Attention with Linear Biases (ALiBi) over traditional positional encoding methods. Based on these insights, a simple yet strong baseline called BEACON-B is proposed, which can achieve outstanding performance with limited data and computational resources. The datasets and source code of our benchmark are available at https://github.com/terry-r123/RNABenchmark.


title: Advancing Robot-Assisted Autism Therapy: A Novel Algorithm for Enhancing Joint Attention Interventions

abstract: Recent studies have revealed that using social robots can accelerate the learning process of several skills in areas where autistic children typically show deficits. However, most early research studies conducted interactions via free play. More recent research has demonstrated that robot-mediated autism therapies focusing on core impairments of autism spectrum disorder (e.g., joint attention) yield better results than unstructured interactions. This paper aims to systematically review the most relevant findings concerning the application of social robotics to joint attention tasks, a cardinal feature of autism spectrum disorder that significantly influences the neurodevelopmental trajectory of autistic children. Initially, we define autism spectrum disorder and explore its societal implications. Following this, we examine the need for technological aid and the potentialities of robot-assisted autism therapy. We then define joint attention and highlight its crucial role in children's social and cognitive development. Subsequently, we analyze the importance of structured interactions and the role of selecting the optimal robot for specific tasks. This is followed by a comparative analysis of the works reviewed earlier, presenting an in-depth examination of two distinct formal models employed to design the prompts and reward system that enables the robot to adapt to children's responses. These models are critically compared to highlight their strengths and limitations. Next, we introduce a novel algorithm to address the identified limitations, integrating interactive environmental factors and a more sophisticated prompting and reward system. Finally, we propose further research directions, discuss the most relevant open questions, and draw conclusions regarding the effectiveness of social robotics in the medical treatment of autism spectrum disorders.


title: EWEK-QA: Enhanced Web and Efficient Knowledge Graph Retrieval for Citation-based Question Answering Systems

abstract: The emerging citation-based QA systems are gaining more attention especially in generative AI search applications. The importance of extracted knowledge provided to these systems is vital from both accuracy (completeness of information) and efficiency (extracting the information in a timely manner). In this regard, citation-based QA systems are suffering from two shortcomings. First, they usually rely only on web as a source of extracted knowledge and adding other external knowledge sources can hamper the efficiency of the system. Second, web-retrieved contents are usually obtained by some simple heuristics such as fixed length or breakpoints which might lead to splitting information into pieces. To mitigate these issues, we propose our enhanced web and efficient knowledge graph (KG) retrieval solution (EWEK-QA) to enrich the content of the extracted knowledge fed to the system. This has been done through designing an adaptive web retriever and incorporating KGs triples in an efficient manner. We demonstrate the effectiveness of EWEK-QA over the open-source state-of-the-art (SoTA) web-based and KG baseline models using a comprehensive set of quantitative and human evaluation experiments. Our model is able to: first, improve the web-retriever baseline in terms of extracting more relevant passages (>20\%), the coverage of answer span (>25\%) and self containment (>35\%); second, obtain and integrate KG triples into its pipeline very efficiently (by avoiding any LLM calls) to outperform the web-only and KG-only SoTA baselines significantly in 7 quantitative QA tasks and our human evaluation.


title: The Black Hole Explorer: Preliminary Antenna Design

abstract: We present the basic design of a large, light weight, spaceborne antenna for the Black Hole Explorer (BHEX) space Very Long Baseline Interferometry (space-VLBI) mission, achieving high efficiency operation at mm/sub-mm wavelengths. An introductory overview of the mission and its science background are provided. The BHEX mission targets fundamental black hole physics enabled by the detection of the finely structured image feature around black holes known as the photon ring, theoretically expected due to light orbiting the black hole before reaching the observer. Interferometer baselines much longer than an earth diameter are necessary to attain the spatial resolution required to detect the photon ring, leading to a space component. The science goals require high sensitivity observations at mm/sub-mm wavelengths, placing stringent constraints on antenna performance. The design approach described, seeks to balance the antenna aperture, volume and mass constraints of the NASA Explorers mission opportunity profile and the desired high performance. A 3.5 m aperture with a 40 $\mu$m surface rms is targeted. Currently, a symmetric, dual reflector, axially displaced ellipse (Gregorian ring focus) optical design and metallized carbon fiber reinforced plastic (CFRP) sandwich construction have been chosen to deliver high efficiency and light weight. Further exploration of design choices and parameter space and reflector shaping studies are in progress


title: BrainFounder: Towards Brain Foundation Models for Neuroimage Analysis

abstract: The burgeoning field of brain health research increasingly leverages artificial intelligence (AI) to interpret and analyze neurological data. This study introduces a novel approach towards the creation of medical foundation models by integrating a large-scale multi-modal magnetic resonance imaging (MRI) dataset derived from 41,400 participants in its own. Our method involves a novel two-stage pretraining approach using vision transformers. The first stage is dedicated to encoding anatomical structures in generally healthy brains, identifying key features such as shapes and sizes of different brain regions. The second stage concentrates on spatial information, encompassing aspects like location and the relative positioning of brain structures. We rigorously evaluate our model, BrainFounder, using the Brain Tumor Segmentation (BraTS) challenge and Anatomical Tracings of Lesions After Stroke v2.0 (ATLAS v2.0) datasets. BrainFounder demonstrates a significant performance gain, surpassing the achievements of the previous winning solutions using fully supervised learning. Our findings underscore the impact of scaling up both the complexity of the model and the volume of unlabeled training data derived from generally healthy brains, which enhances the accuracy and predictive capabilities of the model in complex neuroimaging tasks with MRI. The implications of this research provide transformative insights and practical applications in healthcare and make substantial steps towards the creation of foundation models for Medical AI. Our pretrained models and training code can be found at https://github.com/lab-smile/GatorBrain.


title: Spanwise wall forcing can reduce turbulent heat transfer more than drag

abstract: Direct numerical simulations are performed of turbulent forced convection in a channel flow with spanwise wall oscillation, either as a plane oscillation or as a streamwise travelling wave. The friction Reynolds number is fixed at $Re_{\tau_0} = 590$, but the Prandtl number $Pr$ is varied from 0.71 to 20. For $Pr>1$, the heat transfer is reduced by more than the drag, 40% compared to 30% at $Pr=7.5$. This Reynolds analogy breaking is related to the different responses of the velocity and thermal fields to the Stokes layer. It is shown that the Stokes layer near the wall attenuates the large-scale energy of the turbulent heat-flux and the turbulent shear-stress, but amplifies their small-scale energy. At higher Prandtl numbers, the thinning of the conductive sublayer means that the energetic scales of the turbulent heat-flux move closer to the wall, where they are exposed to a stronger Stokes layer production, increasing the contribution of the small-scale energy amplification. A predictive model is derived for the Reynolds and Prandtl number dependence of the heat-transfer reduction based on the scaling of the thermal statistics. The model agrees well with the computations for Prandtl numbers up to 20.


title: Optical sensing of charge and spin current fluctuations in centrosymmetric semiconductors

abstract: We propose a time-resolved optical measurement scheme for sampling transient charge and spin currents in a bulk centrosymmetric semiconductor. The technique relies on emission of second harmonic light triggered by a pulsed below-gap optical excitation and a spontaneous intraband polarization arising from spin or charge motion, mediated by a $\chi^(3)$-based nonlinear optical process. Our proposal uses homodyne amplification to boost the weak second harmonic signal, making it detectable with conventional electronics, calculated for charge current in a room temperature GaAs semiconductor. This all-optical technique requires neither electrical contact nor bias fields and the signal is estimated at a few percent relative to the shot noise of the probe. This proposal motivates a novel method for exploring thermal and quantum fluctuations in the solid state in a non-invasive manner.


title: The codegree isomorphism problem for finite simple groups II

abstract: Let $H$ be a nonabelian finite simple group. Huppert's conjecture asserts that if $G$ is a finite group with the same set of complex character degrees as $H$, then $G\cong H\times A$ for some abelian group $A$. Over the past two decades, several specific cases of this conjecture have been addressed. Recently, attention has shifted to the analogous conjecture for character codegrees: if $G$ has the same set of character codegrees as $H$, then $G\cong H$. Unfortunately, both problems have primarily been examined on a case-by-case basis. In this paper and the companion [HM22], we present a more unified approach to the codegree conjecture and confirm it for several families of simple groups.


title: Reverse engineering control of relative phase and populations of two-level quantum systems

abstract: We consider the simultaneous control of the relative phase and populations of two-level quantum systems by an external field. We apply a reverse engineering approach, which allows obtaining an analytical expression for the control field depending upon two user-defined functions that dictate the population and the relative phase dynamics. We show that, in general, the prescribed functions for the dynamics cannot be chosen arbitrarily. We implement the reverse engineering technique to reach several target states using different kinds of functions to specify the system dynamics. We show that by adjusting these dynamical functions, we can produce different kinds of control fields. These controls can be easily build, needing, apart from the dynamical function themselves, only their derivatives. The methodology presented here will certainly find many applications that go beyond simple two-level systems.


title: Self-Reflection Outcome is Sensitive to Prompt Construction

abstract: Large language models (LLMs) demonstrate impressive zero-shot and few-shot reasoning capabilities. Some propose that such capabilities can be improved through self-reflection, i.e., letting LLMs reflect on their own output to identify and correct mistakes in the initial responses. However, despite some evidence showing the benefits of self-reflection, recent studies offer mixed results. Here, we aim to reconcile these conflicting findings by first demonstrating that the outcome of self-reflection is sensitive to prompt wording; e.g., LLMs are more likely to conclude that it has made a mistake when explicitly prompted to find mistakes. Consequently, idiosyncrasies in reflection prompts may lead LLMs to change correct responses unnecessarily. We show that most prompts used in the self-reflection literature are prone to this bias. We then propose different ways of constructing prompts that are conservative in identifying mistakes and show that self-reflection using such prompts results in higher accuracy. Our findings highlight the importance of prompt engineering in self-reflection tasks. We release our code at https://github.com/Michael98Liu/mixture-of-prompts.


title: Evaluating Speaker Identity Coding in Self-supervised Models and Humans

abstract: Speaker identity plays a significant role in human communication and is being increasingly used in societal applications, many through advances in machine learning. Speaker identity perception is an essential cognitive phenomenon that can be broadly reduced to two main tasks: recognizing a voice or discriminating between voices. Several studies have attempted to identify acoustic correlates of identity perception to pinpoint salient parameters for such a task. Unlike other communicative social signals, most efforts have yielded inefficacious conclusions. Furthermore, current neurocognitive models of voice identity processing consider the bases of perception as acoustic dimensions such as fundamental frequency, harmonics-to-noise ratio, and formant dispersion. However, these findings do not account for naturalistic speech and within-speaker variability. Representational spaces of current self-supervised models have shown significant performance in various speech-related tasks. In this work, we demonstrate that self-supervised representations from different families (e.g., generative, contrastive, and predictive models) are significantly better for speaker identification over acoustic representations. We also show that such a speaker identification task can be used to better understand the nature of acoustic information representation in different layers of these powerful networks. By evaluating speaker identification accuracy across acoustic, phonemic, prosodic, and linguistic variants, we report similarity between model performance and human identity perception. We further examine these similarities by juxtaposing the encoding spaces of models and humans and challenging the use of distance metrics as a proxy for speaker proximity. Lastly, we show that some models can predict brain responses in Auditory and Language regions during naturalistic stimuli.


title: Determination of the Number of Topics Intrinsically: Is It Possible?

abstract: The number of topics might be the most important parameter of a topic model. The topic modelling community has developed a set of various procedures to estimate the number of topics in a dataset, but there has not yet been a sufficiently complete comparison of existing practices. This study attempts to partially fill this gap by investigating the performance of various methods applied to several topic models on a number of publicly available corpora. Further analysis demonstrates that intrinsic methods are far from being reliable and accurate tools. The number of topics is shown to be a method- and a model-dependent quantity, as opposed to being an absolute property of a particular corpus. We conclude that other methods for dealing with this problem should be developed and suggest some promising directions for further research.


title: Hadron-ion collisions in Pythia and the vector-meson dominance model for photoproduction

abstract: We present an extension to the Pythia Monte Carlo event generator that enables simulations of collisions between a generic hadron beam on a nuclear target with energy variation in event-by-event basis. This builds upon Pythia's module for heavy ions, Angantyr, as well as previous work on simulating hadron-proton collisions. As such, the extensions in this work are largely technical, except for a rudimentary model for hadronic fluctuations. With hadron-ion simulations, we implement an explicit vector-meson dominance (VMD) model that can be used to simulate interactions of hadronic component of real photons in photo-nuclear collisions. Such processes can be studied in ultra-peripheral heavy-ion collisions and in the future also with the upcoming Electron-Ion Collider. Our work also has applications to hadronic showers, e.g. air showers initiated by high-energy cosmic rays. We first validate the VMD model by comparing to HERA photoproduction data on proton target. Then we apply this to generate events for ultra-peripheral heavy-ion collisions at the LHC and present the results corresponding to the event-selection criteria matching to a recent ATLAS analysis. We find that single-particle multiplicity and rapidity distributions are well in line with the measured ones. We also construct the Fourier coefficients from two-particle correlations for the simulated events and study whether the resulting azimuthal anisotropies are consistent with the ATLAS results.


title: Solvability of $\binom{2k}{k} = \binom{2a}{a} \binom{x+2b}{b}$

abstract: Suppose $k,x,$ and $b$ are positive integers, and $a$ is a nonnegative integer such that $k=a+b$. In this paper, we will prove $\binom{2k}{k} = \binom{2a}{a} \binom{x+2b}{b}$ if and only if $x=a=1$. We do this by looking at different cases depending on the values of $x$ and $k$. We use varying techniques to prove the cases, such as direct proof, verification through Maple software, and a proof technique found in Moser's paper. Previous results from Hanson, St\u{a}nic\u{a}, Shanta, Shorey and Nair are also used.


title: Correctness is Demanding, Performance is Frustrating

abstract: In this paper we demonstrate a technique for developing high performance applications with strong correctness guarantees. We use a theorem prover to derive a high-level specification of the application that includes correctness invariants of our choice. After that, within the same theorem prover, we implement an extraction of the specified application into a high-performance language of our choice. Concretely, we are using Agda to specify a framework for automatic differentiation (reverse mode) that is focused on index-safe tensors. This framework comes with an optimiser for tensor expressions and the ability to translate these expressions into SaC and C. We specify a canonical convolutional neural network within the proposed framework, compute the derivatives needed for the training phase and then demonstrate that the generated code matches the performance of hand-written code when running on a multi-core machine.


title: Methods of Nonconvex Optimization

abstract: This book is devoted to finite-dimensional problems of non-convex non-smooth optimization and numerical methods for their solution. The problem of nonconvexity is studied in the book on two main models of nonconvex dependencies: these are the so-called generalized differentiable functions and locally Lipschitz functions. Non-smooth functions naturally arise in various applications. In addition, they often appear in the theory of extremal problems itself due to the operations of taking the maximum and minimum, decomposition techniques, exact non-smooth penalties, and duality. The considered models of nonconvexity are quite general and cover the majority of practically important optimization problems; they clearly show all the difficulties of non-convex optimization. The method of studying the generalized differentiable functions is that for these functions a generalization of the concept of gradient is introduced, a calculus is constructed, and various properties of nonconvex problems are studied in terms of generalized gradients. As for numerical methods, it is possible to extend the theory and algorithms of subgradient descent of convex optimization to problems with generalized differentiable functions. Methods for solving Lipschitz problems are characterized by the fact that the original functions are approximated by smoothed ones and iterative minimization procedures are applied to them. With this approach, it is possible to approximate the gradients of smoothed functions by stochastic finite differences and thus to construct methods without calculating gradients. A similar approach can be justified in generalized differentiable and Lipschitz stochastic programming. In these cases, various generalizations of the classical stochastic approximation and stochastic quasi-gradient method are obtained for solving constrained nonconvex nonsmooth stochastic programming problems.


title: Suboptimality bounds for trace-bounded SDPs enable a faster and scalable low-rank SDP solver SDPLR+

abstract: Semidefinite programs (SDPs) and their solvers are powerful tools with many applications in machine learning and data science. Designing scalable SDP solvers is challenging because by standard the positive semidefinite decision variable is an $n \times n$ dense matrix, even though the input is often an $n \times n$ sparse matrix. However, the information in the solution may not correspond to a full-rank dense matrix as shown by Bavinok and Pataki. Two decades ago, Burer and Monterio developed an SDP solver $\texttt{SDPLR}$ that optimizes over a low-rank factorization instead of the full matrix. This greatly decreases the storage cost and works well for many problems. The original solver $\texttt{SDPLR}$ tracks only the primal infeasibility of the solution, limiting the technique's flexibility to produce moderate accuracy solutions. We use a suboptimality bound for trace-bounded SDP problems that enables us to track the progress better and perform early termination. We then develop $\texttt{SDPLR+}$, which starts the optimization with an extremely low-rank factorization and dynamically updates the rank based on the primal infeasibility and suboptimality. This further speeds up the computation and saves the storage cost. Numerical experiments on Max Cut, Minimum Bisection, Cut Norm, and Lov\'{a}sz Theta problems with many recent memory-efficient scalable SDP solvers demonstrate its scalability up to problems with million-by-million decision variables and it is often the fastest solver to a moderate accuracy of $10^{-2}$.


title: Final Search for Short-Baseline Neutrino Oscillations with the PROSPECT-I Detector at HFIR

abstract: The PROSPECT experiment is designed to perform precise searches for antineutrino disappearance at short distances (7 - 9~m) from compact nuclear reactor cores. This Letter reports results from a new neutrino oscillation analysis performed using the complete data sample from the PROSPECT-I detector operated at the High Flux Isotope Reactor in 2018. The analysis uses a multi-period selection of inverse beta decay neutrino interactions with reduced backgrounds and enhanced statistical power to set limits on electron-flavor disappearance caused by mixing with sterile neutrinos with 0.2 - 20 eV$^2$ mass splittings. Inverse beta decay positron energy spectra from six different reactor-detector distance ranges are found to be statistically consistent with one another, as would be expected in the absence of sterile neutrino oscillations. The data excludes at 95% confidence level the existence of sterile neutrinos in regions above 3~eV$^2$ previously unexplored by terrestrial experiments, including all space below 10~eV$^2$ suggested by the recently strengthened Gallium Anomaly. The best-fit point of the Neutrino-4 reactor experiment's claimed observation of short-baseline oscillation is ruled out at more than five standard deviations.


title: Quantum caloric effects

abstract: Quantum thermodynamics aims to explore quantum features to enhance energy conversion beyond classical limits. While significant progress has been made, the understanding of caloric potentials in quantum systems remains incomplete. In this context, this study focuses on deriving general expressions for these caloric potentials by developing a quantum Maxwell relationship obtained from a thermal average form of the Ehrenfest theorem. Our results recover the classical cases and also reveal that the isothermal entropy change can be related to genuine quantum correlations in the system. Thus, this work provides a comprehensive framework for understanding the caloric behavior of quantum systems and their potential applications in caloric devices.


title: Changes in mesoscale convective system precipitation structures in response to a warming climate

abstract: Mesoscale convective systems (MCSs) are crucial components of the hydrological cycle and often produce flash floods. Given their impact, it is crucial to understand how they will change under a warming climate. This study uses a satellite- and radar-based MCS tracking algorithm on convection-permitting climate model simulations and examines changes in MCS properties and precipitation structures between historical and future simulations. An underestimation in MCS total precipitation is evident in historical simulation compared to observations, due to model's depiction of MCS precipitation area and summertime occurrence frequency. Under pseudo-global warming, increases in MCS frequency and total warm season precipitation are observed, most notably in the southern U.S. The precipitation intensity and precipitating area generated by future MCSs also rises and results in an increase in precipitation volume. MCS precipitation structures are further classified into convective core and stratiform regions to understand how change in these structures contributes to future rainfall changes. In a warmer climate, the stratiform region demonstrates minimal change in size, but increases in mean precipitation rate and mean maximum precipitation rate by 15% and 29% are noted, respectively. A more robust future response is observed in the convective core region, with its size, mean precipitation rate and mean maximum precipitation rate increasing significantly by 24%, 37% and 42%, respectively. Finally, by examining the environmental properties of MCS initial condition, future intensification of convective rain may be attributed to a combined effect of substantial increases in atmospheric instability and moisture availability.


title: Tree Search for Simultaneous Move Games via Equilibrium Approximation

abstract: Neural network supported tree-search has shown strong results in a variety of perfect information multi-agent tasks. However, the performance of these methods on partial information games has generally been below competing approaches. Here we study the class of simultaneous-move games, which are a subclass of partial information games which are most similar to perfect information games: both agents know the game state with the exception of the opponent's move, which is revealed only after each agent makes its own move. Simultaneous move games include popular benchmarks such as Google Research Football and Starcraft. In this study we answer the question: can we take tree search algorithms trained through self-play from perfect information settings and adapt them to simultaneous move games without significant loss of performance? We answer this question by deriving a practical method that attempts to approximate a coarse correlated equilibrium as a subroutine within a tree search. Our algorithm works on cooperative, competitive, and mixed tasks. Our results are better than the current best MARL algorithms on a wide range of accepted baseline environments.


title: Characterizing the quantum properties of ultralight dark matter -- an open quantum systems approach

abstract: Obtaining insight into the constituents of dark matter and their interactions with normal matter has inspired a wide range of experimental efforts. Several approaches, particularly those involving searches for ultralight bosonic dark matter (UBDM) fields, involve the use of quantum systems or measurements performed at the limits imposed by quantum mechanics. While a classical treatment of UBDM and its detectors is satisfactory, a fully quantum description would assist in developing future detection strategies. Here, we present an open quantum systems approach that accomplishes this while providing intuition into the quantum nature of the detection process itself. Furthermore, we apply the quantum theory of optical coherence to characterize the statistical properties of the UBDM field. Using representative examples, we show that this theoretical treatment has implications in uncovering signatures of the cosmological production mechanism of the UBDM field and its galactic merger history. By adapting tools from quantum optics, this work will help facilitate the creation of novel methods to extract astrophysically relevant information from correlation measurements.


title: Rotation and H$\alpha$ emission in a young SMC cluster: a spectroscopic view of NGC 330

abstract: We present an analysis of high-resolution optical spectra recorded for 30 stars of the split extended main-sequence turnoff (eMSTO) of the young ($\sim$ 40 Myr) Small Magellanic Cloud (SMC) globular cluster NGC 330. Spectra were obtained with the M2FS and MIKE spectrographs located on the Magellan-Clay 6.5m telescope. These spectra revealed the presence of Be stars, occupying primarily the cool side of the split main sequence (MS). Rotational velocity ($v\sin{i}$) measurements for most of the targets are consistent with the presence of two populations of stars in the cluster: one made up of rapidly rotating Be stars ($<v\sin{i}> \approx 200$ $\rm km\,s^{-1}$), and {the other} consisting of warmer stars with slower rotation ($<\!v\sin{i}\!>\approx50$ $\rm km\,s^{-1}$). Core emission in the H$\delta$ photospheric lines was observed for most of the H$\alpha$ emitters. The shell parameter computed for the targets in our sample indicate that most of the observed stars should have inclinations below 75$^{\circ}$. These results confirm the detection of Be stars obtained through photometry, but also reveal the presence of narrow H$\alpha$ and H$\delta$ features for some targets that cannot be detected with low-resolution spectroscopy or photometry. Asymmetry variability of H$\alpha$ line profiles on the timescales of a few years is also observed, and could provide information on the geometry of the decretion disks. Observations revealed the presence of nebular H$\alpha$ emission, strong enough in faint targets to compromise the extraction of spectra and to impact narrow band photometry used to assess the presence of H$\alpha$ emission.


title: On the Field Isomorphism Problem for the Family of Simplest Quartic Fields

abstract: Deciding whether or not two polynomials have isomoprhic splitting fields over the rationals is the Field Isomorphism Problem. We consider polynomials of the form $f_n(x) = x^4-nx^3-6x^2+nx+1$ with $n \neq 3$ a positive integer and we let $K_n$ denote the splitting field of $f_n(x)$; a `simplest quartic field'. Our main theorem states that under certain hypotheses there can be at most one positive integer $m \neq n$ such that $K_m=K_n$. The proof relies on the existence of squares in recurrent sequences and a result of J.H.E. Cohn [3]. These sequences allow us to establish uniqueness of the splitting field under additional hypotheses in Section (5) and to establish a connection with elliptic curves in Section (6).


title: PRISM: A Design Framework for Open-Source Foundation Model Safety

abstract: The rapid advancement of open-source foundation models has brought transparency and accessibility to this groundbreaking technology. However, this openness has also enabled the development of highly-capable, unsafe models, as exemplified by recent instances such as WormGPT and FraudGPT, which are specifically designed to facilitate criminal activity. As the capabilities of open foundation models continue to grow, potentially outpacing those of closed-source models, the risk of misuse by bad actors poses an increasingly serious threat to society. This paper addresses the critical question of how open foundation model developers should approach model safety in light of these challenges. Our analysis reveals that open-source foundation model companies often provide less restrictive acceptable use policies (AUPs) compared to their closed-source counterparts, likely due to the inherent difficulties in enforcing such policies once the models are released. To tackle this issue, we introduce PRISM, a design framework for open-source foundation model safety that emphasizes Private, Robust, Independent Safety measures, at Minimal marginal cost of compute. The PRISM framework proposes the use of modular functions that moderate prompts and outputs independently of the core language model, offering a more adaptable and resilient approach to safety compared to the brittle reinforcement learning methods currently used for value alignment. By focusing on identifying AUP violations and engaging the developer community in establishing consensus around safety design decisions, PRISM aims to create a safer open-source ecosystem that maximizes the potential of these powerful technologies while minimizing the risks to individuals and society as a whole.


title: Byzantine-Robust Decentralized Federated Learning

abstract: Federated learning (FL) enables multiple clients to collaboratively train machine learning models without revealing their private training data. In conventional FL, the system follows the server-assisted architecture (server-assisted FL), where the training process is coordinated by a central server. However, the server-assisted FL framework suffers from poor scalability due to a communication bottleneck at the server, and trust dependency issues. To address challenges, decentralized federated learning (DFL) architecture has been proposed to allow clients to train models collaboratively in a serverless and peer-to-peer manner. However, due to its fully decentralized nature, DFL is highly vulnerable to poisoning attacks, where malicious clients could manipulate the system by sending carefully-crafted local models to their neighboring clients. To date, only a limited number of Byzantine-robust DFL methods have been proposed, most of which are either communication-inefficient or remain vulnerable to advanced poisoning attacks. In this paper, we propose a new algorithm called BALANCE (Byzantine-robust averaging through local similarity in decentralization) to defend against poisoning attacks in DFL. In BALANCE, each client leverages its own local model as a similarity reference to determine if the received model is malicious or benign. We establish the theoretical convergence guarantee for BALANCE under poisoning attacks in both strongly convex and non-convex settings. Furthermore, the convergence rate of BALANCE under poisoning attacks matches those of the state-of-the-art counterparts in Byzantine-free settings. Extensive experiments also demonstrate that BALANCE outperforms existing DFL methods and effectively defends against poisoning attacks.


title: Enhanced Intrusion Detection System for Multiclass Classification in UAV Networks

abstract: Unmanned Aerial Vehicles (UAVs) have become increasingly popular in various applications, especially with the emergence of 6G systems and networks. However, their widespread adoption has also led to concerns regarding security vulnerabilities, making the development of reliable intrusion detection systems (IDS) essential for ensuring UAVs safety and mission success. This paper presents a new IDS for UAV networks. A binary-tuple representation was used for encoding class labels, along with a deep learning-based approach employed for classification. The proposed system enhances the intrusion detection by capturing complex class relationships and temporal network patterns. Moreover, a cross-correlation study between common features of different UAVs was conducted to discard correlated features that might mislead the classification of the proposed IDS. The full study was carried out using the UAV-IDS-2020 dataset, and we assessed the performance of the proposed IDS using different evaluation metrics. The experimental results highlighted the effectiveness of the proposed multiclass classifier model with an accuracy of 95%.


title: An Adaptive Method for Non-Stationary Stochastic Multi-armed Bandits with Rewards Generated by a Linear Dynamical System

abstract: Online decision-making can be formulated as the popular stochastic multi-armed bandit problem where a learner makes decisions (or takes actions) to maximize cumulative rewards collected from an unknown environment. A specific variant of the bandit problem is the non-stationary stochastic multi-armed bandit problem, where the reward distributions\textemdash which are unknown to the learner\textemdash change over time. This paper proposes to model non-stationary stochastic multi-armed bandits as an unknown stochastic linear dynamical system as many applications, such as bandits for dynamic pricing problems or hyperparameter selection for machine learning models, can benefit from this perspective. Following this approach, we can build a matrix representation of the system's steady-state Kalman filter that takes a set of previously collected observations from a time interval of length $s$ to predict the next reward that will be returned for each action. This paper proposes a solution in which the parameter $s$ is determined via an adaptive algorithm by analyzing the model uncertainty of the matrix representation. This algorithm helps the learner adaptively adjust its model size and its length of exploration based on the uncertainty of its environmental model. The effectiveness of the proposed scheme is demonstrated through extensive numerical studies, revealing that the proposed scheme is capable of increasing the rate of collected cumulative rewards.


title: Learning Flexible Time-windowed Granger Causality Integrating Heterogeneous Interventional Time Series Data

abstract: Granger causality, commonly used for inferring causal structures from time series data, has been adopted in widespread applications across various fields due to its intuitive explainability and high compatibility with emerging deep neural network prediction models. To alleviate challenges in better deciphering causal structures unambiguously from time series, the use of interventional data has become a practical approach. However, existing methods have yet to be explored in the context of imperfect interventions with unknown targets, which are more common and often more beneficial in a wide range of real-world applications. Additionally, the identifiability issues of Granger causality with unknown interventional targets in complex network models remain unsolved. Our work presents a theoretically-grounded method that infers Granger causal structure and identifies unknown targets by leveraging heterogeneous interventional time series data. We further illustrate that learning Granger causal structure and recovering interventional targets can mutually promote each other. Comparative experiments demonstrate that our method outperforms several robust baseline methods in learning Granger causal structure from interventional time series data.


title: Fully Dynamic Strongly Connected Components in Planar Digraphs

abstract: In this paper, we consider maintaining strongly connected components (SCCs) of a directed planar graph subject to edge insertions and deletions. We show a data structure maintaining an implicit representation of the SCCs within $\tilde{O}(n^{6/7})$ worst-case time per update. The data structure supports, in $O(\log^2{n})$ time, reporting vertices of any specified SCC (with constant overhead per reported vertex) and aggregating vertex information (e.g., computing the maximum label) over all the vertices of that SCC. Furthermore, it can maintain global information about the structure of SCCs, such as the number of SCCs or the size of the largest SCC. To the best of our knowledge, no fully dynamic SCCs data structures with sublinear update time have been previously known for any major subclass of digraphs. Our result should be contrasted with the known $n^{1-o(1)}$ amortized update time lower bound conditional on SETH, which holds even for dynamically maintaining whether a general digraph has more than two SCCs.


title: SciEx: Benchmarking Large Language Models on Scientific Exams with Human Expert Grading and Automatic Grading

abstract: With the rapid development of Large Language Models (LLMs), it is crucial to have benchmarks which can evaluate the ability of LLMs on different domains. One common use of LLMs is performing tasks on scientific topics, such as writing algorithms, querying databases or giving mathematical proofs. Inspired by the way university students are evaluated on such tasks, in this paper, we propose SciEx - a benchmark consisting of university computer science exam questions, to evaluate LLMs ability on solving scientific tasks. SciEx is (1) multilingual, containing both English and German exams, and (2) multi-modal, containing questions that involve images, and (3) contains various types of freeform questions with different difficulty levels, due to the nature of university exams. We evaluate the performance of various state-of-the-art LLMs on our new benchmark. Since SciEx questions are freeform, it is not straightforward to evaluate LLM performance. Therefore, we provide human expert grading of the LLM outputs on SciEx. We show that the free-form exams in SciEx remain challenging for the current LLMs, where the best LLM only achieves 59.4\% exam grade on average. We also provide detailed comparisons between LLM performance and student performance on SciEx. To enable future evaluation of new LLMs, we propose using LLM-as-a-judge to grade the LLM answers on SciEx. Our experiments show that, although they do not perform perfectly on solving the exams, LLMs are decent as graders, achieving 0.948 Pearson correlation with expert grading.


title: Phoneme Discretized Saliency Maps for Explainable Detection of AI-Generated Voice

abstract: In this paper, we propose Phoneme Discretized Saliency Maps (PDSM), a discretization algorithm for saliency maps that takes advantage of phoneme boundaries for explainable detection of AI-generated voice. We experimentally show with two different Text-to-Speech systems (i.e., Tacotron2 and Fastspeech2) that the proposed algorithm produces saliency maps that result in more faithful explanations compared to standard posthoc explanation methods. Moreover, by associating the saliency maps to the phoneme representations, this methodology generates explanations that tend to be more understandable than standard saliency maps on magnitude spectrograms.


title: A comprehensive generalization of the Friendship Paradox to weights and attributes

abstract: The Friendship Paradox is a simple and powerful statement about node degrees in a graph (Feld 1991). However, it only applies to undirected graphs with no edge weights, and the only node characteristic it concerns is degree. Since many social networks are more complex than that, it is useful to generalize this phenomenon, if possible, and a number of papers have proposed different generalizations. Here, we unify these generalizations in a common framework, retaining the focus on undirected graphs and allowing for weighted edges and for numeric node attributes other than degree to be considered, since this extension allows for a clean characterization and links to the original concepts most naturally. While the original Friendship Paradox and the Weighted Friendship Paradox hold for all graphs, considering non-degree attributes actually makes the extensions fail around 50% of the time, given random attribute assignment. We provide simple correlation-based rules to see whether an attribute-based version of the paradox holds. In addition to theory, our simulation and data results show how all the concepts can be applied to synthetic and real networks. Where applicable, we draw connections to prior work to make this an accessible and comprehensive paper that lets one understand the math behind the Friendship Paradox and its basic extensions.


title: What is the Visual Cognition Gap between Humans and Multimodal LLMs?

abstract: Recently, Multimodal Large Language Models (MLLMs) have shown great promise in language-guided perceptual tasks such as recognition, segmentation, and object detection. However, their effectiveness in addressing visual cognition problems that require high-level reasoning is not well-established. One such challenge is abstract visual reasoning (AVR) -- the cognitive ability to discern relationships among patterns in a set of images and extrapolate to predict subsequent patterns. This skill is crucial during the early neurodevelopmental stages of children. Inspired by the AVR tasks in Raven's Progressive Matrices (RPM) and Wechsler Intelligence Scale for Children (WISC), we propose a new dataset MaRs-VQA and a new benchmark VCog-Bench containing three datasets to evaluate the zero-shot AVR capability of MLLMs and compare their performance with existing human intelligent investigation. Our comparative experiments with different open-source and closed-source MLLMs on the VCog-Bench revealed a gap between MLLMs and human intelligence, highlighting the visual cognitive limitations of current MLLMs. We believe that the public release of VCog-Bench, consisting of MaRs-VQA, and the inference pipeline will drive progress toward the next generation of MLLMs with human-like visual cognition abilities.


title: Multi-source Unsupervised Domain Adaptation on Graphs with Transferability Modeling

abstract: In this paper, we tackle a new problem of \textit{multi-source unsupervised domain adaptation (MSUDA) for graphs}, where models trained on annotated source domains need to be transferred to the unsupervised target graph for node classification. Due to the discrepancy in distribution across domains, the key challenge is how to select good source instances and how to adapt the model. Diverse graph structures further complicate this problem, rendering previous MSUDA approaches less effective. In this work, we present the framework Selective Multi-source Adaptation for Graph ({\method}), with a graph-modeling-based domain selector, a sub-graph node selector, and a bi-level alignment objective for the adaptation. Concretely, to facilitate the identification of informative source data, the similarity across graphs is disentangled and measured with the transferability of a graph-modeling task set, and we use it as evidence for source domain selection. A node selector is further incorporated to capture the variation in transferability of nodes within the same source domain. To learn invariant features for adaptation, we align the target domain to selected source data both at the embedding space by minimizing the optimal transport distance and at the classification level by distilling the label function. Modules are explicitly learned to select informative source data and conduct the alignment in virtual training splits with a meta-learning strategy. Experimental results on five graph datasets show the effectiveness of the proposed method.


title: Towards Neural Scaling Laws for Foundation Models on Temporal Graphs

abstract: The field of temporal graph learning aims to learn from evolving network data to forecast future interactions. Given a collection of observed temporal graphs, is it possible to predict the evolution of an unseen network from the same domain? To answer this question, we first present the Temporal Graph Scaling (TGS) dataset, a large collection of temporal graphs consisting of eighty-four ERC20 token transaction networks collected from 2017 to 2023. Next, we evaluate the transferability of Temporal Graph Neural Networks (TGNNs) for the temporal graph property prediction task by pre-training on a collection of up to sixty-four token transaction networks and then evaluating the downstream performance on twenty unseen token networks. We find that the neural scaling law observed in NLP and Computer Vision also applies in temporal graph learning, where pre-training on greater number of networks leads to improved downstream performance. To the best of our knowledge, this is the first empirical demonstration of the transferability of temporal graphs learning. On downstream token networks, the largest pre-trained model outperforms single model TGNNs on thirteen unseen test networks. Therefore, we believe that this is a promising first step towards building foundation models for temporal graphs.


title: Adaptive Randomized Smoothing: Certifying Multi-Step Defences against Adversarial Examples

abstract: We propose Adaptive Randomized Smoothing (ARS) to certify the predictions of our test-time adaptive models against adversarial examples. ARS extends the analysis of randomized smoothing using f-Differential Privacy to certify the adaptive composition of multiple steps. For the first time, our theory covers the sound adaptive composition of general and high-dimensional functions of noisy input. We instantiate ARS on deep image classification to certify predictions against adversarial examples of bounded $L_{\infty}$ norm. In the $L_{\infty}$ threat model, our flexibility enables adaptation through high-dimensional input-dependent masking. We design adaptivity benchmarks, based on CIFAR-10 and CelebA, and show that ARS improves accuracy by $2$ to $5\%$ points. On ImageNet, ARS improves accuracy by $1$ to $3\%$ points over standard RS without adaptivity.


title: Synergizing Machine Learning with ACOPF: A Comprehensive Overview

abstract: Alternative current optimal power flow (ACOPF) problems have been studied for over fifty years, and yet the development of an optimal algorithm to solve them remains a hot and challenging topic for researchers because of their nonlinear and nonconvex nature. A number of methods based on linearization and convexification have been proposed to solve to ACOPF problems, which result in near-optimal or local solutions, not optimal solutions. Nowadays, with the prevalence of machine learning, some researchers have begun to utilize this technology to solve ACOPF problems using the historical data generated by the grid operators. The present paper reviews the research on solving ACOPF problems using machine learning and neural networks and proposes future studies. This body of research is at the beginning of this area, and further exploration can be undertaken into the possibilities of solving ACOPF problems using machine learning.


title: Consistency-diversity-realism Pareto fronts of conditional image generative models

abstract: Building world models that accurately and comprehensively represent the real world is the utmost aspiration for conditional image generative models as it would enable their use as world simulators. For these models to be successful world models, they should not only excel at image quality and prompt-image consistency but also ensure high representation diversity. However, current research in generative models mostly focuses on creative applications that are predominantly concerned with human preferences of image quality and aesthetics. We note that generative models have inference time mechanisms - or knobs - that allow the control of generation consistency, quality, and diversity. In this paper, we use state-of-the-art text-to-image and image-and-text-to-image models and their knobs to draw consistency-diversity-realism Pareto fronts that provide a holistic view on consistency-diversity-realism multi-objective. Our experiments suggest that realism and consistency can both be improved simultaneously; however there exists a clear tradeoff between realism/consistency and diversity. By looking at Pareto optimal points, we note that earlier models are better at representation diversity and worse in consistency/realism, and more recent models excel in consistency/realism while decreasing significantly the representation diversity. By computing Pareto fronts on a geodiverse dataset, we find that the first version of latent diffusion models tends to perform better than more recent models in all axes of evaluation, and there exist pronounced consistency-diversity-realism disparities between geographical regions. Overall, our analysis clearly shows that there is no best model and the choice of model should be determined by the downstream application. With this analysis, we invite the research community to consider Pareto fronts as an analytical tool to measure progress towards world models.


title: Challenging the Machine: Contestability in Government AI Systems

abstract: In an October 2023 executive order (EO), President Biden issued a detailed but largely aspirational road map for the safe and responsible development and use of artificial intelligence (AI). The challenge for the January 24-25, 2024 workshop was to transform those aspirations regarding one specific but crucial issue -- the ability of individuals to challenge government decisions made about themselves -- into actionable guidance enabling agencies to develop, procure, and use genuinely contestable advanced automated decision-making systems. While the Administration has taken important steps since the October 2023 EO, the insights garnered from our workshop remain highly relevant, as the requirements for contestability of advanced decision-making systems are not yet fully defined or implemented. The workshop brought together technologists, members of government agencies and civil society organizations, litigators, and researchers in an intensive two-day meeting that examined the challenges that users, developers, and agencies faced in enabling contestability in light of advanced automated decision-making systems. To ensure a free and open flow of discussion, the meeting was held under a modified version of the Chatham House rule. Participants were free to use any information or details that they learned, but they may not attribute any remarks made at the meeting by the identity or the affiliation of the speaker. Thus, the workshop summary that follows anonymizes speakers and their affiliation. Where an identification of an agency, company, or organization is made, it is done from a public, identified resource and does not necessarily reflect statements made by participants at the workshop. This document is a report of that workshop, along with recommendations and explanatory material.


title: P. Jones' interpolation theorem for noncommutative martingale Hardy spaces II

abstract: Let $\mathcal{M}$ be a semifinite von Neumann algebra equipped with an increasing filtration $(\mathcal{M}_n)_{n\geq 1}$ of (semifinite) von Neumann subalgebras of $\mathcal{M}$. For $1\leq p \leq\infty$, let $\mathcal{H}_p^c(\mathcal{M})$ denote the noncommutative column martingale Hardy space constructed from column square functions associated with the filtration $(\mathcal{M}_n)_{n\geq 1}$ and the index $p$. We prove the following real interpolation identity: if $0<\theta<1$ and $1/p=1-\theta$, then \[ \big(\mathcal{H}_1^c(\mathcal{M}), \mathcal{H}_\infty^c(\mathcal{M})\big)_{\theta,p}=\mathcal{H}_p^c(\mathcal{M}). \] This is new even for classical martingale Hardy spaces as it is previously known only under the assumption that the filtration is regular. We also obtain analogous result for noncommutative column martingale Orlicz-Hardy spaces.


title: Enhancing In-Context Learning with Semantic Representations for Relation Extraction

abstract: In this work, we employ two AMR-enhanced semantic representations for ICL on RE: one that explores the AMR structure generated for a sentence at the subgraph level (shortest AMR path), and another that explores the full AMR structure generated for a sentence. In both cases, we demonstrate that all settings benefit from the fine-grained AMR's semantic structure. We evaluate our model on four RE datasets. Our results show that our model can outperform the GPT-based baselines, and achieve SOTA performance on two of the datasets, and competitive performance on the other two.


title: Differentiable Predictive Control for Large-Scale Urban Road Networks

abstract: Transportation is a major contributor to CO2 emissions, making it essential to optimize traffic networks to reduce energy-related emissions. This paper presents a novel approach to traffic network control using Differentiable Predictive Control (DPC), a physics-informed machine learning methodology. We base our model on the Macroscopic Fundamental Diagram (MFD) and the Networked Macroscopic Fundamental Diagram (NMFD), offering a simplified representation of citywide traffic networks. Our approach ensures compliance with system constraints by construction. In empirical comparisons with existing state-of-the-art Model Predictive Control (MPC) methods, our approach demonstrates a 4 order of magnitude reduction in computation time and an up to 37% improvement in traffic performance. Furthermore, we assess the robustness of our controller to scenario shifts and find that it adapts well to changes in traffic patterns. This work proposes more efficient traffic control methods, particularly in large-scale urban networks, and aims to mitigate emissions and alleviate congestion in the future.


title: Risk-Aware Value-Oriented Net Demand Forecasting for Virtual Power Plants

abstract: This paper develops a risk-aware net demand forecasting product for virtual power plants, which helps reduce the risk of high operation costs. At the training phase, a bilevel program for parameter estimation is formulated, where the upper level optimizes over the forecast model parameter to minimize the conditional value-at-risk (a risk metric) of operation costs. The lower level solves the operation problems given the forecast. Leveraging the specific structure of the operation problem, we show that the bilevel program is equivalent to a convex program when the forecast model is linear. Numerical results show that our approach effectively reduces the risk of high costs compared to the forecasting approach developed for risk-neutral decision makers.


title: Impact of repetitive ELM transients on ITER divertor tungsten monoblock top surfaces

abstract: Owing to the high stored energy of ITER plasmas, the heat pulses due to uncontrolled Type I edge localized modes (ELMs) can be sufficient to melt the top surface of several poloidal rows of tungsten monoblocks in the divertor strike point regions. Coupled with the melt motion associated with tungsten in the strong tokamak magnetic fields, the resulting surface damage after even a comparatively small number of such repetitive transients may have a significant impact on long-term stationary power handling capability. The permissible numbers set important boundaries on operation and on the performance required from the plasma control system. Modelling is carried out with the recently updated MEMENTO melt dynamics code, which is tailored to tackle melt motion problems characterized by a vast spatio-temporal scale separation. The crucial role of coupling between surface deformation and shallow angle heat loading in aggravating melt damage is highlighted. As a consequence, the allowable operational space in terms of ELM-induced transient heat loads is history-dependent and once deformation has occurred, weaker heat loads, incapable of melting a pristine surface, can further extend the damage.


title: Effect of the spatial curvature on light bending and time delay in curved Einstein-Straus-de Sitter solution

abstract: A method of general applicability has been developed, whereby the null geodesic equations of the Einstein-Straus-de Sitter metric can be integrated simultaneously in terms of the curvature constant $k$. The purpose is to generalize the computation of light deflection and time delay by a spherical mass distribution. Assuming a flat Universe with most recent measurements of the Hubble constant $H_0$ and the cosmological constant $\Lambda$, five time delays between the four bright images of the lensed quasar SDSS J1004+4112 have been forecasted and compared to others in the field. In addition, we have reviewed the question of the possible contribution of a positive $\Lambda$ to reduce the light bending, and concluded that the changes are seemingly too small to be appreciable on cosmological scales. The same conclusion has been reached regarding the time delay. Having addressed the question of the effect of the spatial curvature in both closed and open Universe, we have found that the strong lensing is slightly affected by the expected small curvature density $\Omega_{k0}$ of the current Universe within its error bar $|\Omega_{k0}|\lessapprox 0.001$, in such a way that it may safely be neglected. However, it's only if $\Omega_{k0}$ gets quite larger that the effect being noticeable. While it is only theoretically possible for $\Omega_{k0}$ to be higher, it's worthwhile to stress that this should impact the light bending and time delay, causing them to decrease or increase depending upon whether the spatial curvature is positive or negative. Furthermore, one can infer that the observed light deflection and time delay independently, that are found to be significantly deviated from those of the flat Universe, may serve as a useful means to provide constraints on $\Omega _{k0}$, thus making the approach employed in this work more promising than others.


title: Learning from landmarks, curves, surfaces, and shapes in Geomstats

abstract: We introduce the shape module of the Python package Geomstats to analyze shapes of objects represented as landmarks, curves and surfaces across fields of natural sciences and engineering. The shape module first implements widely used shape spaces, such as the Kendall shape space, as well as elastic spaces of discrete curves and surfaces. The shape module further implements the abstract mathematical structures of group actions, fiber bundles, quotient spaces and associated Riemannian metrics which allow users to build their own shape spaces. The Riemannian geometry tools enable users to compare, average, interpolate between shapes inside a given shape space. These essential operations can then be leveraged to perform statistics and machine learning on shape data. We present the object-oriented implementation of the shape module along with illustrative examples and show how it can be used to perform statistics and machine learning on shape spaces.


title: A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models

abstract: In this paper, we delve into the statistical analysis of the fitted Q-evaluation (FQE) method, which focuses on estimating the value of a target policy using offline data generated by some behavior policy. We provide a comprehensive theoretical understanding of FQE estimators under both parameteric and nonparametric models on the $Q$-function. Specifically, we address three key questions related to FQE that remain largely unexplored in the current literature: (1) Is the optimal convergence rate for estimating the policy value regarding the sample size $n$ ($n^{-1/2}$) achievable for FQE under a non-parametric model with a fixed horizon ($T$)? (2) How does the error bound depend on the horizon $T$? (3) What is the role of the probability ratio function in improving the convergence of FQE estimators? Specifically, we show that under the completeness assumption of $Q$-functions, which is mild in the non-parametric setting, the estimation errors for policy value using both parametric and non-parametric FQE estimators can achieve an optimal rate in terms of $n$. The corresponding error bounds in terms of both $n$ and $T$ are also established. With an additional realizability assumption on ratio functions, the rate of estimation errors can be improved from $T^{1.5}/\sqrt{n}$ to $T/\sqrt{n}$, which matches the sharpest known bound in the current literature under the tabular setting.


title: A modified DFC method based on full state and periodic gain for stabilization and chaos control

abstract: A novel delayed feedback control based on full state is proposed. The designed scheme combines the difference between two delayed states and a periodic control gain. System stabilization is achieved in any hyperbolic unstable equilibrium point. The procedure to build the control is systematic and, the set of the stabilizing control parameters is rigorously featured by analytical arguments. An ad-hoc strategy based on the proposed scheme is implemented for control of chaos by stabilizing equilibrium points embedded in chaotic attractors. Simulated examples illustrate this strategy performance.


title: Extending class group action attacks via sesquilinear pairings

abstract: We introduce a new tool for the study of isogeny-based cryptography, namely pairings which are sesquilinear (conjugate linear) with respect to the $\mathcal{O}$-module structure of an elliptic curve with CM by an imaginary quadratic order $\mathcal{O}$. We use these pairings to study the security of problems based on the class group action on collections of oriented ordinary or supersingular elliptic curves. This extends work of both (Castryck, Houben, Merz, Mula, Buuren, Vercauteren, 2023) and (De Feo, Fouotsa, Panny, 2024).


title: Machine Learning Methods for Large Population Games with Applications in Operations Research

abstract: In this tutorial, we provide an introduction to machine learning methods for finding Nash equilibria in games with large number of agents. These types of problems are important for the operations research community because of their applicability to real life situations such as control of epidemics, optimal decisions in financial markets, electricity grid management, or traffic control for self-driving cars. We start the tutorial by introducing stochastic optimal control problems for a single agent, in discrete time and in continuous time. Then, we present the framework of dynamic games with finite number of agents. To tackle games with a very large number of agents, we discuss the paradigm of mean field games, which provides an efficient way to compute approximate Nash equilibria. Based on this approach, we discuss machine learning algorithms for such problems. First in the context of discrete time games, we introduce fixed point based methods and related methods based on reinforcement learning. Second, we discuss machine learning methods that are specific to continuous time problems, by building on optimality conditions phrased in terms of stochastic or partial differential equations. Several examples and numerical illustrations of problems arising in operations research are provided along the way.


title: Domain-Specific Shorthand for Generation Based on Context-Free Grammar

abstract: The generation of structured data in formats such as JSON, YAML and XML is a critical task in Generative AI (GenAI) applications. These formats, while widely used, contain many redundant constructs that lead to inflated token usage. This inefficiency is particularly evident when employing large language models (LLMs) like GPT-4, where generating extensive structured data incurs increased latency and operational costs. We introduce a domain-specific shorthand (DSS) format, underpinned by a context-free grammar (CFG), and demonstrate its usage to reduce the number of tokens required for structured data generation. The method involves creating a shorthand notation that captures essential elements of the output schema with fewer tokens, ensuring it can be unambiguously converted to and from its verbose form. It employs a CFG to facilitate efficient shorthand generation by the LLM, and to create parsers to translate the shorthand back into standard structured formats. The application of our approach to data visualization with LLMs demonstrates a significant (3x to 5x) reduction in generated tokens, leading to significantly lower latency and cost. This paper outlines the development of the DSS and the accompanying CFG, and the implications of this approach for GenAI applications, presenting a scalable solution to the token inefficiency problem in structured data generation.


title: Attosecond pulse synthesis from high-order harmonic generation in intense squeezed light

abstract: High-order harmonic generation (HHG) provides a broad spectral bandwidth for synthesizing attosecond pulses. However, in the current HHG schemes, only part of the harmonics can be phase-locked, which limits the ability to achieve shorter attosecond pulses. Here, we study attosecond pulse synthesis from HHG of an atom driven by an intense quantum light, i.e., squeezed light. It is interestingly found that the harmonics in the whole spectrum can be phase-locked and, by using these harmonics, the width of the synthesized attosecond pulse is greatly reduced. By developing strong-field approximation theory in squeezed light, the physics of the phase-locked harmonic generation throughout the HHG spectrum is revealed and is found to be independent of the target system. Furthermore, we uncover the dependence of the synthesized attosecond pulse width on the squeezing parameter of the squeezed light. Our findings provide a robust tool for obtaining phase-locked harmonics throughout the HHG spectrum for synthesizing short attosecond pulses.


title: Some theoretical foundations for the design and analysis of randomized experiments

abstract: Neyman[106]'s seminal work in 1923 has been a milestone in statistics over the century, which has motivated many fundamental statistical concepts and methodology. In this review, we delve into Neyman[106]'s groundbreaking contribution and offer technical insights into the design and analysis of randomized experiments. We shall review the basic setup of completely randomized experiments and the classical approaches for inferring the average treatment effects. We shall in particular review more efficient design and analysis of randomized experiments by utilizing pretreatment covariates, which move beyond Neyman's original work without involving any covariate. We then summarize several technical ingredients regarding randomizations and permutations that have been developed over the century, such as permutational central limit theorems and Berry-Esseen bounds, and elaborate on how these technical results facilitate the understanding of randomized experiments. The discussion is also extended to other randomized experiments including rerandomization, stratified randomized experiments, matched pair experiments, cluster randomized experiments, etc.


title: Optimal Reward Labeling: Bridging Offline Preference and Reward-Based Reinforcement Learning

abstract: Offline reinforcement learning has become one of the most practical RL settings. A recent success story has been RLHF, offline preference-based RL (PBRL) with preference from humans. However, most existing works on offline RL focus on the standard setting with scalar reward feedback. It remains unknown how to universally transfer the existing rich understanding of offline RL from the reward-based to the preference-based setting. In this work, we propose a general framework to bridge this gap. Our key insight is transforming preference feedback to scalar rewards via optimal reward labeling (ORL), and then any reward-based offline RL algorithms can be applied to the dataset with the reward labels. We theoretically show the connection between several recent PBRL techniques and our framework combined with specific offline RL algorithms in terms of how they utilize the preference signals. By combining reward labeling with different algorithms, our framework can lead to new and potentially more efficient offline PBRL algorithms. We empirically test our framework on preference datasets based on the standard D4RL benchmark. When combined with a variety of efficient reward-based offline RL algorithms, the learning result achieved under our framework is comparable to training the same algorithm on the dataset with actual rewards in many cases and better than the recent PBRL baselines in most cases.


title: Extended Cyclotron Resonant Heating of the Turbulent Solar Wind

abstract: Circularly polarized, nearly parallel propagating waves are prevalent in the solar wind at ion-kinetic scales. At these scales, the spectrum of turbulent fluctuations in the solar wind steepens, often called the transition-range, before flattening at sub-ion scales. Circularly polarized waves have been proposed as a mechanism to couple electromagnetic fluctuations to ion gyromotion, enabling ion-scale dissipation that results in observed ion-scale steepening. Here, we study Parker Solar Probe observations of an extended stream of fast solar wind ranging from 15-55 solar radii. We demonstrate that, throughout the stream, transition-range steepening at ion-scales is associated with the presence of significant left handed ion-kinetic scale waves, which are thought to be ion-cyclotron waves. We implement quasilinear theory to compute the rate at which ions are heated via cyclotron resonance with the observed circularly polarized waves given the empirically measured proton velocity distribution functions. We apply the Von Karman decay law to estimate the turbulent decay of the large-scale fluctuations, which is equal to the turbulent energy cascade rate. We find that the ion-cyclotron heating rates are correlated with, and amount to a significant fraction of, the turbulent energy cascade rate, implying that cyclotron heating is an important dissipation mechanism in the solar wind.


title: The BabyView dataset: High-resolution egocentric videos of infants' and young children's everyday experiences

abstract: Human children far exceed modern machine learning algorithms in their sample efficiency, achieving high performance in key domains with much less data than current models. This ''data gap'' is a key challenge both for building intelligent artificial systems and for understanding human development. Egocentric video capturing children's experience -- their ''training data'' -- is a key ingredient for comparison of humans and models and for the development of algorithmic innovations to bridge this gap. Yet there are few such datasets available, and extant data are low-resolution, have limited metadata, and importantly, represent only a small set of children's experiences. Here, we provide the first release of the largest developmental egocentric video dataset to date -- the BabyView dataset -- recorded using a high-resolution camera with a large vertical field-of-view and gyroscope/accelerometer data. This 493 hour dataset includes egocentric videos from children spanning 6 months - 5 years of age in both longitudinal, at-home contexts and in a preschool environment. We provide gold-standard annotations for the evaluation of speech transcription, speaker diarization, and human pose estimation, and evaluate models in each of these domains. We train self-supervised language and vision models and evaluate their transfer to out-of-distribution tasks including syntactic structure learning, object recognition, depth estimation, and image segmentation. Although performance in each scales with dataset size, overall performance is relatively lower than when models are trained on curated datasets, especially in the visual domain. Our dataset stands as an open challenge for robust, humanlike AI systems: how can such systems achieve human-levels of success on the same scale and distribution of training data as humans?


title: AVR: Synergizing Foundation Models for Audio-Visual Humor Detection

abstract: In this work, we present, AVR application for audio-visual humor detection. While humor detection has traditionally centered around textual analysis, recent advancements have spotlighted multimodal approaches. However, these methods lean on textual cues as a modality, necessitating the use of ASR systems for transcribing the audio-data. This heavy reliance on ASR accuracy can pose challenges in real-world applications. To address this bottleneck, we propose an innovative audio-visual humor detection system that circumvents textual reliance, eliminating the need for ASR models. Instead, the proposed approach hinges on the intricate interplay between audio and visual content for effective humor detection.


title: Learning Temporal Logic Predicates from Data with Statistical Guarantees

abstract: Temporal logic rules are often used in control and robotics to provide structured, human-interpretable descriptions of high-dimensional trajectory data. These rules have numerous applications including safety validation using formal methods, constraining motion planning among autonomous agents, and classifying data. However, existing methods for learning temporal logic predicates from data provide no assurances about the correctness of the resulting predicate. We present a novel method to learn temporal logic predicates from data with finite-sample correctness guarantees. Our approach leverages expression optimization and conformal prediction to learn predicates that correctly describe future trajectories under mild assumptions with a user-defined confidence level. We provide experimental results showing the performance of our approach on a simulated trajectory dataset and perform ablation studies to understand how each component of our algorithm contributes to its performance.


title: TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendation

abstract: There is a growing interest in utilizing large-scale language models (LLMs) to advance next-generation Recommender Systems (RecSys), driven by their outstanding language understanding and in-context learning capabilities. In this scenario, tokenizing (i.e., indexing) users and items becomes essential for ensuring a seamless alignment of LLMs with recommendations. While several studies have made progress in representing users and items through textual contents or latent representations, challenges remain in efficiently capturing high-order collaborative knowledge into discrete tokens that are compatible with LLMs. Additionally, the majority of existing tokenization approaches often face difficulties in generalizing effectively to new/unseen users or items that were not in the training corpus. To address these challenges, we propose a novel framework called TokenRec, which introduces not only an effective ID tokenization strategy but also an efficient retrieval paradigm for LLM-based recommendations. Specifically, our tokenization strategy, Masked Vector-Quantized (MQ) Tokenizer, involves quantizing the masked user/item representations learned from collaborative filtering into discrete tokens, thus achieving a smooth incorporation of high-order collaborative knowledge and a generalizable tokenization of users and items for LLM-based RecSys. Meanwhile, our generative retrieval paradigm is designed to efficiently recommend top-$K$ items for users to eliminate the need for the time-consuming auto-regressive decoding and beam search processes used by LLMs, thus significantly reducing inference time. Comprehensive experiments validate the effectiveness of the proposed methods, demonstrating that TokenRec outperforms competitive benchmarks, including both traditional recommender systems and emerging LLM-based recommender systems.


title: Climate Change Task Force Report for the American Astronomical Society

abstract: The AAS Strategic Plan for 2021-26 called for the creation of a task force to identify how the AAS can meet the goals of the Paris Agreement. The AAS and its membership recognize the danger climate change represents to humanity and our world, and to astronomy -- as a profession, a hobby, and a cultural good. Our profession in general -- and the AAS in particular -- should work to make it possible for all astronomers to have an equal opportunity to be successful without needing to incur high carbon emissions, and to preserve astronomy for future generations. A study was completed of the carbon emissions associated with the AAS, finding that 84% of total AAS-related emissions are from in-person conferences. We also conducted a survey of AAS members to determine their attitudes about climate change. Respondents overwhelmingly (97%) think that the AAS should reduce its carbon footprint. Our task force created a list of fourteen recommendations, with two ranked as top priorities: The AAS should not schedule additional in-person meetings before 2030 and it should work to innovate the AAS conference model. Based upon our analysis it is clear that online interaction is the only way to increase participation while meaningfully decreasing emissions. Our recommendations are aligned with the Astro2020 Decadal Survey as well as AAS values to disseminate our scientific understanding of the universe, and to do our work in an ethically responsible way. Because of their other benefits -- particularly in making our society more welcoming to those who traditionally have been excluded -- we feel that these are sound decisions, worthy of implementation even if the AAS wasn't trying to reduce its carbon footprint. They simply make sense as steps towards a professional society that better serves a broader membership, as our profession evolves to be greener, more inclusive, and more productive.

categories: physics.soc-ph astro-ph.EP astro-ph.IM physics.ao-ph


title: Radiative Properties of Plasmoids and Plasmoid Mergers in Magnetic Reconnection

abstract: Magnetic reconnection is often considered as the primary particle acceleration mechanism in a magnetized blazar zone environment. The majority of radiation in the reconnection layer comes from plasmoids and their mergers. In particular, plasmoid mergers can produce strong multi-wavelength flares and major variations in synchrotron polarization signatures. However, radiative properties of plasmoid mergers have not been well explored due to difficulties in tracking the merging processes. Here we use an image processing method that combines the magnetic vector potential and density to identify isolated and merging plasmoids. We find that this method can clearly distinguish radiation contributions from isolated plasmoids, merging plasmoids, and the primary current sheet of reconnection. This new method enables us to study the radiative properties of plasmoids and mergers statistically. Our results show that isolated plasmoids have similar emissivity regardless of their sizes, and they generally have nonzero polarization degree (PD) due to their quasi-circular shape. Flares due to plasmoid mergers have relative amplitudes that are anti-proportional to the size ratio of the plasmoids participating in the mergers. Finally, only mergers between plasmoids of comparable sizes (width ratio $\lesssim 5$) can lead to significant spectral hardening and polarization angle (PA) variations; the amplitude of the PA variations is between 0 and $180^{\circ}$ and has a mean value of $90^{\circ}$. Our analyses on 2D simulations can pave the way for future analyses and machine learning techniques on radiative properties of 3D magnetic reconnection simulations.


title: Fast Geometric Learning of MIMO Signal Detection over Grassmannian Manifolds

abstract: Domain or statistical distribution shifts are a key staple of the wireless communication channel, because of the dynamics of the environment. Deep learning (DL) models for detecting multiple-input multiple-output (MIMO) signals in dynamic communication require large training samples (in the order of hundreds of thousands to millions) and online retraining to adapt to domain shift. Some dynamic networks, such as vehicular networks, cannot tolerate the waiting time associated with gathering a large number of training samples or online fine-tuning which incurs significant end-to-end delay. In this paper, a novel classification technique based on the concept of geodesic flow kernel (GFK) is proposed for MIMO signal detection. In particular, received MIMO signals are first represented as points on Grassmannian manifolds by formulating basis of subspaces spanned by the rows vectors of the received signal. Then, the domain shift is modeled using a geodesic flow kernel integrating the subspaces that lie on the geodesic to characterize changes in geometric and statistical properties of the received signals. The kernel derives low-dimensional representations of the received signals over the Grassman manifolds that are invariant to domain shift and is used in a geometric support vector machine (G-SVM) algorithm for MIMO signal detection in an unsupervised manner. Simulation results reveal that the proposed method achieves promising performance against the existing baselines like OAMPnet and MMNet with only 1,200 training samples and without online retraining.


title: HumanPlus: Humanoid Shadowing and Imitation from Humans

abstract: One of the key arguments for building robots that have similar form factors to human beings is that we can leverage the massive human data for training. Yet, doing so has remained challenging in practice due to the complexities in humanoid perception and control, lingering physical gaps between humanoids and humans in morphologies and actuation, and lack of a data pipeline for humanoids to learn autonomous skills from egocentric vision. In this paper, we introduce a full-stack system for humanoids to learn motion and autonomous skills from human data. We first train a low-level policy in simulation via reinforcement learning using existing 40-hour human motion datasets. This policy transfers to the real world and allows humanoid robots to follow human body and hand motion in real time using only a RGB camera, i.e. shadowing. Through shadowing, human operators can teleoperate humanoids to collect whole-body data for learning different tasks in the real world. Using the data collected, we then perform supervised behavior cloning to train skill policies using egocentric vision, allowing humanoids to complete different tasks autonomously by imitating human skills. We demonstrate the system on our customized 33-DoF 180cm humanoid, autonomously completing tasks such as wearing a shoe to stand up and walk, unloading objects from warehouse racks, folding a sweatshirt, rearranging objects, typing, and greeting another robot with 60-100% success rates using up to 40 demonstrations. Project website: https://humanoid-ai.github.io/


title: Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inference

abstract: Cryo-Electron Microscopy (cryo-EM) is an increasingly popular experimental technique for estimating the 3D structure of macromolecular complexes such as proteins based on 2D images. These images are notoriously noisy, and the pose of the structure in each image is unknown \textit{a priori}. Ab-initio 3D reconstruction from 2D images entails estimating the pose in addition to the structure. In this work, we propose a new approach to this problem. We first adopt a multi-head architecture as a pose encoder to infer multiple plausible poses per-image in an amortized fashion. This approach mitigates the high uncertainty in pose estimation by encouraging exploration of pose space early in reconstruction. Once uncertainty is reduced, we refine poses in an auto-decoding fashion. In particular, we initialize with the most likely pose and iteratively update it for individual images using stochastic gradient descent (SGD). Through evaluation on synthetic datasets, we demonstrate that our method is able to handle multi-modal pose distributions during the amortized inference stage, while the later, more flexible stage of direct pose optimization yields faster and more accurate convergence of poses compared to baselines. Finally, on experimental data, we show that our approach is faster than state-of-the-art cryoAI and achieves higher-resolution reconstruction.


title: A Generative Model for Realistic Galaxy Cluster X-ray Morphologies

abstract: The X-ray morphologies of clusters of galaxies display significant variations, reflecting their dynamical histories and the nonlinear dependence of X-ray emissivity on the density of the intracluster gas. Qualitative and quantitative assessments of X-ray morphology have long been considered a proxy for determining whether clusters are dynamically active or "relaxed." Conversely, the use of circularly or elliptically symmetric models for cluster emission can be complicated by the variety of complex features realized in nature, spanning scales from Mpc down to the resolution limit of current X-ray observatories. In this work, we use mock X-ray images from simulated clusters from THE THREE HUNDRED project to define a basis set of cluster image features. We take advantage of clusters' approximate self similarity to minimize the differences between images before encoding the remaining diversity through a distribution of high order polynomial coefficients. Principal component analysis then provides an orthogonal basis for this distribution, corresponding to natural perturbations from an average model. This representation allows novel, realistically complex X-ray cluster images to be easily generated, and we provide code to do so. The approach provides a simple way to generate training data for cluster image analysis algorithms, and could be straightforwardly adapted to generate clusters displaying specific types of features, or selected by physical characteristics available in the original simulations.