title: Finite Mixtures of Multivariate Poisson-Log Normal Factor Analyzers for Clustering Count Data

abstract: A mixture of multivariate Poisson-log normal factor analyzers is introduced by imposing constraints on the covariance matrix, which resulted in flexible models for clustering purposes. In particular, a class of eight parsimonious mixture models based on the mixtures of factor analyzers model are introduced. Variational Gaussian approximation is used for parameter estimation, and information criteria are used for model selection. The proposed models are explored in the context of clustering discrete data arising from RNA sequencing studies. Using real and simulated data, the models are shown to give favourable clustering performance. The GitHub R package for this work is available at https://github.com/anjalisilva/mixMPLNFA and is released under the open-source MIT license.


title: The Disagreement Problem in Faithfulness Metrics

abstract: The field of explainable artificial intelligence (XAI) aims to explain how black-box machine learning models work. Much of the work centers around the holy grail of providing post-hoc feature attributions to any model architecture. While the pace of innovation around novel methods has slowed down, the question remains of how to choose a method, and how to make it fit for purpose. Recently, efforts around benchmarking XAI methods have suggested metrics for that purpose -- but there are many choices. That bounty of choice still leaves an end user unclear on how to proceed. This paper focuses on comparing metrics with the aim of measuring faithfulness of local explanations on tabular classification problems -- and shows that the current metrics don't agree; leaving users unsure how to choose the most faithful explanations.


title: Gravitational Aharonov-Bohm Effect

abstract: We investigate the gravitational Aharonov-Bohm effect, by placing a quantum system in free-fall around a gravitating body {\it e.g.} a satellite orbiting the Earth. Since the system is in free-fall, by the equivalence principle, the quantum system is locally in flat, gravity-free space-time - it is screened from the gravitational field. For a slightly elliptical orbit, the gravitational potential will change with time. This leads to the energy levels of the quantum system developing side bands which is the signature for this version of the Aharonov-Bohm effect. This contrasts with the normal signature of the Aharonov-Bohm effect of shifting of interference fringes.


title: FedOpenHAR: Federated Multi-Task Transfer Learning for Sensor-Based Human Activity Recognition

abstract: Motion sensors integrated into wearable and mobile devices provide valuable information about the device users. Machine learning and, recently, deep learning techniques have been used to characterize sensor data. Mostly, a single task, such as recognition of activities, is targeted, and the data is processed centrally at a server or in a cloud environment. However, the same sensor data can be utilized for multiple tasks and distributed machine-learning techniques can be used without the requirement of the transmission of data to a centre. This paper explores Federated Transfer Learning in a Multi-Task manner for both sensor-based human activity recognition and device position identification tasks. The OpenHAR framework is used to train the models, which contains ten smaller datasets. The aim is to obtain model(s) applicable for both tasks in different datasets, which may include only some label types. Multiple experiments are carried in the Flower federated learning environment using the DeepConvLSTM architecture. Results are presented for federated and centralized versions under different parameters and restrictions. By utilizing transfer learning and training a task-specific and personalized federated model, we obtained a similar accuracy with training each client individually and higher accuracy than a fully centralized approach.


title: Vision-Language Integration in Multimodal Video Transformers (Partially) Aligns with the Brain

abstract: Integrating information from multiple modalities is arguably one of the essential prerequisites for grounding artificial intelligence systems with an understanding of the real world. Recent advances in video transformers that jointly learn from vision, text, and sound over time have made some progress toward this goal, but the degree to which these models integrate information from modalities still remains unclear. In this work, we present a promising approach for probing a pre-trained multimodal video transformer model by leveraging neuroscientific evidence of multimodal information processing in the brain. Using brain recordings of participants watching a popular TV show, we analyze the effects of multi-modal connections and interactions in a pre-trained multi-modal video transformer on the alignment with uni- and multi-modal brain regions. We find evidence that vision enhances masked prediction performance during language processing, providing support that cross-modal representations in models can benefit individual modalities. However, we don't find evidence of brain-relevant information captured by the joint multi-modal transformer representations beyond that captured by all of the individual modalities. We finally show that the brain alignment of the pre-trained joint representation can be improved by fine-tuning using a task that requires vision-language inferences. Overall, our results paint an optimistic picture of the ability of multi-modal transformers to integrate vision and language in partially brain-relevant ways but also show that improving the brain alignment of these models may require new approaches.


title: GreekT5: A Series of Greek Sequence-to-Sequence Models for News Summarization

abstract: Text summarization (TS) is a natural language processing (NLP) subtask pertaining to the automatic formulation of a concise and coherent summary that covers the major concepts and topics from one or multiple documents. Recent advancements in deep learning have led to the development of abstractive summarization transformer-based models, which outperform classical approaches. In any case, research in this field focuses on high resource languages such as English, while the corresponding work for low resource languages is still underdeveloped. Taking the above into account, this paper proposes a series of novel TS models for Greek news articles. The proposed models were thoroughly evaluated on the same dataset against GreekBART, which is the state-of-the-art model in Greek abstractive news summarization. Our evaluation results reveal that most of the proposed models significantly outperform GreekBART on various evaluation metrics. We make our evaluation code public, aiming to increase the reproducibility of this work and facilitate future research in the field.


title: Bayesian Calibration and Uncertainty Quantification of a Rate-dependent Cohesive Zone Model for Polymer Interfaces

abstract: In the present work, a rate-dependent cohesive zone model for the fracture of polymeric interfaces is presented. Inverse calibration of parameters for such complex models through trial and error is computationally tedious due to the large number of parameters and the high computational cost associated. The obtained parameter values are often non-unique and the calibration inherits higher uncertainty when the available experimental data is limited. To alleviate these difficulties, a Bayesian calibration approach is used for the proposed rate-dependent cohesive zone model in this work. The proposed cohesive zone model accounts for both reversible elastic and irreversible rate-dependent separation sliding deformation at the interface. The viscous dissipation due to the irreversible opening at the interface is modeled using elastic-viscoplastic kinematics that incorporates the effects of strain rate. To quantify the uncertainty associated with the inverse parameter estimation, a modular Bayesian approach is employed to calibrate the unknown model parameters, accounting for the parameter uncertainty of the cohesive zone model. Further, to quantify the model uncertainties, such as incorrect assumptions or missing physics, a discrepancy function is introduced and it is approximated as a Gaussian process. The improvement in the model predictions following the introduction of a discrepancy function is demonstrated justifying the need for a discrepancy term. Finally, the overall uncertainty of the model is quantified in a predictive setting and the results are provided as confidence intervals. A sensitivity analysis is also performed to understand the effect of the variability of the inputs on the nature of the output.


title: Characterization of the visit-to-visit Stability of the GR700XD Spectral Traces for NIRISS/SOSS Observations

abstract: In this report, we present the results of our analysis of trace position changes during NIRISS/SOSS observations. We examine the visit-to-visit impact of the GR700XD pupil wheel (PW) position alignment on trace positions for spectral orders 1 and 2 using the data obtained to date. Our goal is to improve the wavelength solution by correlating the trace positions on the detector with the PW position angle. We find that there is a one-to-one correspondence between PW position and spectral trace rotation for both orders. This allowed us in turn to find an analytic model that is able to predict a trace position/shape as a function of PW position with sub-pixel accuracy of about ~0.1 pixels. Such a function can be used to predict the trace position in low signal-to-noise ratio cases, and/or as a template to track trace position changes as function of time in Time Series Observations (TSOs).


title: Queues with service resetting

abstract: Service time fluctuations heavily affect the performance of queuing systems, causing long waiting times and backlogs. Recently, Bonomo et al. [1] showed that when service times are solely determined by the server, service resetting can mitigate the deleterious effects of service time fluctuations and drastically improve queue performance. Yet, in many queueing systems, service times have two independent sources: the intrinsic server slowdown ($S$) and the jobs' inherent size ($X$). In these, so-called $S\&X$ queues [2], service resetting results in a newly drawn server slowdown while the inherent job size remains unchanged. Remarkably, resetting can be useful even then. To show this, we develop a comprehensive theory of $S\&X$ queues with service resetting. We consider cases where the total service time is either a sum or a product of the service slowdown and the jobs' inherent size. For both cases, we derive expressions for the total service time distribution and its mean under a generic service resetting policy. Zooming in on the prevalent constant-rate (Poissonian) resetting policy, we further derive explicit conditions under which resetting reduces the mean service time and improves queue performance. While these results hold regardless of the arrival process, we dedicate special attention to the $S\&X$-M/G/1 queue with service resetting, and obtain the distribution of the number of jobs in the system and their sojourn time. Our analysis highlights situations where service resetting can be used as an effective tool to improve the performance of $S\&X$ queueing systems.


title: Characterization of the visit-to-visit Stability of the GR700XD Wavelength Calibration for NIRISS/SOSS Observations

abstract: When utilizing the NIRISS/SOSS mode on JWST, the pupil wheel (tasked with orienting the GR700XD grism into the optical path) does not consistently settle into its commanded position resulting in a minor misalignment with deviations of a few fractions of a degree. These small offsets subsequently introduce noticeable changes in the trace positions of the NIRISS SOSS spectral orders between visits. This inconsistency, in turn, can lead to variations of the wavelength solution. In this report, we present the visit-to-visit characterization of the NIRISS GR700XD Wavelength Calibration for spectral orders 1 and 2. Employing data from Calibration Program 1512 (PI: Espinoza), which intentionally and randomly sampled assorted pupil wheel positions during observations of the A-star BD+60-1753, as well as data from preceding commissioning and calibration activities to model this effect, we demonstrate that the wavelength solution can fluctuate in a predictable fashion between visits by up to a few pixels. We show that via two independent polynomial regression models for spectral orders 1 and 2, respectively, using the measured x-pixel positions of known Hydrogen absorption features in the A-star spectra and pupil wheel positions as regressors, we can accurately predict the wavelength solution for a particular visit with an RMS error within a few tenths of a pixel. We incorporate these models in PASTASOSS, a Python package for predicting the GR700XD spectral traces, which now allows to accurately predict spectral trace positions and their associated wavelengths for any NIRISS/SOSS observation.


title: In-context Learning and Gradient Descent Revisited

abstract: In-context learning (ICL) has shown impressive results in few-shot learning tasks, yet its underlying mechanism is still not fully understood. A recent line of work suggests that ICL performs gradient descent (GD)-based optimization implicitly. While appealing, much of the research focuses on simplified settings, where the parameters of a shallow model are optimized. In this work, we revisit evidence for ICL-GD correspondence on realistic NLP tasks and models. We find gaps in evaluation, both in terms of problematic metrics and insufficient baselines. We show that surprisingly, even untrained models achieve comparable ICL-GD similarity scores despite not exhibiting ICL. Next, we explore a major discrepancy in the flow of information throughout the model between ICL and GD, which we term Layer Causality. We propose a simple GD-based optimization procedure that respects layer causality, and show it improves similarity scores significantly.


title: Computational and Statistical Thresholds in Multi-layer Stochastic Block Models

abstract: We study the problem of community recovery and detection in multi-layer stochastic block models, focusing on the critical network density threshold for consistent community structure inference. Using a prototypical two-block model, we reveal a computational barrier for such multi-layer stochastic block models that does not exist for its single-layer counterpart: When there are no computational constraints, the density threshold depends linearly on the number of layers. However, when restricted to polynomial-time algorithms, the density threshold scales with the square root of the number of layers, assuming correctness of a low-degree polynomial hardness conjecture. Our results provide a nearly complete picture of the optimal inference in multiple-layer stochastic block models and partially settle the open question in Lei and Lin (2022) regarding the optimality of the bias-adjusted spectral method.


title: Speed of sound in methane under conditions of planetary interiors

abstract: We present direct observations of acoustic waves in warm dense matter. We analyze wave-number- and energy-resolved x-ray spectra taken from warm dense methane created by laser heating a cryogenic liquid jet. X-ray diffraction and inelastic free-electron scattering yield sample conditions of 0.3$\pm$0.1 eV and 0.8$\pm$0.1 g/cm$^3$, corresponding to a pressure of $\sim$13 GPa. Inelastic x-ray scattering was used to observe the collective oscillations of the ions. With a highly improved energy resolution of $\sim$50 meV, we could clearly distinguish the Brillouin peaks from the quasielastic Rayleigh feature. Data at different wave numbers were utilized to derive a sound speed of 5.9$\pm$0.5 km/s, marking a high-temperature data point for methane and demonstrating consistency with Birch's law in this parameter regime.


title: Grain-size measurements in protoplanetary disks indicate fragile pebbles and low turbulence

abstract: Recent laboratory experiments have revealed that destructive collisions of icy dust particles may occur at much lower velocities than previously believed. These low fragmentation velocities push down the maximum grain size in collisional growth models. Motivated by the smooth radial distribution of pebble sizes inferred from ALMA/VLA multi-wavelength continuum analysis, we propose a concise model to explain this feature and aim to constrain the turbulence level at the midplane of protoplanetary disks. Our approach is built on the assumption that the fragmentation threshold is the primary barrier limiting pebble growth within pressure maxima. Consequently, the grain size at the ring location can provide direct insights into the turbulent velocity governing pebble collisions and, by extension, the turbulence level at the disk midplane. We validate this method using the Dustpy code, which simulates dust transport and coagulation. We apply our method to 7 disks, TW Hya, IM Lup, GM Aur, AS 209, HL Tau, HD 163296, and MWC 480, for which grain sizes have been measured from multi-wavelength continuum analysis. A common feature emerges from our analysis, with an overall low turbulence coefficient of $\alpha\sim10^{-4}$ observed in five out of seven disks when taking fragmentation velocity $v_{\rm frag} = 1{\rm \,m\,s}^{-1}$. A higher fragmentation velocity would imply a turbulence coefficient significantly larger than the current observational constraints. IM Lup stands out with a relatively higher coefficient of $10^{-3}$. Notably, HL Tau exhibits an increasing trend in $\alpha$ with distance, which supports enhanced turbulence at its outer disk region, possibly associated with the infalling streamer onto HL~Tau. The current (sub)mm pebble size constrained in disks implies low levels of turbulence, as well as fragile pebbles consistent with recent laboratory measurements.


title: All-fiber broadband spectral acousto-optic modulation of a tubular-lattice hollow-core optical fiber

abstract: We demonstrate a broadband acousto-optic notch filter based on a tubular-lattice hollow-core fiber for the first time. The guided optical modes are modulated by acoustically induced dynamic long-period gratings along the fiber. The device is fabricated employing a short interaction length (7.7 cm) and low drive voltages (10 V). Modulated spectral bands with 20 nm half-width and maximum depths greater than 60 % are achieved. The resonant notch wavelength is tuned from 743 to 1355 nm (612 nm span) by changing the frequency of the electrical signal. The results indicate a broader tuning range compared to previous studies using standard and hollow-core fibers. It further reveals unique properties for reconfigurable spectral filters and fiber lasers, pointing to the fast switching and highly efficient modulation of all-fiber photonic devices.


title: Constrained Spin Systems and KNdS Black Holes

abstract: Kerr-Newman de Sitter (KNdS) spacetimes have a rich thermodynamic structure that involves multiple horizons, and so differs in key respects from asymptotically flat or AdS black holes. In this paper, we show that certain features of KNdS spacetimes can be reproduced by a constrained system of $N$ non-interacting spins in a magnetic field. Both the KNdS and spin systems have bounded energy and entropy, a maximum of the entropy in the interior of the energy range, and a symmetry that maps lower energy states to higher energy states with the same entropy. Consequently, both systems have a temperature that can be positive or negative, where the gravitational temperature is defined analogously to that of the spins. We find that the number of spins $N$ corresponds to $1/\Lambda$ for black holes with very small charge $q$ and rotation parameter $a$, and scales like $\sqrt{(a^2+q^2)/\Lambda}$ for larger values of $a$ and $q$. By studying constrained spin systems, we provide insight into the thermodynamics of KNdS spacetimes and its quantum mechanical description.


title: Depth and regularity of tableau ideals

abstract: We compute the depth and regularity of ideals associated with arbitrary fillings of positive integers to a Young diagram, called the tableau ideals.


title: Control Theory and Parametrizations of Linear Partial Differential Operators

abstract: When ${\cal{D}}:\xi \rightarrow \eta$ is a linear OD or PD operator, a "direct problem" is to find compatibility conditions (CC) as an operator ${\cal{D}}_1:\eta \rightarrow \zeta$ such that ${\cal{D}}\xi=\eta$ implies ${\cal{D}}_1\eta=0$. When ${\cal{D}}$ is involutive, the procedure provides successive first order involutive operators ${\cal{D}}_1, ... , {\cal{D}}_n$ in dimension $n$. Conversely, when ${\cal{D}}_1$ is given, a much more difficult " inverse problem " is to look for an operator ${\cal{D}}: \xi \rightarrow \eta$ having the generating CC ${\cal{D}}_1\eta=0$. This is possible when the differential module defined by ${\cal{D}}_1$ is " {\it torsion-free} ", one shall say that ${\cal{D}}_1$ is parametrized by ${\cal{D}}$. The systematic use of the adjoint of a differential operator provides a constructive test. A control system is controllable {\it if and only if} it can be parametrized. Accordingly, the controllability of any OD or PD control system is a " {\it built in} " property not depending on the choice of the input and output variables among the system variables. In the OD case when ${\cal{D}}_1$ is formally surjective, controllability just amounts to the injectivity of $ad({\cal{D}}_1)$. Among applications, the parametrization of the Cauchy stress operator has attracted many famous scientists from G.B. Airy in 1863 for $n=2$ to A. Einstein in 1915 for $n=4$. We prove that all these works are already explicitly using the self-adjoint Einstein operator {\it which cannot be parametrized} and are based on a confusion between the $div$ operator induced from the Bianchi operator ${\cal{D}}_2$ and the Cauchy operator, adjoint of the Killing operator ${\cal{D}}$ for an arbitrary $n$. This purely mathematical result deeply questions the origin and existence of gravitational waves.


title: Parrot-Trained Adversarial Examples: Pushing the Practicality of Black-Box Audio Attacks against Speaker Recognition Models

abstract: Audio adversarial examples (AEs) have posed significant security challenges to real-world speaker recognition systems. Most black-box attacks still require certain information from the speaker recognition model to be effective (e.g., keeping probing and requiring the knowledge of similarity scores). This work aims to push the practicality of the black-box attacks by minimizing the attacker's knowledge about a target speaker recognition model. Although it is not feasible for an attacker to succeed with completely zero knowledge, we assume that the attacker only knows a short (or a few seconds) speech sample of a target speaker. Without any probing to gain further knowledge about the target model, we propose a new mechanism, called parrot training, to generate AEs against the target model. Motivated by recent advancements in voice conversion (VC), we propose to use the one short sentence knowledge to generate more synthetic speech samples that sound like the target speaker, called parrot speech. Then, we use these parrot speech samples to train a parrot-trained(PT) surrogate model for the attacker. Under a joint transferability and perception framework, we investigate different ways to generate AEs on the PT model (called PT-AEs) to ensure the PT-AEs can be generated with high transferability to a black-box target model with good human perceptual quality. Real-world experiments show that the resultant PT-AEs achieve the attack success rates of 45.8% - 80.8% against the open-source models in the digital-line scenario and 47.9% - 58.3% against smart devices, including Apple HomePod (Siri), Amazon Echo, and Google Home, in the over-the-air scenario.


title: Ex Post Conditions for the Exactness of Optimal Power Flow Conic Relaxations

abstract: Convex relaxations of the optimal power flow (OPF) problem provide an efficient alternative to solving the intractable alternating current (AC) optimal power flow. The conic subset of OPF convex relaxations, in particular, greatly accelerate resolution while leading to high-quality approximations that are exact in several scenarios. However, the sufficient conditions guaranteeing exactness are stringent, e.g., requiring radial topologies. In this short communication, we present two equivalent ex post conditions for the exactness of any conic relaxation of the OPF. These rely on obtaining either a rank-1 voltage matrix or self-coherent cycles. Instead of relying on sufficient conditions a priori, satisfying one of the presented ex post conditions acts as an exactness certificate for the computed solution. The operator can therefore obtain an optimality guarantee when solving a conic relaxation even when a priori exactness requirements are not met. Finally, we present numerical examples from the MATPOWER library where the ex post conditions hold even though the exactness sufficient conditions do not, thereby illustrating the use of the conditions.


title: A characterization of $\ell_1$ double bubbles with general interface interaction

abstract: We investigate the optimal arrangements of two planar sets of given volume which are minimizing the $\ell_1$ double-bubble interaction functional. The latter features a competition between the minimization of the $\ell_1$ perimeters of the two sets and the maximization of their $\ell_1$ interface. We investigate the problem in its full generality for sets of finite perimeter, by considering the whole range of possible interaction intensities and all relative volumes of the two sets. The main result is the complete classification of minimizers.


title: Size-Aware Hypergraph Motifs

abstract: Complex systems frequently exhibit multi-way, rather than pairwise, interactions. These group interactions cannot be faithfully modeled as collections of pairwise interactions using graphs, and instead require hypergraphs. However, methods that analyze hypergraphs directly, rather than via lossy graph reductions, remain limited. Hypergraph motif mining holds promise in this regard, as motif patterns serve as building blocks for larger group interactions which are inexpressible by graphs. Recent work has focused on categorizing and counting hypergraph motifs based on the existence of nodes in hyperedge intersection regions. Here, we argue that the relative sizes of hyperedge intersections within motifs contain varied and valuable information. We propose a suite of efficient algorithms for finding triplets of hyperedges based on optimizing the sizes of these intersection patterns. This formulation uncovers interesting local patterns of interaction, finding hyperedge triplets that either (1) are the least correlated with each other, (2) have the highest pairwise but not groupwise correlation, or (3) are the most correlated with each other. We formalize this as a combinatorial optimization problem and design efficient algorithms based on filtering hyperedges. Our experimental evaluation shows that the resulting hyperedge triplets yield insightful information on real-world hypergraphs. Our approach is also orders of magnitude faster than a naive baseline implementation.

categories: cs.DM cs.SI physics.data-an physics.soc-ph


title: A Data-Free Approach to Mitigate Catastrophic Forgetting in Federated Class Incremental Learning for Vision Tasks

abstract: Deep learning models often suffer from forgetting previously learned information when trained on new data. This problem is exacerbated in federated learning (FL), where the data is distributed and can change independently for each user. Many solutions are proposed to resolve this catastrophic forgetting in a centralized setting. However, they do not apply directly to FL because of its unique complexities, such as privacy concerns and resource limitations. To overcome these challenges, this paper presents a framework for $\textbf{federated class incremental learning}$ that utilizes a generative model to synthesize samples from past distributions. This data can be later exploited alongside the training data to mitigate catastrophic forgetting. To preserve privacy, the generative model is trained on the server using data-free methods at the end of each task without requesting data from clients. Moreover, our solution does not demand the users to store old data or models, which gives them the freedom to join/leave the training at any time. Additionally, we introduce SuperImageNet, a new regrouping of the ImageNet dataset specifically tailored for federated continual learning. We demonstrate significant improvements compared to existing baselines through extensive experiments on multiple datasets.


title: Fracture of bio-cemented sands

abstract: Bio-chemical reactions enable the production of biomimetic materials such as sandstones. In the present study, microbiologically-induced calcium carbonate precipitation (MICP) is used to manufacture laboratory-scale specimens for fracture toughness measurement. The mode I and mixed-mode fracture toughnesses are measured as a function of cementation, and are correlated with strength, permeability and porosity. A micromechanical model is developed to predict the dependence of mode I fracture toughness upon the degree of cementation. In addition, the role of the crack tip $T$-stress in dictating kink angle and toughness is determined for mixed mode loading. At a sufficiently low degree of cementation, the zone of microcracking in the vicinity of the crack tip is sufficiently large for a crack tip $K$-field to cease to exist and for crack kinking theory to not apply. The interplay between cementation and fracture properties of sedimentary rocks is explained; this understanding underpins a wide range of rock fracture phenomena including hydraulic fracture.


title: Predicting the First Response Latency of Maintainers and Contributors in Pull Requests

abstract: The success of a Pull Request (PR) depends on the responsiveness of the maintainers and the contributor during the review process. Being aware of the expected waiting times can lead to better interactions and managed expectations for both the maintainers and the contributor. In this paper, we propose a machine-learning approach to predict the first response latency of the maintainers following the submission of a PR, and the first response latency of the contributor after receiving the first response from the maintainers. We curate a dataset of 20 large and popular open-source projects on GitHub and extract 21 features to characterize projects, contributors, PRs, and review processes. Using these features, we then evaluate seven types of classifiers to identify the best-performing models. We also perform permutation feature importance and SHAP analyses to understand the importance and impact of different features on the predicted response latencies. Our best-performing models achieve an average improvement of 33% in AUC-ROC and 58% in AUC-PR for maintainers, as well as 42% in AUC-ROC and 95% in AUC-PR for contributors compared to a no-skilled classifier across the projects. Our findings indicate that PRs submitted earlier in the week, containing an average or slightly above-average number of commits, and with concise descriptions are more likely to receive faster first responses from the maintainers. Similarly, PRs with a lower first response latency from maintainers, that received the first response of maintainers earlier in the week, and containing an average or slightly above-average number of commits tend to receive faster first responses from the contributors. Additionally, contributors with a higher acceptance rate and a history of timely responses in the project are likely to both obtain and provide faster first responses.


title: Hybrid Synaptic Structure for Spiking Neural Network Realization

abstract: Neural networks and neuromorphic computing play pivotal roles in deep learning and machine vision. Due to their dissipative nature and inherent limitations, traditional semiconductor-based circuits face challenges in realizing ultra-fast and low-power neural networks. However, the spiking behavior characteristic of single flux quantum (SFQ) circuits positions them as promising candidates for spiking neural networks (SNNs). Our previous work showcased a JJ-Soma design capable of operating at tens of gigahertz while consuming only a fraction of the power compared to traditional circuits, as documented in [1]. This paper introduces a compact SFQ-based synapse design that applies positive and negative weighted inputs to the JJ-Soma. Using an RSFQ synapse empowers us to replicate the functionality of a biological neuron, a crucial step in realizing a complete SNN. The JJ-Synapse can operate at ultra-high frequencies, exhibits orders of magnitude lower power consumption than CMOS counterparts, and can be conveniently fabricated using commercial Nb processes. Furthermore, the network's flexibility enables modifications by incorporating cryo-CMOS circuits for weight value adjustments. In our endeavor, we have successfully designed, fabricated, and partially tested the JJ-Synapse within our cryocooler system. Integration with the JJ-Soma further facilitates the realization of a high-speed inference SNN.


title: CSLP-AE: A Contrastive Split-Latent Permutation Autoencoder Framework for Zero-Shot Electroencephalography Signal Conversion

abstract: Electroencephalography (EEG) is a prominent non-invasive neuroimaging technique providing insights into brain function. Unfortunately, EEG data exhibit a high degree of noise and variability across subjects hampering generalizable signal extraction. Therefore, a key aim in EEG analysis is to extract the underlying neural activation (content) as well as to account for the individual subject variability (style). We hypothesize that the ability to convert EEG signals between tasks and subjects requires the extraction of latent representations accounting for content and style. Inspired by recent advancements in voice conversion technologies, we propose a novel contrastive split-latent permutation autoencoder (CSLP-AE) framework that directly optimizes for EEG conversion. Importantly, the latent representations are guided using contrastive learning to promote the latent splits to explicitly represent subject (style) and task (content). We contrast CSLP-AE to conventional supervised, unsupervised (AE), and self-supervised (contrastive learning) training and find that the proposed approach provides favorable generalizable characterizations of subject and task. Importantly, the procedure also enables zero-shot conversion between unseen subjects. While the present work only considers conversion of EEG, the proposed CSLP-AE provides a general framework for signal conversion and extraction of content (task activation) and style (subject variability) components of general interest for the modeling and analysis of biological signals.


title: Level-k Thinking in the Extensive Form

abstract: Level-k thinking has been widely applied as a solution concept for games in normal form in behavioral and experimental game theory. We consider level-k thinking in games in extensive form. Player's may learn about levels of opponents' thinking during the play of the game because some information sets may be inconsistent with certain levels. In particular, for any information set reached, a level-k player attaches the maximum level-l thinking for l < k to her opponents consistent with the information set. We compare our notion of strong level-k thinking with other solution concepts such as level-k thinking in the associated normal form, strong rationalizability, Delta-rationalizability, iterated admissibility, backward rationalizability, backward level-k thinking, and backward induction. We use strong level-k thinking to reanalyze data from some prior experiments in the literature.


title: Leveraging Hamilton-Jacobi PDEs with time-dependent Hamiltonians for continual scientific machine learning

abstract: We address two major challenges in scientific machine learning (SciML): interpretability and computational efficiency. We increase the interpretability of certain learning processes by establishing a new theoretical connection between optimization problems arising from SciML and a generalized Hopf formula, which represents the viscosity solution to a Hamilton-Jacobi partial differential equation (HJ PDE) with time-dependent Hamiltonian. Namely, we show that when we solve certain regularized learning problems with integral-type losses, we actually solve an optimal control problem and its associated HJ PDE with time-dependent Hamiltonian. This connection allows us to reinterpret incremental updates to learned models as the evolution of an associated HJ PDE and optimal control problem in time, where all of the previous information is intrinsically encoded in the solution to the HJ PDE. As a result, existing HJ PDE solvers and optimal control algorithms can be reused to design new efficient training approaches for SciML that naturally coincide with the continual learning framework, while avoiding catastrophic forgetting. As a first exploration of this connection, we consider the special case of linear regression and leverage our connection to develop a new Riccati-based methodology for solving these learning problems that is amenable to continual learning applications. We also provide some corresponding numerical examples that demonstrate the potential computational and memory advantages our Riccati-based approach can provide.


title: Comprehensive Overview of Bottom-up Proteomics using Mass Spectrometry

abstract: Proteomics is the large scale study of protein structure and function from biological systems through protein identification and quantification. "Shotgun proteomics" or "bottom-up proteomics" is the prevailing strategy, in which proteins are hydrolyzed into peptides that are analyzed by mass spectrometry. Proteomics studies can be applied to diverse studies ranging from simple protein identification to studies of proteoforms, protein-protein interactions, protein structural alterations, absolute and relative protein quantification, post-translational modifications, and protein stability. To enable this range of different experiments, there are diverse strategies for proteome analysis. The nuances of how proteomic workflows differ may be challenging to understand for new practitioners. Here, we provide a comprehensive overview of different proteomics methods to aid the novice and experienced researcher. We cover from biochemistry basics and protein extraction to biological interpretation and orthogonal validation. We expect this work to serve as a basic resource for new practitioners in the field of shotgun or bottom-up proteomics.


title: Western, Religious or Spiritual: An Evaluation of Moral Justification in Large Language Models

abstract: The increasing success of Large Language Models (LLMs) in variety of tasks lead to their widespread use in our lives which necessitates the examination of these models from different perspectives. The alignment of these models to human values is an essential concern in order to establish trust that we have safe and responsible systems. In this paper, we aim to find out which values and principles are embedded in LLMs in the process of moral justification. For this purpose, we come up with three different moral perspective categories: Western tradition perspective (WT), Abrahamic tradition perspective (AT), and Spiritualist/Mystic tradition perspective (SMT). In two different experiment settings, we asked models to choose principles from the three for suggesting a moral action and evaluating the moral permissibility of an action if one tries to justify an action on these categories, respectively. Our experiments indicate that tested LLMs favors the Western tradition moral perspective over others. Additionally, we observe that there potentially exists an over-alignment towards religious values represented in the Abrahamic Tradition, which causes models to fail to recognize an action is immoral if it is presented as a "religious-action". We believe that these results are essential in order to direct our attention in future efforts.


title: The brain uses renewal points to model random sequences of stimuli

abstract: It has been classically conjectured that the brain assigns probabilistic models to sequences of stimuli. An important issue associated with this conjecture is the identification of the classes of models used by the brain to perform this task. We address this issue by using a new clustering procedure for sets of electroencephalographic (EEG) data recorded from participants exposed to a sequence of auditory stimuli generated by a stochastic chain. This clustering procedure indicates that the brain uses renewal points in the stochastic sequence of auditory stimuli in order to build a model.


title: How to Use Quantum Indistinguishability Obfuscation

abstract: Quantum copy protection, introduced by Aaronson, enables giving out a quantum program-description that cannot be meaningfully duplicated. Despite over a decade of study, copy protection is only known to be possible for a very limited class of programs. As our first contribution, we show how to achieve "best-possible" copy protection for all programs. We do this by introducing quantum state indistinguishability obfuscation (qsiO), a notion of obfuscation for quantum descriptions of classical programs. We show that applying qsiO to a program immediately achieves best-possible copy protection. Our second contribution is to show that, assuming injective one-way functions exist, qsiO is concrete copy protection for a large family of puncturable programs -- significantly expanding the class of copy-protectable programs. A key tool in our proof is a new variant of unclonable encryption (UE) that we call coupled unclonable encryption (cUE). While constructing UE in the standard model remains an important open problem, we are able to build cUE from one-way functions. If we additionally assume the existence of UE, then we can further expand the class of puncturable programs for which qsiO is copy protection. Finally, we construct qsiO relative to an efficient quantum oracle.


title: Optimal control formulation of transition path problems for Markov Jump Processes

abstract: Among various rare events, the effective computation of transition paths connecting metastable states in a stochastic model is an important problem. This paper proposes a stochastic optimal control formulation for transition path problems in an infinite time horizon for Markov jump processes on polish space. An unbounded terminal cost at a stopping time and a controlled transition rate for the jump process regulate the transition from one metastable state to another. The running cost is taken as an entropy form of the control velocity, in contrast to the quadratic form for diffusion processes. Using the Girsanov transformation for Markov jump processes, the optimal control problem in both finite time and infinite time horizon with stopping time fit into one framework: the optimal change of measures in the C\`adl\`ag path space via minimizing their relative entropy. We prove that the committor function, solved from the backward equation with appropriate boundary conditions, yields an explicit formula for the optimal path measure and the associated optimal control for the transition path problem. The unbounded terminal cost leads to a singular transition rate (unbounded control velocity), for which, the Gamma convergence technique is applied to pass the limit for a regularized optimal path measure. The limiting path measure is proved to solve a Martingale problem with an optimally controlled transition rate and the associated optimal control is given by Doob-h transformation. The resulting optimally controlled process can realize the transitions almost surely.


title: Conditions for recurrence and transience for time-inhomogeneous random walks

abstract: The present paper extends the earlier results obtained by Abramov [`Conditions for recurrence and transience for time-inhomogeneous birth-and-death processes' \emph{Bull. Aust. Math. Soc.} \textbf{109} (2024), 393--402] for the case of time-inhomogeneous random walks, the increments of which take values in $\mathbb{R}$. By this, we give a full solution of the open problem formulated by Menshikov and Volkov [`Urn-related random walk with drift $\rho x^\alpha/t^\beta$' \emph{Electron. J. Probab.}, \textbf{13} (2008), paper No. 31, 944--960] that was partially solved in the aforementioned paper by Abramov.


title: Explainable History Distillation by Marked Temporal Point Process

abstract: Explainability of machine learning models is mandatory when researchers introduce these commonly believed black boxes to real-world tasks, especially high-stakes ones. In this paper, we build a machine learning system to automatically generate explanations of happened events from history by \gls{ca} based on the \acrfull{tpp}. Specifically, we propose a new task called \acrfull{ehd}. This task requires a model to distill as few events as possible from observed history. The target is that the event distribution conditioned on left events predicts the observed future noticeably worse. We then regard distilled events as the explanation for the future. To efficiently solve \acrshort{ehd}, we rewrite the task into a \gls{01ip} and directly estimate the solution to the program by a model called \acrfull{model}. This work fills the gap between our task and existing works, which only spot the difference between factual and counterfactual worlds after applying a predefined modification to the environment. Experiment results on Retweet and StackOverflow datasets prove that \acrshort{model} significantly outperforms other \acrshort{ehd} baselines and can reveal the rationale underpinning real-world processes.


title: Probabilistic Physics-integrated Neural Differentiable Modeling for Isothermal Chemical Vapor Infiltration Process

abstract: Chemical vapor infiltration (CVI) is a widely adopted manufacturing technique used in producing carbon-carbon and carbon-silicon carbide composites. These materials are especially valued in the aerospace and automotive industries for their robust strength and lightweight characteristics. The densification process during CVI critically influences the final performance, quality, and consistency of these composite materials. Experimentally optimizing the CVI processes is challenging due to long experimental time and large optimization space. To address these challenges, this work takes a modeling-centric approach. Due to the complexities and limited experimental data of the isothermal CVI densification process, we have developed a data-driven predictive model using the physics-integrated neural differentiable (PiNDiff) modeling framework. An uncertainty quantification feature has been embedded within the PiNDiff method, bolstering the model's reliability and robustness. Through comprehensive numerical experiments involving both synthetic and real-world manufacturing data, the proposed method showcases its capability in modeling densification during the CVI process. This research highlights the potential of the PiNDiff framework as an instrumental tool for advancing our understanding, simulation, and optimization of the CVI manufacturing process, particularly when faced with sparse data and an incomplete description of the underlying physics.


title: Comparisons of Lie algebra cohomologies of $(\varphi,\Gamma)$-modules

abstract: We generalise a result of Fourquaux and Xie thereby completely determining the relationship between $\mathbb{Q}_p$ and $L$-analytic Lie algebra cohomology of analytic $(\varphi_L,\Gamma_L)$-modules. We use the results to conclude that for $L\neq \mathbb{Q}_p,$ there exist examples of \'etale $(\varphi_L,\Gamma_L)$-modules over Robba rings whose $\mathbb{Q}_p$-analytic cohomology does not arise as a base change of Galois cohomology.


title: Atypical behaviors of a tagged particle in asymmetric simple exclusion

abstract: Consider the asymmetric nearest-neighbor exclusion process (ASEP) on ${\mathbb Z}$ with single particle drift $\gamma>0$, starting from a Bernoulli product invariant measure $\nu_\rho$ with density $\rho$. It is known that the position $X_{N}$ of a tagged particle, say initially at the origin, at time $N$ satisfies an a.s. law of large numbers $\frac{1}{N}X_N \rightarrow \gamma(1-\rho)$ as $N\uparrow\infty$. In this context, we study the `typical' behavior of the tagged particle and `bulk' density evolution subject to `atypical' events $\{X_N\geq AN\}$ or $\{X_N\leq AN\}$ for $A\neq \gamma(1-\rho)$. We detail different structures, depending on whether $A<0$, $0\leq A< \gamma(1-\rho)$, $\gamma(1-\rho)<A< \gamma$, or $A\geq \gamma$, under which these atypical events are achieved, and compute associated large deviation costs. Among our results is an `upper tail' large deviation principle in scale $N$ for $\frac{1}{N}X_N$.


title: Deconstructing Magnetization Noise: Degeneracies, Phases, and Mobile Fractionalized Excitations in Tetris Artificial Spin Ice

abstract: Direct detection of spontaneous spin fluctuations, or "magnetization noise", is emerging as a powerful means of revealing and studying magnetic excitations in both natural and artificial frustrated magnets. Depending on the lattice and nature of the frustration, these excitations can often be described as fractionalized quasiparticles possessing an effective magnetic charge. Here, by combining ultrasensitive optical detection of thermodynamic magnetization noise with Monte Carlo simulations, we reveal emergent regimes of magnetic excitations in artificial "tetris ice". A marked increase of the intrinsic noise at certain applied magnetic fields heralds the spontaneous proliferation of fractionalized excitations, which can diffuse independently, without cost in energy, along specific quasi-1D spin chains in the tetris ice lattice.


title: Global Solutions For Systems of Quadratic Nonlinear Schr\"odinger Equations in 3D

abstract: In this work, we prove global well-posedness and scattering for systems of quadratic nonlinear Schr\"odinger equations in the critical three-dimensional case, for small, localized data. For the terms corresponding to the nonlinearity $u\bar{u}$, we need to do an $\epsilon$ regularization of this part of the nonlinearity. In order to tackle quadratic space-time resonances, after performing a Littlewood-Paley decomposition, we use integration by parts in the Duhamel term, to take advantage of the oscillations when space-time resonances are absent.


title: Designing Theory of Computing Backwards

abstract: The design of any technical Computer Science course must involve its context within the institution's CS program, but also incorporate any new material that is relevant and appropriately accessible to students. In many institutions, theory of computing (ToC) courses within undergraduate CS programs are often placed near the end of the program, and have a very common structure of building off previous sections of the course. The central question behind any such course is ``What are the limits of computers?'' for various types of computational models. However, what is often intuitive for students about what a ``computer'' is--a Turing machine--is taught at the end of the course, which necessitates motivation for earlier models. This poster contains our experiences in designing a ToC course that teaches the material effectively ``backwards,'' with pedagogic motivation of instead asking the question ``What suitable restrictions can we place on computers to make their problems tractable?'' We also give recommendations for future course design.


title: IruMozhi: Automatically classifying diglossia in Tamil

abstract: Tamil, a Dravidian language of South Asia, is a highly diglossic language with two very different registers in everyday use: Literary Tamil (preferred in writing and formal communication) and Spoken Tamil (confined to speech and informal media). Spoken Tamil is under-supported in modern NLP systems. In this paper, we release IruMozhi, a human-annotated dataset of parallel text in Literary and Spoken Tamil. We train classifiers on the task of identifying which variety a text belongs to. We use these models to gauge the availability of pretraining data in Spoken Tamil, to audit the composition of existing labelled datasets for Tamil, and to encourage future work on the variety.


title: Optimal Summary Statistics for X-ray Polarization

abstract: We develop two new highly efficient estimators to measure the polarization (Stokes parameters) in experiments that constrain the position angle of individual photons such as scattering and gas-pixel-detector polarimeters, and analyse in detail a previously proposed estimator. All three of these estimators are at least fifty percent more efficient on typical datasets than the standard estimator used in the field. We present analytic estimates of the variance of these estimators and numerical experiments to verify these estimates. Two of the three estimators can be calculated quickly and directly through summations over the measurements of individual photons.


title: Assessing Test-time Variability for Interactive 3D Medical Image Segmentation with Diverse Point Prompts

abstract: Interactive segmentation model leverages prompts from users to produce robust segmentation. This advancement is facilitated by prompt engineering, where interactive prompts serve as strong priors during test-time. However, this is an inherently subjective and hard-to-reproduce process. The variability in user expertise and inherently ambiguous boundaries in medical images can lead to inconsistent prompt selections, potentially affecting segmentation accuracy. This issue has not yet been extensively explored for medical imaging. In this paper, we assess the test-time variability for interactive medical image segmentation with diverse point prompts. For a given target region, the point is classified into three sub-regions: boundary, margin, and center. Our goal is to identify a straightforward and efficient approach for optimal prompt selection during test-time based on three considerations: (1) benefits of additional prompts, (2) effects of prompt placement, and (3) strategies for optimal prompt selection. We conduct extensive experiments on the public Medical Segmentation Decathlon dataset for challenging colon tumor segmentation task. We suggest an optimal strategy for prompt selection during test-time, supported by comprehensive results. The code is publicly available at https://github.com/MedICL-VU/variability


title: Creation of a CS1 Course with Modern C++ Principles

abstract: Best practices in programming need to be emphasized in a CS1 course as bad student habits persist if not reinforced well. The C++ programming language, although a relatively old language, has been regularly updated with new versions since 2011, on the pace of once every three years. Each new version contains important features that make the C++ language more complex for backwards compatibility, but often introduce new features to make common use cases simpler to implement. This poster contains experiences in designing a CS1 course that uses the C++ programming language that incorporates ``modern'' versions of the language from the start, as well as recent conferences about the language. Our goals were to prevent many common bad habits among C++ programmers.


title: A Primal-Dual Analysis of Monotone Submodular Maximization

abstract: In this paper we design a new primal-dual algorithm for the classic discrete optimization problem of maximizing a monotone submodular function subject to a cardinality constraint achieving the optimal approximation of $(1-1/e)$. This problem and its special case, the maximum $k$-coverage problem, have a wide range of applications in various fields including operations research, machine learning, and economics. While greedy algorithms have been known to achieve this approximation factor, our algorithms also provide a dual certificate which upper bounds the optimum value of any instance. This certificate may be used in practice to certify much stronger guarantees than the worst-case $(1-1/e)$ approximation factor.


title: Non-radiative configurations of a few quantum emitters ensembles: evolutionary optimization approach

abstract: In this work, we employ differential evolution algorithm to identify the optimal configurations of small atomic ensembles supporting quantum states with maximal radiative lifetime. We demonstrate that atoms mostly tend to assemble in quasi-regular structures with specific geometry strongly depending on the minimal interatomic distance $r_{min}$. We identified the clear underlying physics that governs the suppression of the radiative losses in particular geometries. However, we reveal that the specific configurations in small ensembles are not easily predictable based on the knowledge established for the arrays of large size. In particular, the states that inherit their properties from bound states in continuum in infinite lattices turn out to be the most subradiant in a wide range of $r_{min}$ values. We also show that for small interatomic distance the chains with modulated interatomic distances exhibit fast exponential decrease of the radiative losses with the size of the ensemble.


title: The D3-anti-D3-Brane Inflation Model Revisited

abstract: Combining previous results, the D3-anti-D3-brane pair potential U(T,{\phi}) is presented here, where the inflaton {\phi} measures the separation between the D3-brane and the anti-D3-brane, and the complex scalar mode T becomes tachyonic when the annihilation of the branes happens as they collide. Besides the distinct form of the inflationary potential, this hybrid inflationary model differs from a typical hybrid model in 2 important aspects: (1) U(T,{\phi}) becomes complex when T becomes tachyonic, where Im U(T,{\phi}) plays an important role in the dynamics towards the end of the inflationary epoch; (2) tunnelling during the inflationary epoch can happen; this is particularly relevant if there are multiple D3-anti-D3-brane pairs in different warped throats. Besides the production of cosmic superstrings, the model offers the possibility of first order phase transition that may generate large enough density perturbation for the primordial black hole production. Stochastic gravitational wave background from these sources remain to be fully investigated.


title: In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax

abstract: In-context learning (ICL) is now a common method for teaching large language models (LLMs) new tasks: given labeled examples in the input context, the LLM learns to perform the task without weight updates. Do models guided via ICL infer the underlying structure of the task defined by the context, or do they rely on superficial heuristics that only generalize to identically distributed examples? We address this question using transformations tasks and an NLI task that assess sensitivity to syntax - a requirement for robust language understanding. We further investigate whether out-of-distribution generalization can be improved via chain-of-thought prompting, where the model is provided with a sequence of intermediate computation steps that illustrate how the task ought to be performed. In experiments with models from the GPT, PaLM, and Llama 2 families, we find large variance across LMs. The variance is explained more by the composition of the pre-training corpus and supervision methods than by model size; in particular, models pre-trained on code generalize better, and benefit more from chain-of-thought prompting.


title: The formation of blue large-amplitude pulsators from white-dwarf main-sequence star mergers

abstract: Blue large-amplitude pulsators (BLAPs) are hot low-mass stars which show large-amplitude light variations likely due to radial oscillations driven by iron-group opacities. Period changes provide evidence of both secular contraction and expansion amongst the class. Various formation histories have been proposed, but none are completely satisfactory. \citet{Zhang2017} proposed that the merger of a helium core white dwarf with a low-mass main-sequence star (HeWD+MS) can lead to the formation of some classes of hot subdwarf. We have analyzed these HeWD+MS merger models in more detail. Between helium-shell ignition and full helium-core burning, the models pass through the volume of luminosity -- gravity-- temperature space occupied by BLAPs. Periods of expansion and contraction associated with helium-shell flashes can account for the observed rates of period change. We argue that the HeWD+MS merger model provides at least one BLAP formation channel.


title: Rigidity of Travelling Times for Strictly Convex Obstacles in Riemannian Manifolds

abstract: Let $K$ and $L$ be two disjoint unions of strictly convex obstacles contained within a Riemannian manifold with boundary $S$ of dimension $m\geq 2$. The sets of travelling times $\mathcal{T}_K$ and $\mathcal{T}_L$ of $K$ and $L$, respectively, are composed of triples $(x,y,t)\in\partial S\times\partial S\times\mathbb{R}^+$ where $t$ is the length of a billiard trajectory with endpoints $x$ and $y$ that reflects elastically on $K$ (or $L$ for $(x,y,t)\in\mathcal{T}_L$). It has been shown (arXiv:2309.11141) that (under some natural curvature bounds on $S$) if $\mathcal{T}_K=\mathcal{T}_L$ and $K$ and $L$ were equivalent up to tangency then $K = L$. In this paper we remove this requirement for $K$ and $L$, and show that if $\mathcal{T}_K = \mathcal{T}_L$ then $K = L$ whenever $m\geq 3$.


title: A novel and simple spectral method for nonlocal PDEs with the fractional Laplacian

abstract: We propose a novel and simple spectral method based on the semi-discrete Fourier transforms to discretize the fractional Laplacian $(-\Delta)^\frac{\alpha}{2}$. Numerical analysis and experiments are provided to study its performance. Our method has the same symbol $|\boldsymbol\xi|^\alpha$ as the fractional Laplacian $(-\Delta)^\frac{\alpha}{2}$ at the discrete level, and thus it can be viewed as the exact discrete analogue of the fractional Laplacian. This {\it unique feature} distinguishes our method from other existing methods for the fractional Laplacian. Note that our method is different from the Fourier pseudospectral methods in the literature which are usually limited to periodic boundary conditions (see Remark \ref{remark0}). Numerical analysis shows that our method can achieve a spectral accuracy. The stability and convergence of our method in solving the fractional Poisson equations were analyzed. Our scheme yields a multilevel Toeplitz stiffness matrix, and thus fast algorithms can be developed for efficient matrix-vector multiplications. The computational complexity is ${\mathcal O}(2N\log(2N))$, and the memory storage is ${\mathcal O}(N)$ with $N$ the total number of points. Extensive numerical experiments verify our analytical results and demonstrate the effectiveness of our method in solving various problems.


title: Cooperative AI via Decentralized Commitment Devices

abstract: Credible commitment devices have been a popular approach for robust multi-agent coordination. However, existing commitment mechanisms face limitations like privacy, integrity, and susceptibility to mediator or user strategic behavior. It is unclear if the cooperative AI techniques we study are robust to real-world incentives and attack vectors. However, decentralized commitment devices that utilize cryptography have been deployed in the wild, and numerous studies have shown their ability to coordinate algorithmic agents facing adversarial opponents with significant economic incentives, currently in the order of several million to billions of dollars. In this paper, we use examples in the decentralization and, in particular, Maximal Extractable Value (MEV) (arXiv:1904.05234) literature to illustrate the potential security issues in cooperative AI. We call for expanded research into decentralized commitments to advance cooperative AI capabilities for secure coordination in open environments and empirical testing frameworks to evaluate multi-agent coordination ability given real-world commitment constraints.


title: Leveraging Large Language Models to Detect Influence Campaigns in Social Media

abstract: Social media influence campaigns pose significant challenges to public discourse and democracy. Traditional detection methods fall short due to the complexity and dynamic nature of social media. Addressing this, we propose a novel detection method using Large Language Models (LLMs) that incorporates both user metadata and network structures. By converting these elements into a text format, our approach effectively processes multilingual content and adapts to the shifting tactics of malicious campaign actors. We validate our model through rigorous testing on multiple datasets, showcasing its superior performance in identifying influence efforts. This research not only offers a powerful tool for detecting campaigns, but also sets the stage for future enhancements to keep up with the fast-paced evolution of social media-based influence tactics.


title: Closer look at the matching condition for radiative QCD $\theta$ parameter

abstract: In this paper, we scrutinize a radiatively generated QCD $\theta$ parameter at the two-loop level based on both full analytical loop functions with the Fock-Schwinger gauge method and the effective field theory approach, using simplified models. We observe that the radiatively generated $\theta$ parameters at the low energy scale precisely match between them. It provides validity to perturbative loop calculations of the QCD $\theta$ parameter with the Fock-Schwinger gauge method. Furthermore, it is also shown that the ordinary Fujikawa method for the radiative $\theta$ parameter by using $\bar\theta = - arg det M_q^{loop}$ does not cover all contributions in the simplified models. But, we also find that when there is a scale hierarchy in $CP$-violating sector, evaluation of the Fujikawa method is numerically sufficient. As an application, we calculate the radiative $\theta$ parameter at the two-loop level in a slightly extended Nelson-Barr model, where the spontaneous $CP$ violation occurs to solve the strong $CP$ problem. It is found a part of the radiative $\theta$ parameters cannot be described by the Fujikawa method.


title: Container Resource Allocation versus Performance of Data-intensive Applications on Different Cloud Servers

abstract: In recent years, data-intensive applications have been increasingly deployed on cloud systems. Such applications utilize significant compute, memory, and I/O resources to process large volumes of data. Optimizing the performance and cost-efficiency for such applications is a non-trivial problem. The problem becomes even more challenging with the increasing use of containers, which are popular due to their lower operational overheads and faster boot speed at the cost of weaker resource assurances for the hosted applications. In this paper, two containerized data-intensive applications with very different performance objectives and resource needs were studied on cloud servers with Docker containers running on Intel Xeon E5 and AMD EPYC Rome multi-core processors with a range of CPU, memory, and I/O configurations. Primary findings from our experiments include: 1) Allocating multiple cores to a compute-intensive application can improve performance, but only if the cores do not contend for the same caches, and the optimal core counts depend on the specific workload; 2) allocating more memory to a memory-intensive application than its deterministic data workload does not further improve performance; however, 3) having multiple such memory-intensive containers on the same server can lead to cache and memory bus contention leading to significant and volatile performance degradation. The comparative observations on Intel and AMD servers provided insights into trade-offs between larger numbers of distributed chiplets interconnected with higher speed buses (AMD) and larger numbers of centrally integrated cores and caches with lesser speed buses (Intel). For the two types of applications studied, the more distributed caches and faster data buses have benefited the deployment of larger numbers of containers.


title: Imaging Self-aligned Moir\'e Crystals and Quasicrystals in Magic-angle Bilayer Graphene on hBN Heterostructures

abstract: Using scanning-tunneling-microscopy and theoretical modeling on heterostructures of twisted bilayer graphene and hexagonal Boron-Nitride, we show that the emergent super-moire structures display a rich landscape of moire-crystals and quasicrystals. We reveal a phase-diagram comprised of commensurate moire-crystals embedded in swaths of moire quasicrystals. The 1:1 commensurate crystal, expected to be a Chern insulator, should only exist at one point on the phase-diagram, implying that it ought to be practically undetectable. Surprisingly we find that the commensurate crystals exist over a much wider than predicted range, providing evidence of an unexpected self-alignment mechanism that is explained using an elastic-network model. The remainder of the phase-diagram, where we observe tunable quasicrystals, affords a new platform for exploring the unique electronic-properties of these rarely found in nature structures.


title: On the Analysis of Cross-Lingual Prompt Tuning for Decoder-based Multilingual Model

abstract: An exciting advancement in the field of multilingual models is the emergence of autoregressive models with zero- and few-shot capabilities, a phenomenon widely reported in large-scale language models. To further improve model adaptation to cross-lingual tasks, another trend is to further fine-tune the language models with either full fine-tuning or parameter-efficient tuning. However, the interaction between parameter-efficient fine-tuning (PEFT) and cross-lingual tasks in multilingual autoregressive models has yet to be studied. Specifically, we lack an understanding of the role of linguistic distributions in multilingual models in the effectiveness of token-based prompt tuning. To address this question, we conduct experiments comparing prompt tuning and fine-tuning on the decoder-based multilingual model, XGLM, with four cross-lingual tasks (XNLI, PAWS-X, POS, NER). According to our study, prompt tuning achieves on par or better performance over fine-tuning across all languages while updating at most 0.13\% of the model parameters. Moreover, we empirically show that prompt tuning is more effective in enhancing the performance of low-resource languages than fine-tuning. Our further analysis shows that the phenomenon is related to the tokenization scheme of the multilingual model.


title: Statistical Parameterized Physics-Based Machine Learning Digital Twin Models for Laser Powder Bed Fusion Process

abstract: A digital twin (DT) is a virtual representation of physical process, products and/or systems that requires a high-fidelity computational model for continuous update through the integration of sensor data and user input. In the context of laser powder bed fusion (LPBF) additive manufacturing, a digital twin of the manufacturing process can offer predictions for the produced parts, diagnostics for manufacturing defects, as well as control capabilities. This paper introduces a parameterized physics-based digital twin (PPB-DT) for the statistical predictions of LPBF metal additive manufacturing process. We accomplish this by creating a high-fidelity computational model that accurately represents the melt pool phenomena and subsequently calibrating and validating it through controlled experiments. In PPB-DT, a mechanistic reduced-order method-driven stochastic calibration process is introduced, which enables the statistical predictions of the melt pool geometries and the identification of defects such as lack-of-fusion porosity and surface roughness, specifically for diagnostic applications. Leveraging data derived from this physics-based model and experiments, we have trained a machine learning-based digital twin (PPB-ML-DT) model for predicting, monitoring, and controlling melt pool geometries. These proposed digital twin models can be employed for predictions, control, optimization, and quality assurance within the LPBF process, ultimately expediting product development and certification in LPBF-based metal additive manufacturing.

categories: cs.LG cs.CE cs.NA math.NA physics.data-an


title: A Central Motor System Inspired Pre-training Reinforcement Learning for Robotic Control

abstract: Designing controllers to achieve natural motor capabilities for multi-joint robots is a significant challenge. However, animals in nature are naturally with basic motor abilities and can master various complex motor skills through acquired learning. On the basis of analyzing the mechanism of the central motor system in mammals, we propose a novel pre-training reinforcement learning algorithm that enables robots to learn rich motor skills and apply them to complex task environments without relying on external data. We first design a skill based network similar to the cerebellum by utilizing the selection mechanism of voluntary movements in the basal ganglia and the basic motor regulation ability of the cerebellum. Subsequently, by imitating the structure of advanced centers in the central motor system, we propose a high-level policy to generate different skill combinations, thereby enabling the robot to acquire natural motor abilities. We conduct experiments on 4 types of robots and 22 task environments, and the results show that the proposed method can enable different types of robots to achieve flexible motor skills. Overall, our research provides a promising framework for the design of neural network motor controllers.


title: Plug-and-Play Latent Feature Editing for Orientation-Adaptive Quantitative Susceptibility Mapping Neural Networks

abstract: Quantitative susceptibility mapping (QSM) is a post-processing technique for deriving tissue magnetic susceptibility distribution from MRI phase measurements. Deep learning (DL) algorithms hold great potential for solving the ill-posed QSM reconstruction problem. However, a significant challenge facing current DL-QSM approaches is their limited adaptability to magnetic dipole field orientation variations during training and testing. In this work, we propose a novel Orientation-Adaptive Latent Feature Editing (OA-LFE) module to learn the encoding of acquisition orientation vectors and seamlessly integrate them into the latent features of deep networks. Importantly, it can be directly Plug-and-Play (PnP) into various existing DL-QSM architectures, enabling reconstructions of QSM from arbitrary magnetic dipole orientations. Its effectiveness is demonstrated by combining the OA-LFE module into our previously proposed phase-to-susceptibility single-step instant QSM (iQSM) network, which was initially tailored for pure-axial acquisitions. The proposed OA-LFE-empowered iQSM, which we refer to as iQSM+, is trained in a self-supervised manner on a specially-designed simulation brain dataset. Comprehensive experiments are conducted on simulated and in vivo human brain datasets, encompassing subjects ranging from healthy individuals to those with pathological conditions. These experiments involve various MRI platforms (3T and 7T) and aim to compare our proposed iQSM+ against several established QSM reconstruction frameworks, including the original iQSM. The iQSM+ yields QSM images with significantly improved accuracies and mitigates artifacts, surpassing other state-of-the-art DL-QSM algorithms.


title: Schr\"oder trees, antipode formulas and non-commutative probability

abstract: We obtain a cancellation-free formula, represented in terms of Schr\"oder trees, for the antipode in the double tensor Hopf algebra introduced by Ebrahimi-Fard and Patras. We apply the antipode formula in the context of non-commutative probability and recover cumulant-moment formulas as well as a new expression for Anshelevich's free Wick polynomials in terms of Schr\"oder trees.


title: Cauchy-Riemann beams

abstract: By using operator techniques, we solve the paraxial wave equation for a field given by the multiplication of a Gaussian function and an entire function. The latter possesses a unique property, being an eigenfunction of the {\it perpendicular} Laplacian with a zero eigenvalue, a consequence of the Cauchy-Riemann equations. We demonstrate, both theoretically and experimentally, the inherent rotation of this field during its propagation. The explanation for these rotations lies in the utilization of the quantum (Bohm) potential. The simplicity of this outcome reveals promising prospects: it enables the analytical deduction of the Fraunhofer or Fresnel diffraction pattern. In essence, this means that obtaining the Fresnel or Fourier transform of a function satisfying the Cauchy-Riemann equations becomes a straightforward task.


title: Adaptive Search Optimization: Dynamic Algorithm Selection and Caching for Enhanced Database Performance

abstract: Efficient search operations in databases are paramount for timely retrieval of information various applications. This research introduces a novel approach, combining dynamicalgorithm1 selection and caching2 strategies, to optimize search performance. The proposed dynamic search algorithm intelligently switches between Binary3 and Interpolation 4 Search based on dataset characteristics, significantly improving efficiency for non-uniformly distributed data. Additionally, a robust caching mechanism5 stores and retrieves previous search results, further enhancing computational efficiency6. Theoretical analysis and extensive experiments demonstrate the effectiveness of the approach, showcasing its potential to revolutionize database performance7 in scenarios with diverse data distributions. This research contributes valuable insights and practical solutions to the realm of database optimization, offering a promising avenue for enhancing search operations in real-world applications


title: Semiclassical truncated-Wigner-approximation theory of molecular-vibration-polariton dynamics in optical cavities

abstract: It has been experimentally demonstrated that molecular-vibration polaritons formed by strong coupling of a molecular vibration to an infrared cavity mode can significantly modify the physical properties and chemical reactivity of various molecular systems. However, a complete theoretical understanding of the underlying mechanisms of the modifications remains elusive due to the complexity of the hybrid system, especially the collective nature of polaritonic states in systems containing many molecules. We develop here the semiclassical theory of molecular-vibration-polariton dynamics based on the truncated Wigner approximation (TWA) that is tractable in large molecular systems and simultaneously captures the quantum character of photons in the optical cavity. The theory is then applied to investigate the nuclear quantum dynamics of a system of identical diatomic molecules having the ground-state Morse potential and strongly coupled to an infrared cavity mode in the ultrastrong coupling regime. The validity of TWA is examined by comparing it with the fully quantum dynamics of a single-molecule system for two different initial states in the dipole and Coulomb gauges. For the initial tensor-product ground state in the dipole gauge, which corresponds to a light-matter entangled state in the Coulomb gauge, the collective and resonance effects of molecular-vibration-polariton formation on the nuclear dynamics are observed in a system of many molecules.


title: Machine learning analysis of dimensional reduction conjecture for nonequilibrium Berezinskii-Kosterlitz-Thouless transition in three dimensions

abstract: We investigate the recently proposed dimensional reduction conjecture in driven disordered systems using a machine learning technique. The conjecture states that a static snapshot of a disordered system driven at a constant velocity is equal to a space-time trajectory of its lower-dimensional pure counterpart. This suggests that the three-dimensional random field XY model exhibits the Berezinskii-Kosterlitz-Thouless transition when driven out of equilibrium. To verify the conjecture directly by observing configurations of the system, we utilize the capacity of neural networks to detect subtle features of images. Specifically, we train a convolutional neural network to differentiate snapshots of the three-dimensional driven random field XY model from space-time trajectories of the two-dimensional pure XY model. Our results demonstrate that the network cannot distinguish between the two, confirming the dimensional reduction conjecture.


title: A Coding Scheme for Unresponsive and Byzantine Server Resilient Quantum $X$-Secure $T$-Private Information Retrieval

abstract: Building on recent constructions of Quantum Cross Subspace Alignment (QCSA) codes, this work develops a coding scheme for QEBXSTPIR, i.e., classical private information retrieval with $X$-secure storage and $T$-private queries, over a quantum multiple access channel, that is resilient to any set of up to $E$ erased servers (equivalently known as unresponsive servers, or stragglers) together with any set of up to $B$ Byzantine servers. The scheme is accordingly labeled QEBCSA, with the `E' and `B' indicating resilience to erased and Byzantine servers respectively. The QEBCSA code structure may be broadly useful for problems such as quantum coded secure distributed computation, where security, straggler resilience, and distributed superdense coding gains are simultaneously required. The $X$-security property is further exploited to improve the communication rate when $\epsilon$-error decoding is allowed.


title: Challenges in molecular dynamics simulations of heat exchange statistics

abstract: We study heat exchange in temperature-biased metal-molecule-metal molecular junctions by employing the LAMMPS atomic molecular dynamics simulator. Generating the nonequilibrium steady state with Langevin thermostats at the boundaries of the junction, we show that the {\it average} heat current across a gold-alkanedithiol-gold nanojunction behaves correctly-physically, with the thermal conductance value matching the literature. In contrast, the {\it full probability distribution function} for heat exchange, as generated by the simulator, violates the fundamental fluctuation symmetry for entropy production. We trace this failure back to the implementation of the thermostats and the expression used to calculate the heat exchange. To rectify this issue and produce the correct statistics, we introduce single-atom thermostats as an alternative to conventional many-atom thermostats. Once averaging heat exchange over the hot and cold thermostats, this approach successfully generates the correct probability distribution function, which we use to study the behavior of both the average heat current and its noise. We further examine the thermodynamic uncertainty relation in the molecular junction and show that it holds, albeit demonstrating nontrivial trends. Our study points to the need to carefully implement nonequilibrium molecular dynamics solvers in atomistic simulation software tools for future investigations of noise phenomena in thermal transport.


title: Covering Codes, List-Decodable Codes and Strong Singleton-Like Bounds in the Sum-Rank Metric

abstract: Codes in the sum-rank metric have received many attentions in recent years, since they have wide applications in the multishot network coding, the space-time coding and the distributed storage. Fundamental bounds, some explicit or probabilistic constructions of sum-rank codes and their decoding algorithms have been developed in previous papers. In this paper, we construct covering codes in the sum-rank metric from covering codes in the Hamming metric. Then some upper bounds on sizes of covering codes in the sum-rank metric are presented. Block length functions of covering codes in the sum-rank metric are also introduced and studied. As applications of our upper bounds on covering codes in the sum-rank metric and block length functions, several strong Singleton-like bounds on sum-rank codes are proposed and proved. These strong Singleton-like bounds are much stronger than the Singleton-like bound for sum-rank codes, when block lengths are larger and minimum sum-rank distances are small. An upper bound on sizes of list-decodable codes in the sum-rank metric is also given, which leads to an asymptotic bound on list-decodability of sum-rank codes. We also give upper bounds on block lengths of general MSRD codes.


title: Mass Ratio Distribution of Hierarchical Triple Systems from the LAMOST-MRS Survey

abstract: Hierarchical triple-star systems consists of three components organised into an inner binary ($M_{1}$,$M_{2}$) and a more distant outer tertiary ($M_{3}$) star. The LAMOST Medium-Resolution Spectroscopic Survey (LAMOST-MRS) has offered a great sample for the study of triple system populations. We used the Peak Amplitude Ratio (PAR) method to obtain the mass ratio ($q_\mathrm{{in}}$, $q_\mathrm{{out}}$) of a triple system from its normalised spectrum. By calculating Cross-Correlation Function (CCF), we determined the correlation between the mass ratio $q_\mathrm{{out}}$ ($M_{3}$/($M_{1}$+$M_{2}$)) and the amplitude ratio ($A_{3}$/($A_{1}$+$A_{2}$)). We derived $q_\mathrm{{in}}$ of $0.5-1.0$ and $q_\mathrm{{out}}$ between 0.2 and 0.8. By fitting a power-law function of the corrected $q_\mathrm{{in}}$ distribution, the $\gamma_\mathrm{{in}}$ are estimated to be $-0.654\pm2.915$, $4.304\pm1.125$ and $11.371\pm1.309$ for A, F and G type stars. The derived $\gamma_\mathrm{{in}}$-values increase as the mass decrease, indicating that less massive stars are more likely to have companion stars with similar masses. By fitting a power-law function of the corrected $q_\mathrm{{out}}$ distribution, the ${\gamma_\mathrm{{out}}}$ are estimated to be $-2.016\pm0.172$, $-1.962\pm0.853$ and $-1.238\pm0.141$ for G, F and A type stars, respectively. The ${\gamma_\mathrm{{out}}}$-values show a trend of growth toward lower primary star masses.


title: Toward Efficient and Incremental Spectral Clustering via Parametric Spectral Clustering

abstract: Spectral clustering is a popular method for effectively clustering nonlinearly separable data. However, computational limitations, memory requirements, and the inability to perform incremental learning challenge its widespread application. To overcome these limitations, this paper introduces a novel approach called parametric spectral clustering (PSC). By extending the capabilities of spectral clustering, PSC addresses the challenges associated with big data and real-time scenarios and enables efficient incremental clustering with new data points. Experimental evaluations conducted on various open datasets demonstrate the superiority of PSC in terms of computational efficiency while achieving clustering quality mostly comparable to standard spectral clustering. The proposed approach has significant potential for incremental and real-time data analysis applications, facilitating timely and accurate clustering in dynamic and evolving datasets. The findings of this research contribute to the advancement of clustering techniques and open new avenues for efficient and effective data analysis. We publish the experimental code at https://github.com/109502518/PSC_BigData.


title: Research on the X-Ray Polarization Deconstruction Method Based on Hexagonal Convolutional Neural Network

abstract: Track reconstruction algorithms are critical for polarization measurements. In addition to traditional moment-based track reconstruction approaches, convolutional neural networks (CNN) are a promising alternative. However, hexagonal grid track images in gas pixel detectors (GPD) for better anisotropy do not match the classical rectangle-based CNN, and converting the track images from hexagonal to square results in loss of information. We developed a new hexagonal CNN algorithm for track reconstruction and polarization estimation in X-ray polarimeters, which was used to extract emission angles and absorption points from photoelectron track images and predict the uncertainty of the predicted emission angles. The simulated data of PolarLight test were used to train and test the hexagonal CNN models. For individual energies, the hexagonal CNN algorithm produced 15-30% improvements in modulation factor compared to moment analysis method for 100% polarized data, and its performance was comparable to rectangle-based CNN algorithm newly developed by IXPE team, but at a much less computational cost.


title: Expanding neutrino oscillation parameter measurements in NOvA using a Bayesian approach

abstract: NOvA is a long-baseline neutrino oscillation experiment that measures oscillations in charged-current $\nu_{\mu} \rightarrow \nu_{\mu}$ (disappearance) and $\nu_{\mu} \rightarrow \nu_{e}$ (appearance) channels, and their antineutrino counterparts, using neutrinos of energies around 2 GeV over a distance of 810 km. In this work we reanalyze the dataset first examined in our previous paper [Phys. Rev. D 106, 032004 (2022)] using an alternative statistical approach based on Bayesian Markov Chain Monte Carlo. We measure oscillation parameters consistent with the previous results. We also extend our inferences to include the first NOvA measurements of the reactor mixing angle $\theta_{13}$ and the Jarlskog invariant. We use these results to quantify the strength of our inferences about CP violation, as well as to examine the effects of constraints from short-baseline measurements of $\theta_{13}$ using antineutrinos from nuclear reactors when making NOvA measurements of $\theta_{23}$. Our long-baseline measurement of $\theta_{13}$ is also shown to be consistent with the reactor measurements, supporting the general applicability and robustness of the PMNS framework for neutrino oscillations.


title: Gaia GraL: Gaia DR2 Gravitational Lens Systems. VIII. A radio census of lensed systems

abstract: We present radio observations of 24 confirmed and candidate strongly lensed quasars identified by the Gaia Gravitational Lenses (GraL) working group. We detect radio emission from 8 systems in 5.5 and 9 GHz observations with the Australia Telescope Compact Array (ATCA), and 12 systems in 6 GHz observations with the Karl G. Jansky Very Large Array (VLA). The resolution of our ATCA observations is insufficient to resolve the radio emission into multiple lensed images, but we do detect multiple images from 11 VLA targets. We have analysed these systems using our observations in conjunction with existing optical measurements, including measuring offsets between the radio and optical positions, for each image and building updated lens models. These observations significantly expand the existing sample of lensed radio quasars, suggest that most lensed systems are detectable at radio wavelengths with targeted observations, and demonstrate the feasibility of population studies with high resolution radio imaging.


title: Gauss's form class groups and Shimura's canonical models

abstract: Let $N$ be a positive integer and $\Gamma$ be a subgroup of $\mathrm{SL}_2(\mathbb{Z})$ containing $\Gamma_1(N)$. Let $K$ be an imaginary quadratic field and $\mathcal{O}$ be an order of discriminant $D_\mathcal{O}$ in $K$. Under some assumptions, we show that $\Gamma$ induces a form class group of discriminant $D_\mathcal{O}$ (or of order $\mathcal{O}$) and level $N$ if and only if there is a certain canonical model of the modular curve for $\Gamma$ defined over a suitably small number field. In this way we can find an interesting link between two different subjects, which will be useful in the study of certain quadratic Diophantine equations in terms of primes $p$.


title: LLatrieval: LLM-Verified Retrieval for Verifiable Generation

abstract: Verifiable generation aims to let the large language model (LLM) generate text with supporting documents, which enables the user to flexibly verify the answer and makes the LLM's output more reliable. Retrieval plays a crucial role in verifiable generation. Specifically, the retrieved documents not only supplement knowledge to help the LLM generate correct answers, but also serve as supporting evidence for the user to verify the LLM's output. However, the widely used retrievers become the bottleneck of the entire pipeline and limit the overall performance. Their capabilities are usually inferior to LLMs since they often have much fewer parameters than the large language model and have not been demonstrated to scale well to the size of LLMs. If the retriever does not correctly find the supporting documents, the LLM can not generate the correct and verifiable answer, which overshadows the LLM's remarkable abilities. To address these limitations, we propose \LLatrieval (Large Language Model Verified Retrieval), where the LLM updates the retrieval result until it verifies that the retrieved documents can sufficiently support answering the question. Thus, the LLM can iteratively provide feedback to retrieval and facilitate the retrieval result to fully support verifiable generation. Experiments show that LLatrieval significantly outperforms extensive baselines and achieves state-of-the-art results.


title: Dynamics of Inspiraling Dark Energy

abstract: We investigate the dynamics of a multifield dark energy model, which arises from certain rapid-turning and inspiraling trajectories in field space. We find the speed of sound $c_s$ of the dark energy perturbations around the background and show that $c_s$ is monotonically decreasing with time. Furthermore, it has a positive-definite lower bound that implies a certain clustering scale. We also extend the previously known background solution for dark energy to an exact solution that includes matter. This allows us to address the implications of our model for two cosmological tensions. More precisely, we argue that the $\sigma_8$ tension can be alleviated generically, while reducing the Hubble tension requires certain constraints on the parameter space of the model. Notably, a necessary condition for alleviating the Hubble tension is that the transition from matter domination to the dark energy epoch begins earlier than in $\Lambda$CDM.


title: Enabling Decision-Support Systems through Automated Cell Tower Detection

abstract: Cell phone coverage and high-speed service gaps persist in rural areas in sub-Saharan Africa, impacting public access to mobile-based financial, educational, and humanitarian services. Improving maps of telecommunications infrastructure can help inform strategies to eliminate gaps in mobile coverage. Deep neural networks, paired with remote sensing images, can be used for object detection of cell towers and eliminate the need for inefficient and burdensome manual mapping to find objects over large geographic regions. In this study, we demonstrate a partially automated workflow to train an object detection model to locate cell towers using OpenStreetMap (OSM) features and high-resolution Maxar imagery. For model fine-tuning and evaluation, we curated a diverse dataset of over 6,000 unique images of cell towers in 26 countries in eastern, southern, and central Africa using automatically generated annotations from OSM points. Our model achieves an average precision at 50% Intersection over Union (IoU) (AP@50) of 81.2 with good performance across different geographies and out-of-sample testing. Accurate localization of cell towers can yield more accurate cell coverage maps, in turn enabling improved delivery of digital services for decision-support applications.


title: PEMS: Pre-trained Epidemic Time-series Models

abstract: Providing accurate and reliable predictions about the future of an epidemic is an important problem for enabling informed public health decisions. Recent works have shown that leveraging data-driven solutions that utilize advances in deep learning methods to learn from past data of an epidemic often outperform traditional mechanistic models. However, in many cases, the past data is sparse and may not sufficiently capture the underlying dynamics. While there exists a large amount of data from past epidemics, leveraging prior knowledge from time-series data of other diseases is a non-trivial challenge. Motivated by the success of pre-trained models in language and vision tasks, we tackle the problem of pre-training epidemic time-series models to learn from multiple datasets from different diseases and epidemics. We introduce Pre-trained Epidemic Time-Series Models (PEMS) that learn from diverse time-series datasets of a variety of diseases by formulating pre-training as a set of self-supervised learning (SSL) tasks. We tackle various important challenges specific to pre-training for epidemic time-series such as dealing with heterogeneous dynamics and efficiently capturing useful patterns from multiple epidemic datasets by carefully designing the SSL tasks to learn important priors about the epidemic dynamics that can be leveraged for fine-tuning to multiple downstream tasks. The resultant PEM outperforms previous state-of-the-art methods in various downstream time-series tasks across datasets of varying seasonal patterns, geography, and mechanism of contagion including the novel Covid-19 pandemic unseen in pre-trained data with better efficiency using smaller fraction of datasets.