title: ToPro: Token-Level Prompt Decomposition for Cross-Lingual Sequence Labeling Tasks

abstract: Prompt-based methods have been successfully applied to multilingual pretrained language models for zero-shot cross-lingual understanding. However, most previous studies primarily focused on sentence-level classification tasks, and only a few considered token-level labeling tasks such as Named Entity Recognition (NER) and Part-of-Speech (POS) tagging. In this paper, we propose Token-Level Prompt Decomposition (ToPro), which facilitates the prompt-based method for token-level sequence labeling tasks. The ToPro method decomposes an input sentence into single tokens and applies one prompt template to each token. Our experiments on multilingual NER and POS tagging datasets demonstrate that ToPro-based fine-tuning outperforms Vanilla fine-tuning and Prompt-Tuning in zero-shot cross-lingual transfer, especially for languages that are typologically different from the source language English. Our method also attains state-of-the-art performance when employed with the mT5 model. Besides, our exploratory study in multilingual large language models shows that ToPro performs much better than the current in-context learning method. Overall, the performance improvements show that ToPro could potentially serve as a novel and simple benchmarking method for sequence labeling tasks.


title: Influence of source parameters on the longitudinal phase-space distribution of a pulsed cryogenic beam of barium fluoride molecules

abstract: Recently, we have demonstrated a method to record the longitudinal phase-space distribution of a pulsed cryogenic buffer gas cooled beam of barium fluoride molecules. In this paper, we use this method to determine the influence of various source parameters. Besides the expected dependence on temperature and pressure, the forward velocity of the molecules is strongly correlated with the time they exit the cell, revealing the dynamics of the gas inside the cell. Three observations are particularly noteworthy: (1) The velocity of the barium fluoride molecules increases rapidly as a function of time, reaches a maximum 50-200 $\mu$s after the ablation pulse and then decreases exponentially. We attribute this to the buffer gas being heated up by the plume of hot atoms released from the target by the ablation pulse and subsequently being cooled down via conduction to the cell walls. (2) The time constant associated with the exponentially decreasing temperature increases when the source is used for a longer period of time, which we attribute to the formation of a layer of isolating dust on the walls of the cell. By thoroughly cleaning the cell, the time constant is reset to its initial value. (3) The velocity of the molecules at the trailing end of the molecular pulse depends on the length of the cell. For short cells, the velocity is significantly higher than expected from the sudden freeze model. We attribute this to the target remaining warm over the duration of the molecular pulse giving rise to a temperature gradient within the cell. Our observations will help to optimize the source parameters for producing the most intense molecular beam at the target velocity.


title: Celestial Holography Revisited II: Correlators and K\"all\'en-Lehmann

abstract: In this work we continue the investigation of the extrapolate dictionary for celestial holography recently proposed in [2301.01810], at both the perturbative and non-perturbative level. Focusing on scalar field theories, we give a complete set of Feynman rules for extrapolate celestial correlation functions and their radial reduction in the hyperbolic slicing of Minkowski space. We prove to all orders in perturbation theory that celestial correlators can be re-written in terms of corresponding Witten diagrams in EAdS which, in the hyperbolic slicing of Minkowski space, follows from the fact that the same is true in dS space. We then initiate the study of non-perturbative properties of celestial correlators, deriving the radial reduction of the K\"all\'en-Lehmann spectral representation of the exact Minkowski two-point function. We discuss the analytic properties of the radially reduced spectral function, which is a meromorphic function of the spectral parameter, and highlight a connection with the Watson-Sommerfeld transform.


title: A compact and cost-effective laser-powered speckle visibility spectroscopy (SVS) device for measuring cerebral blood flow

abstract: In the realm of cerebrovascular monitoring, primary metrics typically include blood pressure, which influences cerebral blood flow (CBF) and is contingent upon vessel radius. Measuring CBF non-invasively poses a persistent challenge, primarily attributed to the difficulty of accessing and obtaining signal from the brain. This study aims to introduce a compact speckle visibility spectroscopy (SVS) device designed for non-invasive CBF measurements, offering cost-effectiveness and scalability while tracking CBF with remarkable sensitivity and temporal resolution. The wearable hardware has a modular design approach consisting solely of a laser diode as the source and a meticulously selected board camera as the detector. They both can be easily placed on the head of a subject to measure CBF with no additional optical elements. The SVS device can achieve a sampling rate of 80 Hz with minimal susceptibility to external disturbances. The device also achieves better SNR compared with traditional fiber-based SVS devices, capturing about 70 times more signal and showing superior stability and reproducibility. It is designed to be paired and distributed in multiple configurations around the head, and measure signals that exceed the quality of prior optical CBF measurement techniques. Given its cost-effectiveness, scalability, and simplicity, this laser-centric tool offers significant potential in advancing non-invasive cerebral monitoring technologies.


title: When discrete fronts and pulses form a single family: FPU chain with hardening-softening springs

abstract: We consider a version of the classical Hamiltonian FPU (Fermi-Pasta-Ulam) problem with nonlinear force-strain relation in which a hardening response is taken over by a softening regime above a critical strain value. We show that in addition to pulses (solitary waves) this discrete system also supports non-topological and dissipation-free fronts (kinks). Moreover, we demonstrate that these two types of supersonic traveling wave solutions belong to the same family. Within this family, solitary waves exist for continuous ranges of velocity that extend up to a limiting speed corresponding to kinks. As the kink velocity limit is approached from above or below, the solitary waves become progressively more broad and acquire the structure of a kink-antikink bundle. Direct numerical simulations and Floquet analysis of linear stability suggest that all of the obtained solutions are effectively stable. To motivate and support our study of the discrete problem we also analyze a quasicontinuum approximation with temporal dispersion. We show that this model captures the main effects observed in the discrete problem both qualitatively and quantitatively.


title: Consistent algorithms for multi-label classification with macro-at-$k$ metrics

abstract: We consider the optimization of complex performance metrics in multi-label classification under the population utility framework. We mainly focus on metrics linearly decomposable into a sum of binary classification utilities applied separately to each label with an additional requirement of exactly $k$ labels predicted for each instance. These "macro-at-$k$" metrics possess desired properties for extreme classification problems with long tail labels. Unfortunately, the at-$k$ constraint couples the otherwise independent binary classification tasks, leading to a much more challenging optimization problem than standard macro-averages. We provide a statistical framework to study this problem, prove the existence and the form of the optimal classifier, and propose a statistically consistent and practical learning algorithm based on the Frank-Wolfe method. Interestingly, our main results concern even more general metrics being non-linear functions of label-wise confusion matrices. Empirical results provide evidence for the competitive performance of the proposed approach.


title: A Fault-Tolerant Distributed Termination Method for Distributed Optimization Algorithms

abstract: This paper proposes a fully distributed termination method for distributed optimization algorithms solved by multiple agents. The proposed method guarantees terminating a distributed optimization algorithm after satisfying the global termination criterion using information from local computations and neighboring agents. The proposed method requires additional iterations after satisfying the global terminating criterion to communicate the termination status. The number of additional iterations is bounded by the diameter of the communication network. This paper also proposes a fault-tolerant extension of this termination method that prevents early termination due to faulty agents or communication errors. We provide a proof of the method's correctness and demonstrate the proposed method by solving the optimal power flow problem for electric power grids using the alternating direction method of multipliers.


title: PrIsing: Privacy-Preserving Peer Effect Estimation via Ising Model

abstract: The Ising model, originally developed as a spin-glass model for ferromagnetic elements, has gained popularity as a network-based model for capturing dependencies in agents' outputs. Its increasing adoption in healthcare and the social sciences has raised privacy concerns regarding the confidentiality of agents' responses. In this paper, we present a novel $(\varepsilon,\delta)$-differentially private algorithm specifically designed to protect the privacy of individual agents' outcomes. Our algorithm allows for precise estimation of the natural parameter using a single network through an objective perturbation technique. Furthermore, we establish regret bounds for this algorithm and assess its performance on synthetic datasets and two real-world networks: one involving HIV status in a social network and the other concerning the political leaning of online blogs.

categories: stat.ME cs.CR cs.SI math.ST stat.ML stat.TH


title: Astrophysics as a Service: Turning radio astronomy as an opportunity to impact society and businesses

abstract: For more than 25 years, the Instituto Argentino de Radioastronom\'ia has been directing efforts from basic research and radio astronomy development to technology transfer projects around Argentina's National Space Plan and to Small and Medium Enterprises. With the surge of COVID-19, our organization's transformation accelerated, bringing new opportunities and challenges which can be applied to impact health, education, processes and businesses. In this article, we explore our efforts to bridge the gap between basic science and the needs of our society.


title: Probabilistic Context Neighborhood Model for Lattices

abstract: We present the Probabilistic Context Neighborhood model designed for two-dimensional lattices as a variation of a Markov Random Field assuming discrete values. In this model, the neighborhood structure has a fixed geometry but a variable order, depending on the neighbors' values. Our model extends the Probabilistic Context Tree model, originally applicable to one-dimensional space. It retains advantageous properties, such as representing the dependence neighborhood structure as a graph in a tree format, facilitating an understanding of model complexity. Furthermore, we adapt the algorithm used to estimate the Probabilistic Context Tree to estimate the parameters of the proposed model. We illustrate the accuracy of our estimation methodology through simulation studies. Additionally, we apply the Probabilistic Context Neighborhood model to spatial real-world data, showcasing its practical utility.


title: ReLoki: Infrastructure-free Distributed Relative Localization using On-board UWB Antenna Arrays

abstract: Coordination of multi-robot systems require some form of localization between agents, but most methods today rely on some external infrastructure. Ultra Wide Band (UWB) sensing has gained popularity in relative localization applications, and we see many implementations that use cooperative agents augmenting UWB range measurements with other sensing modalities (e.g., ViO, IMU, VSLAM) for infrastructure-free relative localization. A lesser researched option is using Angle of Arrival (AoA) readings obtained from UWB Antenna pairs to perform relative localization. In this paper we present a UWB platform called ReLoki that can be used for ranging and AoA-based relative localization in~3D. ReLoki enables any message sent from a transmitting agent to be localized by using a Regular Tetrahedral Antenna Array (RTA). As a full scale proof of concept, we deploy ReLoki on a 3-robot system and compare its performance in terms of accuracy and speed with prior methods.


title: Depth Anything in Medical Images: A Comparative Study

abstract: Monocular depth estimation (MDE) is a critical component of many medical tracking and mapping algorithms, particularly from endoscopic or laparoscopic video. However, because ground truth depth maps cannot be acquired from real patient data, supervised learning is not a viable approach to predict depth maps for medical scenes. Although self-supervised learning for MDE has recently gained attention, the outputs are difficult to evaluate reliably and each MDE's generalizability to other patients and anatomies is limited. This work evaluates the zero-shot performance of the newly released Depth Anything Model on medical endoscopic and laparoscopic scenes. We compare the accuracy and inference speeds of Depth Anything with other MDE models trained on general scenes as well as in-domain models trained on endoscopic data. Our findings show that although the zero-shot capability of Depth Anything is quite impressive, it is not necessarily better than other models in both speed and performance. We hope that this study can spark further research in employing foundation models for MDE in medical scenes.


title: 3-D Position Optimization of Solar-Powered Hovering UAV Relay in Optical Wireless Backhaul

abstract: A major hurdle in widespread deployment of UAVs (unmanned aerial vehicle) in existing communications infrastructure is the limited UAV onboard energy. Therefore, this study considers solar energy harvesting UAVs for wireless communications. In this context, we consider three dimensional position optimization of a solar-powered UAV relay that connects a distant sensor field to an optical ground station (OGS) for data processing. The integrated sensor-UAV-OGS network utilizes radio frequency band for sensor-to-UAV links and the optical band for the UAV-to-OGS feeder link. Since atmospheric conditions affect both the harvested solar energy as well as the optical wireless signal, this study tackles UAV position optimization problems under various channel conditions such as clouds, atmospheric turbulence and dirt. From this study, we discover that the optimum position of the UAV -- that maximizes the end-to-end channel capacity -- is heavily dependent on the atmospheric channel conditions.


title: Two refined notions in quadratic form theory

abstract: We use the Witt index to define and study a refined notion of the local-global principle for isotropy of quadratic forms over a field $k$ and to define and study refined versions of the $m$-invariant of $k$. We also explore connections between these refinements.


title: LeftoverLocals: Listening to LLM Responses Through Leaked GPU Local Memory

abstract: This paper describes LeftoverLocals: a vulnerability that allows data recovery from GPU memory created by another process on Apple, Qualcomm, and AMD GPUs. LeftoverLocals impacts the security posture of GPU applications, with particular significance to LLMs and ML models that run on impacted GPUs. By recovering local memory, an optimized GPU memory region, we built a PoC where an attacker can listen into another user's interactive LLM session (e.g., llama.cpp) across process or container boundaries.


title: Beta Functions of 2d Adjoint QCD

abstract: We discuss the long-distance physics of 2d adjoint QCD when it is viewed as an effective field theory, and determine the beta functions for its two classically-marginal four-fermi operators. These four-fermion terms preserve the invertible symmetries of the kinetic terms, and they have important implications at long distances if they are generated at short distances. Our results are likely to be important for future numerical lattice Monte Carlo studies of 2d adjoint QCD.


title: Towards Robust and Scalable Dispatch Modeling of Long-Duration Energy Storage

abstract: Existing modeling approaches for long-duration energy storage (LDES) are often based either on an oversimplified representation of power system operations or limited representation of storage technologies, e.g., evaluation of only a single application. This manuscript presents an overview of the challenges of modeling LDES technologies, as well as a discussion regarding the capabilities and limitations of existing approaches. We used two test power systems with high shares of both solar photovoltaics- and wind (70% - 90% annual variable renewable energy shares) to assess LDES dispatch approaches. Our results estimate that better dispatch modeling of LDES could increase the associated operational value by 4% - 14% and increase the standard capacity credit by 14% - 34%. Thus, a better LDES dispatch could represent significant cost saving opportunities for electric utilities and system operators. In addition, existing LDES dispatch modeling approaches were tested in terms of both improved system value (e.g., based on production cost and standard capacity credit) and scalability (e.g., based on central processing unit time and peak memory usage). Both copper plate and nodal representations of the power system were considered. Although the end volume target dispatch approach, i.e., based on mid-term scheduling, showed promising performance in terms of both improved system value and scalability, there is a need for robust and scalable dispatch approaches for LDES in transmission-constrained electric grids. Moreover, more research is required to better understand the optimal operation of LDES considering extreme climate/weather events, reliability applications, and power system operational uncertainties.


title: Modeling the Temperature-Dependent Material Dispersion of Imidazolium-Based Ionic Liquids in the VIS-NIR

abstract: A thorough analysis of the refractive index of eleven 1-alkyl-3-methylimidazolium-based ionic liquids with three different anions, tetrafluoroborate bis(trifluoromethylsulfonyl)imide, and trifluoromethanesulfonate, is reported. Refractive indices were estimated, in the temperature interval from 298.15 to 323.15 K, using an Abbe refractometer to determine the value at the sodium D line and white light spectral interferometry to obtain dispersion in the range of wavelengths from 400 to 1000 nm. The first part of the manuscript is focused on the dependence of refractive index with wavelength, temperature, cation alkyl chain length, and anion nature. Once the main features are detailed, and in order to explain the experimental trends, a model for the refractive index is considered where its square is expressed by a single resonance Sellmeier dispersion formula. This formula has two coefficients: the first one identifies the position of the resonance in the spectral axis, and the second one specifies its strength. It was found that, for a given compound, the resonances position is independent of temperature, while the strength varies linearly with it. This model reproduces successfully the experimental data within the refractive index uncertainty. Furthermore, the model allows calculating the thermo-optic coefficient and its wavelength dependence.


title: A Loop-Opening Model for the Intrinsic Fracture Energy of Polymer Networks

abstract: We present a loop-opening model that accounts for the molecular details of the intrinsic fracture energy for fracturing polymer networks. This model includes not only the energy released from the scission of bridging chains but also the subsequent energy released from the network continuum. Scission of a bridging chain releases the crosslinks and opens the corresponding topological loop. The released crosslinks will be caught by the opened loop to reach a new force-balanced state. The amount of energy released from the network continuum is limited by the stretchability of the opened loop. Based on this loop-opening process, we suggest that the intrinsics fracture energy per broken chain approximately scales with the product of the fracture force and the contour length of the opened loop. This model predicts an intrinsic fracture energy that aligns well with various experimental data on the fracture of polymer networks.


title: The evolution of galaxy morphology from redshift z=6 to 3: Mock JWST observations of galaxies in the ASTRID simulation

abstract: We present mock JWST observations for more than 215,000 different galaxies from the Astrid simulation with $3 \leq z \leq 6$. The mock observations are made using the BPASS stellar SED model, and a simple dust model. They are then viewed through NIRCam filters, convolved with a PSF, have noise added, and are drizzled together to emulate the Cosmic Evolution Early Release Science (CEERS) survey. We analyse this dataset by computing a number of morphological measures and find our catalog to have comparable statistics to similar mock catalogs, and the first release of CEERS data. We find that most of the Sersic indices of galaxies in our redshift range are lower than observed, with most having n less than one. Additionally, we observe the sizes of galaxies of all masses to increase from redshift z=6 to redshift z=3 consistent with other results. The number of galaxies in our catalog allows us to examine how relationships like the mass-size relation evolve with redshift, and compare the accuracy of a variety of traditional galaxy classification techniques (Sersic fit, Asymmetry-Concentration, and Gini-$M_{20}$) within our redshift range. We find the mass-size relation to be nearly flat at redshift z=6, and consistently increases as redshift decreases, and find the galaxy classification methods have minimal correlation with each other in our redshift range. We also investigate the impact that different stages of our imaging pipeline have on these morphological measures to determine how robust mock catalogs are to different choices at each step. Finally, we test the addition of incorporating light from AGNs into our pipeline and find that while the population of galaxies that have significant AGN luminosity is low, those galaxies do tend to have higher Sersic indices once the AGN luminosity is added, rectifying some of the systematic bias towards lower Sersic indices present in our dataset.


title: Turbulent Threshold for Continuum Calogero-Moser Models

abstract: We determine the sharp mass threshold for Sobolev norm growth for the focusing continuum Calogero--Moser model. It is known that below the mass of $2\pi$, solutions to this completely integrable model enjoy uniform-in-time $H^s$ bounds for all $s \geq 0$. In contrast, we show that for arbitrarily small $\varepsilon > 0$ there exists initial data $u_0 \in H^\infty_+$ of mass $2\pi + \varepsilon$ such that the corresponding maximal lifespan solution $u : (T_-, T_+) \times \mathbb{R} \to \mathbb{C}$ satisfies $\lim_{t \to T_\pm} \|u(t)\|_{H^s} = \infty$ for all $s > 0$. As part of our proof, we demonstrate an orbital stability statement for the soliton and a dispersive decay bound for solutions with suitable initial data.


title: Perceptions of Moderators as a Large-Scale Measure of Online Community Governance

abstract: Millions of online communities are governed by volunteer moderators, who shape their communities by setting and enforcing rules, recruiting additional moderators, and participating in the community themselves. These moderators must regularly make decisions about how to govern, yet it is challenging to determine what governance strategies are most successful, as measuring the `success' of governance is complex and nuanced. Furthermore, the incredible diversity in community topic, size, and membership all but guarantee that there is no `one-size-fits-all' solution for community governance. In this work, we measure governance by assessing how community members publicly discuss their own moderators. We quantify perceptions of moderators through 1.89 million labeled posts and comments made on reddit over an 18 month period, and relate these perceptions to characteristics of community governance and to different actions that community moderators can take. We identify key differences between different types of communities, and highlight promising strategies for moderator teams. Amongst other findings, we show that positive perceptions of moderators are associated with other measures of community health, and that strict rule enforcement is perceived more favorably for certain topics, such as news communities, than others. We investigate what kinds of moderators have the most positive impact on the community when they join the mod team, and find that moderators who are active community members before and during their mod tenures result in the largest improvement of community members' perceptions of moderators. We make all our models, datasets, and code public.


title: Accelerating superconductor discovery through tempered deep learning of the electron-phonon spectral function

abstract: Integrating deep learning with the search for new electron-phonon superconductors represents a burgeoning field of research, where the primary challenge lies in the computational intensity of calculating the electron-phonon spectral function, $\alpha^2F(\omega)$, the essential ingredient of Midgal-Eliashberg theory of superconductivity. To overcome this challenge, we adopt a two-step approach. First, we compute $\alpha^2F(\omega)$ for 818 dynamically stable materials. We then train a deep-learning model to predict $\alpha^2F(\omega)$, using an unconventional training strategy to temper the model's overfitting, enhancing predictions. Specifically, we train a Bootstrapped Ensemble of Tempered Equivariant graph neural NETworks (BETE-NET), obtaining an MAE of 0.21, 45 K, and 43 K for the Eliashberg moments derived from $\alpha^2F(\omega)$: $\lambda$, $\omega_{\log}$, and $\omega_{2}$, respectively, yielding an MAE of 2.5 K for the critical temperature, $T_c$. Further, we incorporate domain knowledge of the site-projected phonon density of states to impose inductive bias into the model's node attributes and enhance predictions. This methodological innovation decreases the MAE to 0.18, 29 K, and 28 K, respectively, yielding an MAE of 2.1 K for $T_c$. We illustrate the practical application of our model in high-throughput screening for high-$T_c$ materials. The model demonstrates an average precision nearly five times higher than random screening, highlighting the potential of ML in accelerating superconductor discovery. BETE-NET accelerates the search for high-$T_c$ superconductors while setting a precedent for applying ML in materials discovery, particularly when data is limited.


title: Learning a Gaussian Mixture for Sparsity Regularization in Inverse Problems

abstract: In inverse problems, it is widely recognized that the incorporation of a sparsity prior yields a regularization effect on the solution. This approach is grounded on the a priori assumption that the unknown can be appropriately represented in a basis with a limited number of significant components, while most coefficients are close to zero. This occurrence is frequently observed in real-world scenarios, such as with piecewise smooth signals. In this study, we propose a probabilistic sparsity prior formulated as a mixture of degenerate Gaussians, capable of modeling sparsity with respect to a generic basis. Under this premise, we design a neural network that can be interpreted as the Bayes estimator for linear inverse problems. Additionally, we put forth both a supervised and an unsupervised training strategy to estimate the parameters of this network. To evaluate the effectiveness of our approach, we conduct a numerical comparison with commonly employed sparsity-promoting regularization techniques, namely LASSO, group LASSO, iterative hard thresholding, and sparse coding/dictionary learning. Notably, our reconstructions consistently exhibit lower mean square error values across all $1$D datasets utilized for the comparisons, even in cases where the datasets significantly deviate from a Gaussian mixture model.


title: Algebraic Complexity and Neurovariety of Linear Convolutional Networks

abstract: In this paper, we study linear convolutional networks with one-dimensional filters and arbitrary strides. The neuromanifold of such a network is a semialgebraic set, represented by a space of polynomials admitting specific factorizations. Introducing a recursive algorithm, we generate polynomial equations whose common zero locus corresponds to the Zariski closure of the corresponding neuromanifold. Furthermore, we explore the algebraic complexity of training these networks employing tools from metric algebraic geometry. Our findings reveal that the number of all complex critical points in the optimization of such a network is equal to the generic Euclidean distance degree of a Segre variety. Notably, this count significantly surpasses the number of critical points encountered in the training of a fully connected linear network with the same number of parameters.


title: Isovector Axial Charge and Form Factors of Nucleons from Lattice QCD

abstract: I present an overview of the calculations of the isovector axial vector form factor of the nucleon, $G_A(Q^2)$, using lattice QCD. Based on a comparison of results from various collaborations, a case is made that lattice results are now consistent within 10\%. A similar level of uncertainty is found also in the axial charge $g_A^{u-d}$, the mean squared axial charge radius, $\langle r_A^2 \rangle$, the induced pseudoscalar charge $g_P^\ast$, and the pion-nucleon coupling $g_{\pi NN}$. These lattice results for $G_A(Q^2)$ are already compatible with those obtained from the recent MINER$\nu$A experiment but lie 2-3$\sigma$ higher than the phenomenological extraction from the old $\nu$-deuterium bubble chamber scattering data for $Q^2 > 0.3$~GeV${}^2$. Fits to our data show that the dipole ansatz does not have enough parameters to parameterize the form factor over the range $0 \le Q^2 \le 1$~GeV${}^2$, whereas even a $z^2$ truncation of the $z$-expansion or a low order Pad\'e are sufficient. Looking ahead, lattice QCD calculations will provide increasingly precise results over the range $0 \le Q^2 \lesssim 1$~GeV${}^2$, and MINER$\nu$A-like experiments will extend the range to $Q^2 \sim 2$~GeV${}^2$ or higher. To increase precision of lattice data to the percent level, new developments are needed to address two related issues: the exponentially falling signal-to-noise ratio in all nucleon correlation functions and removing excited state contributions. Nevertheless, even with the current methodology, significant reduction in errors is expected over the next few years with higher statistics data on more ensembles closer to the physical point.


title: On Total Bondage Number of Graphs

abstract: In this paper, we explore the concept of total bondage in finite graphs without isolated vertices. A vertex set $D$ is considered a total dominating set if every vertex $v$ in the graph $G$ has a neighbor in $D$. The minimum cardinality of all total dominating sets in $G$ is denoted as $\gamma_t(G)$. A total bondage edge set $B$ is a subset of the edges of $G$ such that the removal of $B$ from $G$ does not create isolated vertices, and the total dominating number of the resulting graph $G-B$ is strictly greater than $\gamma_t(G)$. The total bondage number of $G$, denoted $b_t(G)$, is defined as the minimum cardinality of such total bondage edge sets. Our paper establishes upper bounds on $b_t(G)$ based on the maximum degree of a graph. Notably, for planar graphs with minimum degree $\delta(G) \geq 3$, we prove $b_t(G) \leq \Delta + 8$ or $b_t(G) \leq 10$. Additionally, for a connected planar graph with $\delta(G) \geq 3$ and $g(G) \geq 4$, we show that $b_t(G) \leq \Delta + 3$ if $G$ does not contain an edge with degree sum at most 7. We also improve some upper bounds of the total bondage number for trees, enhance existing lemmas, and find upper bounds for total bondage in specific graph classes.


title: The NuSTAR View of Perseus: the ICM and a Peculiar Hard Excess

abstract: As the brightest galaxy cluster in the X-ray sky, Perseus is an excellent target for studying the Intracluster Medium (ICM), but until recently, its active galactic nucleus (AGN) made studies of the diffuse emission near its center nearly impossible to accomplish with NuSTAR due to the extended wings of NuSTAR's PSF. The development of a new open source software package -- nucrossarf -- now allows the contribution from point and diffuse sources to be modeled so that scattered light from the AGN can be accounted for. Using this technique, we present an analysis of diffuse hard X-ray (3-25keV) emission from the ICM using three archival NuSTAR observations of the Perseus cluster. We find a ~10% excess of emission beyond 20keV not describable by purely thermal models. By performing similar analyses of AGN in archival observations, we have characterized the systematic uncertainty of the modeled AGN contribution to be 3.4%. However, in order to explain the excess, the total scattered AGN emission would have to be 39% stronger than we have measured. We test physical explanations for the excess, such as diffuse inverse Compton emission potentially originating from the radio mini-halo, but we determine that none of the models are compelling. An upper limit on inverse Compton flux ($\leq1.5\times10^{-11}$erg s$^{-1}$cm$^{-2}$) and a corresponding lower limit on global magnetic field strength ($\geq 0.35~\mu G$) is derived. We discuss the potential origin and implications of the excess and present our characterization of the nucrossarf systematic uncertainty, which should be useful for future work.


title: Propagation of chaos for doubly mean reflected BSDEs

abstract: In this paper, we establish propagation of chaos (POC) for doubly mean reflected backward stochastic differential equations (MRBSDEs). MRBSDEs differentiate the typical RBSDEs in that the constraint is not on the paths of the solution but on its law. This unique property has garnered significant attention since the inception of MRBSDEs. Rather than directly investigating these equations, we focus on approximating them by interacting particle systems (IPS). We propose two sets of IPS having mean-field Skorokhod problems, capturing the dynamics of IPS reflected in a mean-field way. As the dimension of the IPS tends to infinity, the POC phenomenon emerges, indicating that the system converges to a limit with independent particles, where each solves the MRBSDE. Beyond establishing the first POC result for doubly MRBSDEs, we achieve distinct convergence speeds under different scenarios.


title: A comparison of RL-based and PID controllers for 6-DOF swimming robots: hybrid underwater object tracking

abstract: In this paper, we present an exploration and assessment of employing a centralized deep Q-network (DQN) controller as a substitute for the prevalent use of PID controllers in the context of 6DOF swimming robots. Our primary focus centers on illustrating this transition with the specific case of underwater object tracking. DQN offers advantages such as data efficiency and off-policy learning, while remaining simpler to implement than other reinforcement learning methods. Given the absence of a dynamic model for our robot, we propose an RL agent to control this multi-input-multi-output (MIMO) system, where a centralized controller may offer more robust control than distinct PIDs. Our approach involves initially using classical controllers for safe exploration, then gradually shifting to DQN to take full control of the robot. We divide the underwater tracking task into vision and control modules. We use established methods for vision-based tracking and introduce a centralized DQN controller. By transmitting bounding box data from the vision module to the control module, we enable adaptation to various objects and effortless vision system replacement. Furthermore, dealing with low-dimensional data facilitates cost-effective online learning for the controller. Our experiments, conducted within a Unity-based simulator, validate the effectiveness of a centralized RL agent over separated PID controllers, showcasing the applicability of our framework for training the underwater RL agent and improved performance compared to traditional control methods. The code for both real and simulation implementations is at https://github.com/FARAZLOTFI/underwater-object-tracking.


title: Polynomial-depth quantum algorithm for computing matrix determinant

abstract: We propose an algorithm for calculating the determinant of a square matrix, and construct the quantum circuit realizing it, using multiqubit control gates (representable in terms of Toffoli gates, CNOTs and SWAPs), Hadamard transformations and $Z$-operators. Each row of the matrix is encoded as a pure state of some quantum system. The admitted matrix is therefore arbitrary up to the normalization of quantum states of those systems. The depth of the proposed algorithm is $O(N^3\log \, N)$ for the $N\times N$ matrix.


title: Advances in algorithms for solvers and gauge generation

abstract: I review recent research and advances in algorithms for solvers and gauge generation, with an emphasis on practical algorithms for four dimensional simulations. Particular consideration is given to advances in multigrid solvers, fourier acceleration and field transformation approaches to accelerating evolution dynamics, and to parallel tempering approaches to solving the topological tunneling problem. Particular consideration is given to the interaction between rapidly evolving computer architecture and optimal algorithms that exploit these. In this conference, nascent machine learning algorithms were separately reviewed


title: Ultrafast relaxation dynamics of excited carriers in metals: Simplifying the intertwined dependencies upon scattering strengths, phonon temperature, photon energy, and excitation level

abstract: Using the Boltzmann transport equation (BTE), we study the evolution of nonequilibrium carrier distributions in simple ($sp$) metals, assumed to have been instantaneously excited by an ultrafast laser pulse with photon energy $h \nu$. The mathematical structure of the BTE scattering integrals reveals that $h \nu$ is a natural energy scale for describing the dynamics. Normalizing all energy quantities by $h \nu$ leads to a set of three unitless parameters -- $\beta / \delta$, $\gamma$, and $\alpha$ -- that control the relaxation dynamics: $\beta / \delta$ is the normalized ratio of electron-phonon to electron-electron scattering strengths, $\gamma$ is the normalized phonon (lattice) temperature, and $\alpha$ is the normalized absorbed energy density. Using this theory, we systematically investigate relaxation times for the high-energy part of the distribution ($\tau_H$), energy transfer to the phonon subsystem ($\tau_E$), and intracarrier thermalization ($\tau_{th}$). In the linear region of response (valid when $\alpha$ is sufficiently small), we offer heuristic descriptions of each of these relaxation times as functions of $\beta / \delta$ and $\gamma$. Our results as a function of excitation level $\alpha$ show that many ultrafast experimental investigations lie in a transition region between low excitation (where the relaxation times are independent of $\alpha$) and high excitation (where the two-temperature model of carrier dynamics is valid). Approximate boundaries that separate these three regions are described by simple expressions involving the normalized parameters of our model.


title: Canted antiferromagnetism in a spin-orbit coupled $S_{\text{eff}} = 3/2$ triangular-lattice magnet DyAuGe

abstract: Exploration of nontrivial magnetic states induced by strong spin-orbit interaction is a central topic of frustrated magnetism. Extensive studies are concentrated on rare-earth-based magnets and 4d/5d transition metal compounds, which are mostly described by an effective spin $S_{\text{eff}} = 1/2$ for the Kramers doublet of the lowest crystal-electric-field levels. Variety of magnetic orderings may be greatly enhanced when magnetic dipolar moments intertwined with multipolar degrees of freedom which are described by higher-rank tensors and often require the magnetic ions with $S_{\text{eff}} > 1/2$. Here, our synchrotron x-ray diffraction near the Dy $L_3$ edge has unveiled a canted antiferromagnetic ground state arising from a quasi-quartet ($S_{\text{eff}} = 3/2$) of 4f electrons in a triangular-lattice (TL) rare-earth intermetallics DyAuGe. Magnetic moment and electric-quadrupole moment are closely interlocked and noncollinear magnetic-dipole alignment is induced by antiferroic electric-quadrupole (AFQ) ordering in the TL layers. The correlation between the AFQ and canted magnetic structures is further confirmed by phase transitions in an in-plane magnetic field. These findings offer insights into the emergence of nontrivial magnetic states in frustrated TL systems described beyond the $S_{\text{eff}} = 1/2$.


title: Towards Optimal Grammars for RNA Structures

abstract: In past work (Onokpasa, Wild, Wong, DCC 2023), we showed that (a) for joint compression of RNA sequence and structure, stochastic context-free grammars are the best known compressors and (b) that grammars which have better compression ability also show better performance in ab initio structure prediction. Previous grammars were manually curated by human experts. In this work, we develop a framework for automatic and systematic search algorithms for stochastic grammars with better compression (and prediction) ability for RNA. We perform an exhaustive search of small grammars and identify grammars that surpass the performance of human-expert grammars.


title: Substructure Detection in Realistic Strong Lensing Systems with Machine Learning

abstract: Tens of thousands of galaxy-galaxy strong lensing systems are expected to be discovered by the end of the decade. These will form a vast new dataset that can be used to probe subgalactic dark matter structures through its gravitational effects, which will in turn allow us to study the nature of dark matter at small length scales. This work shows how we can leverage machine learning to search through the data and identify which systems are most likely to contain dark matter substructure and thus can be studied in greater depth. We use a UNet, an image segmentation architecture, on a simulated strongly-lensed dataset with realistic sources (COSMOS galaxies), lenses (power-law elliptical profiles with multipoles and external shear), and noise. Our machine learning algorithm is able to quickly detect most substructure at high image resolution and subhalo concentration. At a false positive rate of $10\%$, we are able to identify systems with substructure at a true positive rate of $71\%$ for a subhalo mass range of $10^{9}\text{-}10^{9.5}\,M_\odot$. While recent detections are consistent with higher concentrations, we find that our algorithm fails at detecting subhalos with lower concentrations (expected from $\Lambda$CDM simulations).


title: FakeClaim: A Multiple Platform-driven Dataset for Identification of Fake News on 2023 Israel-Hamas War

abstract: We contribute the first publicly available dataset of factual claims from different platforms and fake YouTube videos on the 2023 Israel-Hamas war for automatic fake YouTube video classification. The FakeClaim data is collected from 60 fact-checking organizations in 30 languages and enriched with metadata from the fact-checking organizations curated by trained journalists specialized in fact-checking. Further, we classify fake videos within the subset of YouTube videos using textual information and user comments. We used a pre-trained model to classify each video with different feature combinations. Our best-performing fine-tuned language model, Universal Sentence Encoder (USE), achieves a Macro F1 of 87\%, which shows that the trained model can be helpful for debunking fake videos using the comments from the user discussion. The dataset is available on Github\footnote{https://github.com/Gautamshahi/FakeClaim}


title: Implications of Zoning Ordinances for Rural Utility-Scale Solar Deployment and Power System Decarbonization in the Great Lakes Region

abstract: Local zoning ordinances across the United States have the impact of restricting development of energy infrastructure, including utility-scale solar photovoltaics. While these ordinances may be developed for legitimate purposes to protect public health and safety, they could impede or increase costs of power sector decarbonization. We quantify the role of utility-scale solar zoning ordinances on power sector decarbonization across the Great Lakes region (Illinois, Indiana, Michigan, Minnesota, Ohio, and Wisconsin) by integrating 6,300 rural community zoning ordinances into a power system planning model. Relative to no ordinances, solar zoning ordinances reduce total potential deployment of solar PV by 52% (or 1.6 TW) across our region. Currently, however, the biggest zoning barrier to deployment is zoning ordinances which are silent on utility-scale solar. Deployment restrictions translate to up to 4 GW greater investment needs and 5.6% greater PV investment costs to achieve a 10% PV generation target. Starker shifts occur at the state level, e.g. Wisconsin sees a 40% reduction in PV investments due to zoning restrictions. Our results underscore the need for planning that aligns local zoning laws with state and regional goals.


title: Resource allocation exploiting reflective surfaces to minimize the outage probability in VLC

abstract: Visible light communication (VLC) is a technology that complements radio frequency (RF) to fulfill the ever-increasing demand for wireless data traffic. The ubiquity of light-emitting diodes (LEDs), exploited as transmitters, increases the VLC market penetration and positions it as one of the most promising technologies to alleviate the spectrum scarcity of RF. However, VLC deployment is hindered by blockage causing connectivity outages in the presence of obstacles. Recently, optical reconfigurable intelligent surfaces (ORISs) have been considered to mitigate this problem. While prior works exploit ORISs for data or secrecy rate maximization, this paper studies the optimal placement of mirrors and ORISs, and the LED power allocation, for jointly minimizing the outage probability while keeping the lighting standards. We describe an optimal outage minimization framework and present solvable heuristics. We provide extensive numerical results and show that the use of ORISs may reduce the outage probability by up to 67% with respect to a no-mirror scenario and provide a gain of hundreds of kbit/J in optical energy efficiency with respect to the presented benchmark.


title: A New Approach to Harnessing Side Information in Multi-Server Private Information Retrieval

abstract: This paper presents new solutions for Private Information Retrieval (PIR) with side information. This problem is motivated by PIR settings in which a client has side information about the data held by the servers and would like to leverage this information in order to improve the download rate. The problem of PIR with side information has been the subject of several recent studies that presented achievability schemes as well as converses for both multi-server and single-server settings. However, the solutions for the multi-server settings adapted from the solutions for the single-server setting in a rather straightforward manner, relying on the concept of super-messages. Such solutions require an exponential degree of sub-packetization (in terms of the number of messages). This paper makes the following contributions. First, we revisit the PIR problem with side information and present a new approach to leverage side information in the context of PIR. The key idea of our approach is a randomized algorithm to determine the linear combinations of the sub-packets that need to be recovered from each server. In addition, our approach takes advantage of the fact that the identity of the side information messages does not need to be kept private, and, as a result, the information retrieval scheme does not need to be symmetric. Second, we present schemes for PIR with side information that achieve a higher rate than previously proposed solutions and require a significantly lower degree of sub-packetization (linear in the number of servers). Our scheme not only achieves the highest known download rate for the problem at hand but also invalidates a previously claimed converse bound on the maximum achievable download rate.


title: Generation of solitons and periodic wave trains in birefringent optical fibers

abstract: We investigate the existence and propagation properties of all possible types of envelope soliton pulses in a birefringent optical fiber wherein the light propagation is governed by two coupled nonlinear Schrodinger equations with coherent and incoherent nonlinear couplings. Especially, we study the existence of optical solitons under the influence of group-velocity dispersion and third-order nonlinearity, which have physical relevance in the context of elliptical core optical fiber. The results show that the waveguiding medium supports the existence of a wide variety of propagating envelope solitons, including dipole-bright, bright-dipole, bright-dark, dark-bright, W-shaped-dipole and dipole-W-shaped pulses which exhibit different characteristics. Interestingly, we find that the obtained soliton pairs are allowable in both the normal and anomalous dispersion regimes. A wide class of exact analytic periodic (elliptic) wave solutions are identified. This illustrates the potentially rich set of localized pulses and nonlinear periodic waves in birefringent optical fiber media.


title: Achieving Capacity of PIR with Private Side Information with Low Sub-packetization and without MDS Codes

abstract: This paper revisits the problem of multi-server Private Information Retrieval with Private Side Information (PIR-PSI). In this problem, $N$ non-colluding servers store identical copies of $K$ messages, each comprising $L$ symbols from $\mathbb{F}_q$, and a user, who knows $M$ of these messages, wants to retrieve one of the remaining $K-M$ messages. The user's goal is to retrieve the desired message by downloading the minimum amount of information from the servers while revealing no information about the identities of the desired message and side information messages to any server. The capacity of PIR-PSI, defined as the maximum achievable download rate, was previously characterized for all $N$, $K$, and $M$ when $L$ and $q$ are sufficiently large -- specifically, growing exponentially with $K$, to ensure the divisibility of each message into $N^K$ sub-packets and to guarantee the existence of an MDS code with its length and dimension being exponential in $K$. In this work, we propose a new capacity-achieving PIR-PSI scheme that is applicable to all $N$, $K$, $M$, $L$, and $q$ where $N\geq M+1$ and $N-1\mid L$. The proposed scheme operates with a sub-packetization level of $N-1$, independent of $K$, and works over any finite field without requiring an MDS code.


title: Noise-induced phase transitions in hybrid quantum circuits

abstract: The presence of quantum noises inherent to real physical systems can strongly impact the physics in quantum hybrid circuits with local random unitaries and mid-circuit measurements. For example, an infinitesimal size-independent noise probability can lead to the disappearance of measurement-induced entanglement phase transition and the emergence of a single area-law phase. In this Letter, we investigate the effects of quantum noises with size-dependent probabilities $q=p/L^{\alpha}$ where $\alpha$ represents the scaling exponent. We have identified a noise-induced entanglement phase transition from a volume law to a power (area) law in the presence (absence) of measurements as $p$ increases when $\alpha=1.0$. With the help of an effective statistical model, we find that this transition is a first-order phase transition and shares the same analytical understanding as the noise-induced coding transition. We also discuss the differences between the effect of size-dependent noise and the boundary noise in the phase transitions. We validate our analytical predictions with extensive numerical results from stabilizer circuit simulations.

categories: quant-ph cond-mat.dis-nn cond-mat.stat-mech cond-mat.str-el


title: Hybridized Implicit-Explicit Flux Reconstruction Methods

abstract: For turbulent problems of industrial scale, computational cost may become prohibitive due to the stability constraints associated with explicit time discretization of the underlying conservation laws. On the other hand, implicit methods allow for larger time-step sizes but require exorbitant computational resources. Implicit-explicit (IMEX) formulations combine both temporal approaches, using an explicit method in nonstiff portions of the domain and implicit in stiff portions. While these methods can be shown to be orders of magnitude faster than typical explicit discretizations, they are still limited by their implicit discretization in terms of cost. Hybridization reduces the scaling of these systems to an effective lower dimension, which allows the system to be solved at significant speedup factors compared to standard implicit methods. This work proposes an IMEX scheme that combines hybridized and standard flux reconstriction (FR) methods to tackle geometry-induced stiffness. By using the so-called transmission conditions, an overall conservative formulation can be obtained after combining both explicit FR and hybridized implicit FR methods. We verify and apply our approach to a series of numerical examples, including a multi-element airfoil at Reynolds number 1.7 million. Results demonstrate speedup factors of four against standard IMEX formulations and at least 15 against standard explicit formulations for the same problem.


title: I came, I saw, I certified: some perspectives on the safety assurance of cyber-physical systems

abstract: The execution failure of cyber-physical systems (e.g., autonomous driving systems, unmanned aerial systems, and robotic systems) could result in the loss of life, severe injuries, large-scale environmental damage, property destruction, and major economic loss. Hence, such systems usually require a strong justification that they will effectively support critical requirements (e.g., safety, security, and reliability) for which they were designed. Thus, it is often mandatory to develop compelling assurance cases to support that justification and allow regulatory bodies to certify such systems. In such contexts, detecting assurance deficits, relying on patterns to improve the structure of assurance cases, improving existing assurance case notations, and (semi-)automating the generation of assurance cases are key to develop compelling assurance cases and foster consumer acceptance. We therefore explore challenges related to such assurance enablers and outline some potential directions that could be explored to tackle them.


title: The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Exploration

abstract: Active learning strategies for 3D object detection in autonomous driving datasets may help to address challenges of data imbalance, redundancy, and high-dimensional data. We demonstrate the effectiveness of entropy querying to select informative samples, aiming to reduce annotation costs and improve model performance. We experiment using the BEVFusion model for 3D object detection on the nuScenes dataset, comparing active learning to random sampling and demonstrating that entropy querying outperforms in most cases. The method is particularly effective in reducing the performance gap between majority and minority classes. Class-specific analysis reveals efficient allocation of annotated resources for limited data budgets, emphasizing the importance of selecting diverse and informative data for model training. Our findings suggest that entropy querying is a promising strategy for selecting data that enhances model learning in resource-constrained environments.


title: Improving Reinforcement Learning from Human Feedback with Efficient Reward Model Ensemble

abstract: Reinforcement Learning from Human Feedback (RLHF) is a widely adopted approach for aligning large language models with human values. However, RLHF relies on a reward model that is trained with a limited amount of human preference data, which could lead to inaccurate predictions. As a result, RLHF may produce outputs that are misaligned with human values. To mitigate this issue, we contribute a reward ensemble method that allows the reward model to make more accurate predictions. As using an ensemble of large language model-based reward models can be computationally and resource-expensive, we explore efficient ensemble methods including linear-layer ensemble and LoRA-based ensemble. Empirically, we run Best-of-$n$ and Proximal Policy Optimization with our ensembled reward models, and verify that our ensemble methods help improve the alignment performance of RLHF outputs.


title: Curve attractors for marked rational maps

abstract: A Thurston map $f\colon (S^2, A) \to (S^2, A)$ with marking set $A$ induces a pullback relation on isotopy classes of Jordan curves in $(S^2, A)$. If every curve lands in a finite list of possible curve classes after iterating this pullback relation, then the pair $(f,A)$ is said to have a finite global curve attractor. It is conjectured by Pilgrim that all rational Thurston maps that are not flexible Latt\`{e}s maps have a finite global curve attractor. We present partial progress on this problem. Specifically, we prove that if $A$ has four points and the postcritical set (which is a subset of $A$) has two or three points, then $(f,A)$ has a finite global curve attractor. We also discuss extensions of the main result to certain special cases where $f$ has four postcritical points and $A=P_f$. Additionally, we speculate on how some of these ideas might be used in the more general case.


title: IRCoCo: Immediate Rewards-Guided Deep Reinforcement Learning for Code Completion

abstract: Code completion aims to enhance programming productivity by predicting potential code based on the current programming context. Recently, pretrained language models (LMs) have become prominent in this field. Various approaches have been proposed to fine-tune LMs using supervised fine-tuning (SFT) techniques for code completion. However, the inherent exposure bias of these models can cause errors to accumulate early in the sequence completion, leading to even more errors in subsequent completions. To address this problem, deep reinforcement learning (DRL) is an alternative technique for fine-tuning LMs for code completion, which can improve the generalization capabilities and overall performance. Nevertheless, integrating DRL-based strategies into code completion faces two major challenges: 1) The dynamic nature of the code context requires the completion model to quickly adapt to changes, which poses difficulties for conventional DRL strategies that focus on delayed rewarding of the final code state. 2) It is difficult to evaluate the correctness of partial code, thus the reward redistribution-based strategies cannot be adapted to code completion. To tackle these challenges, we propose IRCoCo, a code completion-specific DRL-based fine-tuning framework. This framework is designed to provide immediate rewards as feedback for detecting dynamic context changes arising from continuous edits during code completion. With the aid of immediate feedback, the fine-tuned LM can gain a more precise understanding of the current context, thereby enabling effective adjustment of the LM and optimizing code completion in a more refined manner. Experimental results demonstrate that fine-tuning pretrained LMs with IRCoCo leads to significant improvements in the code completion task, outperforming both SFT-based and other DRL-based baselines.


title: Breaking Free Transformer Models: Task-specific Context Attribution Promises Improved Generalizability Without Fine-tuning Pre-trained LLMs

abstract: Fine-tuning large pre-trained language models (LLMs) on particular datasets is a commonly employed strategy in Natural Language Processing (NLP) classification tasks. However, this approach usually results in a loss of models generalizability. In this paper, we present a framework that allows for maintaining generalizability, and enhances the performance on the downstream task by utilizing task-specific context attribution. We show that a linear transformation of the text representation from any transformer model using the task-specific concept operator results in a projection onto the latent concept space, referred to as context attribution in this paper. The specific concept operator is optimized during the supervised learning stage via novel loss functions. The proposed framework demonstrates that context attribution of the text representation for each task objective can improve the capacity of the discriminator function and thus achieve better performance for the classification task. Experimental results on three datasets, namely HateXplain, IMDB reviews, and Social Media Attributions, illustrate that the proposed model attains superior accuracy and generalizability. Specifically, for the non-fine-tuned BERT on the HateXplain dataset, we observe 8% improvement in accuracy and 10% improvement in F1-score. Whereas for the IMDB dataset, fine-tuned state-of-the-art XLNet is outperformed by 1% for both accuracy and F1-score. Furthermore, in an out-of-domain cross-dataset test, DistilBERT fine-tuned on the IMDB dataset in conjunction with the proposed model improves the F1-score on the HateXplain dataset by 7%. For the Social Media Attributions dataset of YouTube comments, we observe 5.2% increase in F1-metric. The proposed framework is implemented with PyTorch and provided open-source on GitHub.


title: Structure of tight (k,0)-stable graphs

abstract: We say that a graph G is $(k,\ell)$-stable if removing $k$ vertices from it reduces its independence number by at most $\ell$. We say that G is tight $(k,\ell)$-stable if it is $(k,\ell)$-stable and its independence number equals $\lfloor{\frac{n-k+1}{2}\rfloor}+\ell$, the maximum possible, where $n$ is the vertex number of G. Answering a question of Dong and Wu, we show that every tight $(2,0)$-stable graph with odd vertex number must be an odd cycle. Moreover, we show that for all $k\geq 3$, every tight $(k,0)$-stable graph has at most $k+6$ vertices.


title: TeenyTinyLlama: open-source tiny language models trained in Brazilian Portuguese

abstract: Large language models (LLMs) have significantly advanced natural language processing, but their progress has yet to be equal across languages. While most LLMs are trained in high-resource languages like English, multilingual models generally underperform monolingual ones. Additionally, aspects of their multilingual foundation sometimes restrict the byproducts they produce, like computational demands and licensing regimes. In this study, we document the development of open-foundation models tailored for use in low-resource settings, their limitations, and their benefits. This is the TeenyTinyLlama pair: two compact models for Brazilian Portuguese text generation. We release them under the permissive Apache 2.0 license on GitHub and Hugging Face for community use and further development. See https://github.com/Nkluge-correa/TeenyTinyLlama


title: Producers Equilibria and Dynamics in Engagement-Driven Recommender Systems

abstract: Online platforms such as YouTube or Instagram heavily rely on recommender systems to decide what content to show to which users. Producers often aim to produce content that is likely to be shown to users and have the users engage. To do so, producers try to align their content with the preferences of their targeted user base. In this work, we explore the equilibrium behavior of producers who are interested in maximizing user engagement. We study two variants of the content-serving rule for the platform's recommender system, and provide a structural characterization of producer behavior at equilibrium: namely, each producer chooses to focus on a single embedded feature. We further show that specialization, defined as different producers optimizing for different types of content, naturally arises from the competition among producers trying to maximize user engagement. We provide a heuristic for computing equilibria of our engagement game, and evaluate it experimentally. We highlight how i) the performance and convergence of our heuristic, ii) the level of producer specialization, and iii) the producer and user utilities at equilibrium are affected by the choice of content-serving rule and provide guidance on how to set the content-serving rule to use in engagement games.


title: How well do one-electron self-interaction-correction methods perform for systems with fractional electrons?

abstract: Recently developed locally scaled self-interaction correction (LSIC) is a one-electron SIC method that, when used with a ratio of kinetic energy densities (z$_\sigma$) as iso-orbital indicator, performs remarkably well for both thermochemical properties as well as for barrier heights overcoming the paradoxical behavior of the well-known Perdew-Zunger self-interaction correction (PZSIC) method. In this work, we examine how well the LSIC method performs for the delocalization error. Our results show that both LSIC and PZSIC methods correctly describe the dissociation of H$_2^+$ and He$_2^+$ but LSIC is overall more accurate than the PZSIC method. Likewise, in the case of the vertical ionization energy of an ensemble of isolated He atoms, the LSIC and PZSIC methods do not exhibit delocalization errors. For the fractional charges, both LSIC and PZSIC significantly reduce the deviation from linearity in the energy versus number of electrons curve, with PZSIC performing superior for C, Ne, and Ar atoms while for Kr they perform similarly. The LSIC performs well at the endpoints (integer occupations) while substantially reducing the deviation. The dissociation of LiF shows both LSIC and PZSIC dissociate into neutral Li and F but only LSIC exhibits charge transfer from Li$^+$ to F$^-$ at the expected distance from the experimental data and accurate ab initio data. Overall both the PZSIC and LSIC methods reduce the delocalization errors substantially.


title: Game of Coding: Beyond Trusted Majorities

abstract: Coding theory revolves around the incorporation of redundancy into transmitted symbols, computation tasks, and stored data to guard against adversarial manipulation. However, error correction in coding theory is contingent upon a strict trust assumption. In the context of computation and storage, it is required that honest nodes outnumber adversarial ones by a certain margin. However, in several emerging real-world cases, particularly, in decentralized blockchain-oriented applications, such assumptions are often unrealistic. Consequently, despite the important role of coding in addressing significant challenges within decentralized systems, its applications become constrained. Still, in decentralized platforms, a distinctive characteristic emerges, offering new avenues for secure coding beyond the constraints of conventional methods. In these scenarios, the adversary benefits when the legitimate decoder recovers the data, and preferably with a high estimation error. This incentive motivates them to act rationally, trying to maximize their gains. In this paper, we propose a game theoretic formulation for coding, called the game of coding, that captures this unique dynamic where each of the adversary and the data collector (decoder) have a utility function to optimize. The utility functions reflect the fact that both the data collector and the adversary are interested in increasing the chance of data being recoverable by the data collector. Moreover, the utility functions express the interest of the data collector to estimate the input with lower estimation error, but the opposite interest of the adversary. As a first, still highly non-trivial step, we characterize the equilibrium of the game for the repetition code with a repetition factor of 2, for a wide class of utility functions with minimal assumptions.


title: Solving norm equations in global function fields

abstract: We present two new algorithms for solving norm equations over global function fields with at least one infinite place of degree 1 and no wild ramification. The first of these is a substantial improvement of a method due to Ga\'{a}l and Pohst, while the second approach uses index calculus techniques and is significantly faster asymptotically and in practice. Both algorithms incorporate compact representations of field elements which results in a significant gain in performance compared to the Ga\'{a}l-Pohst approach. We provide Magma implementations, analyze the complexity of all three algorithms under varying asymptotics on the field parameters, and provide empirical data on their performance.


title: Speeding up and reducing memory usage for scientific machine learning via mixed precision

abstract: Scientific machine learning (SciML) has emerged as a versatile approach to address complex computational science and engineering problems. Within this field, physics-informed neural networks (PINNs) and deep operator networks (DeepONets) stand out as the leading techniques for solving partial differential equations by incorporating both physical equations and experimental data. However, training PINNs and DeepONets requires significant computational resources, including long computational times and large amounts of memory. In search of computational efficiency, training neural networks using half precision (float16) rather than the conventional single (float32) or double (float64) precision has gained substantial interest, given the inherent benefits of reduced computational time and memory consumed. However, we find that float16 cannot be applied to SciML methods, because of gradient divergence at the start of training, weight updates going to zero, and the inability to converge to a local minima. To overcome these limitations, we explore mixed precision, which is an approach that combines the float16 and float32 numerical formats to reduce memory usage and increase computational speed. Our experiments showcase that mixed precision training not only substantially decreases training times and memory demands but also maintains model accuracy. We also reinforce our empirical observations with a theoretical analysis. The research has broad implications for SciML in various computational applications.


title: Incoherent Probability Judgments in Large Language Models

abstract: Autoregressive Large Language Models (LLMs) trained for next-word prediction have demonstrated remarkable proficiency at producing coherent text. But are they equally adept at forming coherent probability judgments? We use probabilistic identities and repeated judgments to assess the coherence of probability judgments made by LLMs. Our results show that the judgments produced by these models are often incoherent, displaying human-like systematic deviations from the rules of probability theory. Moreover, when prompted to judge the same event, the mean-variance relationship of probability judgments produced by LLMs shows an inverted-U-shaped like that seen in humans. We propose that these deviations from rationality can be explained by linking autoregressive LLMs to implicit Bayesian inference and drawing parallels with the Bayesian Sampler model of human probability judgments.


title: A Family of Low-Complexity Binary Codes with Constant Hamming Weights

abstract: In this paper, we focus on the design of binary constant-weight codes that admit low-complexity encoding and decoding algorithms, and that have size as a power of $2$. We construct a family of $(n=2^\ell, M=2^k, d=2)$ constant-weight codes ${\cal C}[\ell, r]$ parameterized by integers $\ell \geq 3$ and $1 \leq r \leq \lfloor \frac{\ell+3}{4} \rfloor$, by encoding information in the gaps between successive $1$'s of a vector. The code has weight $w = \ell$ and combinatorial dimension $k$ that scales quadratically with $\ell$. The encoding time is linear in the input size $k$, and the decoding time is poly-logarithmic in the input size $n$, discounting the linear time spent on parsing the input. Encoding and decoding algorithms of similar codes known in either information-theoretic or combinatorial literature require computation of large number of binomial coefficients. Our algorithms fully eliminate the need to evaluate binomial coefficients. While the code has a natural price to pay in $k$, it performs fairly well against the information-theoretic upper bound $\lfloor \log_2 {n \choose w} \rfloor$. When $\ell =3$, the code is optimal achieving the upper bound; when $\ell=4$, it is one bit away from the upper bound, and as $\ell$ grows it is order-optimal in the sense that the ratio of $k$ with its upper bound becomes a constant $\frac{11}{16}$ when $r=\lfloor \frac{\ell+3}{4} \rfloor$. With the same or even lower complexity, we derive new codes permitting a wider range of parameters by modifying ${\cal C}[\ell, r]$ in two different ways. The code derived using the first approach has the same blocklength $n=2^\ell$, but weight $w$ is allowed to vary from $\ell-1$ to $1$. In the second approach, the weight remains fixed as $w = \ell$, but the blocklength is reduced to $n=2^\ell - 2^r +1$. For certain selected values of parameters, these modified codes have an optimal $k$.


title: JWST Observations of Starbursts: Polycyclic Aromatic Hydrocarbon Emission at the Base of the M 82 Galactic Wind

abstract: We present new observations of the central 1 kpc of the M 82 starburst obtained with the James Webb Space Telescope (JWST) near-infrared camera (NIRCam) instrument at a resolution ~0.05"-0.1" (~1-2 pc). The data comprises images in three mostly continuum filters (F140M, F250M, and F360M), and filters that contain [FeII] (F164N), H2 v=1-0 (F212N), and the 3.3 um PAH feature (F335M). We find prominent plumes of PAH emission extending outward from the central starburst region, together with a network of complex filamentary substructure and edge-brightened bubble-like features. The structure of the PAH emission closely resembles that of the ionized gas, as revealed in Paschen alpha and free-free radio emission. We discuss the origin of the structure, and suggest the PAHs are embedded in a combination of neutral, molecular, and photoionized gas.


title: Using Motion Forecasting for Behavior-Based Virtual Reality (VR) Authentication

abstract: Task-based behavioral biometric authentication of users interacting in virtual reality (VR) environments enables seamless continuous authentication by using only the motion trajectories of the person's body as a unique signature. Deep learning-based approaches for behavioral biometrics show high accuracy when using complete or near complete portions of the user trajectory, but show lower performance when using smaller segments from the start of the task. Thus, any systems designed with existing techniques are vulnerable while waiting for future segments of motion trajectories to become available. In this work, we present the first approach that predicts future user behavior using Transformer-based forecasting and using the forecasted trajectory to perform user authentication. Our work leverages the notion that given the current trajectory of a user in a task-based environment we can predict the future trajectory of the user as they are unlikely to dramatically shift their behavior since it would preclude the user from successfully completing their task goal. Using the publicly available 41-subject ball throwing dataset of Miller et al. we show improvement in user authentication when using forecasted data. When compared to no forecasting, our approach reduces the authentication equal error rate (EER) by an average of 23.85% and a maximum reduction of 36.14%.


title: Augmenting Replay in World Models for Continual Reinforcement Learning

abstract: Continual RL is a challenging problem where the agent is exposed to a sequence of tasks; it should learn new tasks without forgetting old ones, and learning the new task should improve performance on previous and future tasks. The most common approaches use model-free RL algorithms as a base, and replay buffers have been used to overcome catastrophic forgetting. However, the buffers are often very large making scalability difficult. Also, the concept of replay comes from biological inspiration, where evidence suggests that replay is applied to a world model, which implies model-based RL -- and model-based RL should have benefits for continual RL, where it is possible to exploit knowledge independent of the policy. We present WMAR, World Models with Augmented Replay, a model-based RL algorithm with a world model and memory efficient distribution matching replay buffer. It is based on the well-known DreamerV3 algorithm, which has a simple FIFO buffer and was not tested in a continual RL setting. We evaluated WMAR vs WMAR (FIFO only) on tasks with and without shared structure from OpenAI ProcGen and Atari respectively, and without a task oracle. We found that WMAR has favourable properties on continual RL with significantly reduced computational overhead compared to WMAR (FIFO only). WMAR had small benefits over DreamerV3 on tasks with shared structure and substantially better forgetting characteristics on tasks without shared structure; but at the cost of lower plasticity seen in a lower maximum on new tasks. The results suggest that model-based RL using a world model with a memory efficient replay buffer can be an effective and practical approach to continual RL, justifying future work.


title: A constructive approach to selective risk control

abstract: Many modern applications require the use of data to both select the statistical tasks and make valid inference after selection. In this article, we provide a unifying approach to control for a class of selective risks. Our method is motivated by a reformulation of the celebrated Benjamini-Hochberg (BH) procedure for multiple hypothesis testing as the iterative limit of the Benjamini-Yekutieli (BY) procedure for constructing post-selection confidence intervals. Although several earlier authors have made noteworthy observations related to this, our discussion highlights that (1) the BH procedure is precisely the fixed-point iteration of the BY procedure; (2) the fact that the BH procedure controls the false discovery rate is almost an immediate corollary of the fact that the BY procedure controls the false coverage-statement rate. Building on this observation, we propose a constructive approach to control extra-selection risk (selection made after decision) by iterating decision strategies that control the post-selection risk (decision made after selection), and show that many previous methods and results are special cases of this general framework. We further extend this approach to problems with multiple selective risks and demonstrate how new methods can be developed. Our development leads to two surprising results about the BH procedure: (1) in the context of one-sided location testing, the BH procedure not only controls the false discovery rate at the null but also at other locations for free; (2) in the context of permutation tests, the BH procedure with exact permutation p-values can be well approximated by a procedure which only requires a total number of permutations that is almost linear in the total number of hypotheses.


title: Moments of undersampled distributions: Application to the size of epidemics

abstract: The total number of fatalities of an epidemic outbreak is a dramatic but extremely informative quantity. Knowledge of the statistics of this quantity allows the calculation of the mean total number of fatalities conditioned to the fact that the outbreak has surpassed a given number of fatalities, which is very relevant for risk assessment. However, the fact that the total number of fatalities seems to be characterized by a power-law tailed distribution with exponent (of the survival function) smaller than one poses an important theoretical difficulty, due to the non-existence of a mean value for such distributions. Cirillo and Taleb [Nature Phys. 16, 606 (2020)] propose a transformation from a so-called dual variable, which displays a power-law tail, to the total number of fatalities, which becomes bounded by the total world population. Here, we (i) show that such a transformation is ad hoc and unphysical; (ii) propose alternative transformations and distributions (also ad hoc); (iii) argue that the right framework for this problem is statistical physics, through finite-size scaling; and (iv) demonstrate that the real problem is not the non-existence of the mean value for power-law tailed distributions but the fact that the tail of the different theoretical distributions (which is what distinguishes one model from the other) is far from being well sampled with the available number of empirical data. Our results are also valid for many other hazards displaying (apparent) power-law tails in their size.


title: ILBiT: Imitation Learning for Robot Using Position and Torque Information based on Bilateral Control with Transformer

abstract: Autonomous manipulation in robot arms is a complex and evolving field of study in robotics. This paper introduces an innovative approach to this challenge by focusing on imitation learning (IL). Unlike traditional imitation methods, our approach uses IL based on bilateral control, allowing for more precise and adaptable robot movements. The conventional IL based on bilateral control method have relied on Long Short-Term Memory (LSTM) networks. In this paper, we present the IL for robot using position and torque information based on Bilateral control with Transformer (ILBiT). This proposed method employs the Transformer model, known for its robust performance in handling diverse datasets and its capability to surpass LSTM's limitations, especially in tasks requiring detailed force adjustments. A standout feature of ILBiT is its high-frequency operation at 100 Hz, which significantly improves the system's adaptability and response to varying environments and objects of different hardness levels. The effectiveness of the Transformer-based ILBiT method can be seen through comprehensive real-world experiments.


title: Enabling BLV Developers with LLM-driven Code Debugging

abstract: BLVRUN is a command line shell script designed to offer developers within the BLV community a succinct and insightful overview of traceback errors. Its primary function involves parsing errors and utilizing a refined large language model to generate informative error summaries. In terms of performance, our model rivals that of well-known models like ChatGPT or AI-chatbot plug-ins tailored for specific Integrated Development Environments (IDEs). Importantly, BLV users can seamlessly integrate this tool into their existing development workflows, eliminating the need for any modifications or adaptations to facilitate debugging tasks.


title: Rademacher Complexity of Neural ODEs via Chen-Fliess Series

abstract: We show how continuous-depth neural ODE models can be framed as single-layer, infinite-width nets using the Chen--Fliess series expansion for nonlinear ODEs. In this net, the output ``weights'' are taken from the signature of the control input -- a tool used to represent infinite-dimensional paths as a sequence of tensors -- which comprises iterated integrals of the control input over a simplex. The ``features'' are taken to be iterated Lie derivatives of the output function with respect to the vector fields in the controlled ODE model. The main result of this work applies this framework to derive compact expressions for the Rademacher complexity of ODE models that map an initial condition to a scalar output at some terminal time. The result leverages the straightforward analysis afforded by single-layer architectures. We conclude with some examples instantiating the bound for some specific systems and discuss potential follow-up work.


title: Gradient-Based Language Model Red Teaming

abstract: Red teaming is a common strategy for identifying weaknesses in generative language models (LMs), where adversarial prompts are produced that trigger an LM to generate unsafe responses. Red teaming is instrumental for both model alignment and evaluation, but is labor-intensive and difficult to scale when done by humans. In this paper, we present Gradient-Based Red Teaming (GBRT), a red teaming method for automatically generating diverse prompts that are likely to cause an LM to output unsafe responses. GBRT is a form of prompt learning, trained by scoring an LM response with a safety classifier and then backpropagating through the frozen safety classifier and LM to update the prompt. To improve the coherence of input prompts, we introduce two variants that add a realism loss and fine-tune a pretrained model to generate the prompts instead of learning the prompts directly. Our experiments show that GBRT is more effective at finding prompts that trigger an LM to generate unsafe responses than a strong reinforcement learning-based red teaming approach, and succeeds even when the LM has been fine-tuned to produce safer outputs.


title: Recovering Mental Representations from Large Language Models with Markov Chain Monte Carlo

abstract: Simulating sampling algorithms with people has proven a useful method for efficiently probing and understanding their mental representations. We propose that the same methods can be used to study the representations of Large Language Models (LLMs). While one can always directly prompt either humans or LLMs to disclose their mental representations introspectively, we show that increased efficiency can be achieved by using LLMs as elements of a sampling algorithm. We explore the extent to which we recover human-like representations when LLMs are interrogated with Direct Sampling and Markov chain Monte Carlo (MCMC). We found a significant increase in efficiency and performance using adaptive sampling algorithms based on MCMC. We also highlight the potential of our method to yield a more general method of conducting Bayesian inference \textit{with} LLMs.


title: OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer

abstract: Recent studies have highlighted the importance of fully open foundation models. The Open Whisper-style Speech Model (OWSM) is an initial step towards reproducing OpenAI Whisper using public data and open-source toolkits. However, previous versions of OWSM (v1 to v3) are still based on standard Transformer, which might lead to inferior performance compared to state-of-the-art speech encoder architectures. This work aims to improve the performance and efficiency of OWSM without additional data. We present a series of E-Branchformer-based models named OWSM v3.1, ranging from 100M to 1B parameters. OWSM v3.1 outperforms its predecessor, OWSM v3, in most evaluation benchmarks, while showing an improved inference speed of up to 25%. We further reveal the emergent ability of OWSM v3.1 in zero-shot contextual biasing speech recognition. We also provide a model trained on a subset of data with low license restrictions. We will publicly release the code, pre-trained models, and training logs.


abstract: Conversational search facilitates complex information retrieval by enabling multi-turn interactions between users and the system. Supporting such interactions requires a comprehensive understanding of the conversational inputs to formulate a good search query based on historical information. In particular, the search query should include the relevant information from the previous conversation turns. However, current approaches for conversational dense retrieval primarily rely on fine-tuning a pre-trained ad-hoc retriever using the whole conversational search session, which can be lengthy and noisy. Moreover, existing approaches are limited by the amount of manual supervision signals in the existing datasets. To address the aforementioned issues, we propose a History-Aware Conversational Dense Retrieval (HAConvDR) system, which incorporates two ideas: context-denoised query reformulation and automatic mining of supervision signals based on the actual impact of historical turns. Experiments on two public conversational search datasets demonstrate the improved history modeling capability of HAConvDR, in particular for long conversations with topic shifts.


title: A Nonparametric Approach for Estimating the Effective Sample Size in Gaussian Approximation of Expected Value of Sample Information

abstract: The effective sample size (ESS) measures the informational value of a probability distribution in terms of an equivalent number of study participants. The ESS plays a crucial role in estimating the Expected Value of Sample Information (EVSI) through the Gaussian approximation approach. Despite the significance of ESS, existing ESS estimation methods within the Gaussian approximation framework are either computationally expensive or potentially inaccurate. To address these limitations, we propose a novel approach that estimates the ESS using the summary statistics of generated datasets and nonparametric regression methods. The simulation results suggest that the proposed method provides accurate ESS estimates at a low computational cost, making it an efficient and practical way to quantify the information contained in the probability distribution of a parameter. Overall, determining the ESS can help analysts understand the uncertainty levels in complex prior distributions in the probability analyses of decision models and perform efficient EVSI calculations.


title: Generalization of LiNGAM that allows confounding

abstract: LiNGAM determines the variable order from cause to effect using additive noise models, but it faces challenges with confounding. Previous methods maintained LiNGAM's fundamental structure while trying to identify and address variables affected by confounding. As a result, these methods required significant computational resources regardless of the presence of confounding, and they did not ensure the detection of all confounding types. In contrast, this paper enhances LiNGAM by introducing LiNGAM-MMI, a method that quantifies the magnitude of confounding using KL divergence and arranges the variables to minimize its impact. This method efficiently achieves a globally optimal variable order through the shortest path problem formulation. LiNGAM-MMI processes data as efficiently as traditional LiNGAM in scenarios without confounding while effectively addressing confounding situations. Our experimental results suggest that LiNGAM-MMI more accurately determines the correct variable order, both in the presence and absence of confounding.


title: Linear relation between short range correlation and EMC effect of gluons in nuclei

abstract: We explore the EMC effects of gluons through heavy quark production in deep inelastic scattering (DIS) and short range correlation (SRC) from sub-threshold photoproduction of the $J/\psi$. We perform an effective field theory analysis of gluon parton distribution functions in nuclei, and derive a linear relation between the slope of reduced cross section, which reflects the magnitude of gluon EMC effect, and the $J/\psi$ production cross section at the photon energy $E_\gamma = 7.0\,\textrm{GeV}$ in the nucleus rest frame which characterizes the SRC. This finding is confirmed by a numerical calculation using the available phenomenological results for gluon parton distribution functions. Examining this linear relation by the forthcoming experimental data on electron-ion collider allows to decipher nuclear effects of gluon distributions and gain a better understanding of the substructure in bound nuclei.


title: VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality

abstract: As consumer Virtual Reality (VR) and Mixed Reality (MR) technologies gain momentum, there's a growing focus on the development of engagements with 3D virtual content. Unfortunately, traditional techniques for content creation, editing, and interaction within these virtual spaces are fraught with difficulties. They tend to be not only engineering-intensive but also require extensive expertise, which adds to the frustration and inefficiency in virtual object manipulation. Our proposed VR-GS system represents a leap forward in human-centered 3D content interaction, offering a seamless and intuitive user experience. By developing a physical dynamics-aware interactive Gaussian Splatting in a Virtual Reality setting, and constructing a highly efficient two-level embedding strategy alongside deformable body simulations, VR-GS ensures real-time execution with highly realistic dynamic responses. The components of our Virtual Reality system are designed for high efficiency and effectiveness, starting from detailed scene reconstruction and object segmentation, advancing through multi-view image in-painting, and extending to interactive physics-based editing. The system also incorporates real-time deformation embedding and dynamic shadow casting, ensuring a comprehensive and engaging virtual experience.Our project page is available at: https://yingjiang96.github.io/VR-GS/.


title: Fast Dual-Regularized Autoencoder for Sparse Biological Data

abstract: Relationship inference from sparse data is an important task with applications ranging from product recommendation to drug discovery. A recently proposed linear model for sparse matrix completion has demonstrated surprising advantage in speed and accuracy over more sophisticated recommender systems algorithms. Here we extend the linear model to develop a shallow autoencoder for the dual neighborhood-regularized matrix completion problem. We demonstrate the speed and accuracy advantage of our approach over the existing state-of-the-art in predicting drug-target interactions and drug-disease associations.


title: The Reliability of Accretion Disk Inclination Derived from X-ray Spectroscopy of Active Galaxies

abstract: The inclination angle of substructures in active galaxies gives insights into physical components from scales of the vicinity of the central black hole to the entire host galaxy. We use the self-consistent reflection spectral model \textsc{RELXILL} to measure the inclination of the inner region of accretion disks with broadband ($0.3-78\,\rm keV$) X-ray observations, systematically studying the reliability of this methodology. To test the capability of the model to return statistically consistent results, we analyze multi-epoch, joint XMM-Newton and NuSTAR data of the narrow-line Seyfert~1 galaxy I\,Zwicky\,1 and the broad-line radio galaxy 3C\,382, which exhibit different degrees of spectral complexity and reflection features. As expected, we find that adding more data for analysis narrows the confidence interval and that multi-epoch, joint observations return optimal measurements; however, even single-epoch data can be well-fitted if the reflection component is sufficiently dominant. Mock spectra are used to test the capability of \textsc{RELXILL} to recover input parameters from typical single-epoch, joint observations. We find that inclination is well-recovered at 90\% confidence, with improved constraints at higher reflection fraction and higher inclination. Higher iron abundance and corona temperature tighten the constraints as well, but the effect is not as significant as a higher reflection fraction. The spin, however, have little effect in reflection-based inclination measurements. We conclude that broadband reflection spectroscopy can reliably measure inner accretion disk inclination.


title: Labeling eigenstates of qubit-cavity systems based on the continuity of qubit occupancy: Detecting resonances to higher excited qubit states

abstract: We propose a new method for labeling the eigenstates of qubit-cavity systems based on the continuity of the qubit occupancy. The labeled eigenstates give a rough estimation of the evolution of a quantum state under cavity driving. The photon-number dependence of the resonant cavity frequency can be estimated from the labeled eigenenergies, and resonances to higher excited qubit states are visible in the dependence. Our proposed method can be applied to a broader parameter region compared to an existing method. With the proposed method, we investigate the offset charge dependence of the resonances to higher excited states that can induce leakage effects from the computational basis. The results imply that the leakage can occur with only around ten photons.