title: Benchmarking Aggregation-Disaggregation Pipelines for Smart Charging of Electric Vehicles

abstract: As the global energy landscape shifts towards renewable energy and the electrification of the transport and heating sectors, national energy systems will include more controllable prosumers. Many future scenarios contain millions of such prosumers with individualistic behavior. This poses a problem for energy system modelers. Memory and runtime limitations often make it impossible to model each prosumer individually. In these cases, it is necessary to model the prosumers with representatives or in aggregated form. Existing literature offers various aggregation methods, each with strengths, drawbacks, and an inherent modeling error. It is difficult to evaluate which of these methods perform best. Each paper presenting a new aggregation method usually includes a performance evaluation. However, what is missing is a direct comparison on the same benchmark, preferably by a neutral third party that is not associated with any of the compared methods. This paper addresses this gap by introducing a benchmark to evaluate the end-to-end performance of multiple aggregation-disaggregation pipelines, specifically focusing on electric vehicles (EVs). Our study assesses the performance of the common representative profile (REP) approach, four different versions of the virtual battery (VB) approach, the Flex Object (FO) method, and the Dependency-based FlexOffer (DFO) method. The results show that each method has a clear use case. Depending on the price signal, additional median charging costs of 2%-50% are incurred using an aggregation method, compared to the optimal charging costs (i.e., the charging costs resulting from optimizing the EVs directly, without aggregation). The representative profile approach results in the lowest additional costs (2%-20%), while the FO and DFO methods allow for error-free disaggregation, which is advantageous in real-world use cases.


title: GFM4MPM: Towards Geospatial Foundation Models for Mineral Prospectivity Mapping

abstract: Machine Learning (ML) for Mineral Prospectivity Mapping (MPM) remains a challenging problem as it requires the analysis of associations between large-scale multi-modal geospatial data and few historical mineral commodity observations (positive labels). Recent MPM works have explored Deep Learning (DL) as a modeling tool with more representation capacity. However, these overparameterized methods may be more prone to overfitting due to their reliance on scarce labeled data. While a large quantity of unlabeled geospatial data exists, no prior MPM works have considered using such information in a self-supervised manner. Our MPM approach uses a masked image modeling framework to pretrain a backbone neural network in a self-supervised manner using unlabeled geospatial data alone. After pretraining, the backbone network provides feature extraction for downstream MPM tasks. We evaluated our approach alongside existing methods to assess mineral prospectivity of Mississippi Valley Type (MVT) and Clastic-Dominated (CD) Lead-Zinc deposits in North America and Australia. Our results demonstrate that self-supervision promotes robustness in learned features, improving prospectivity predictions. Additionally, we leverage explainable artificial intelligence techniques to demonstrate that individual predictions can be interpreted from a geological perspective.


title: MAC: A Benchmark for Multiple Attributes Compositional Zero-Shot Learning

abstract: Compositional Zero-Shot Learning (CZSL) aims to learn semantic primitives (attributes and objects) from seen compositions and recognize unseen attribute-object compositions. Existing CZSL datasets focus on single attributes, neglecting the fact that objects naturally exhibit multiple interrelated attributes. Real-world objects often possess multiple interrelated attributes, and current datasets' narrow attribute scope and single attribute labeling introduce annotation biases, undermining model performance and evaluation. To address these limitations, we introduce the Multi-Attribute Composition (MAC) dataset, encompassing 18,217 images and 11,067 compositions with comprehensive, representative, and diverse attribute annotations. MAC includes an average of 30.2 attributes per object and 65.4 objects per attribute, facilitating better multi-attribute composition predictions. Our dataset supports deeper semantic understanding and higher-order attribute associations, providing a more realistic and challenging benchmark for the CZSL task. We also develop solutions for multi-attribute compositional learning and propose the MM-encoder to disentangling the attributes and objects.


title: Small solutions to inhomogeneous and homogeneous quadratic congruences modulo prime powers

abstract: We prove asymptotic formulae for small weighted solutions of quadratic congruences of the form $\lambda_1x_1^2+\cdots +\lambda_nx_n^2\equiv \lambda_{n+1}\bmod{p^m}$, where $p$ is a fixed odd prime, $\lambda_1,...,\lambda_{n+1}$ are integer coefficients such that $(\lambda_1\cdots \lambda _{n},p)=1$ and $m\rightarrow \infty$. If $n\ge 6$, $p\ge 5$ and the coefficients are fixed and satisfy $\lambda_1,...,\lambda_n>0$ and $(\lambda_{n+1},p)=1$ (inhomogeneous case), we obtain an asymptotic formula which is valid for integral solutions $(x_1,...,x_n)$ in cubes of side length at least $p^{(1/2+\varepsilon)m}$, centered at the origin. If $n\ge 4$ and $\lambda_{n+1}=0$ (homogeneous case), we prove a result of the same strength for coefficients $\lambda_i$ which are allowed to vary with $m$. These results extend previous results of the first- and the third-named authors and N. Bag.


title: Stretched-exponential mixing for surface semiflows and Anosov flows

abstract: For a surface semiflow that is a suspension of a \( C^{1+\alpha} \) expanding Markov interval map, we prove that, under the assumptions that the roof function is Lipschitz continuous and not cohomologous to a locally constant function, the semiflow exhibits stretched-exponential mixing with respect to the SRB measure. This result extends to hyperbolic skew-product semiflows and hyperbolic attractors. Specifically, codimension-one topologically mixing Anosov flows with Lipschitz continuous stable foliations demonstrate stretched-exponential mixing with respect to their SRB measures.


title: The Mathematics of Dots and Pixels: On the Theoretical Foundations of Image Halftoning

abstract: The evolution of image halftoning, from its analog roots to contemporary digital methodologies, encapsulates a fascinating journey marked by technological advancements and creative innovations. Yet the theoretical understanding of halftoning is much more recent. In this article, we explore various approaches towards shedding light on the design of halftoning approaches and why they work. We discuss both halftoning in a continuous domain and on a pixel grid. We start by reviewing the mathematical foundation of the so-called electrostatic halftoning method, which departed from the heuristic of considering the back dots of the halftoned image as charged particles attracted by the grey values of the image in combination with mutual repulsion. Such an attraction-repulsion model can be mathematically represented via an energy functional in a reproducing kernel Hilbert space allowing for a rigorous analysis of the resulting optimization problem as well as a convergence analysis in a suitable topology. A second class of methods that we discuss in detail is the class of error diffusion schemes, arguably among the most popular halftoning techniques due to their ability to work directly on a pixel grid and their ease of application. The main idea of these schemes is to choose the locations of the black pixels via a recurrence relation designed to agree with the image in terms of the local averages. We discuss some recent mathematical understanding of these methods that is based on a connection to Sigma-Delta quantizers, a popular class of algorithms for analog-to-digital conversion.


title: Obstructing two-torsion in the rational knot concordance group

abstract: It is well known that there are many 2-torsion elements in the classical knot concordance group. On the other hand, it is not known if there is any torsion element in the rational knot concordance group $\mathcal{C}_\mathbb{Q}$. Cha defined the algebraic rational concordance group $\mathcal{AC}_\mathbb{Q}$, an analogue of the classical algebraic concordance group, and showed that $\mathcal{AC}_\mathbb{Q}\cong\mathbb{Z}^\infty\oplus\mathbb{Z}_2^\infty\oplus\mathbb{Z}_4^\infty$. The knots that represent 2-torsions in $\mathcal{AC}_\mathbb{Q}$ potentially have order $2$ in $\mathcal{C}_\mathbb{Q}$. In this paper, we provide an obstruction for knots of order $2$ in $\mathcal{AC}_\mathbb{Q}$ from being of finite order in $\mathcal{C}_\mathbb{Q}$. Moreover, we give a family consisting of such knots that generates an infinite rank subgroup of $\mathcal{C}_\mathbb{Q}$. We also note that Cha proved that in higher dimensions, the algebraic rational concordance order is the same as the rational knot concordance order. Our obstruction is based on the localized von Neumann $\rho$-invariant.


title: Unsupervised explainable activity prediction in competitive Nordic Walking from experimental data

abstract: Artificial Intelligence (AI) has found application in Human Activity Recognition (HAR) in competitive sports. To date, most Machine Learning (ML) approaches for HAR have relied on offline (batch) training, imposing higher computational and tagging burdens compared to online processing unsupervised approaches. Additionally, the decisions behind traditional ML predictors are opaque and require human interpretation. In this work, we apply an online processing unsupervised clustering approach based on low-cost wearable Inertial Measurement Units (IMUs). The outcomes generated by the system allow for the automatic expansion of limited tagging available (e.g., by referees) within those clusters, producing pertinent information for the explainable classification stage. Specifically, our work focuses on achieving automatic explainability for predictions related to athletes' activities, distinguishing between correct, incorrect, and cheating practices in Nordic Walking. The proposed solution achieved performance metrics of close to 100 % on average.


title: Implicit Bias of Mirror Flow on Separable Data

abstract: We examine the continuous-time counterpart of mirror descent, namely mirror flow, on classification problems which are linearly separable. Such problems are minimised `at infinity' and have many possible solutions; we study which solution is preferred by the algorithm depending on the mirror potential. For exponential tailed losses and under mild assumptions on the potential, we show that the iterates converge in direction towards a $\phi_\infty$-maximum margin classifier. The function $\phi_\infty$ is the $\textit{horizon function}$ of the mirror potential and characterises its shape `at infinity'. When the potential is separable, a simple formula allows to compute this function. We analyse several examples of potentials and provide numerical experiments highlighting our results.


title: Quasi-Bayes meets Vines

abstract: Recently proposed quasi-Bayesian (QB) methods initiated a new era in Bayesian computation by directly constructing the Bayesian predictive distribution through recursion, removing the need for expensive computations involved in sampling the Bayesian posterior distribution. This has proved to be data-efficient for univariate predictions, but extensions to multiple dimensions rely on a conditional decomposition resulting from predefined assumptions on the kernel of the Dirichlet Process Mixture Model, which is the implicit nonparametric model used. Here, we propose a different way to extend Quasi-Bayesian prediction to high dimensions through the use of Sklar's theorem by decomposing the predictive distribution into one-dimensional predictive marginals and a high-dimensional copula. Thus, we use the efficient recursive QB construction for the one-dimensional marginals and model the dependence using highly expressive vine copulas. Further, we tune hyperparameters using robust divergences (eg. energy score) and show that our proposed Quasi-Bayesian Vine (QB-Vine) is a fully non-parametric density estimator with \emph{an analytical form} and convergence rate independent of the dimension of data in some situations. Our experiments illustrate that the QB-Vine is appropriate for high dimensional distributions ($\sim$64), needs very few samples to train ($\sim$200) and outperforms state-of-the-art methods with analytical forms for density estimation and supervised tasks by a considerable margin.


title: Windows Into Other Worlds: Pitfalls in the physical interpretation of exoplanet atmospheric spectroscopy

abstract: Atmospheric spectroscopy provides a window into the properties of exoplanets. However, the physical interpretation of retrieved data and its implications for the internal properties of exoplanets remains nebulous. This letter addresses three misconceptions held by some atmospheric spectroscopists regarding the connection between observed chemical abundances and theory: (1) Whether atmospheric spectroscopy can provide the bulk atmospheric chemistry, (2) whether it can identify if a planet is cloudless, and (3) whether atmospheric evaporation arguments can be used to dismiss certain compositions inferred through spectroscopy. This letter concludes by exploring applications of remote sensing in the quest for the search for life outside of our solar system.


title: On a p-adic version of Narasimhan and Seshadri's theorem

abstract: Consider a smooth projective curve C of genus g over a complete discrete valuation field of characteristic 0 and residue field \Fbar_p. Motivated by Narasimhan and Seshadri's theorem, Faltings asked whether all semistable vector bundles of degree 0 over C_{\C_p} are in the image of the p-adic Simpson correspondence. Works of Deninger-Werner and Xu show that this is equivalent for the vector bundle to having potentially strongly semistable reduction. We prove that if C has good reduction, p>r(r-1) (g-1) and we consider a vector bundle of rank r with stable reduction, the conditions of having potentially strongly semistable reduction and of having strongly semistable reduction are equivalent. In particular, we provide a negative answer to Faltings' question


title: Moduli Spaces of Lagrangian Surfaces in $\mathbb{CP}^2$ obtained from Triple Grid Diagrams

abstract: Links in $S^3$ as well as Legendrian links in the standard tight contact structure on $S^3$ can be encoded by grid diagrams. These consist of a collection of points on a toroidal grid, connected by vertical and horizontal edges. Blackwell, Gay and second author studied triple grid diagrams, a generalization where the points are connected by vertical, horizontal and diagonal edges. In certain cases, these determine Lagrangian surfaces in $\mathbb{CP}^2$. However, it was difficult to construct explicit examples of triple grid diagrams, either by an approximation method or combinatorial search. We give an elegant geometric construction that produces the moduli space of all triple grid diagrams. By conditioning on the abstract graph underlying the triple grid diagram, as opposed to the grid size, the problem reduces to linear algebra and can be solved quickly in polynomial time.


title: Modelling predicts a molecule-rich disk around the AGB star L2 Puppis

abstract: The nearby oxygen-rich AGB star L2 Pup hosts a well-studied nearly edge-on disk. To date, disks around AGB stars have not been chemically studied in detail. By combining a parameterisation commonly used for protoplanetary disks and archival ALMA observations, we retrieved an updated density and temperature structure of this disk. This physical model was then used as input to the first chemical model of an AGB disk. The model shows that the physical structure of the disk has a large impact on its chemistry, with certain species showing large changes in column density relative to a radial outflow, indicating that chemistry could be used as a tracer of disks that cannot be directly imaged. Despite its oxygen-rich nature, the daughter species formed within the disk are surprisingly carbon-rich. Two chemical regimes can be distinguished: cosmic-ray induced chemistry in the midplane and photochemistry induced by the interstellar radiation field in the outer regions. Certain complex organic molecules are formed in the midplane. This occurs via gas-phase chemistry only, as the disk is too warm for dust-gas chemistry. The photochemistry in the outer regions leads to the efficient formation of (long) carbon-chains. The predictions of the model allow us to tentatively put the disk's age $\lesssim 10^5$ yr. Additional observations are necessary to better constrain the physical structure of L2 Pup's disk and are essential to test the predictions made by the chemical model. Our exploratory work paves the way for a more general study of the chemistry of AGB disks.


title: Latent Intuitive Physics: Learning to Transfer Hidden Physics from A 3D Video

abstract: We introduce latent intuitive physics, a transfer learning framework for physics simulation that can infer hidden properties of fluids from a single 3D video and simulate the observed fluid in novel scenes. Our key insight is to use latent features drawn from a learnable prior distribution conditioned on the underlying particle states to capture the invisible and complex physical properties. To achieve this, we train a parametrized prior learner given visual observations to approximate the visual posterior of inverse graphics, and both the particle states and the visual posterior are obtained from a learned neural renderer. The converged prior learner is embedded in our probabilistic physics engine, allowing us to perform novel simulations on unseen geometries, boundaries, and dynamics without knowledge of the true physical parameters. We validate our model in three ways: (i) novel scene simulation with the learned visual-world physics, (ii) future prediction of the observed fluid dynamics, and (iii) supervised particle simulation. Our model demonstrates strong performance in all three tasks.


title: Informatics & dairy industry coalition: AI trends and present challenges

abstract: Artificial Intelligence (AI) can potentially transform the industry, enhancing the production process and minimizing manual, repetitive tasks. Accordingly, the synergy between high-performance computing and powerful mathematical models enables the application of sophisticated data analysis procedures like Machine Learning. However, challenges exist regarding effective, efficient, and flexible processing to generate valuable knowledge. Consequently, this work comprehensively describes industrial challenges where AI can be exploited, focusing on the dairy industry. The conclusions presented can help researchers apply novel approaches for cattle monitoring and farmers by proposing advanced technological solutions to their needs.


title: First-Order Methods for Linearly Constrained Bilevel Optimization

abstract: Algorithms for bilevel optimization often encounter Hessian computations, which are prohibitive in high dimensions. While recent works offer first-order methods for unconstrained bilevel problems, the constrained setting remains relatively underexplored. We present first-order linearly constrained optimization methods with finite-time hypergradient stationarity guarantees. For linear equality constraints, we attain $\epsilon$-stationarity in $\widetilde{O}(\epsilon^{-2})$ gradient oracle calls, which is nearly-optimal. For linear inequality constraints, we attain $(\delta,\epsilon)$-Goldstein stationarity in $\widetilde{O}(d{\delta^{-1} \epsilon^{-3}})$ gradient oracle calls, where $d$ is the upper-level dimension. Finally, we obtain for the linear inequality setting dimension-free rates of $\widetilde{O}({\delta^{-1} \epsilon^{-4}})$ oracle complexity under the additional assumption of oracle access to the optimal dual variable. Along the way, we develop new nonsmooth nonconvex optimization methods with inexact oracles. We verify these guarantees with preliminary numerical experiments.


title: QCD Phase Diagram at finite Magnetic Field and Chemical Potential: A Holographic Approach Using Machine Learning

abstract: By leveraging neural networks, we address the inverse problem of constructing a quantitative 2+1-flavor holographic QCD model based on state-of-the-art lattice QCD data. Our model demonstrates quantitative agreement with the latest lattice QCD results. We construct the full phase diagram at finite magnetic field $B$, baryon chemical potential $\mu_B$ and temperature $T$. We uncover rich phase structure with a first-order phase transition surface and a critical endpoint line within the 3-dimensional phase diagram. The critical endpoint at vanishing chemical potential aligns with current speculations in the lattice QCD literature. In particular, for large magnetic field, we find two critical endpoints in the $T$-$\mu_B$ plane. The critical exponents of the critical endpoints adhere to scaling relations and depend on the background magnetic field. Moreover, they are exhibit deviations from mean-field theory, highlighting the distinctive features of our holographic approach.


title: Robustness of contextuality under different types of noise as quantifiers for parity-oblivious multiplexing tasks

abstract: Generalised contextuality is a well-motivated notion of nonclassicality powering up a myriad of quantum tasks, among which is the celebrated case of a two-party information processing task where classical information is compressed in a quantum channel, the parity-oblivious multiplexing (POM) task. The success rate is the standard quantifier of resourcefulness for this task, while robustness-based quantifiers are as operationally motivated and have known general properties. In this work, we leverage analytical and numerical tools to estimate robustness of contextuality in POM scenarios under different types of noise. We conclude that for the 3-to-1 case the robustness of contextuality to depolarisation, as well as a minimisation of the robustness of contextuality to dephasing over all bases, are good quantifiers for the nonclassical advantage of this scenario. Moreover, we obtain a general relation between robustness of contextuality to depolarisation and the success rate in any $n$-to-1 POM scenario and show how it can be used to bound the number of bits encoded in this task.


title: Towards Exact Gradient-based Training on Analog In-memory Computing

abstract: Given the high economic and environmental costs of using large vision or language models, analog in-memory accelerators present a promising solution for energy-efficient AI. While inference on analog accelerators has been studied recently, the training perspective is underexplored. Recent studies have shown that the "workhorse" of digital AI training - stochastic gradient descent (SGD) algorithm converges inexactly when applied to model training on non-ideal devices. This paper puts forth a theoretical foundation for gradient-based training on analog devices. We begin by characterizing the non-convergent issue of SGD, which is caused by the asymmetric updates on the analog devices. We then provide a lower bound of the asymptotic error to show that there is a fundamental performance limit of SGD-based analog training rather than an artifact of our analysis. To address this issue, we study a heuristic analog algorithm called Tiki-Taka that has recently exhibited superior empirical performance compared to SGD and rigorously show its ability to exactly converge to a critical point and hence eliminates the asymptotic error. The simulations verify the correctness of the analyses.


title: Hopping Too Late: Exploring the Limitations of Large Language Models on Multi-Hop Queries

abstract: Large language models (LLMs) can solve complex multi-step problems, but little is known about how these computations are implemented internally. Motivated by this, we study how LLMs answer multi-hop queries such as "The spouse of the performer of Imagine is". These queries require two information extraction steps: a latent one for resolving the first hop ("the performer of Imagine") into the bridge entity (John Lennon), and one for resolving the second hop ("the spouse of John Lennon") into the target entity (Yoko Ono). Understanding how the latent step is computed internally is key to understanding the overall computation. By carefully analyzing the internal computations of transformer-based LLMs, we discover that the bridge entity is resolved in the early layers of the model. Then, only after this resolution, the two-hop query is solved in the later layers. Because the second hop commences in later layers, there could be cases where these layers no longer encode the necessary knowledge for correctly predicting the answer. Motivated by this, we propose a novel "back-patching" analysis method whereby a hidden representation from a later layer is patched back to an earlier layer. We find that in up to 57% of previously incorrect cases there exists a back-patch that results in the correct generation of the answer, showing that the later layers indeed sometimes lack the needed functionality. Overall our methods and findings open further opportunities for understanding and improving latent reasoning in transformer-based LLMs.


title: Axiom $\mathcal{A}$ and supercompactness

abstract: We produce a model where every supercompact cardinal is $C^{(1)}$-supercompact with inaccessible targets. This is a significant improvement of the main identity-crises configuration obtained in \cite{HMP} and provides a definitive answer to a question of Bagaria \cite[p.19]{Bag}. This configuration is a consequence of a new axiom we introduce -- called $\mathcal{A}$ -- which is showed to be compatible with Woodin's $I_0$ cardinals. We also answer a question of V. Gitman and G. Goldberg on the relationship between supercompactness and cardinal-preserving extendibility. As an incidental result, we prove a theorem suggesting that supercompactness is the strongest large-cardinal notion preserved by Radin forcing.


title: Medvedev degrees of subshifts on groups

abstract: The Medvedev degree of a subshift is a dynamical invariant of computable origin that can be used to compare the complexity of subshifts that contain only uncomputable configurations. We develop theory to describe how these degrees can be transferred from one group to another through algebraic and geometric relations, such as quotients, subgroups, translation-like actions and quasi-isometries. We use the aforementioned tools to study the possible values taken by this invariant on subshifts of finite type on some finitely generated groups. We obtain a full classification for some classes, such as virtually polycyclic groups and branch groups with decidable word problem. We also show that all groups which are quasi-isometric to the hyperbolic plane admit SFTs with nonzero Medvedev degree. Furthermore, we provide a classification of the degrees of sofic subshifts for several classes of groups.


title: Mechanism to transfer linear momentum from a Surface Acoustic Wave to a Magnetic Domain Wall

abstract: Surface Acoustic Waves (SAW) have been used frequently in spintronic applications, mostly to decrease the magnetic field or the electric current required to move magnetic domain walls (DW). Because the SAW cannot achieve magnetic switching without the assistance of a magnetic field or a current, for a marginal improvement in the energy required for the magnetic switching, the device gains in complexity, making it impractical. In this work, we report a mechanism that allows a transfer of linear momentum from the acoustic wave to the magnetic domain wall. Experimentally we show that, using the appropriate dimensions of the magnetic strip, the SAW can move the DW in the same direction as the traveling SAW. With the help of micromagnetic simulations, we reveal a complex yet direct mechanism that allows the SAW to push the DW in the same direction of its travel, even without any external field or currents. The DW can reach velocities in the range of 100 m/s and at a very small energetic cost, equivalent to using a current density of $\sim 5 \cdot 10^4 A/cm^2$ if the movement was triggered by spin transfer. This new mechanism opens the door to designing innovative spintronic devices where the magnetization can be controlled exclusively by an acoustic wave.


title: Composited-Nested-Learning with Data Augmentation for Nested Named Entity Recognition

abstract: Nested Named Entity Recognition (NNER) focuses on addressing overlapped entity recognition. Compared to Flat Named Entity Recognition (FNER), annotated resources are scarce in the corpus for NNER. Data augmentation is an effective approach to address the insufficient annotated corpus. However, there is a significant lack of exploration in data augmentation methods for NNER. Due to the presence of nested entities in NNER, existing data augmentation methods cannot be directly applied to NNER tasks. Therefore, in this work, we focus on data augmentation for NNER and resort to more expressive structures, Composited-Nested-Label Classification (CNLC) in which constituents are combined by nested-word and nested-label, to model nested entities. The dataset is augmented using the Composited-Nested-Learning (CNL). In addition, we propose the Confidence Filtering Mechanism (CFM) for a more efficient selection of generated data. Experimental results demonstrate that this approach results in improvements in ACE2004 and ACE2005 and alleviates the impact of sample imbalance.


title: Bayesian Consistency for Long Memory Processes: A Semiparametric Perspective

abstract: In this work, we will investigate a Bayesian approach to estimating the parameters of long memory models. Long memory, characterized by the phenomenon of hyperbolic autocorrelation decay in time series, has garnered significant attention. This is because, in many situations, the assumption of short memory, such as the Markovianity assumption, can be deemed too restrictive. Applications for long memory models can be readily found in fields such as astronomy, finance, and environmental sciences. However, current parametric and semiparametric approaches to modeling long memory present challenges, particularly in the estimation process. In this study, we will introduce various methods applied to this problem from a Bayesian perspective, along with a novel semiparametric approach for deriving the posterior distribution of the long memory parameter. Additionally, we will establish the asymptotic properties of the model. An advantage of this approach is that it allows to implement state-of-the-art efficient algorithms for nonparametric Bayesian models.


title: Asymptotic behaviour of determinants through the expansion of the Moyal star product

abstract: We work out a generalization of the Szeg\"o limit theorems on the determinant of large matrices. We focus on matrices with nonzero leading principal minors and elements that decay to zero exponentially fast with the distance from the main diagonal, but we relax the constraint of the Toeplitz structure. We obtain an expression for the asymptotic behaviour of the determinant written in terms of the factors of a left and right Wiener-Hopf type factorization of an appropriately defined symbol. For matrices with elements varying slowly along the diagonals (e.g., in locally Toeplitz sequences), we propose to apply the analogue of the semiclassical expansion of the Moyal star product in phase-space quantum mechanics. This is a systematic method that provides approximations up to any order in the typical scale of the inhomogeneity and allows us to obtain explicit asymptotic formulas.


title: Relative Rota-Baxter operators, modules and projections

abstract: The present article is devoted to introduce, in a braided monoidal setting, the notion of module over a relative Rota-Baxter operator. It is proved that there exists an adjunction between the category of modules associated to an invertible relative Rota-Baxter operator and the category of modules associated to a Hopf brace, which induces an equivalence by assuming certain additional hypothesis. Moreover, the notion of projection between relative Rota-Baxter operators is defined, and it is proved that those which are called ``strong'' give rise to a module according to the previous definition in the cocommutative setting.


title: Zeroing neural dynamics solving time-variant complex conjugate matrix equation

abstract: Complex conjugate matrix equations (CCME) have aroused the interest of many researchers because of computations and antilinear systems. Existing research is dominated by its time-invariant solving methods, but lacks proposed theories for solving its time-variant version. Moreover, artificial neural networks are rarely studied for solving CCME. In this paper, starting with the earliest CCME, zeroing neural dynamics (ZND) is applied to solve its time-variant version. Firstly, the vectorization and Kronecker product in the complex field are defined uniformly. Secondly, Con-CZND1 model and Con-CZND2 model are proposed and theoretically prove convergence and effectiveness. Thirdly, three numerical experiments are designed to illustrate the effectiveness of the two models, compare their differences, highlight the significance of neural dynamics in the complex field, and refine the theory related to ZND.


title: UBENCH: Benchmarking Uncertainty in Large Language Models with Multiple Choice Questions

abstract: The rapid development of large language models (LLMs) has shown promising practical results. However, their low interpretability often leads to errors in unforeseen circumstances, limiting their utility. Many works have focused on creating comprehensive evaluation systems, but previous benchmarks have primarily assessed problem-solving abilities while neglecting the response's uncertainty, which may result in unreliability. Recent methods for measuring LLM reliability are resource-intensive and unable to test black-box models. To address this, we propose UBENCH, a comprehensive benchmark for evaluating LLM reliability. UBENCH includes 3,978 multiple-choice questions covering knowledge, language, understanding, and reasoning abilities. Experimental results show that UBENCH has achieved state-of-the-art performance, while its single-sampling method significantly saves computational resources compared to baseline methods that require multiple samplings. Additionally, based on UBENCH, we evaluate the reliability of 15 popular LLMs, finding GLM4 to be the most outstanding, closely followed by GPT-4. We also explore the impact of Chain-of-Thought prompts, role-playing prompts, option order, and temperature on LLM reliability, analyzing the varying effects on different LLMs.


title: In-Context Learning of Energy Functions

abstract: In-context learning is a powerful capability of certain machine learning models that arguably underpins the success of today's frontier AI models. However, in-context learning is critically limited to settings where the in-context distribution of interest $p_{\theta}^{ICL}( x|\mathcal{D})$ can be straightforwardly expressed and/or parameterized by the model; for instance, language modeling relies on expressing the next-token distribution as a categorical distribution parameterized by the network's output logits. In this work, we present a more general form of in-context learning without such a limitation that we call \textit{in-context learning of energy functions}. The idea is to instead learn the unconstrained and arbitrary in-context energy function $E_{\theta}^{ICL}(x|\mathcal{D})$ corresponding to the in-context distribution $p_{\theta}^{ICL}(x|\mathcal{D})$. To do this, we use classic ideas from energy-based modeling. We provide preliminary evidence that our method empirically works on synthetic data. Interestingly, our work contributes (to the best of our knowledge) the first example of in-context learning where the input space and output space differ from one another, suggesting that in-context learning is a more-general capability than previously realized.


title: Dynamical mass determination and partial eclipses of the heartbeat star HD 181793

abstract: We identify the bright Am-type star HD 181793 to be a previously-unknown eclipsing, chemically peculiar heartbeat binary, the second of its kind known. The system carries an orbital period of $P = 11.47578275 \pm 0.00000055$ days. We use TESS photometry and LCOGT NRES radial velocity data to build a self-consistent orbital model and determine the fundamental stellar characteristics of the primary. We use a spectral separation method to unveil the secondary and measure the masses of both stars. The radial velocity amplitude of the primary, $K_1 = 47.41+0.13-0.12 km s^{-1}$, gives a mass $M_1 = 1.57 \pm 0.01 $ Msun. The secondary radial velocity amplitude $K_2 = 84.95+0.12-0.09 km s^{-1}$ yields a mass ratio $q = 0.558 \pm 0.002$ and a secondary mass $M_2 = 0.87 \pm 0.01 $ Msun. From the spectral energy distribution and Gaia parallax we find a radius $R_1 = 2.04 \pm 0.05$ Rsun. The grazing transit profile and spectroscopic luminosity ratio indicate $R_2 = 1.04+0.15-0.10$ Rsun, suggesting an early-K spectral type. We show that the heartbeat feature in the TESS light curve can be explained by time-varying ellipsoidal variation, driven by the orbital eccentricity of $e = 0.3056+0.0024-0.0026$, and relativistic beaming of the light of the primary. We find no evidence of tidally-excited oscillations.


title: Generating Educational Materials with Different Levels of Readability using LLMs

abstract: This study introduces the leveled-text generation task, aiming to rewrite educational materials to specific readability levels while preserving meaning. We assess the capability of GPT-3.5, LLaMA-2 70B, and Mixtral 8x7B, to generate content at various readability levels through zero-shot and few-shot prompting. Evaluating 100 processed educational materials reveals that few-shot prompting significantly improves performance in readability manipulation and information preservation. LLaMA-2 70B performs better in achieving the desired difficulty range, while GPT-3.5 maintains original meaning. However, manual inspection highlights concerns such as misinformation introduction and inconsistent edit distribution. These findings emphasize the need for further research to ensure the quality of generated educational content.


title: Almost-everywhere uniqueness of Lagrangian trajectories for $3$D Navier--Stokes revisited

abstract: We show that, for any Leray solution $u$ to the $3$D Navier--Stokes equations with $u_0\in L^2$, the associated Lagrangian trajectories are unique for Lebesgue a.e. initial condition. Additionally, if $u_0\in H^{1/2}$, then pathwise uniqueness is established for the stochastic Lagrangian trajectories starting from every initial condition. The result sharpens and extends the original one by Robinson and Sadowski (Nonlinearity 2009) and is based on rather different techniques. A key role is played by a newly established asymmetric Lusin--Lipschitz property of Leray solutions $u$, in the framework of (random) Regular Lagrangian flows.


title: Extracting overlapping gravitational-wave signals of galactic compact binaries: a mini review

abstract: Gravitational wave (GW) observations have provided a novel tool to explore the universe. In the near future, space-borne detectors will further open the window of low-frequency GW band where abundant sources exist and invaluable information for astrophysics, cosmology, and fundamental physics can be revealed. However, there are various new challenges in data analyses for space-borne detectors coming with the abundance of GW signals. For example, there are galactic compact binaries (GCBs) with an overwhelming number that can produce continuous GW signals existing the entire mission time of detectors. The enormous overlapping GCB signals tangle and correlate with each other, and blend with other types of sources together in the observed data. Extracting source information from overlapping signals is one of the key problems for data analyses of space-borne detectors. In the paper, we present a review of currently available solutions for extracting overlapping GCB signals as thoroughly as possible aiming at promoting more interest in this question and inspiring further improvements. Current solutions can be roughly categorized by two classes, iterative subtraction and global fitting. There are diverse implementations of both strategies with enhancements focusing on different aspects. Meanwhile, the hybrid approach and the machine learning technique are also used in recent years. In the last, we also present an introduction of the stochastic foreground formed by unresolvable faint GCBs about its separation from extra-galactic backgrounds and its utility in exploring the properties of the Galaxy.


title: Dissociative Electron Attachment on Metal Surfaces: The Case of HCl$^-$ on Au(111)

abstract: The transfer of charges, including electrons and holes, is a key step in heterogeneous catalysis, taking part in the reduction and oxidation of adsorbate species on catalyst surfaces. In plasmonic catalysis, electrons can transfer from photo-excited metal nanoparticles to molecular adsorbates, forming transient negative ions that can easily undergo reactions such as dissociation, desorption, or other chemical transformations. However, ab initio characterization of these anionic states has proven challenging, and little is known about the topology of their potential energy surfaces. In this work, we investigate the dissociative adsorption of HCl on Au(111) as a representative catalytic process with relatively low reaction probabilities, which could potentially be enhanced by electron transfer from photo-excited gold nanoparticles to HCl. We employ projection-based density embedding that combines the equation-of-motion electron-attachment coupled-cluster singles and doubles (EOM-EA-CCSD) method with density functional theory (DFT), and build dissociation curves of HCl$^-$ on Au(111) along the H-Cl bond distance. The HCl anion in the gas phase is unbound at equilibrium distances and only becomes bound as the bond stretches. However, our results show that, upon adsorption on Au(111), HCl$^-$ remains a stable, bound anion at all bond lengths due to charge delocalization to the metal. Forming bound anions is easier, and dissociation of HCl$^-$ on Au(111) is further facilitated, with its dissociation energy reduced by 0.61 eV compared to its neutral counterpart on Au(111), and by 1.16 eV relative to HCl. These results underscore the efficacy of embedded EOM-CCSD methods in addressing surface science challenges and highlight the potential of plasmonic catalysis proceeding via bound, rather than transient, anionic states.


title: Hilbert's tenth problem for rings of holomorphic functions of bounded order

abstract: One of the main open problems in the context of extensions of Hilbert's tenth problem (HTP) is the case of the ring of complex entire functions in one variable. Our main result provides a step towards an answer: For every $\rho\ge 0$, we give a negative solution to the analogue of HTP in the ring of complex entire functions in one variable of growth order at most $\rho$.


title: Inference of entropy production for periodically driven systems

abstract: The problem of estimating entropy production from incomplete information in stochastic thermodynamics is essential for theory and experiments. Whereas a considerable amount of work has been done on this topic, arguably, most of it is restricted to the case of nonequilibrium steady states driven by a fixed thermodynamic force. Based on a recent method that has been proposed for nonequilibrium steady states, we obtain an estimate of the entropy production based on the statistics of visible transitions and their waiting times for the case of periodically driven systems. The time-dependence of transition rates in periodically driven systems produces several differences in relation to steady states, which is reflected in the entropy production estimation. More specifically, we propose an estimate that does depend on the time between transitions but is independent of the specific time of the first transition, thus it does not require tracking the protocol. Formally, this elimination of the time-dependence of the first transition leads to an extra term in the inequality that involves the rate of entropy production and its estimate. We analyze a simple model of a molecular pump to understand the relation between the performance of the method and physical quantities such as energies, energy barriers, and thermodynamic affinity. Our results with this model indicate that the emergence of net motion in the form of a probability current in the space of states is a necessary condition for a relevant estimate of the rate of entropy production.


title: ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools

abstract: We introduce ChatGLM, an evolving family of large language models that we have been developing over time. This report primarily focuses on the GLM-4 language series, which includes GLM-4, GLM-4-Air, and GLM-4-9B. They represent our most capable models that are trained with all the insights and lessons gained from the preceding three generations of ChatGLM. To date, the GLM-4 models are pre-trained on ten trillions of tokens mostly in Chinese and English, along with a small set of corpus from 24 languages, and aligned primarily for Chinese and English usage. The high-quality alignment is achieved via a multi-stage post-training process, which involves supervised fine-tuning and learning from human feedback. Evaluations show that GLM-4 1) closely rivals or outperforms GPT-4 in terms of general metrics such as MMLU, GSM8K, MATH, BBH, GPQA, and HumanEval, 2) gets close to GPT-4-Turbo in instruction following as measured by IFEval, 3) matches GPT-4 Turbo (128K) and Claude 3 for long context tasks, and 4) outperforms GPT-4 in Chinese alignments as measured by AlignBench. The GLM-4 All Tools model is further aligned to understand user intent and autonomously decide when and which tool(s) touse -- including web browser, Python interpreter, text-to-image model, and user-defined functions -- to effectively complete complex tasks. In practical applications, it matches and even surpasses GPT-4 All Tools in tasks like accessing online information via web browsing and solving math problems using Python interpreter. Over the course, we have open-sourced a series of models, including ChatGLM-6B (three generations), GLM-4-9B (128K, 1M), GLM-4V-9B, WebGLM, and CodeGeeX, attracting over 10 million downloads on Hugging face in the year 2023 alone. The open models can be accessed through https://github.com/THUDM and https://huggingface.co/THUDM.


title: The Hycean Paradigm in the Search for Life Elsewhere

abstract: The search for habitable conditions and signs of life on exoplanets is a major frontier in modern astronomy. Detecting atmospheric signatures of Earth-like exoplanets is challenging due to their small sizes and relatively thin atmospheres. Recently, a new class of habitable sub-Neptune exoplanets, called Hycean worlds, has been theorized. Hycean worlds are planets with H2-rich atmospheres and planet-wide oceans with thermodynamic conditions similar to those in the Earth's oceans. Their large sizes and extended atmospheres, compared to rocky planets of similar mass, make Hycean worlds significantly more accessible to atmospheric observations. These planets open a new avenue in the search for planetary habitability and life elsewhere using spectroscopic observations with the James Webb Space Telescope (JWST). We observed the transmission spectrum of a candidate Hycean world, K2-18 b, recently with JWST in its first year of operations. The spectrum reveals multiple spectral features of carbon bearing molecules in the planetary atmosphere, leading to the first detections of methane (CH4) and carbon dioxide (CO2) in a habitable-zone exoplanet. We discuss inferences of the atmospheric chemical composition and its implications for the atmospheric, interior and surface conditions on the planet, along with the possibility of a habitable ocean underneath the atmosphere. We discuss new observational and theoretical developments in this emerging frontier and their implications for exoplanetary habitability and search for life elsewhere.


title: The Limits of Pure Exploration in POMDPs: When the Observation Entropy is Enough

abstract: The problem of pure exploration in Markov decision processes has been cast as maximizing the entropy over the state distribution induced by the agent's policy, an objective that has been extensively studied. However, little attention has been dedicated to state entropy maximization under partial observability, despite the latter being ubiquitous in applications, e.g., finance and robotics, in which the agent only receives noisy observations of the true state governing the system's dynamics. How can we address state entropy maximization in those domains? In this paper, we study the simple approach of maximizing the entropy over observations in place of true latent states. First, we provide lower and upper bounds to the approximation of the true state entropy that only depends on some properties of the observation function. Then, we show how knowledge of the latter can be exploited to compute a principled regularization of the observation entropy to improve performance. With this work, we provide both a flexible approach to bring advances in state entropy maximization to the POMDP setting and a theoretical characterization of its intrinsic limits.


title: Extensions of Steiner triple systems

abstract: In this paper we study extensions of Steiner triple systems by means of the associated Steiner loops. We recognize that the set of Veblen points of a Steiner triple system corresponds to the center of the Steiner loop. We investigate extensions of Steiner loops, focusing in particular on the case of Schreier extensions, which provide a powerful method for constructing Steiner triple systems containing Veblen points.


title: Dark Photon Dark Matter Radio Signal from the Milky Way Electron Density

abstract: We consider Thomson-like processes between dark matter dark photons and free electrons in the Milky Way. The result is a radio signal background that can be detectable with current or future radio telescope arrays. In particular, we computed sensitivity prospects for the Atacama Large Millimeter Array (ALMA) radio telescope and for the future Square Kilometer Array (SKA), concluding that unconstrained parameter space in a wide range of dark photon masses can be probed.


title: The Aligned Orbit of a Hot Jupiter around the M Dwarf TOI-4201

abstract: Measuring the obliquities of stars hosting giant planets may shed light on the dynamical history of planetary systems. Significant efforts have been made to measure the obliquities of FGK stars with hot Jupiters, mainly based on observations of the Rossiter-McLaughlin effect. In contrast, M dwarfs with hot Jupiters have hardly been explored, because such systems are rare and often not favorable for such precise observations. Here, we report the first detection of the Rossiter-McLaughlin effect for an M dwarf with a hot Jupiter, TOI-4201, using the Gemini-North/MAROON-X spectrograph. We find TOI-4201 to be well-aligned with its giant planet, with a sky-projected obliquity of $\lambda=-3.0_{-3.2}^{+3.7}\ ^{\circ}$ and a true obliquity of $\psi=21.3_{-12.8}^{+12.5}\ ^{\circ}$ with an upper limit of $40^{\circ}$ at a 95% confidence level. The result agrees with dynamically quiet formation or tidal obliquity damping that realigned the system. As the first hot Jupiter around an M dwarf with its obliquity measured, TOI-4201b joins the group of aligned giant planets around cool stars ($T_{\rm eff}<6250\ K$), as well as the small but growing sample of planets with relatively high planet-to-star mass ratio ($M_p/M_\ast\gtrsim 3\times 10^{-3}$) that also appear to be mostly aligned.


title: Sample-Based Matroid Prophet Inequalities

abstract: We study matroid prophet inequalities when distributions are unknown and accessible only through samples. While single-sample prophet inequalities for special matroids are known, no constant-factor competitive algorithm with even a sublinear number of samples was known for general matroids. Adding more to the stake, the single-sample version of the question for general matroids has close (two-way) connections with the long-standing matroid secretary conjecture. In this work, we give a $(\frac14 - \varepsilon)$-competitive matroid prophet inequality with only $O_\varepsilon(\mathrm{poly} \log n)$ samples. Our algorithm consists of two parts: (i) a novel quantile-based reduction from matroid prophet inequalities to online contention resolution schemes (OCRSs) with $O_\varepsilon(\log n)$ samples, and (ii) a $(\frac14 - \varepsilon)$-selectable matroid OCRS with $O_\varepsilon(\mathrm{poly} \log n)$ samples which carefully addresses an adaptivity challenge.


title: Supporting Human Raters with the Detection of Harmful Content using Large Language Models

abstract: In this paper, we explore the feasibility of leveraging large language models (LLMs) to automate or otherwise assist human raters with identifying harmful content including hate speech, harassment, violent extremism, and election misinformation. Using a dataset of 50,000 comments, we demonstrate that LLMs can achieve 90% accuracy when compared to human verdicts. We explore how to best leverage these capabilities, proposing five design patterns that integrate LLMs with human rating, such as pre-filtering non-violative content, detecting potential errors in human rating, or surfacing critical context to support human rating. We outline how to support all of these design patterns using a single, optimized prompt. Beyond these synthetic experiments, we share how piloting our proposed techniques in a real-world review queue yielded a 41.5% improvement in optimizing available human rater capacity, and a 9--11% increase (absolute) in precision and recall for detecting violative content.


title: "A Lot of Moving Parts": A Case Study of Open-Source Hardware Design Collaboration in the Thingiverse Community

abstract: Open-source is a decentralized and collaborative method of development that encourages open contribution from an extensive and undefined network of individuals. Although commonly associated with software development (OSS), the open-source model extends to hardware development, forming the basis of open-source hardware development (OSH). Compared to OSS, OSH is relatively nascent, lacking adequate tooling support from existing platforms and best practices for efficient collaboration. Taking a necessary step towards improving OSH collaboration, we conduct a detailed case study of DrawBot, a successful OSH project that remarkably fostered a long-term collaboration on Thingiverse - a platform not explicitly intended for complex collaborative design. Through analyzing comment threads and design changes over the course of the project, we found how collaboration occurred, the challenges faced, and how the DrawBot community managed to overcome these obstacles. Beyond offering a detailed account of collaboration practices and challenges, our work contributes best practices, design implications, and practical implications for OSH project maintainers, platform builders, and researchers, respectively. With these insights and our publicly available dataset, we aim to foster more effective and efficient collaborative design in OSH projects.


title: Decentralized Multi-Robot Line-of-Sight Connectivity Maintenance under Uncertainty

abstract: In this paper, we propose a novel decentralized control method to maintain Line-of-Sight connectivity for multi-robot networks in the presence of Guassian-distributed localization uncertainty. In contrast to most existing work that assumes perfect positional information about robots or enforces overly restrictive rigid formation against uncertainty, our method enables robots to preserve Line-of-Sight connectivity with high probability under unbounded Gaussian-like positional noises while remaining minimally intrusive to the original robots' tasks. This is achieved by a motion coordination framework that jointly optimizes the set of existing Line-of-Sight edges to preserve and control revisions to the nominal task-related controllers, subject to the safety constraints and the corresponding composition of uncertainty-aware Line-of-Sight control constraints. Such compositional control constraints, expressed by our novel notion of probabilistic Line-of-Sight connectivity barrier certificates (PrLOS-CBC) for pairwise robots using control barrier functions, explicitly characterize the deterministic admissible control space for the two robots. The resulting motion ensures Line-of-Sight connectedness for the robot team with high probability. Furthermore, we propose a fully decentralized algorithm that decomposes the motion coordination framework by interleaving the composite constraint specification and solving for the resulting optimization-based controllers. The optimality of our approach is justified by the theoretical proofs. Simulation and real-world experiments results are given to demonstrate the effectiveness of our method.


title: Scalable Rule Lists Learning with Sampling

abstract: Learning interpretable models has become a major focus of machine learning research, given the increasing prominence of machine learning in socially important decision-making. Among interpretable models, rule lists are among the best-known and easily interpretable ones. However, finding optimal rule lists is computationally challenging, and current approaches are impractical for large datasets. We present a novel and scalable approach to learn nearly optimal rule lists from large datasets. Our algorithm uses sampling to efficiently obtain an approximation of the optimal rule list with rigorous guarantees on the quality of the approximation. In particular, our algorithm guarantees to find a rule list with accuracy very close to the optimal rule list when a rule list with high accuracy exists. Our algorithm builds on the VC-dimension of rule lists, for which we prove novel upper and lower bounds. Our experimental evaluation on large datasets shows that our algorithm identifies nearly optimal rule lists with a speed-up up to two orders of magnitude over state-of-the-art exact approaches. Moreover, our algorithm is as fast as, and sometimes faster than, recent heuristic approaches, while reporting higher quality rule lists. In addition, the rules reported by our algorithm are more similar to the rules in the optimal rule list than the rules from heuristic approaches.


title: Varying activity and the bursts properties of FRB 20240114A probed with GMRT down to 300 MHz

abstract: Repeating fast radio bursts can exhibit a wide range of burst repetition rates, from none to hundreds of bursts per hour. Here, we report the detection and characteristics of 57 bursts from the recently discovered FRB 20240114A, observed with GMRT in the frequency ranges 300-500 MHz and 550-750 MHz. Majority of the bursts show narrow emission-bandwidth with $\Delta\nu/\nu \sim$ around 10 %. All of the bursts we detect are faint ($<$10 Jy ms), and thus probe the lower end of the energy distribution. We determine the rate function for FRB 20240114A at 400 MHz, and downward drift rates at 400 and 650 MHz, and discuss our measurements in the context of the repeating FRB population. We observe sudden variations in the burst activity of FRB 20240114A over time. Our data as well as the other publicly available information on other observations of FRB 20240114A so far, there is an indication that FRB 20240114A potentially exhibit a chromaticity in its burst activity. While the burst properties of FRB 20240114A are similar to ther repeating FRBs, the frequency-dependent activity, if established, could provide crucial clues to the origin of repeating FRBs. We also place the most stringent 5$\sigma$ upper limits of 600 $\mu$Jy and 89 $\mu$Jy on any persistent radio source (PRS) associated with FRB 20240114A at 400 MHz and 650 MHz, respectively, and compare these with the luminosity of the known PRSs associated with FRB121102A and FRB190520B.


title: AITTI: Learning Adaptive Inclusive Token for Text-to-Image Generation

abstract: Despite the high-quality results of text-to-image generation, stereotypical biases have been spotted in their generated contents, compromising the fairness of generative models. In this work, we propose to learn adaptive inclusive tokens to shift the attribute distribution of the final generative outputs. Unlike existing de-biasing approaches, our method requires neither explicit attribute specification nor prior knowledge of the bias distribution. Specifically, the core of our method is a lightweight adaptive mapping network, which can customize the inclusive tokens for the concepts to be de-biased, making the tokens generalizable to unseen concepts regardless of their original bias distributions. This is achieved by tuning the adaptive mapping network with a handful of balanced and inclusive samples using an anchor loss. Experimental results demonstrate that our method outperforms previous bias mitigation methods without attribute specification while preserving the alignment between generative results and text descriptions. Moreover, our method achieves comparable performance to models that require specific attributes or editing directions for generation. Extensive experiments showcase the effectiveness of our adaptive inclusive tokens in mitigating stereotypical bias in text-to-image generation. The code will be available at https://github.com/itsmag11/AITTI.


title: Identifying Performance-Sensitive Configurations in Software Systems through Code Analysis with LLM Agents

abstract: Configuration settings are essential for tailoring software behavior to meet specific performance requirements. However, incorrect configurations are widespread, and identifying those that impact system performance is challenging due to the vast number and complexity of possible settings. In this work, we present PerfSense, a lightweight framework that leverages Large Language Models (LLMs) to efficiently identify performance-sensitive configurations with minimal overhead. PerfSense employs LLM agents to simulate interactions between developers and performance engineers using advanced prompting techniques such as prompt chaining and retrieval-augmented generation (RAG). Our evaluation of seven open-source Java systems demonstrates that PerfSense achieves an average accuracy of 64.77% in classifying performance-sensitive configurations, outperforming both our LLM baseline (50.36%) and the previous state-of-the-art method (61.75%). Notably, our prompt chaining technique improves recall by 10% to 30% while maintaining similar precision levels. Additionally, a manual analysis of 362 misclassifications reveals common issues, including LLMs' misunderstandings of requirements (26.8%). In summary, PerfSense significantly reduces manual effort in classifying performance-sensitive configurations and offers valuable insights for future LLM-based code analysis research.


title: Probabilistic Temporal Prediction of Continuous Disease Trajectories and Treatment Effects Using Neural SDEs

abstract: Personalized medicine based on medical images, including predicting future individualized clinical disease progression and treatment response, would have an enormous impact on healthcare and drug development, particularly for diseases (e.g. multiple sclerosis (MS)) with long term, complex, heterogeneous evolutions and no cure. In this work, we present the first stochastic causal temporal framework to model the continuous temporal evolution of disease progression via Neural Stochastic Differential Equations (NSDE). The proposed causal inference model takes as input the patient's high dimensional images (MRI) and tabular data, and predicts both factual and counterfactual progression trajectories on different treatments in latent space. The NSDE permits the estimation of high-confidence personalized trajectories and treatment effects. Extensive experiments were performed on a large, multi-centre, proprietary dataset of patient 3D MRI and clinical data acquired during several randomized clinical trials for MS treatments. Our results present the first successful uncertainty-based causal Deep Learning (DL) model to: (a) accurately predict future patient MS disability evolution (e.g. EDSS) and treatment effects leveraging baseline MRI, and (b) permit the discovery of subgroups of patients for which the model has high confidence in their response to treatment even in clinical trials which did not reach their clinical endpoints.


title: Graph Neural Networks in Histopathology: Emerging Trends and Future Directions

abstract: Histopathological analysis of Whole Slide Images (WSIs) has seen a surge in the utilization of deep learning methods, particularly Convolutional Neural Networks (CNNs). However, CNNs often fall short in capturing the intricate spatial dependencies inherent in WSIs. Graph Neural Networks (GNNs) present a promising alternative, adept at directly modeling pairwise interactions and effectively discerning the topological tissue and cellular structures within WSIs. Recognizing the pressing need for deep learning techniques that harness the topological structure of WSIs, the application of GNNs in histopathology has experienced rapid growth. In this comprehensive review, we survey GNNs in histopathology, discuss their applications, and explore emerging trends that pave the way for future advancements in the field. We begin by elucidating the fundamentals of GNNs and their potential applications in histopathology. Leveraging quantitative literature analysis, we identify four emerging trends: Hierarchical GNNs, Adaptive Graph Structure Learning, Multimodal GNNs, and Higher-order GNNs. Through an in-depth exploration of these trends, we offer insights into the evolving landscape of GNNs in histopathological analysis. Based on our findings, we propose future directions to propel the field forward. Our analysis serves to guide researchers and practitioners towards innovative approaches and methodologies, fostering advancements in histopathological analysis through the lens of graph neural networks.


title: Can Large Language Models Always Solve Easy Problems if They Can Solve Harder Ones?

abstract: Large language models (LLMs) have demonstrated impressive capabilities, but still suffer from inconsistency issues (e.g. LLMs can react differently to disturbances like rephrasing or inconsequential order change). In addition to these inconsistencies, we also observe that LLMs, while capable of solving hard problems, can paradoxically fail at easier ones. To evaluate this hard-to-easy inconsistency, we develop the ConsisEval benchmark, where each entry comprises a pair of questions with a strict order of difficulty. Furthermore, we introduce the concept of consistency score to quantitatively measure this inconsistency and analyze the potential for improvement in consistency by relative consistency score. Based on comprehensive experiments across a variety of existing models, we find: (1) GPT-4 achieves the highest consistency score of 92.2\% but is still inconsistent to specific questions due to distraction by redundant information, misinterpretation of questions, etc.; (2) models with stronger capabilities typically exhibit higher consistency, but exceptions also exist; (3) hard data enhances consistency for both fine-tuning and in-context learning. Our data and code will be publicly available on GitHub.


title: Detecting Outbreaks Using a Latent Field: Part I -- Spatial Modeling

abstract: In this paper, we develop a method to estimate the infection-rate of a disease, over a region, as a field that varies in space and time. To do so, we use time-series of case-counts of symptomatic patients as observed in the areal units that comprise the region. We also extend an epidemiological model, initially developed to represent the temporal dynamics in a single areal unit, to encompass multiple areal units. This is done using a (parameterized) Gaussian random field, whose structure is modeled using the dynamics in the case-counts, and which serves as a spatial prior, in the estimation process. The estimation is performed using an adaptive Markov chain Monte Carlo method, using COVID-19 case-count data collected from three adjacent counties in New Mexico, USA. We find that we can estimate both the temporal and spatial variation of the infection with sufficient accuracy to be useful in forecasting. Further, the ability to "borrow" information from neighboring areal units allows us to regularize the estimation in areal units with high variance ("poor quality") data. The ability to forecast allows us to check whether the estimated infection-rate can be used to detect a change in the epidemiological dynamics e.g., the arrival of a new wave of infection, such as the fall wave of 2020 which arrived in New Mexico in mid-September 2020. We fashion a simple anomaly detector, conditioned on the estimated infection-rate and find that it performs better than a conventional surveillance algorithm that uses case-counts (and not the infection-rate) to detect the arrival of the same wave.


title: Circuit-partition of infinite matroids

abstract: Komj\'ath, Milner, and Polat investigated when a finitary matroid admits a partition into circuits. They defined the class of ``finite matching extendable'' matroids and showed in their compactness theorem that those matroids always admit such a partition. Their proof is based on Shelah's singular compactness technique and a careful analysis of certain $\triangle$-systems. We provide a short, simple proof of their theorem. Then we show that a finitary binary oriented matroid can be partitioned into directed circuits if and only if, in every cocircuit, the cardinality of the negative and positive edges are the same. This generalizes a former conjecture of Thomassen, settled affirmatively by the second author, about partitioning the edges of an infinite directed graph into directed cycles. As side results, a Laviolette theorem for finitary matroids and a Farkas lemma for finitary binary oriented matroids are proven. An example is given to show that, in contrast to finite oriented matroids, `binary' cannot be omitted in the latter result.


title: A second order approach to the Kato square root problem on open sets

abstract: We give a proof for the Kato square root problem on suitable open sets and subject to pure Dirichlet boundary conditions. In contrast to earlier work, our proof uses only second-order techniques and is in the spirit of the proof given by Egert--Haller--Monniaux--Tolksdorf in the scope of the 27th international internet seminar for $\Omega = \mathbb{R}^n$. In contrast to the usual proofs based on the first-order framework by Axelsson--Keith--McIntosh, the proof becomes substantially shorter and technically less demanding.


title: Low-mass planets falling into gaps with cyclonic vortices

abstract: We investigate the planetary migration of low-mass planets ($M_p\in[1,15]M_\oplus$, here $M_\oplus$ is the Earth mass) in a gaseous disc containing a previously formed gap. We perform high-resolution 3D simulations with the FARGO3D code. To create the gap in the surface density of the disc, we use a radial viscosity profile with a bump, which is maintained during the entire simulation time. We find that when the gap is sufficiently deep, the spiral waves excited by the planet trigger the Rossby wave instability, forming cyclonic (underdense) vortices at the edges of the gap. When the planet approaches the gap, it interacts with the vortices, which produce a complex flow structure around the planet. Remarkably, we find a widening of the horseshoe region of the planet produced by the vortex at the outer edge of the gap, which depending on the mass of the planet differs by at least a factor of two with respect to the standard horseshoe width. This inevitably leads to an increase in the corotation torque on the planet and produces an efficient trap to halt its inward migration. In some cases, the planet becomes locked in corotation with the outer vortex. Under this scenario, our results could explain why low-mass planets do not fall towards the central star within the lifetime of the protoplanetary disc. Lastly, the development of these vortices produces an asymmetric temporal evolution of the gap, which could explain the structures observed in some protoplanetary discs.


title: Adversarial Attacks on Multimodal Agents

abstract: Vision-enabled language models (VLMs) are now used to build autonomous multimodal agents capable of taking actions in real environments. In this paper, we show that multimodal agents raise new safety risks, even though attacking agents is more challenging than prior attacks due to limited access to and knowledge about the environment. Our attacks use adversarial text strings to guide gradient-based perturbation over one trigger image in the environment: (1) our captioner attack attacks white-box captioners if they are used to process images into captions as additional inputs to the VLM; (2) our CLIP attack attacks a set of CLIP models jointly, which can transfer to proprietary VLMs. To evaluate the attacks, we curated VisualWebArena-Adv, a set of adversarial tasks based on VisualWebArena, an environment for web-based multimodal agent tasks. Within an L-infinity norm of $16/256$ on a single image, the captioner attack can make a captioner-augmented GPT-4V agent execute the adversarial goals with a 75% success rate. When we remove the captioner or use GPT-4V to generate its own captions, the CLIP attack can achieve success rates of 21% and 43%, respectively. Experiments on agents based on other VLMs, such as Gemini-1.5, Claude-3, and GPT-4o, show interesting differences in their robustness. Further analysis reveals several key factors contributing to the attack's success, and we also discuss the implications for defenses as well. Project page: https://chenwu.io/attack-agent Code and data: https://github.com/ChenWu98/agent-attack


title: Privacy Preserving Federated Learning in Medical Imaging with Uncertainty Estimation

abstract: Machine learning (ML) and Artificial Intelligence (AI) have fueled remarkable advancements, particularly in healthcare. Within medical imaging, ML models hold the promise of improving disease diagnoses, treatment planning, and post-treatment monitoring. Various computer vision tasks like image classification, object detection, and image segmentation are poised to become routine in clinical analysis. However, privacy concerns surrounding patient data hinder the assembly of large training datasets needed for developing and training accurate, robust, and generalizable models. Federated Learning (FL) emerges as a compelling solution, enabling organizations to collaborate on ML model training by sharing model training information (gradients) rather than data (e.g., medical images). FL's distributed learning framework facilitates inter-institutional collaboration while preserving patient privacy. However, FL, while robust in privacy preservation, faces several challenges. Sensitive information can still be gleaned from shared gradients that are passed on between organizations during model training. Additionally, in medical imaging, quantifying model confidence\uncertainty accurately is crucial due to the noise and artifacts present in the data. Uncertainty estimation in FL encounters unique hurdles due to data heterogeneity across organizations. This paper offers a comprehensive review of FL, privacy preservation, and uncertainty estimation, with a focus on medical imaging. Alongside a survey of current research, we identify gaps in the field and suggest future directions for FL research to enhance privacy and address noisy medical imaging data challenges.


title: Neural Approximate Mirror Maps for Constrained Diffusion Models

abstract: Diffusion models excel at creating visually-convincing images, but they often struggle to meet subtle constraints inherent in the training data. Such constraints could be physics-based (e.g., satisfying a PDE), geometric (e.g., respecting symmetry), or semantic (e.g., including a particular number of objects). When the training data all satisfy a certain constraint, enforcing this constraint on a diffusion model not only improves its distribution-matching accuracy but also makes it more reliable for generating valid synthetic data and solving constrained inverse problems. However, existing methods for constrained diffusion models are inflexible with different types of constraints. Recent work proposed to learn mirror diffusion models (MDMs) in an unconstrained space defined by a mirror map and to impose the constraint with an inverse mirror map, but analytical mirror maps are challenging to derive for complex constraints. We propose neural approximate mirror maps (NAMMs) for general constraints. Our approach only requires a differentiable distance function from the constraint set. We learn an approximate mirror map that pushes data into an unconstrained space and a corresponding approximate inverse that maps data back to the constraint set. A generative model, such as an MDM, can then be trained in the learned mirror space and its samples restored to the constraint set by the inverse map. We validate our approach on a variety of constraints, showing that compared to an unconstrained diffusion model, a NAMM-based MDM substantially improves constraint satisfaction. We also demonstrate how existing diffusion-based inverse-problem solvers can be easily applied in the learned mirror space to solve constrained inverse problems.


title: Intrinsic Modeling of Shape-Constrained Functional Data, With Applications to Growth Curves and Activity Profiles

abstract: Shape-constrained functional data encompass a wide array of application fields especially in the life sciences, such as activity profiling, growth curves, healthcare and mortality. Most existing methods for general functional data analysis often ignore that such data are subject to inherent shape constraints, while some specialized techniques rely on strict distributional assumptions. We propose an approach for modeling such data that harnesses the intrinsic geometry of functional trajectories by decomposing them into size and shape components. We focus on the two most prevalent shape constraints, positivity and monotonicity, and develop individual-level estimators for the size and shape components. Furthermore, we demonstrate the applicability of our approach by conducting subsequent analyses involving Fr\'{e}chet mean and Fr\'{e}chet regression and establish rates of convergence for the empirical estimators. Illustrative examples include simulations and data applications for activity profiles for Mediterranean fruit flies during their entire lifespan and for data from the Z\"{u}rich longitudinal growth study.


title: Optimal Bailouts in Diversified Financial Networks

abstract: Widespread default involves substantial deadweight costs which could be countered by injecting capital into failing firms. Injections have positive spillovers that can trigger a repayment cascade. But which firms should a regulator bailout so as to minimize the total injection of capital while ensuring solvency of all firms? While the problem is, in general, NP-hard, for a wide range of networks that arise from a stochastic block model, we show that the optimal bailout can be implemented by a simple policy that targets firms based on their characteristics and position in the network. Specific examples of the setting include core-periphery networks.


title: A Dust-Trapping Ring in the Planet-Hosting Disk of Elias 2-24

abstract: Rings and gaps are among the most widely observed forms of substructure in protoplanetary disks. A gap-ring pair may be formed when a planet carves a gap in the disk, which produces a local pressure maximum following the gap that traps inwardly drifting dust grains and appears as a bright ring due to the enhanced dust density. A dust-trapping ring would provide a promising environment for solid growth and possibly planetesimal production via the streaming instability. We present evidence of dust trapping in the bright ring of the planet-hosting disk Elias 2-24, from the analysis of 1.3 mm and 3 mm ALMA observations at high spatial resolution (0.029 arcsec, 4.0 au). We leverage the high spatial resolution to demonstrate that larger grains are more efficiently trapped and place constraints on the local turbulence ($8 \times 10^{-4} < \alpha_\mathrm{turb} < 0.03$) and the gas-to-dust ratio ($\Sigma_g / \Sigma_d < 30$) in the ring. Using a scattering-included marginal probability analysis we measure a total dust disk mass of $M_\mathrm{dust} = 13.8^{+0.7}_{-0.5} \times 10^{-4} \ M_\odot$. We also show that at the orbital radius of the proposed perturber, the gap is cleared of material down to a flux contrast of 10$^{-3}$ of the peak flux in the disk.


title: Realizing string-net condensation: Fibonacci anyon braiding for universal gates and sampling chromatic polynomials

abstract: Fibonacci string-net condensate, a complex topological state that supports non-Abelian anyon excitations, holds promise for fault-tolerant universal quantum computation. However, its realization by a static-lattice Hamiltonian has remained elusive due to the inherent high-order interactions demanded. Here, we introduce a scalable dynamical string-net preparation (DSNP) approach, suitable even for near-term quantum processors, that can dynamically prepare the state through reconfigurable graphs. DSNP enables the creation and manipulation of the Fibonacci string-net condensate (Fib-SNC). Using a superconducting quantum processor, we couple the DSNP approach with a composite error-mitigation strategy on deep circuits to successfully create, measure, and braid Fibonacci anyons in two spatial dimensions (2D) demonstrating their potential for universal quantum computation. To this end, we measure anyon charges for two species of anyons associated with the doubled topological quantum field theory underlying Fid-SNC, with an average experimental accuracy of 94%. We validate that a scalable 2D braiding operation on a logical qubit encoded on three anyons yields the golden ratio $\phi$ with 98% average accuracy and 8% measurement uncertainty. We further sample the Fib-SNC wavefunction to estimate the chromatic polynomial at $\phi+2$ for various graphs. Given the established computational hardness of the chromatic polynomial, the wavefunction amplitude is classically hard to evaluate. Our results establish the first proof of principle that scalable DSNP can open doors to fault-tolerant universal quantum computation and to classically-hard problems.

categories: quant-ph cond-mat.mes-hall cond-mat.str-el cond-mat.supr-con


title: Lower box dimension of infinitely generated self-conformal sets

abstract: Let $\Lambda$ be the limit set of an infinite conformal iterated function system and let $F$ denote the set of fixed points of the maps. We prove that the box dimension of $\Lambda$ exists if and only if \[ \overline{\dim}_{\mathrm B} F\leq \max \{\dim_{\mathrm H} \Lambda, \underline{\dim}_{\mathrm B} F\}. \] In particular, this provides the first examples of sets of continued fraction expansions with restricted digits for which the box dimension does not exist. More generally, we establish an explicit asymptotic formula for the covering numbers $N_r(\Lambda)$ in terms of $\dim_{\mathrm H}\Lambda$ and the covering function $r\mapsto N_r(F)$, where $N_r(\cdot)$ denotes the least number of open balls of radius $r$ required to cover a given set. Such finer scaling information is necessary: in general, the lower box dimension $\underline{\dim}_{\mathrm B} \Lambda$ is not a function of the Hausdorff dimension of $\Lambda$ and the upper and lower box dimensions of $F$, and we prove sharp bounds for $\underline{\dim}_{\mathrm B} \Lambda$ in terms of these three quantities.


title: Is It Good Data for Multilingual Instruction Tuning or Just Bad Multilingual Evaluation for Large Language Models?

abstract: Large language models, particularly multilingual ones, are designed, claimed, and expected to cater to native speakers of varied languages. We hypothesise that the current practices of fine-tuning and evaluating these models may mismatch this intention owing to a heavy reliance on translation, which can introduce translation artefacts and defects. It remains unknown whether the nature of the instruction data has an impact on the model output; on the other hand, it remains questionable whether translated test sets can capture such nuances. Due to the often coupled practices of using translated data in both stages, such imperfections could have been overlooked. This work investigates these issues by using controlled native or translated data during instruction tuning and evaluation stages and observing model results. Experiments on eight base models and eight different benchmarks reveal that native or generation benchmarks display a notable difference between native and translated instruction data especially when model performance is high, whereas other types of test sets cannot. Finally, we demonstrate that regularization is beneficial to bridging this gap on structured but not generative tasks.


title: Three-outcome multipartite Bell inequalities: applications to dimension witnessing and spin-nematic squeezing in many-body systems

abstract: We present a three-outcome permutationally-invariant Bell inequality, which we show to be naturally suited to explore nonlocal correlations in many-body spin-1 systems or SU(3) models. In the specific, we show how to derive from this inequality experimentally practical Bell correlation witnesses based on the measurement of collective spin components. Moreover, we present approaches that allow us to derive scalable Bell dimension witnesses, namely criteria whose violation signals the impossibility of reproducing the observed statistics by single-particle Hilbert spaces of a certain dimension.This enables the certification of genuine three-level correlations that cannot occur in two-level, i.e. qubit, systems. As an example, we show the application of these witnesses in spin-nematic squeezed states, such as the one that can be prepared in spin-1 Bose-Einstein condensates.


title: From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries

abstract: Retrieval Augmented Generation (RAG) enriches the ability of language models to reason using external context to augment responses for a given user prompt. This approach has risen in popularity due to practical applications in various applications of language models in search, question/answering, and chat-bots. However, the exact nature of how this approach works isn't clearly understood. In this paper, we mechanistically examine the RAG pipeline to highlight that language models take shortcut and have a strong bias towards utilizing only the context information to answer the question, while relying minimally on their parametric memory. We probe this mechanistic behavior in language models with: (i) Causal Mediation Analysis to show that the parametric memory is minimally utilized when answering a question and (ii) Attention Contributions and Knockouts to show that the last token residual stream do not get enriched from the subject token in the question, but gets enriched from other informative tokens in the context. We find this pronounced shortcut behaviour true across both LLaMa and Phi family of models.


title: Theory of Coulomb driven nematicity in a multi-valley two-dimensional electron gas

abstract: The properties of a two-dimensional electron gas (2DEG) in a semiconductor host with two valleys related by an underlying $C_4$ rotational symmetry are studied using Hartree-Fock (HF) and various other many-body approaches. A familiar artifact of the HF approach is a degeneracy between the valley polarized - ``Ising nematic'' - and spin polarized - ferromagnetic - phases, which is inconsistent with recent variational Monte Carlo (VMC) results. Correlation effects, computed either within the random phase approximation (RPA) or the T-matrix approximation, enhance the valley susceptibility relative to the spin susceptibility. Extrapolating the results to finite interaction strength, we find a direct first-order transition from a symmetry-unbroken state to a spin unpolarized Ising nematic fluid with full valley polarization, in qualitative agreement with VMC. The RPA results are also reminiscent of experiments on the corresponding 2DEG in AlAs heterostructures.


title: Every Poincar\'e gauge theory is conformal: a compelling case for dynamical vector torsion

abstract: The Poincar\'e gauge theory (PGT) of gravity provides a viable formulation of general relativity (Einstein-Cartan theory), and a popular model-building framework for modified gravity with torsion. Notoriously, however, the PGT terms which propagate vector torsion lead to strongly-coupled ghosts: the modern view is that only scalar torsion can propagate. To fix this, we revisit the concept of embedding explicit mass scales in scale-invariant theories, showing how the Klein-Gordon theory naturally leads to a slowly-rolling inflaton. We then show that the unique scale-invariant embedding of PGT leads to two new terms, one of which is the Maxwell term for vector torsion. We provide the full spectrum of quantum particles in the resulting theory. Our result means that every PGT is conformal and - after a two-decade hiatus - vector torsion is back on the menu.


title: Inverse-scattering separable NN potential constrained to phase-shift data up to 2.5 GeV. I.- Uncoupled states

abstract: We introduce a new method to construct, within inverse-scattering theory, an energy-independent separable potential capable of reproducing exactly both phase shift and absorption over a predefined energy range. The approach relies on the construction of non-overlapping multi-rank separable potentials, whose form factors are obtained by solving linear equations on intervals where the $K$ matrix does have zeros. Applications are made to nucleon-nucleon $NN$ interactions constrained to the SAID-SP07 phase-shift analysis up to 2.5 GeV lab energy. The inversion potentials are channel dependent with rank dictated by the number of zeros of the $K$ matrix, reproducing the data up to a selected upper momentum. The account for absorption yields complex separable form factors, resulting in a non-Hermitian potential. Applications are restricted to $NN$ spin-uncoupled states considering a Schr\"odinger-like wave equation with minimal relativity. Its extension to spin-coupled states and relativistic kernels are discussed.


title: Feasibility of Non-Line-of-Sight Integrated Sensing and Communication at mmWave

abstract: One rarely addressed direction in the context of Integrated Sensing and Communication (ISAC) is non-line-of-sight (NLOS) sensing, with the potential to enable use cases like intrusion detection and to increase the value that wireless networks can bring. However, ISAC networks impose challenges for sensing due to their communication-oriented design. For instance, time division duplex transmission creates spectral holes in time, resulting in spectral replicas in the radar image. To counteract this, we evaluate different channel state information processing strategies and discuss their tradeoffs. We further propose an ensemble of techniques to detect targets in NLOS conditions. Our approaches are validated with experiments using a millimeter wave ISAC proof of concept in a factory-like environment. The results show that target detection in NLOS is generally possible with ISAC.


title: Measurement of Spin-Density Matrix Elements in $\Delta^{++}(1232)$ photoproduction

abstract: We report the measurement of spin-density matrix elements of the $\Delta^{++}(1232)$ in the photoproduction reaction $\gamma p \to \pi^-\Delta^{++}(1232)$ with the GlueX experiment in Hall D at Jefferson Lab. The measurement used a linearly polarized photon beam with $E_\gamma=8.2-8.8$~GeV and the statistical precision exceeds the previous measurement from SLAC by three orders of magnitude for the momentum transfer squared region $-t < 1.4$ GeV$^2$. The data are sensitive to the previously undetermined relative sign between couplings in existing Regge exchange models. Linear combinations of the extracted SDMEs allow for a decomposition into natural and unnatural exchange amplitudes, which shows that the unnatural exchange plays an important role in the low $-t$ region.


title: What Are the Odds? Language Models Are Capable of Probabilistic Reasoning

abstract: Language models (LM) are capable of remarkably complex linguistic tasks; however, numerical reasoning is an area in which they frequently struggle. An important but rarely evaluated form of reasoning is understanding probability distributions. In this paper, we focus on evaluating the probabilistic reasoning capabilities of LMs using idealized and real-world statistical distributions. We perform a systematic evaluation of state-of-the-art LMs on three tasks: estimating percentiles, drawing samples, and calculating probabilities. We evaluate three ways to provide context to LMs 1) anchoring examples from within a distribution or family of distributions, 2) real-world context, 3) summary statistics on which to base a Normal approximation. Models can make inferences about distributions, and can be further aided by the incorporation of real-world context, example shots and simplified assumptions, even if these assumptions are incorrect or misspecified. To conduct this work, we developed a comprehensive benchmark distribution dataset with associated question-answer pairs that we will release publicly.


title: VIA: A Spatiotemporal Video Adaptation Framework for Global and Local Video Editing

abstract: Video editing stands as a cornerstone of digital media, from entertainment and education to professional communication. However, previous methods often overlook the necessity of comprehensively understanding both global and local contexts, leading to inaccurate and inconsistency edits in the spatiotemporal dimension, especially for long videos. In this paper, we introduce VIA, a unified spatiotemporal VIdeo Adaptation framework for global and local video editing, pushing the limits of consistently editing minute-long videos. First, to ensure local consistency within individual frames, the foundation of VIA is a novel test-time editing adaptation method, which adapts a pre-trained image editing model for improving consistency between potential editing directions and the text instruction, and adapts masked latent variables for precise local control. Furthermore, to maintain global consistency over the video sequence, we introduce spatiotemporal adaptation that adapts consistent attention variables in key frames and strategically applies them across the whole sequence to realize the editing effects. Extensive experiments demonstrate that, compared to baseline methods, our VIA approach produces edits that are more faithful to the source videos, more coherent in the spatiotemporal context, and more precise in local control. More importantly, we show that VIA can achieve consistent long video editing in minutes, unlocking the potentials for advanced video editing tasks over long video sequences.


title: LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptation

abstract: Low-rank adaptation (LoRA) has become the default approach to fine-tune large language models (LLMs) due to its significant reduction in trainable parameters. However, trainable parameter demand for LoRA increases with increasing model embedding dimensions, leading to high compute costs. Additionally, its backward updates require storing high-dimensional intermediate activations and optimizer states, demanding high peak GPU memory. In this paper, we introduce large model fine-tuning via spectrally decomposed low-dimensional adaptation (LaMDA), a novel approach to fine-tuning large language models, which leverages low-dimensional adaptation to achieve significant reductions in trainable parameters and peak GPU memory footprint. LaMDA freezes a first projection matrix (PMA) in the adaptation path while introducing a low-dimensional trainable square matrix, resulting in substantial reductions in trainable parameters and peak GPU memory usage. LaMDA gradually freezes a second projection matrix (PMB) during the early fine-tuning stages, reducing the compute cost associated with weight updates to enhance parameter efficiency further. We also present an enhancement, LaMDA++, incorporating a ``lite-weight" adaptive rank allocation for the LoRA path via normalized spectrum analysis of pre-trained model weights. We evaluate LaMDA/LaMDA++ across various tasks, including natural language understanding with the GLUE benchmark, text summarization, natural language generation, and complex reasoning on different LLMs. Results show that LaMDA matches or surpasses the performance of existing alternatives while requiring up to 17.7x fewer parameter updates and up to 1.32x lower peak GPU memory usage during fine-tuning. Code will be publicly available.