title: Realistic models of general-relativistic differentially rotating stars

abstract: General-relativistic equilibria of differentially rotating stars are expected in a number of astrophysical scenarios, from core-collapse supernovae to the remnant of binary neutron-star mergers. The latter, in particular, have been the subject of extensive studies where they were modeled with a variety of laws of differential rotation with varying degree of realism. Starting from accurate and fully general-relativistic simulations of binary neutron-star mergers with various equations of state and mass ratios, we establish the time when the merger remnant has reached a quasi-stationary equilibrium and extract in this way realistic profiles of differential rotation. This allows us to explore how well traditional laws reproduce such differential-rotation properties and to derive new laws of differential rotation that better match the numerical data in the low-density Keplerian regions of the remnant. In this way, we have obtained a novel and somewhat surprising result: the dynamical stability line to quasi-radial oscillations computed from the turning-point criterion can have a slope that is not necessarily negative with respect to the central rest-mass density, as previously found with traditional differential-rotation laws. Indeed, for stellar models reproducing well the properties of the merger remnants, the slope is actually positive, thus reflecting remnants with angular momentum at large distances from the rotation axis, and hence with cores having higher central rest-mass densities and slower rotation rates.


title: On splitting of morphisms induced by unit map of adjoint functors

abstract: Given a right adjoint functor between triangulated categories and an object in the target category, we show that the unit map of adjunction on that object is a split monomorphism if and only if the object belongs to the additive closure of (all possible) shifts of an object in the image of the functor. Applications to geometric context related to (derived) splinters and rational singularities are given.


title: "We are at the mercy of others' opinion": Supporting Blind People in Recreational Window Shopping with AI-infused Technology

abstract: Engaging in recreational activities in public spaces poses challenges for blind people, often involving dependency on sighted help. Window shopping is a key recreational activity that remains inaccessible. In this paper, we investigate the information needs, challenges, and current approaches blind people have to recreational window shopping to inform the design of existing wayfinding and navigation technology for supporting blind shoppers in exploration and serendipitous discovery. We conduct a formative study with a total of 18 blind participants that include both focus groups (N=8) and interviews for requirements analysis (N=10). We find that there is a desire for push notifications of promotional information and pull notifications about shops of interest such as the targeted audience of a brand. Information about obstacles and points-of-interest required customization depending on one's mobility aid as well as presence of a crowd, children, and wheelchair users. We translate these findings into specific information modalities and rendering in the context of two existing AI-infused assistive applications: NavCog (a turn-by-turn navigation app) and Cabot (a navigation robot).


title: Non-finite type \'etale sites over fields

abstract: We consider the notion of finite type-ness of a site introduced by Morel and Voevodsky, for the \'etale site of a field. For a given field $k$, we conjecture that the \'etale site of $Sm/k$ is of finite type if and only if the field $k$ admits a finite extension of finite cohomological dimension. We prove this conjecture in some cases, e.g. in the case when $k$ is countable, or in the case when the $p$-cohomological dimension $cd_p(k)$ is infinite for infinitely many primes $p$.


title: Simultaneously detecting spatiotemporal changes with penalized Poisson regression models

abstract: In the realm of large-scale spatiotemporal data, abrupt changes are commonly occurring across both spatial and temporal domains. This study aims to address the concurrent challenges of detecting change points and identifying spatial clusters within spatiotemporal count data. We introduce an innovative method based on the Poisson regression model, employing doubly fused penalization to unveil the underlying spatiotemporal change patterns. To efficiently estimate the model, we present an iterative shrinkage and threshold based algorithm to minimize the doubly penalized likelihood function. We establish the statistical consistency properties of the proposed estimator, confirming its reliability and accuracy. Furthermore, we conduct extensive numerical experiments to validate our theoretical findings, thereby highlighting the superior performance of our method when compared to existing competitive approaches.


title: An explicit granular-mechanics approach to marine sediment acoustics

abstract: Here we theoretically and computationally study the frequency dependence of phase speed and attenuation for marine sediments from the perspective of granular mechanics. We leverage recent theoretical insights from the granular physics community as well as discrete-element method simulations, where the granular material is treated as a packing of discrete objects that interact via pairwise forces. These pairwise forces include both repulsive contact forces as well as dissipative terms which may include losses from the fluid as well as losses from inelasticity at grain-grain contacts. We show that the structure of disordered granular packings leads to anomalous scaling laws for frequency-dependent phase speed and attenuation that do not follow from a continuum treatment. Our results demonstrate that granular packing structure, which is not explicitly considered in existing models, may play a crucial role in a complete theory of sediment acoustics. While this simple approach does not explicitly treat sound propagation or inertial effects in the interstitial fluid, it provides a starting point for future models that include these and other more complex features.


title: The Coupled Impacts of Atmospheric Composition and Obliquity on the Climate Dynamics of TRAPPIST-1e

abstract: Planets in multi-planet systems are expected to migrate inward as near-resonant chains, thus allowing them to undergo gravitational planet-planet interactions and possibly maintain a non-zero obliquity. The TRAPPIST-1 system is in such a near-resonant configuration, making it plausible that TRAPPIST-1e has a non-zero obliquity. In this work, we use the ExoCAM GCM to study the possible climates of TRAPPIST-1e at varying obliquities and atmospheric compositions. We vary obliquity from 0$^\circ$ to 90$^\circ$ and the partial pressure of carbon dioxide from 0.0004 bars (modern Earth-like) to 1 bar. We find that models with a higher obliquity are hotter overall and have a smaller day-night temperature contrast than the lower obliquity models, which is consistent with previous studies. Most significantly, the super-rotating high-altitude jet becomes sub-rotating at high obliquity, thus impacting cloud and surface temperature patterns. As the amount of carbon dioxide increases, the climate of TRAPPIST-1e becomes hotter, cloudier, and less variable. From modeled thermal phase curves, we find that the impact of obliquity could potentially have observable consequences due to the effect of cloud coverage on the outgoing longwave radiation.


title: Fast Mixing in Sparse Random Ising Models

abstract: Motivated by the community detection problem in Bayesian inference, as well as the recent explosion of interest in spin glasses from statistical physics, we study the classical Glauber dynamics for sampling from Ising models with sparse random interactions. It is now well-known that when the interaction matrix has spectral diameter less than $1$, Glauber dynamics mixes in $O(n\log n)$ steps. Unfortunately, such criteria fail dramatically for interactions supported on arguably the most well-studied sparse random graph: the Erd\H{o}s--R\'{e}nyi random graph $G(n,d/n)$, due to the presence of almost linearly many outlier eigenvalues of unbounded magnitude. We prove that for the \emph{Viana--Bray spin glass}, where the interactions are supported on $G(n,d/n)$ and randomly assigned $\pm\beta$, Glauber dynamics mixes in $n^{1+o(1)}$ time with high probability as long as $\beta \le O(1/\sqrt{d})$, independent of $n$. We further extend our results to random graphs drawn according to the $2$-community stochastic block model, as well as when the interactions are given by a "centered" version of the adjacency matrix. The latter setting is particularly relevant for the inference problem in community detection. Indeed, we build on this result to demonstrate that Glauber dynamics succeeds at recovering communities in the stochastic block model in an upcoming paper. The primary technical ingredient in our proof is showing that with high probability, a sparse random graph can be decomposed into two parts --- a \emph{bulk} which behaves like a graph with bounded maximum degree and a well-behaved spectrum, and a \emph{near-forest} with favorable pseudorandom properties. We then use this decomposition to design a localization procedure that interpolates to simpler Ising models supported only on the near-forest, and then execute a pathwise analysis to establish a modified log-Sobolev inequality.


title: Optimal Uniform Circle Formation by Asynchronous Luminous Robots

abstract: We study the {\sc Uniform Circle Formation} ({\sc UCF}) problem for a swarm of $n$ autonomous mobile robots operating in \emph{Look-Compute-Move} (LCM) cycles on the Euclidean plane. We assume our robots are \emph{luminous}, i.e. embedded with a persistent light that can assume a color chosen from a fixed palette, and \emph{opaque}, i.e. not able to see beyond a collinear robot. Robots are said to \emph{collide} if they share positions or their paths intersect within concurrent LCM cycles. To solve {\sc UCF}, a swarm of $n$ robots must autonomously arrange themselves so that each robot occupies a vertex of the same regular $n$-gon not fixed in advance. In terms of efficiency, the goal is to design an algorithm that optimizes (or provides a tradeoff between) two fundamental performance metrics: \emph{(i)} the execution time and \emph{(ii)} the size of the color palette. There exists an $O(1)$-time $O(1)$-color algorithm for this problem under the fully synchronous and semi-synchronous schedulers and a $O(\log\log n)$-time $O(1)$-color or $O(1)$-time $O(\sqrt{n})$-color algorithm under the asynchronous scheduler, avoiding collisions. In this paper, we develop a deterministic algorithm solving {\sc UCF} avoiding collisions in $O(1)$-time with $O(1)$ colors under the asynchronous scheduler, which is asymptotically optimal with respect to both time and number of colors used, the first such result. Furthermore, the algorithm proposed here minimizes for the first time what we call the \emph{computational SEC}, i.e. the smallest circular area where robots operate throughout the whole algorithm.


title: A new diagnostic for the null test of dynamical dark energy in light of DESI 2024 and other BAO data

abstract: We introduce a new diagnostic for the null test of dynamical dark energy. This diagnostic is useful, especially when we include anisotropic baryon acoustic oscillation (BAO) data in an analysis, to quantify the deviations from the standard $\Lambda$CDM model. This null test is independent of any late-time cosmological model or parametrization. With this, we study the evidence for dynamical dark energy in light of Dark Energy Spectroscopic Instrument (DESI) 2024 data combined with cosmic microwave background (CMB) observations of the Planck 2018 mission and local $H_0$ measurements. We find low (around 0.6$\sigma$) to moderate (around 1$\sigma$) evidence for dynamical dark energy which is not that significant. Although we get individual deviations at around 2$\sigma$ at the effective redshift 0.51 of the DESI 2024 data, the average deviations combining all redshift points are almost independent of the inclusion or exclusion of the data at effective redshift 0.51 (the differences are only around 0.3$\sigma$). We get almost similar results for other non-DESI BAO data. The evidences are almost independent of the early-time physics and these evidences have very low dependence on $H_0$ values. The evidence of dynamical dark energy, obtained in this analysis, is not consistent with the DESI key paper results with the $w_0w_a$CDM model, but interestingly, these are almost consistent with the DESI's results with $z_pw_p$CDM model.


title: Interfacial spin-orbit coupling driven enhancement of superconductivity by parallel magnetic field

abstract: It is commonly believed that time reversal symmetry breaking perturbations such as magnetic field or scattering on magnetic impurities destruct superconductivity and suppress the critical temperature of the superconducting phase transition. However, in the recent experimental studies significant enhancement of superconducting critical temperature by parallel magnetic field was found for several thin superconducting systems [H.J. Gardner, et al., Nature Physics {\bf 7}, 895 (2011); T. Asaba, et al., Scientific Reports {\bf 8}, 1 (2018) ]. Here we present a possible explanation of the observed phenomenon showing that combination of interfacial spin-orbit interaction and external magnetic field can cause the increase of the superconducting critical temperature of thin superconducting film in wide range of magnetic fields. We use the Ginzburg-Landau formalism taking into account Lifshitz invariant originated from Rashba spin-orbit interaction, which is also responsible for the superconducting diode effect. We also calculate the modification of the Little-Parks oscillations of the critical temperature of hollow superconducting cylinder at the presence of Rashba interfacial spin-orbit interaction.


title: Steps Toward Quantum Simulations of Hadronization and Energy-Loss in Dense Matter

abstract: A framework for simulating the real-time dynamics of particles in dense matter using quantum computers is developed. As a demonstration, we perform classical simulations of heavy-hadrons propagating through a dense medium in the Schwinger model. Measurements of the time-dependent energy and charge density are used to identify mechanisms responsible for energy loss and hadron production (hadronization). A study of entanglement dynamics highlights the importance of quantum coherence between the particles that make up the dense medium. Throughout this work, care is taken to isolate, and remove, phenomena that arise solely from a finite lattice spacing. It is found that signatures of entanglement are more sensitive to lattice artifacts than other observables. Toward quantum simulations, we present an efficient method and the corresponding quantum circuits for preparing ground states in the presence of heavy mesons. These circuits are used to estimate the resources required to simulate in-medium energy loss and hadronization in the Schwinger model using quantum computers.


title: On Streaming Codes for Simultaneously Correcting Burst and Random Erasures

abstract: Streaming codes are packet-level codes that recover dropped packets within a strict decoding-delay constraint. We study streaming codes over a sliding-window (SW) channel model which admits only those erasure patterns which allow either a single burst erasure of $\le b$ packets along with $\le e$ random packet erasures, or else, $\le a$ random packet erasures, in any sliding-window of $w$ time slots. We determine the optimal rate of a streaming code constructed via the popular diagonal embedding (DE) technique over such a SW channel under delay constraint $\tau=(w-1)$ and provide an $O(w)$ field size code construction. For the case $e>1$, we show that it is not possible to significantly reduce this field size requirement, assuming the well-known MDS conjecture. We then provide a block code construction whose DE yields a streaming code achieving the rate derived above, over a field of size sub-linear in $w,$ for a family of parameters having $e=1.$ We show the field size optimality of this construction for some parameters, and near-optimality for others under a sparsity constraint. Additionally, we derive an upper-bound on the $d_{\text{min}}$ of a cyclic code and characterize cyclic codes which achieve this bound via their ability to simultaneously recover from burst and random erasures.


title: Faster entanglement driven by quantum resonance in many-body kicked rotors

abstract: Quantum resonance in the paradigmatic kicked rotor system is a purely quantum effect that ignores the state of underlying classical chaos. In this work, it is shown that quantum resonance leads to superlinear entanglement production. In $N$-interacting kicked rotors set to be at quantum resonance, entanglement growth is super-linear until a crossover timescale $t^*$, beyond which growth slows down to a logarithmic form with superimposed oscillations. By mapping positional interaction to momentum space and analytically assessing the linear entropy, we unravel the mechanism driving these two distinct growth profiles. The analytical results agree with the numerical simulations performed for two- and three-interacting kicked rotors. The late time entanglement oscillation is sensitive to changes in scaled Planck's constant with a high quality factor suitable for high precision measurements. These results are amenable to an experimental realization on atom optics setup.


title: Dynamic programming principle and computable prices in financial market models with transaction costs

abstract: How to compute (super) hedging costs in rather general fi- nancial market models with transaction costs in discrete-time ? Despite the huge literature on this topic, most of results are characterizations of the super-hedging prices while it remains difficult to deduce numerical procedure to estimate them. We establish here a dynamic programming principle and we prove that it is possible to implement it under some conditions on the conditional supports of the price and volume processes for a large class of market models including convex costs such as order books but also non convex costs, e.g. fixed cost models.


title: Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems

abstract: Ensuring that AI systems reliably and robustly avoid harmful or dangerous behaviours is a crucial challenge, especially for AI systems with a high degree of autonomy and general intelligence, or systems used in safety-critical contexts. In this paper, we will introduce and define a family of approaches to AI safety, which we will refer to as guaranteed safe (GS) AI. The core feature of these approaches is that they aim to produce AI systems which are equipped with high-assurance quantitative safety guarantees. This is achieved by the interplay of three core components: a world model (which provides a mathematical description of how the AI system affects the outside world), a safety specification (which is a mathematical description of what effects are acceptable), and a verifier (which provides an auditable proof certificate that the AI satisfies the safety specification relative to the world model). We outline a number of approaches for creating each of these three core components, describe the main technical challenges, and suggest a number of potential solutions to them. We also argue for the necessity of this approach to AI safety, and for the inadequacy of the main alternative approaches.


title: Strong existence for free-discontinuity problems with non-standard growth

abstract: An Ahlfors-type regularity result for free-discontinuity energies defined on the space $SBV^{\varphi}$ of special functions of bounded variation with $\varphi$-growth, where $\varphi$ is a generalized Orlicz function, is proved. Our analysis expands on the regularity theory for minimizers of a class of free-discontinuity problems in the non-standard growth case.


title: Characterizing the Accuracy - Efficiency Trade-off of Low-rank Decomposition in Language Models

abstract: Large language models (LLMs) have emerged and presented their general problem-solving capabilities with one model. However, the model size has increased dramatically with billions of parameters to enable such broad problem-solving capabilities. In addition, due to the dominance of matrix-matrix and matrix-vector multiplications in LLMs, the compute-to-model size ratio is significantly lower than that of CNNs. This shift pushes LLMs from a computation-bound regime to a memory-bound regime. Therefore, optimizing the memory footprint and traffic is an important optimization direction for LLMs today. Model compression methods such as quantization and parameter pruning have been actively explored for achieving the memory footprint and traffic optimization. However, the accuracy-efficiency trade-off of rank pruning for LLMs is not well-understood yet. Therefore, we characterize the accuracy-efficiency trade-off of a low-rank decomposition method, specifically Tucker decomposition, on recent language models, including an open-source LLM, Llama 2. We formalize the low-rank decomposition design space and show that the decomposition design space is enormous (e.g., O($2^{37}$) for Llama2-7B). To navigate such a vast design space, we formulate the design space and perform thorough case studies of accuracy-efficiency trade-offs using six widely used LLM benchmarks on BERT and Llama 2 models. Our results show that we can achieve a 9\% model size reduction with minimal accuracy drops, which range from 4\%p to 10\%p, depending on the difficulty of the benchmark, without any retraining to recover accuracy after decomposition. The results show that low-rank decomposition can be a promising direction for LLM-based applications that require real-time service in scale (e.g., AI agent assist and real-time coding assistant), where the latency is as important as the model accuracy.


title: Conformal Validity Guarantees Exist for Any Data Distribution (and How to Find Them)

abstract: As artificial intelligence (AI) / machine learning (ML) gain widespread adoption, practitioners are increasingly seeking means to quantify and control the risk these systems incur. This challenge is especially salient when such systems have autonomy to collect their own data, such as in black-box optimization and active learning, where their actions induce sequential feedback-loop shifts in the data distribution. Conformal prediction is a promising approach to uncertainty and risk quantification, but prior variants' validity guarantees have assumed some form of ``quasi-exchangeability'' on the data distribution, thereby excluding many types of sequential shifts. In this paper we prove that conformal prediction can theoretically be extended to \textit{any} joint data distribution, not just exchangeable or quasi-exchangeable ones. Although the most general case is exceedingly impractical to compute, for concrete practical applications we outline a procedure for deriving specific conformal algorithms for any data distribution, and we use this procedure to derive tractable algorithms for a series of AI/ML-agent-induced covariate shifts. We evaluate the proposed algorithms empirically on synthetic black-box optimization and active learning tasks.


title: Optimal epidemic control by social distancing and vaccination of an infection structured by time since infection: the covid-19 case study

abstract: Motivated by the issue of COVID-19 mitigation, in this work we tackle the general problem of optimally controlling an epidemic outbreak of a communicable disease structured by time since exposure, by the aid of two types of control instruments namely, social distancing and vaccination by a vaccine at least partly effective in protecting from infection. Effective vaccines are assumed to be made available only in a subsequent period of the epidemic so that - in the first period - epidemic control only relies on social distancing, as it happened for the COVID-19 pandemic. By our analyses, we could prove the existence of (at least) one optimal control pair, we derived first-order necessary conditions for optimality, and proved some useful properties of such optimal solutions. A worked example provides a number of further insights on the relationships between key control and epidemic parameters.


title: A General Hierarchy of Charges at Null Infinity via the Todd Polynomials

abstract: We give a general procedure for constructing an extended phase space for Yang-Mills theory at null infinity, capable of handling the asymptotic symmetries and construction of charges responsible for sub$^n$-leading soft theorems at all orders. The procedure is coordinate and gauge-choice independent, and can be fed into the calculation of both tree and loop-level soft limits. We find a hierarchy in the extended phase space controlled by the Bernoulli numbers arising in Todd genus computations. We give an explicit example of a calculation at tree level, in radial gauge, where we also uncover recursion relations at all orders for the equations of motion and charges.


title: Nonlocal correlations transmitted between quantum dots via short topological superconductor

abstract: We study the quasiparticle states and nonlocal correlations of a hybrid structure, comprising two quantum dots interconnected through a short-length topological superconducting nanowire hosting overlaping Majorana modes. We show that the hybridization between different components of this setup gives rise to the emergence of molecular states, which are responsible for nonlocal correlations. We inspect the resulting energy structure, focusing on the inter-dependence between the quasiparticles of individual quantum dots. We predict the existence of nonlocal effects, which could be accessed and probed by crossed Andreev reflection spectroscopy. Our study would be relevant to a recent experimental realization of the minimal Kitaev model [T. Dvir et al., Nature 614, 445 (2023)], by considering its hybrid structure with side-attached quantum dots.


title: The Sunburst Arc with JWST: III. An Abundance of Direct Chemical Abundances

abstract: We measure the gas-phase abundances of the elements He, N, O, Ne, S, Ar, and Fe in the Lyman-continuum emitting region of the Sunburst Arc, a highly magnified galaxy at redshift $z=2.37$. We detect the temperature-sensitive auroral lines [SII]$\lambda\lambda4069,4076$, [OII]$\lambda\lambda7320,7330$, [SIII]$\lambda6312$, [OIII]$\lambda4363$, and [NeIII]$\lambda3343$ in a stacked spectrum of 5 multiple images of the Lyman-continuum emitter (LCE), from which we directly measure the electron temperature in the low, intermediate, and high ionization zones. We also detect the density-sensitive doublets of [OII]$\lambda\lambda3727,3729$, [SII]$\lambda\lambda6717,6731$, and [ArIV]$\lambda\lambda4713,4741$, which constrain the density in both the low- and high-ionization gas. With these temperature and density measurements, we measure gas-phase abundances with similar rigor as studies of local galaxies. We measure a gas-phase metallicity for the LCE of $12+\log(\textrm{O}/\textrm{H}) = 7.97 \pm 0.05$, and find an enhanced nitrogen abundance $\log(\textrm{N}/\textrm{O}) = -0.65^{+0.16}_{-0.25}$. This nitrogen abundance is consistent with enrichment from a population of Wolf-Rayet stars, additional signatures of which are reported in a companion paper. Abundances of sulfur, argon, neon, and iron are consistent with local low-metallicity HII regions and low-redshift galaxies. This study represents the most complete chemical abundance analysis of a galaxy at Cosmic Noon to date, which enables direct comparisons between local HII regions and those in the distant universe.


title: QSpace - An open-source tensor library for Abelian and non-Abelian symmetries

abstract: This is the documentation for the tensor library QSpace (v4.0), a toolbox to exploit `quantum symmetry spaces' in tensor network states in the quantum many-body context. QSpace permits arbitrary combinations of symmetries including the abelian symmetries $\mathbb{Z}_n$ and $U(1)$, as well as all non-abelian symmetries based on the semisimple classical Lie algebras: $A_n$, $B_n$, $C_n$, and $D_n$, or respectively, the special unitary group SU($n$), the odd orthogonal group SO($2n+1$), the symplectic group Sp($2n$), and the even orthogonal group SO($2n$). The code (C++ embedded via the MEX interface into Matlab) is available open source as of QSpace v4.0 at https://bitbucket.org/qspace4u/ under the Apache 2.0 license. QSpace is designed as a bottom-up approach for non-abelian symmetries. It starts from the defining representation and the respective Lie algebra. By explicitly computing and tabulating generalized Clebsch-Gordan coefficient tensors, QSpace is versatile in the type of operations that it can perform across all symmetries. At the level of an application, much of the symmetry-related details are hidden within the QSpace C++ core libraries. Hence when developing tensor network algorithms with QSpace, these can be coded (nearly) as if there are no symmetries at all, despite being able to fully exploit general non-abelian symmetries.


title: Testing $f(T)$ cosmologies with HII Hubble diagram and CMB distance priors

abstract: In this work, we present independent determinations of cosmological parameters and new constraints on $f(T)$ cosmologies, employing two new catalogs related to HII galaxy Hubble and CMB distance priors, along with the local standard measurements, SNIa, $H(z)$ measurements, growth rate data (RSD), and BAO baselines. We found that the marginalised best-fit C.L. $H_0$ and $\sigma_8$ parameters within these cosmologies can relax the current cosmological tensions using HIIG data. This produces a larger range of admissible values for the current Hubble constant, and when all baselines are considered, the uncertainty bands for $H_0$ and the matter density parameter reduce significantly.


title: Multimodal LLMs Struggle with Basic Visual Network Analysis: a VNA Benchmark

abstract: We evaluate the zero-shot ability of GPT-4 and LLaVa to perform simple Visual Network Analysis (VNA) tasks on small-scale graphs. We evaluate the Vision Language Models (VLMs) on 5 tasks related to three foundational network science concepts: identifying nodes of maximal degree on a rendered graph, identifying whether signed triads are balanced or unbalanced, and counting components. The tasks are structured to be easy for a human who understands the underlying graph theoretic concepts, and can all be solved by counting the appropriate elements in graphs. We find that while GPT-4 consistently outperforms LLaVa, both models struggle with every visual network analysis task we propose. We publicly release the first benchmark for the evaluation of VLMs on foundational VNA tasks.


title: Multivariate Interval-Valued Models in Frequentist and Bayesian Schemes

abstract: In recent years, addressing the challenges posed by massive datasets has led researchers to explore aggregated data, particularly leveraging interval-valued data, akin to traditional symbolic data analysis. While much recent research, with the exception of Samdai et al. (2023) who focused on the bivariate case, has primarily concentrated on parameter estimation in single-variable scenarios, this paper extends such investigations to the multivariate domain for the first time. We derive maximum likelihood (ML) estimators for the parameters and establish their asymptotic distributions. Additionally, we pioneer a theoretical Bayesian framework, previously confined to the univariate setting, for multivariate data. We provide a detailed exposition of the proposed estimators and conduct comparative performance analyses. Finally, we validate the effectiveness of our estimators through simulations and real-world data analysis.


title: Federated Document Visual Question Answering: A Pilot Study

abstract: An important handicap of document analysis research is that documents tend to be copyrighted or contain private information, which prohibits their open publication and the creation of centralised, large-scale document datasets. Instead, documents are scattered in private data silos, making extensive training over heterogeneous data a tedious task. In this work, we explore the use of a federated learning (FL) scheme as a way to train a shared model on decentralised private document data. We focus on the problem of Document VQA, a task particularly suited to this approach, as the type of reasoning capabilities required from the model can be quite different in diverse domains. Enabling training over heterogeneous document datasets can thus substantially enrich DocVQA models. We assemble existing DocVQA datasets from diverse domains to reflect the data heterogeneity in real-world applications. We explore the self-pretraining technique in this multi-modal setting, where the same data is used for both pretraining and finetuning, making it relevant for privacy preservation. We further propose combining self-pretraining with a Federated DocVQA training method using centralized adaptive optimization that outperforms the FedAvg baseline. With extensive experiments, we also present a multi-faceted analysis on training DocVQA models with FL, which provides insights for future research on this task. We show that our pretraining strategies can effectively learn and scale up under federated training with diverse DocVQA datasets and tuning hyperparameters is essential for practical document tasks under federation.


title: Stable equivalence relations on 4-manifolds

abstract: Kreck's modified surgery gives an approach to classifying smooth $2n$-manifolds up to stable diffeomorphism, i.e. up to connected sum with copies of $S^n \times S^n$. In dimension 4, we use a combination of modified and classical surgery to study various stable equivalence relations which we compare to stable diffeomorphism. Most importantly, we consider homotopy equivalence up to stabilisation with copies of $S^2 \times S^2$. As an application, we show that closed oriented homotopy equivalent 4-manifolds with abelian fundamental group are stably diffeomorphic. We give analogues of the cancellation theorems of Hambleton--Kreck for stable homeomorphism for homotopy up to stabilisations. Finally, we give a complete algebraic obstruction to the existence of closed smooth 4-manifolds which are homotopy equivalent but not simple homotopy equivalent up to connected sum with $S^2 \times S^2$.


title: Assorted remarks on bending measures and energies for plates and shells, and their invariance properties

abstract: In this note, we address several issues, including some raised in recent works and commentary, related to bending measures and energies for plates and shells, and certain of their invariance properties. We discuss the distinction between definitions and results in our and others' approaches, correct an error and citation oversights in our work, and provide additional brief observations regarding the relative size of energetic terms and the symmetrization of bending measures. Particular points of emphasis are a reiteration of some of the early history of dilation-invariant measures, the similarities between all such measures, and the non-dilation-invariance of our recently introduced bending measure for shells and curved rods. In the course of this discussion, we provide a simpler presentation of the elementary, but much overlooked, fact that the additional tangential stretch of material near the mid-surface of a thin body is the product of the mid-surface stretch and the change in curvature.


title: Value Augmented Sampling for Language Model Alignment and Personalization

abstract: Aligning Large Language Models (LLMs) to cater to different human preferences, learning new skills, and unlearning harmful behavior is an important problem. Search-based methods, such as Best-of-N or Monte-Carlo Tree Search, are performant, but impractical for LLM adaptation due to their high inference cost. On the other hand, using Reinforcement Learning (RL) for adaptation is computationally efficient, but performs worse due to the optimization challenges in co-training the value function and the policy. We present a new framework for reward optimization, Value Augmented Sampling (VAS), that can maximize different reward functions using data sampled from only the initial, frozen LLM. VAS solves for the optimal reward-maximizing policy without co-training the policy and the value function, making the optimization stable, outperforming established baselines, such as PPO and DPO, on standard benchmarks, and achieving comparable results to Best-of-128 with lower inference cost. Unlike existing RL methods that require changing the weights of the LLM, VAS does not require access to the weights of the pre-trained LLM. Thus, it can even adapt LLMs (e.g., ChatGPT), which are available only as APIs. In addition, our algorithm unlocks the new capability of composing several rewards and controlling the extent of each one during deployment time, paving the road ahead for the future of aligned, personalized LLMs.


title: Linearizing Large Language Models

abstract: Linear transformers have emerged as a subquadratic-time alternative to softmax attention and have garnered significant interest due to their fixed-size recurrent state that lowers inference cost. However, their original formulation suffers from poor scaling and underperforms compute-matched transformers. Recent linear models such as RWKV and Mamba have attempted to address these shortcomings by proposing novel time-mixing and gating architectures, but pre-training large language models requires significant data and compute investments. Thus, the search for subquadratic architectures is limited by the availability of compute and quality pre-training datasets. As a cost-effective alternative to pre-training linear transformers, we propose Scalable UPtraining for Recurrent Attention (SUPRA). We present a method to uptrain existing large pre-trained transformers into Recurrent Neural Networks (RNNs) with a modest compute budget. This allows us to leverage the strong pre-training data and performance of existing transformer LLMs, while requiring 5% of the training cost. We find that our linearization technique leads to competitive performance on standard benchmarks, but we identify persistent in-context learning and long-context modeling shortfalls for even the largest linear models. Our code and models can be found at https://github.com/TRI-ML/linear_open_lm.


title: On Existence of Latency Optimal Uncoded Storage Schemes in Geo-Distributed Data Storage Systems

abstract: We consider the problem of geographically distributed data storage in a network of servers (or nodes) where the nodes are connected to each other via communication links having certain round-trip times (RTTs). Each node serves a specific set of clients, where a client can request for any of the files available in the distributed system. The parent node provides the requested file if available locally; else it contacts other nodes that have the data needed to retrieve the requested file. This inter-node communication incurs a delay resulting in a certain latency in servicing the data request. The worst-case latency incurred at a servicing node and the system average latency are important performance metrics of a storage system, which depend not only on inter-node RTTs, but also on how the data is stored across the nodes. Data files could be placed in the nodes as they are, i.e., in uncoded fashion, or can be coded and placed. This paper provides the necessary and sufficient conditions for the existence of uncoded storage schemes that are optimal in terms of both per-node worst-case latency and system average latency. In addition, the paper provides efficient binary storage codes for a specific case where optimal uncoded schemes do not exist.


title: PPFlow: Target-aware Peptide Design with Torsional Flow Matching

abstract: Therapeutic peptides have proven to have great pharmaceutical value and potential in recent decades. However, methods of AI-assisted peptide drug discovery are not fully explored. To fill the gap, we propose a target-aware peptide design method called \textsc{PPFlow}, based on conditional flow matching on torus manifolds, to model the internal geometries of torsion angles for the peptide structure design. Besides, we establish a protein-peptide binding dataset named PPBench2024 to fill the void of massive data for the task of structure-based peptide drug design and to allow the training of deep learning methods. Extensive experiments show that PPFlow reaches state-of-the-art performance in tasks of peptide drug generation and optimization in comparison with baseline models, and can be generalized to other tasks including docking and side-chain packing.


title: Levels of AI Agents: from Rules to Large Language Models

abstract: AI agents are defined as artificial entities to perceive the environment, make decisions and take actions. Inspired by the 6 levels of autonomous driving by Society of Automotive Engineers, the AI agents are also categorized based on utilities and strongness, as the following levels: L0, no AI, with tools taking into account perception plus actions; L1, using rule-based AI; L2, making rule-based AI replaced by IL/RL-based AI, with additional reasoning & decision making; L3, applying LLM-based AI instead of IL/RL-based AI, additionally setting up memory & reflection; L4, based on L3, facilitating autonomous learning & generalization; L5, based on L4, appending personality of emotion and character and collaborative behavior with multi-agents.


title: The Mathematics of Chlorophyll Photoexcitation

abstract: Photosynthesis is a fundamental process for plants to produce energy and survive. It is a well known fact that the light reactions in photosynthesis are a significant part of the overall process, and are carried out by chlorophyll molecules. This paper outlines the quantum chemical and mathematical description concerning electronic state transitions that take place in chlorophyll molecules during photosynthesis. In particular, the electronic transition of chlorophylls is assumed as a diatomic rovibrational 0 --> 0 transition, and is mathematically described accordingly. Then, the correlation of the Franck-Condon Principle in accordance to the photoexcitation of chlorophylls is delineated. Finally, existing research concerning the concepts laid out in this paper is discussed, and future implications of quantum chemical theory concerning chlorophyll photoexcitation is discussed.


title: On Recovering Higher-order Interactions from Protein Language Models

abstract: Protein language models leverage evolutionary information to perform state-of-the-art 3D structure and zero-shot variant prediction. Yet, extracting and explaining all the mutational interactions that govern model predictions remains difficult as it requires querying the entire amino acid space for $n$ sites using $20^n$ sequences, which is computationally expensive even for moderate values of $n$ (e.g., $n\sim10$). Although approaches to lower the sample complexity exist, they often limit the interpretability of the model to just single and pairwise interactions. Recently, computationally scalable algorithms relying on the assumption of sparsity in the Fourier domain have emerged to learn interactions from experimental data. However, extracting interactions from language models poses unique challenges: it's unclear if sparsity is always present or if it is the only metric needed to assess the utility of Fourier algorithms. Herein, we develop a framework to do a systematic Fourier analysis of the protein language model ESM2 applied on three proteins-green fluorescent protein (GFP), tumor protein P53 (TP53), and G domain B1 (GB1)-across various sites for 228 experiments. We demonstrate that ESM2 is dominated by three regions in the sparsity-ruggedness plane, two of which are better suited for sparse Fourier transforms. Validations on two sample proteins demonstrate recovery of all interactions with $R^2=0.72$ in the more sparse region and $R^2=0.66$ in the more dense region, using only 7 million out of $20^{10}\sim10^{13}$ ESM2 samples, reducing the computational time by a staggering factor of 15,000. All codes and data are available on our GitHub repository https://github.com/amirgroup-codes/InteractionRecovery.


title: On-the-fly Learning to Transfer Motion Style with Diffusion Models: A Semantic Guidance Approach

abstract: In recent years, the emergence of generative models has spurred development of human motion generation, among which the generation of stylized human motion has consistently been a focal point of research. The conventional approach for stylized human motion generation involves transferring the style from given style examples to new motions. Despite decades of research in human motion style transfer, it still faces three main challenges: 1) difficulties in decoupling the motion content and style; 2) generalization to unseen motion style. 3) requirements of dedicated motion style dataset; To address these issues, we propose an on-the-fly human motion style transfer learning method based on the diffusion model, which can learn a style transfer model in a few minutes of fine-tuning to transfer an unseen style to diverse content motions. The key idea of our method is to consider the denoising process of the diffusion model as a motion translation process that learns the difference between the style-neutral motion pair, thereby avoiding the challenge of style and content decoupling. Specifically, given an unseen style example, we first generate the corresponding neutral motion through the proposed Style-Neutral Motion Pair Generation module. We then add noise to the generated neutral motion and denoise it to be close to the style example to fine-tune the style transfer diffusion model. We only need one style example and a text-to-motion dataset with predominantly neutral motion (e.g. HumanML3D). The qualitative and quantitative evaluations demonstrate that our method can achieve state-of-the-art performance and has practical applications.


title: Exploring Motion: Integrating Arduino in Physics Education for 21st Century Skills

abstract: In the study, analyzes were made for one-dimensional constant acceleration motion using the Arduino microcontroller and distance sensor, using the position and time values obtained for the movement of an object thrown from bottom to top until it falls to the ground. Within the scope of the study, the concepts of displacement, distance traveled, average speed and their relationships, position-time and speed-time graphs and kinematic equations were analyzed respectively. It was observed that all the results obtained from the analyzes were compatible with the theoretical results obtained using the equations. This study, in which innovative experimental activities and comprehensive analyzes for both constant acceleration motion and motion graphs and flight movements are carried out at a very low cost, has a high reproducibility potential as it contains easily accessible materials. With this type of study, it is very important and necessary to add training for 21st century skills such as material development, programming, and data analysis to physics teaching processes in the age of technology.


title: Protein atom traps as seeing by neutron scattering

abstract: The expression for the higher temperature dependence of the mean squared displacement in proteins is obtained. The quantum multi-well model explains the dynamic transitions of the proteins and minimizes the amount of parameters to a single one leading to the few-state harmonic system at low-temperatures, and, thus, justifying the possibility of using proteins as atom traps to control qubits at a bit higher temperatures.

categories: q-bio.BM cond-mat.mes-hall cond-mat.soft physics.bio-ph


title: ProLLM: Protein Chain-of-Thoughts Enhanced LLM for Protein-Protein Interaction Prediction

abstract: The prediction of protein-protein interactions (PPIs) is crucial for understanding biological functions and diseases. Previous machine learning approaches to PPI prediction mainly focus on direct physical interactions, ignoring the broader context of nonphysical connections through intermediate proteins, thus limiting their effectiveness. The emergence of Large Language Models (LLMs) provides a new opportunity for addressing this complex biological challenge. By transforming structured data into natural language prompts, we can map the relationships between proteins into texts. This approach allows LLMs to identify indirect connections between proteins, tracing the path from upstream to downstream. Therefore, we propose a novel framework ProLLM that employs an LLM tailored for PPI for the first time. Specifically, we propose Protein Chain of Thought (ProCoT), which replicates the biological mechanism of signaling pathways as natural language prompts. ProCoT considers a signaling pathway as a protein reasoning process, which starts from upstream proteins and passes through several intermediate proteins to transmit biological signals to downstream proteins. Thus, we can use ProCoT to predict the interaction between upstream proteins and downstream proteins. The training of ProLLM employs the ProCoT format, which enhances the model's understanding of complex biological problems. In addition to ProCoT, this paper also contributes to the exploration of embedding replacement of protein sites in natural language prompts, and instruction fine-tuning in protein knowledge datasets. We demonstrate the efficacy of ProLLM through rigorous validation against benchmark datasets, showing significant improvement over existing methods in terms of prediction accuracy and generalizability. The code is available at: https://github.com/MingyuJ666/ProLLM.


title: Large Language Models as Planning Domain Generators

abstract: Developing domain models is one of the few remaining places that require manual human labor in AI planning. Thus, in order to make planning more accessible, it is desirable to automate the process of domain model generation. To this end, we investigate if large language models (LLMs) can be used to generate planning domain models from simple textual descriptions. Specifically, we introduce a framework for automated evaluation of LLM-generated domains by comparing the sets of plans for domain instances. Finally, we perform an empirical analysis of 7 large language models, including coding and chat models across 9 different planning domains, and under three classes of natural language domain descriptions. Our results indicate that LLMs, particularly those with high parameter counts, exhibit a moderate level of proficiency in generating correct planning domains from natural language descriptions. Our code is available at https://github.com/IBM/NL2PDDL.


title: Using GANs for De Novo Protein Design Targeting Microglial IL-3R$\alpha$ to Inhibit Alzheimer's Progression

abstract: IL-3 is a hemopoietic growth factor that usually targets blood cell precursors; IL-3R is a cytokine receptor that binds to IL-3. However, IL-3 takes on a different role in the context of glial cells in the nervous system, where studies show that the protein IL-3 protects against Alzheimer's disease by activating microglia at their IL-3R receptors, causing the microglia to clear out the tangles caused by the build-up of misfolded Tau proteins. In this study, we seek to ascertain what role the secondary structure of IL-3 plays in its binding with the receptor. The motivation behind this study is to learn more about the mechanism and identify possible drugs that might be able to activate it, in hopes of inhibiting the spread of Alzheimer's Disease. From a preliminary analysis of complexes containing IL-3 and IL-3R, we hypothesized that the binding is largely due to the interactions of three alpha helix structures stretching towards the active site on the receptor. The original Il-3 protein serves as the control in this experiment; the other proteins being tested are generated through several types of computational de novo protein design, where machine learning allows for the production of entirely novel structures. The efficacy of the generated proteins is assessed through docking simulations with the IL-3R receptor, and the binding poses are also qualitatively examined to gain insight into the function of the binding. From the docking data and poses, the most successful proteins were those with similar secondary structure to IL-3.


title: Large Language Model (LLM) AI text generation detection based on transformer deep learning algorithm

abstract: In this paper, a tool for detecting LLM AI text generation is developed based on the Transformer model, aiming to improve the accuracy of AI text generation detection and provide reference for subsequent research. Firstly the text is Unicode normalised, converted to lowercase form, characters other than non-alphabetic characters and punctuation marks are removed by regular expressions, spaces are added around punctuation marks, first and last spaces are removed, consecutive ellipses are replaced with single spaces and the text is connected using the specified delimiter. Next remove non-alphabetic characters and extra whitespace characters, replace multiple consecutive whitespace characters with a single space and again convert to lowercase form. The deep learning model combines layers such as LSTM, Transformer and CNN for text classification or sequence labelling tasks. The training and validation sets show that the model loss decreases from 0.127 to 0.005 and accuracy increases from 94.96 to 99.8, indicating that the model has good detection and classification ability for AI generated text. The test set confusion matrix and accuracy show that the model has 99% prediction accuracy for AI-generated text, with a precision of 0.99, a recall of 1, and an f1 score of 0.99, achieving a very high classification accuracy. Looking forward, it has the prospect of wide application in the field of AI text detection.


title: A unified cross-attention model for predicting antigen binding specificity to both HLA and TCR molecules

abstract: The immune checkpoint inhibitors have demonstrated promising clinical efficacy across various tumor types, yet the percentage of patients who benefit from them remains low. The binding affinity between antigens and HLA-I/TCR molecules plays a critical role in antigen presentation and T-cell activation. Some computational methods have been developed to predict antigen-HLA or antigen-TCR binding specificity, but they focus solely on one task at a time. In this paper, we propose UnifyImmun, a unified cross-attention transformer model designed to simultaneously predicts the binding of antigens to both HLA and TCR molecules, thereby providing more comprehensive evaluation of antigen immunogenicity. We devise a two-phase progressive training strategy that enables these two tasks to mutually reinforce each other, by compelling the encoders to extract more expressive features. To further enhance the model generalizability, we incorporate virtual adversarial training. Compared to over ten existing methods for predicting antigen-HLA and antigen-TCR binding, our method demonstrates better performance in both tasks. Notably, on a large-scale COVID-19 antigen-TCR binding test set, our method improves performance by at least 9% compared to the current state-of-the-art methods. The validation experiments on three clinical cohorts confirm that our approach effectively predicts immunotherapy response and clinical outcomes. Furthermore, the cross-attention scores reveal the amino acids sites critical for antigen binding to receptors. In essence, our approach marks a significant step towards comprehensive evaluation of antigen immunogenicity.


title: PROflow: An iterative refinement model for PROTAC-induced structure prediction

abstract: Proteolysis targeting chimeras (PROTACs) are small molecules that trigger the breakdown of traditionally ``undruggable'' proteins by binding simultaneously to their targets and degradation-associated proteins. A key challenge in their rational design is understanding their structural basis of activity. Due to the lack of crystal structures (18 in the PDB), existing PROTAC docking methods have been forced to simplify the problem into a distance-constrained protein-protein docking task. To address the data issue, we develop a novel pseudo-data generation scheme that requires only binary protein-protein complexes. This new dataset enables PROflow, an iterative refinement model for PROTAC-induced structure prediction that models the full PROTAC flexibility during constrained protein-protein docking. PROflow outperforms the state-of-the-art across docking metrics and runtime. Its inference speed enables the large-scale screening of PROTAC designs, and computed properties of predicted structures achieve statistically significant correlations with published degradation activities.


title: RNA Secondary Structure Prediction Using Transformer-Based Deep Learning Models

abstract: The Human Genome Project has led to an exponential increase in data related to the sequence, structure, and function of biomolecules. Bioinformatics is an interdisciplinary research field that primarily uses computational methods to analyze large amounts of biological macromolecule data. Its goal is to discover hidden biological patterns and related information. Furthermore, analysing additional relevant information can enhance the study of biological operating mechanisms. This paper discusses the fundamental concepts of RNA, RNA secondary structure, and its prediction.Subsequently, the application of machine learning technologies in predicting the structure of biological macromolecules is explored. This chapter describes the relevant knowledge of algorithms and computational complexity and presents a RNA tertiary structure prediction algorithm based on ResNet. To address the issue of the current scoring function's unsuitability for long RNA, a scoring model based on ResNet is proposed, and a structure prediction algorithm is designed. The chapter concludes by presenting some open and interesting challenges in the field of RNA tertiary structure prediction.


title: Exploring Social Media Posts for Depression Identification: A Study on Reddit Dataset

abstract: Depression is one of the most common mental disorders affecting an individual's personal and professional life. In this work, we investigated the possibility of utilizing social media posts to identify depression in individuals. To achieve this goal, we conducted a preliminary study where we extracted and analyzed the top Reddit posts made in 2022 from depression-related forums. The collected data were labeled as depressive and non-depressive using UMLS Metathesaurus. Further, the pre-processed data were fed to classical machine learning models, where we achieved an accuracy of 92.28\% in predicting the depressive and non-depressive posts.


title: Molecular Docking via Weighted Subgraph Isomorphism on Quantum Annealers

abstract: Molecular docking is an essential step in the drug discovery process involving the detection of three-dimensional poses of a ligand inside the active site of the protein. In this paper, we address the Molecular Docking search phase by formulating the problem in QUBO terms, suitable for an annealing approach. We propose a problem formulation as a weighted subgraph isomorphism between the ligand graph and the grid of the target protein pocket. In particular, we applied a graph representation to the ligand embedding all the geometrical properties of the molecule including its flexibility, and we created a weighted spatial grid to the 3D space region inside the pocket. Results and performance obtained with quantum annealers are compared with classical simulated annealing solvers.


title: ProteinEngine: Empower LLM with Domain Knowledge for Protein Engineering

abstract: Large language models (LLMs) have garnered considerable attention for their proficiency in tackling intricate tasks, particularly leveraging their capacities for zero-shot and in-context learning. However, their utility has been predominantly restricted to general tasks due to an absence of domain-specific knowledge. This constraint becomes particularly pertinent in the realm of protein engineering, where specialized expertise is required for tasks such as protein function prediction, protein evolution analysis, and protein design, with a level of specialization that existing LLMs cannot furnish. In response to this challenge, we introduce \textsc{ProteinEngine}, a human-centered platform aimed at amplifying the capabilities of LLMs in protein engineering by seamlessly integrating a comprehensive range of relevant tools, packages, and software via API calls. Uniquely, \textsc{ProteinEngine} assigns three distinct roles to LLMs, facilitating efficient task delegation, specialized task resolution, and effective communication of results. This design fosters high extensibility and promotes the smooth incorporation of new algorithms, models, and features for future development. Extensive user studies, involving participants from both the AI and protein engineering communities across academia and industry, consistently validate the superiority of \textsc{ProteinEngine} in augmenting the reliability and precision of deep learning in protein engineering tasks. Consequently, our findings highlight the potential of \textsc{ProteinEngine} to bride the disconnected tools for future research in the protein engineering domain.


title: ControlMol: Adding Substruture Control To Molecule Diffusion Models

abstract: Designing new molecules is an important task in the field of pharmaceuticals. Due to the vast design space of molecules, generating molecules conditioned on a specific sub-structure relevant to a particular function or therapeutic target is a crucial task in computer-aided drug design. In this paper, we present ControlMol, which adds sub-structure control to molecule generation with diffusion models. Unlike previous methods which view this task as inpainting or conditional generation, we adopt the idea of ControlNet into conditional molecule generation and make adaptive adjustments to a pre-trained diffusion model. We apply our method to both 2D and 3D molecule generation tasks. Conditioned on randomly partitioned sub-structure data, our method outperforms previous methods by generating more valid and diverse molecules. The method is easy to implement and can be quickly applied to a variety of pre-trained molecule generation models.


title: AI and Machine Learning for Next Generation Science Assessments

abstract: This chapter focuses on the transformative role of Artificial Intelligence (AI) and Machine Learning (ML) in science assessments. The paper begins with a discussion of the Framework for K-12 Science Education, which calls for a shift from conceptual learning to knowledge-in-use. This shift necessitates the development of new types of assessments that align with the Framework's three dimensions: science and engineering practices, disciplinary core ideas, and crosscutting concepts. The paper further highlights the limitations of traditional assessment methods like multiple-choice questions, which often fail to capture the complexities of scientific thinking and three-dimensional learning in science. It emphasizes the need for performance-based assessments that require students to engage in scientific practices like modeling, explanation, and argumentation. The paper achieves three major goals: reviewing the current state of ML-based assessments in science education, introducing a framework for scoring accuracy in ML-based automatic assessments, and discussing future directions and challenges. It delves into the evolution of ML-based automatic scoring systems, discussing various types of ML, like supervised, unsupervised, and semi-supervised learning. These systems can provide timely and objective feedback, thus alleviating the burden on teachers. The paper concludes by exploring pre-trained models like BERT and finetuned ChatGPT, which have shown promise in assessing students' written responses effectively.


title: On the image of the total power operation for Burnside rings

abstract: We prove that the image of the total power operation for Burnside rings $A(G) \to A(G\wr\Sigma_n)$ lies inside a relatively small, combinatorial subring $\mathring A(G,n) \subseteq A(G \wr \Sigma_n)$. As $n$ varies, the subrings $\mathring A(G,n)$ assemble into a commutative graded ring $\mathring A(G)$ with a universal property: $\mathring A(G)$ carries the universal family of power operations out of $A(G)$. We construct character maps for $\mathring A(G,n)$ and give a formula for the character of the total power operation. Using $\mathring A(G)$, we extend the Frobenius--Wielandt homomorphism of Dress--Siebeneicher--Yoshida to wreath products compatibly with the total power operation. Finally, we prove a generalization of Burnside's orbit counting lemma that describes the transfer map $A(G \wr \Sigma_n) \to A(\Sigma_n)$ on the subring $\mathring A(G,n)$.


title: Language Interaction Network for Clinical Trial Approval Estimation

abstract: Clinical trial outcome prediction seeks to estimate the likelihood that a clinical trial will successfully reach its intended endpoint. This process predominantly involves the development of machine learning models that utilize a variety of data sources such as descriptions of the clinical trials, characteristics of the drug molecules, and specific disease conditions being targeted. Accurate predictions of trial outcomes are crucial for optimizing trial planning and prioritizing investments in a drug portfolio. While previous research has largely concentrated on small-molecule drugs, there is a growing need to focus on biologics-a rapidly expanding category of therapeutic agents that often lack the well-defined molecular properties associated with traditional drugs. Additionally, applying conventional methods like graph neural networks to biologics data proves challenging due to their complex nature. To address these challenges, we introduce the Language Interaction Network (LINT), a novel approach that predicts trial outcomes using only the free-text descriptions of the trials. We have rigorously tested the effectiveness of LINT across three phases of clinical trials, where it achieved ROC-AUC scores of 0.770, 0.740, and 0.748 for phases I, II, and III, respectively, specifically concerning trials involving biologic interventions.


title: Protein Representation Learning by Capturing Protein Sequence-Structure-Function Relationship

abstract: The goal of protein representation learning is to extract knowledge from protein databases that can be applied to various protein-related downstream tasks. Although protein sequence, structure, and function are the three key modalities for a comprehensive understanding of proteins, existing methods for protein representation learning have utilized only one or two of these modalities due to the difficulty of capturing the asymmetric interrelationships between them. To account for this asymmetry, we introduce our novel asymmetric multi-modal masked autoencoder (AMMA). AMMA adopts (1) a unified multi-modal encoder to integrate all three modalities into a unified representation space and (2) asymmetric decoders to ensure that sequence latent features reflect structural and functional information. The experiments demonstrate that the proposed AMMA is highly effective in learning protein representations that exhibit well-aligned inter-modal relationships, which in turn makes it effective for various downstream protein-related tasks.


title: A categorical account of composition methods in logic (extended version)

abstract: We present a categorical theory of the composition methods in finite model theory -- a key technique enabling modular reasoning about complex structures by building them out of simpler components. The crucial results required by the composition methods are Feferman--Vaught--Mostowski (FVM) type theorems, which characterize how logical equivalence behaves under composition and transformation of models. Our results are developed by extending the recently introduced game comonad semantics for model comparison games. This level of abstraction allow us to give conditions yielding FVM type results in a uniform way. Our theorems are parametric in the classes of models, logics and operations involved. Furthermore, they naturally account for the existential and positive existential fragments, and extensions with counting quantifiers of these logics. We also reveal surprising connections between FVM type theorems, and classical concepts in the theory of monads. We illustrate our methods by recovering many classical theorems of practical interest, including a refinement of a previous result by Dawar, Severini, and Zapata concerning the 3-variable counting logic and cospectrality. To highlight the importance of our techniques being parametric in the logic of interest, we prove a family of FVM theorems for products of structures, uniformly in the logic in question, which cannot be done using specific game arguments. This is an extended version of the LiCS 2023 conference paper of the same name.


title: Enhancing Language Models for Financial Relation Extraction with Named Entities and Part-of-Speech

abstract: The Financial Relation Extraction (FinRE) task involves identifying the entities and their relation, given a piece of financial statement/text. To solve this FinRE problem, we propose a simple but effective strategy that improves the performance of pre-trained language models by augmenting them with Named Entity Recognition (NER) and Part-Of-Speech (POS), as well as different approaches to combine these information. Experiments on a financial relations dataset show promising results and highlights the benefits of incorporating NER and POS in existing models. Our dataset and codes are available at https://github.com/kwanhui/FinRelExtract.


title: Phenomenological Simulation of Quantum Systems

abstract: This paper describes an algorithmic system called SQT for the computer simulation of a wide class of quantum experiments on entangled particles. SQT provides an initialization process and measurement processes with visual outputs and a means of connecting these in software to make the simulator for a given experiment in Quantum Mechanics. The statistical behavior of the Quantum Mechanical system is replicated by incorporating the probabilities that are observed in real world quantum experiments. SQT is thus a tool to provide educational understanding of quantum systems and this tool removes the mystery surrounding entangled particles. It shows that only initial measurement probabilities and conditional probabilities of transition from the previous state and no earlier to the next state are sufficient inputs for the simulator to replicate all Quantum Mechanical experiments in the simulator and no complex numbers must be entered into the simulator. The simulator, unlike the real world quantum system, can display the hidden sub-quantum state after which it can be seen that there is no spooky interaction between entangled particles at all. SQT therefore provides a new interpretation of quantum phenomena that may well replace the Copenhagen interpretation founded by Niels Bohr and it answers Einsteins final question regarding whether Quantum Mechanics can be considered a complete theory or not.


title: Sentiment Polarity Analysis of Bangla Food Reviews Using Machine and Deep Learning Algorithms

abstract: The Internet has become an essential tool for people in the modern world. Humans, like all living organisms, have essential requirements for survival. These include access to atmospheric oxygen, potable water, protective shelter, and sustenance. The constant flux of the world is making our existence less complicated. A significant portion of the population utilizes online food ordering services to have meals delivered to their residences. Although there are numerous methods for ordering food, customers sometimes experience disappointment with the food they receive. Our endeavor was to establish a model that could determine if food is of good or poor quality. We compiled an extensive dataset of over 1484 online reviews from prominent food ordering platforms, including Food Panda and HungryNaki. Leveraging the collected data, a rigorous assessment of various deep learning and machine learning techniques was performed to determine the most accurate approach for predicting food quality. Out of all the algorithms evaluated, logistic regression emerged as the most accurate, achieving an impressive 90.91% accuracy. The review offers valuable insights that will guide the user in deciding whether or not to order the food.


title: Exposing and Explaining Fake News On-the-Fly

abstract: Social media platforms enable the rapid dissemination and consumption of information. However, users instantly consume such content regardless of the reliability of the shared data. Consequently, the latter crowdsourcing model is exposed to manipulation. This work contributes with an explainable and online classification method to recognize fake news in real-time. The proposed method combines both unsupervised and supervised Machine Learning approaches with online created lexica. The profiling is built using creator-, content- and context-based features using Natural Language Processing techniques. The explainable classification mechanism displays in a dashboard the features selected for classification and the prediction confidence. The performance of the proposed solution has been validated with real data sets from Twitter and the results attain 80 % accuracy and macro F-measure. This proposal is the first to jointly provide data stream processing, profiling, classification and explainability. Ultimately, the proposed early detection, isolation and explanation of fake news contribute to increase the quality and trustworthiness of social media contents.


title: Instruction-Guided Bullet Point Summarization of Long Financial Earnings Call Transcripts

abstract: While automatic summarization techniques have made significant advancements, their primary focus has been on summarizing short news articles or documents that have clear structural patterns like scientific articles or government reports. There has not been much exploration into developing efficient methods for summarizing financial documents, which often contain complex facts and figures. Here, we study the problem of bullet point summarization of long Earning Call Transcripts (ECTs) using the recently released ECTSum dataset. We leverage an unsupervised question-based extractive module followed by a parameter efficient instruction-tuned abstractive module to solve this task. Our proposed model FLAN-FinBPS achieves new state-of-the-art performances outperforming the strongest baseline with 14.88% average ROUGE score gain, and is capable of generating factually consistent bullet point summaries that capture the important facts discussed in the ECTs.


title: TLINet: Differentiable Neural Network Temporal Logic Inference

abstract: There has been a growing interest in extracting formal descriptions of the system behaviors from data. Signal Temporal Logic (STL) is an expressive formal language used to describe spatial-temporal properties with interpretability. This paper introduces TLINet, a neural-symbolic framework for learning STL formulas. The computation in TLINet is differentiable, enabling the usage of off-the-shelf gradient-based tools during the learning process. In contrast to existing approaches, we introduce approximation methods for max operator designed specifically for temporal logic-based gradient techniques, ensuring the correctness of STL satisfaction evaluation. Our framework not only learns the structure but also the parameters of STL formulas, allowing flexible combinations of operators and various logical structures. We validate TLINet against state-of-the-art baselines, demonstrating that our approach outperforms these baselines in terms of interpretability, compactness, rich expressibility, and computational efficiency.


title: Parameter-Efficient Instruction Tuning of Large Language Models For Extreme Financial Numeral Labelling

abstract: We study the problem of automatically annotating relevant numerals (GAAP metrics) occurring in the financial documents with their corresponding XBRL tags. Different from prior works, we investigate the feasibility of solving this extreme classification problem using a generative paradigm through instruction tuning of Large Language Models (LLMs). To this end, we leverage metric metadata information to frame our target outputs while proposing a parameter efficient solution for the task using LoRA. We perform experiments on two recently released financial numeric labeling datasets. Our proposed model, FLAN-FinXC, achieves new state-of-the-art performances on both the datasets, outperforming several strong baselines. We explain the better scores of our proposed model by demonstrating its capability for zero-shot as well as the least frequently occurring tags. Also, even when we fail to predict the XBRL tags correctly, our generated output has substantial overlap with the ground-truth in majority of the cases.


title: Liouville Flow Importance Sampler

abstract: We present the Liouville Flow Importance Sampler (LFIS), an innovative flow-based model for generating samples from unnormalized density functions. LFIS learns a time-dependent velocity field that deterministically transports samples from a simple initial distribution to a complex target distribution, guided by a prescribed path of annealed distributions. The training of LFIS utilizes a unique method that enforces the structure of a derived partial differential equation to neural networks modeling velocity fields. By considering the neural velocity field as an importance sampler, sample weights can be computed through accumulating errors along the sample trajectories driven by neural velocity fields, ensuring unbiased and consistent estimation of statistical quantities. We demonstrate the effectiveness of LFIS through its application to a range of benchmark problems, on many of which LFIS achieved state-of-the-art performance.

categories: stat.ML cs.LG math.PR physics.data-an stat.CO


title: Overview of the EHRSQL 2024 Shared Task on Reliable Text-to-SQL Modeling on Electronic Health Records

abstract: Electronic Health Records (EHRs) are relational databases that store the entire medical histories of patients within hospitals. They record numerous aspects of patients' medical care, from hospital admission and diagnosis to treatment and discharge. While EHRs are vital sources of clinical data, exploring them beyond a predefined set of queries requires skills in query languages like SQL. To make information retrieval more accessible, one strategy is to build a question-answering system, possibly leveraging text-to-SQL models that can automatically translate natural language questions into corresponding SQL queries and use these queries to retrieve the answers. The EHRSQL 2024 shared task aims to advance and promote research in developing a question-answering system for EHRs using text-to-SQL modeling, capable of reliably providing requested answers to various healthcare professionals to improve their clinical work processes and satisfy their needs. Among more than 100 participants who applied to the shared task, eight teams were formed and completed the entire shared task requirement and demonstrated a wide range of methods to effectively solve this task. In this paper, we describe the task of reliable text-to-SQL modeling, the dataset, and the methods and results of the participants. We hope this shared task will spur further research and insights into developing reliable question-answering systems for EHRs.


title: Open-SQL Framework: Enhancing Text-to-SQL on Open-source Large Language Models

abstract: Despite the success of large language models (LLMs) in Text-to-SQL tasks, open-source LLMs encounter challenges in contextual understanding and response coherence. To tackle these issues, we present \ours, a systematic methodology tailored for Text-to-SQL with open-source LLMs. Our contributions include a comprehensive evaluation of open-source LLMs in Text-to-SQL tasks, the \openprompt strategy for effective question representation, and novel strategies for supervised fine-tuning. We explore the benefits of Chain-of-Thought in step-by-step inference and propose the \openexample method for enhanced few-shot learning. Additionally, we introduce token-efficient techniques, such as \textbf{Variable-length Open DB Schema}, \textbf{Target Column Truncation}, and \textbf{Example Column Truncation}, addressing challenges in large-scale databases. Our findings emphasize the need for further investigation into the impact of supervised fine-tuning on contextual learning capabilities. Remarkably, our method significantly improved Llama2-7B from 2.54\% to 41.04\% and Code Llama-7B from 14.54\% to 48.24\% on the BIRD-Dev dataset. Notably, the performance of Code Llama-7B surpassed GPT-4 (46.35\%) on the BIRD-Dev dataset.


title: A note on hidden classes in spinor classification

abstract: The Lounesto classification is a well-established scheme for categorizing spinors based on their physical content, which are determined by their associated bilinear forms. It consists of six disjoint classes encompassing the known spinors within the context of the standard model of high-energy physics. However, advancements in theories beyond the standard model have opened the door to potential new spinorial adjoint structures, leading to new unforeseen classess. These developments indicate the potential for extending the standard Lounesto classification. In this paper, we explore all possible subclasses that could extend the Lounesto scheme. We highlight the most relevant subclasses by imposing constraints to their corresponding dual structures, thus broadening our understanding of spinor and its applications in theoretical physics.


title: EDA Corpus: A Large Language Model Dataset for Enhanced Interaction with OpenROAD

abstract: Large language models (LLMs) serve as powerful tools for design, providing capabilities for both task automation and design assistance. Recent advancements have shown tremendous potential for facilitating LLM integration into the chip design process; however, many of these works rely on data that are not publicly available and/or not permissively licensed for use in LLM training and distribution. In this paper, we present a solution aimed at bridging this gap by introducing an open-source dataset tailored for OpenROAD, a widely adopted open-source EDA toolchain. The dataset features over 1000 data points and is structured in two formats: (i) a pairwise set comprised of question prompts with prose answers, and (ii) a pairwise set comprised of code prompts and their corresponding OpenROAD scripts. By providing this dataset, we aim to facilitate LLM-focused research within the EDA domain. The dataset is available at https://github.com/OpenROAD-Assistant/EDA-Corpus.


title: ATG: Benchmarking Automated Theorem Generation for Generative Language Models

abstract: Humans can develop new theorems to explore broader and more complex mathematical results. While current generative language models (LMs) have achieved significant improvement in automatically proving theorems, their ability to generate new or reusable theorems is still under-explored. Without the new theorems, current LMs struggle to prove harder theorems that are distant from the given hypotheses with the exponentially growing search space. Therefore, this paper proposes an Automated Theorem Generation (ATG) benchmark that evaluates whether an agent can automatically generate valuable (and possibly brand new) theorems that are applicable for downstream theorem proving as reusable knowledge. Specifically, we construct the ATG benchmark by splitting the Metamath library into three sets: axioms, library, and problem based on their proving depth. We conduct extensive experiments to investigate whether current LMs can generate theorems in the library and benefit the problem theorems proving. The results demonstrate that high-quality ATG data facilitates models' performances on downstream ATP. However, there is still room for current LMs to develop better ATG and generate more advanced and human-like theorems. We hope the new ATG challenge can shed some light on advanced complex theorem proving.


title: Modularity of certain products of the Rogers-Ramanujan continued fraction

abstract: We study the modularity of the functions of the form $r(\tau)^ar(2\tau)^b$, where $a$ and $b$ are integers with $(a,b)\neq (0,0)$ and $r(\tau)$ is the Rogers-Ramanujan continued fraction, which may be considered as companions to the Ramanujan's function $k(\tau)=r(\tau)r(2\tau)^2$. In particular, we show that under some condition on $a$ and $b$, there are finitely many such functions generating the field of all modular functions on the congruence subgroup $\Gamma_1(10)$. Furthermore, we establish certain arithmetic properties of the function $l(\tau)=r(2\tau)/r(\tau)^2$, which can be used to evaluate these products. We employ the methods of Lee and Park, and some properties of $\eta$-quotients and generalized $\eta$-quotients to prove our results.


title: Complex Analytic Structure of Stationary Flows of an Ideal Incompressible Fluid

abstract: In this article we introduce the structure of an analytic Banach manifold in the set of stationary flows without stagnation points of the ideal incompressible fluid in a periodic 2-d channel bounded by the curves $y=f(x)$ and $y=g(x)$ where $f, g$ are periodic analytic functions. The work is based on the recent discovery (Serfati, Shnirelman, Frisch, and others) that for the stationary flows the level lines of the stream function (and hence the flow lines) are real-analytic curves. The set of such functions is not a linear subspace of any reasonable function space. However, we are able to introduce in this set a structure of a real-analytic Banach manifold if we regard its elements as collections of level lines parametrized by the function value. If $\psi(x,y)$ is the stream function, then the flow line has equation $y=a(x,\psi)$ where $a(\cdot,\cdot)$ is a "partially analytic" function. This means that this function is analytic in the first argument while it has a finite regularity in the second one. We define the spaces of analytic functions on the line, analogous to the Hardy space, and the spaces of partially analytic functions. The equation $\Delta\psi=F(\psi)$ is transformed into a quasilinear equation $\Phi(a)=F$ for the function $a(x,\psi)$. Using the Analytic Implicit Function Theorem in the complex Banach space, we are able to prove that for the functions $f(x), g(x)$ close to constant the solution $a(x,\psi; F, f, g)$ exists and depends analytically on parameters $F, f, g$.


title: Exploring the Compositional Deficiency of Large Language Models in Mathematical Reasoning

abstract: Human cognition exhibits systematic compositionality, the algebraic ability to generate infinite novel combinations from finite learned components, which is the key to understanding and reasoning about complex logic. In this work, we investigate the compositionality of large language models (LLMs) in mathematical reasoning. Specifically, we construct a new dataset \textsc{MathTrap}\footnotemark[3] by introducing carefully designed logical traps into the problem descriptions of MATH and GSM8k. Since problems with logical flaws are quite rare in the real world, these represent ``unseen'' cases to LLMs. Solving these requires the models to systematically compose (1) the mathematical knowledge involved in the original problems with (2) knowledge related to the introduced traps. Our experiments show that while LLMs possess both components of requisite knowledge, they do not \textbf{spontaneously} combine them to handle these novel cases. We explore several methods to mitigate this deficiency, such as natural language prompts, few-shot demonstrations, and fine-tuning. We find that LLMs' performance can be \textbf{passively} improved through the above external intervention. Overall, systematic compositionality remains an open challenge for large language models.


title: Leveraging Lecture Content for Improved Feedback: Explorations with GPT-4 and Retrieval Augmented Generation

abstract: This paper presents the use of Retrieval Augmented Generation (RAG) to improve the feedback generated by Large Language Models for programming tasks. For this purpose, corresponding lecture recordings were transcribed and made available to the Large Language Model GPT-4 as external knowledge source together with timestamps as metainformation by using RAG. The purpose of this is to prevent hallucinations and to enforce the use of the technical terms and phrases from the lecture. In an exercise platform developed to solve programming problems for an introductory programming lecture, students can request feedback on their solutions generated by GPT-4. For this task GPT-4 receives the students' code solution, the compiler output, the result of unit tests and the relevant passages from the lecture notes available through the use of RAG as additional context. The feedback generated by GPT-4 should guide students to solve problems independently and link to the lecture content, using the time stamps of the transcript as meta-information. In this way, the corresponding lecture videos can be viewed immediately at the corresponding positions. For the evaluation, students worked with the tool in a workshop and decided for each feedback whether it should be extended by RAG or not. First results based on a questionnaire and the collected usage data show that the use of RAG can improve feedback generation and is preferred by students in some situations. Due to the slower speed of feedback generation, the benefits are situation dependent.


title: Self-Reflection in LLM Agents: Effects on Problem-Solving Performance

abstract: In this study, we investigated the effects of self-reflection in large language models (LLMs) on problem-solving performance. We instructed nine popular LLMs to answer a series of multiple-choice questions to provide a performance baseline. For each incorrectly answered question, we instructed eight types of self-reflecting LLM agents to reflect on their mistakes and provide themselves with guidance to improve problem-solving. Then, using this guidance, each self-reflecting agent attempted to re-answer the same questions. Our results indicate that LLM agents are able to significantly improve their problem-solving performance through self-reflection ($p < 0.001$). In addition, we compared the various types of self-reflection to determine their individual contribution to performance. All code and data are available on GitHub at https://github.com/matthewrenze/self-reflection


title: ERAGent: Enhancing Retrieval-Augmented Language Models with Improved Accuracy, Efficiency, and Personalization

abstract: Retrieval-augmented generation (RAG) for language models significantly improves language understanding systems. The basic retrieval-then-read pipeline of response generation has evolved into a more extended process due to the integration of various components, sometimes even forming loop structures. Despite its advancements in improving response accuracy, challenges like poor retrieval quality for complex questions that require the search of multifaceted semantic information, inefficiencies in knowledge re-retrieval during long-term serving, and lack of personalized responses persist. Motivated by transcending these limitations, we introduce ERAGent, a cutting-edge framework that embodies an advancement in the RAG area. Our contribution is the introduction of the synergistically operated module: Enhanced Question Rewriter and Knowledge Filter, for better retrieval quality. Retrieval Trigger is incorporated to curtail extraneous external knowledge retrieval without sacrificing response quality. ERAGent also personalizes responses by incorporating a learned user profile. The efficiency and personalization characteristics of ERAGent are supported by the Experiential Learner module which makes the AI assistant being capable of expanding its knowledge and modeling user profile incrementally. Rigorous evaluations across six datasets and three question-answering tasks prove ERAGent's superior accuracy, efficiency, and personalization, emphasizing its potential to advance the RAG field and its applicability in practical systems.


title: QuakeBERT: Accurate Classification of Social Media Texts for Rapid Earthquake Impact Assessment

abstract: Social media aids disaster response but suffers from noise, hindering accurate impact assessment and decision making for resilient cities, which few studies considered. To address the problem, this study proposes the first domain-specific LLM model and an integrated method for rapid earthquake impact assessment. First, a few categories are introduced to classify and filter microblogs considering their relationship to the physical and social impacts of earthquakes, and a dataset comprising 7282 earthquake-related microblogs from twenty earthquakes in different locations is developed as well. Then, with a systematic analysis of various influential factors, QuakeBERT, a domain-specific large language model (LLM), is developed and fine-tuned for accurate classification and filtering of microblogs. Meanwhile, an integrated method integrating public opinion trend analysis, sentiment analysis, and keyword-based physical impact quantification is introduced to assess both the physical and social impacts of earthquakes based on social media texts. Experiments show that data diversity and data volume dominate the performance of QuakeBERT and increase the macro average F1 score by 27%, while the best classification model QuakeBERT outperforms the CNN- or RNN-based models by improving the macro average F1 score from 60.87% to 84.33%. Finally, the proposed approach is applied to assess two earthquakes with the same magnitude and focal depth. Results show that the proposed approach can effectively enhance the impact assessment process by accurate detection of noisy microblogs, which enables effective post-disaster emergency responses to create more resilient cities.


title: Multigenre AI-powered Story Composition

abstract: This paper shows how to construct genre patterns, whose purpose is to guide interactive story composition in a way that enforces thematic consistency. To start the discussion we argue, based on previous seminal works, for the existence of five fundamental genres, namely comedy, romance - in the sense of epic plots, flourishing since the twelfth century -, tragedy, satire, and mystery. To construct the patterns, a simple two-phase process is employed: first retrieving examples that match our genre characterizations, and then applying a form of most specific generalization to the groups of examples in order to find their commonalities. In both phases, AI agents are instrumental, with our PatternTeller prototype being called to operate the story composition process, offering the opportunity to generate stories from a given premise of the user, to be developed under the guidance of the chosen pattern and trying to accommodate the user's suggestions along the composition stages.


title: Word2World: Generating Stories and Worlds through Large Language Models

abstract: Large Language Models (LLMs) have proven their worth across a diverse spectrum of disciplines. LLMs have shown great potential in Procedural Content Generation (PCG) as well, but directly generating a level through a pre-trained LLM is still challenging. This work introduces Word2World, a system that enables LLMs to procedurally design playable games through stories, without any task-specific fine-tuning. Word2World leverages the abilities of LLMs to create diverse content and extract information. Combining these abilities, LLMs can create a story for the game, design narrative, and place tiles in appropriate places to create coherent worlds and playable games. We test Word2World with different LLMs and perform a thorough ablation study to validate each step. We open-source the code at https://github.com/umair-nasir14/Word2World.


title: Hire Me or Not? Examining Language Model's Behavior with Occupation Attributes

abstract: With the impressive performance in various downstream tasks, large language models (LLMs) have been widely integrated into production pipelines, like recruitment and recommendation systems. A known issue of models trained on natural language data is the presence of human biases, which can impact the fairness of the system. This paper investigates LLMs' behavior with respect to gender stereotypes, in the context of occupation decision making. Our framework is designed to investigate and quantify the presence of gender stereotypes in LLMs' behavior via multi-round question answering. Inspired by prior works, we construct a dataset by leveraging a standard occupation classification knowledge base released by authoritative agencies. We tested three LLMs (RoBERTa-large, GPT-3.5-turbo, and Llama2-70b-chat) and found that all models exhibit gender stereotypes analogous to human biases, but with different preferences. The distinct preferences of GPT-3.5-turbo and Llama2-70b-chat may imply the current alignment methods are insufficient for debiasing and could introduce new biases contradicting the traditional gender stereotypes.


title: Learning the local density of states of a bilayer moir\'e material in one dimension

abstract: Recent work of three of the authors showed that the operator which maps the local density of states of a one-dimensional untwisted bilayer material to the local density of states of the same bilayer material at non-zero twist, known as the twist operator, can be learned by a neural network. In this work, we first provide a mathematical formulation of that work, making the relevant models and operator learning problem precise. We then prove that the operator learning problem is well-posed for a family of one-dimensional models. To do this, we first prove existence and regularity of the twist operator by solving an inverse problem. We then invoke the universal approximation theorem for operators to prove existence of a neural network capable of approximating the twist operator.