title: Dominant 1/3-filling Correlated Insulator States and Orbital Geometric Frustration in Twisted Bilayer Graphene

abstract: Geometric frustration is a phenomenon in a lattice system where not all interactions can be satisfied, the simplest example being antiferromagnetically coupled spins on a triangular lattice. Frustrated systems are characterized by their many nearly degenerate ground states, leading to non-trivial phases such as spin ice and spin liquids. To date most studies are on geometric frustration of spins; much less explored is orbital geometric frustration. For electrons in twisted bilayer graphene (tBLG) at denominator 3 fractional filling, Coulomb interactions and the Wannier orbital shapes are predicted to strongly constrain spatial charge ordering, leading to geometrically frustrated ground states that produce a new class of correlated insulators (CIs). Here we report the observation of dominant denominator 3 fractional filling insulating states in large angle tBLG; these states persist in magnetic fields and display magnetic ordering signatures and tripled unit cell reconstruction. These results are in agreement with a strong-coupling theory of symmetry-breaking of geometrically frustrated fractional states.


title: Localised Natural Causal Learning Algorithms for Weak Consistency Conditions

abstract: By relaxing conditions for natural structure learning algorithms, a family of constraint-based algorithms containing all exact structure learning algorithms under the faithfulness assumption, we define localised natural structure learning algorithms (LoNS). We also provide a set of necessary and sufficient assumptions for consistency of LoNS, which can be thought of as a strict relaxation of the restricted faithfulness assumption. We provide a practical LoNS algorithm that runs in exponential time, which is then compared with related existing structure learning algorithms, namely PC/SGS and the relatively recent sparsest permutation algorithm. Simulation studies are also provided.


title: ESE: Espresso Sentence Embeddings

abstract: High-quality sentence embeddings are fundamental in many natural language processing (NLP) tasks, such as semantic textual similarity (STS) and retrieval-augmented generation (RAG). Nevertheless, most existing methods leverage fixed-length embeddings from full-layer language models, which lack the scalability to accommodate the diverse available resources across various applications. Viewing this gap, we propose a novel sentence embedding model $\mathrm{Espresso}$ $\mathrm{Sentence}$ $\mathrm{Embeddings}$ (ESE) with two learning processes. First, the learn-to-express process encodes more salient representations to lower layers. Second, the learn-to-compress process compacts essential features into the initial dimensions using Principal Component Analysis (PCA). This way, ESE can scale model depth via the former process and embedding size via the latter. Extensive experiments on STS and RAG suggest that ESE can effectively produce high-quality embeddings with less model depth and embedding size, enhancing embedding inference efficiency.


title: Causal Imputation for Counterfactual SCMs: Bridging Graphs and Latent Factor Models

abstract: We consider the task of causal imputation, where we aim to predict the outcomes of some set of actions across a wide range of possible contexts. As a running example, we consider predicting how different drugs affect cells from different cell types. We study the index-only setting, where the actions and contexts are categorical variables with a finite number of possible values. Even in this simple setting, a practical challenge arises, since often only a small subset of possible action-context pairs have been studied. Thus, models must extrapolate to novel action-context pairs, which can be framed as a form of matrix completion with rows indexed by actions, columns indexed by contexts, and matrix entries corresponding to outcomes. We introduce a novel SCM-based model class, where the outcome is expressed as a counterfactual, actions are expressed as interventions on an instrumental variable, and contexts are defined based on the initial state of the system. We show that, under a linearity assumption, this setup induces a latent factor model over the matrix of outcomes, with an additional fixed effect term. To perform causal prediction based on this model class, we introduce simple extension to the Synthetic Interventions estimator (Agarwal et al., 2020). We evaluate several matrix completion approaches on the PRISM drug repurposing dataset, showing that our method outperforms all other considered matrix completion approaches.


title: Zero-shot cross-lingual transfer in instruction tuning of large language models

abstract: Instruction tuning (IT) is widely used to teach pretrained large language models (LLMs) to follow arbitrary instructions, but is under-studied in multilingual settings. In this work, we conduct a systematic study of zero-shot cross-lingual transfer in IT, when an LLM is instruction-tuned on English-only data and then tested on user prompts in other languages. We advocate for the importance of evaluating various aspects of model responses in multilingual instruction following and investigate the influence of different model configuration choices. We find that cross-lingual transfer does happen successfully in IT even if all stages of model training are English-centric, but only if multiliguality is taken into account in hyperparameter tuning and with large enough IT data. English-trained LLMs are capable of generating correct-language, comprehensive and helpful responses in other languages, but suffer from low factuality and may occasionally have fluency errors.


title: Measure contraction property and curvature-dimension condition on sub-Finsler Heisenberg groups

abstract: In this paper, we investigate the validity of synthetic curvature-dimension bounds in the sub-Finsler Heisenberg group, equipped with a positive smooth measure. Firstly, we study the measure contraction property, in short $\mathsf{MCP}$, proving that its validity depends on the norm generating the sub-Finsler structure. Indeed, we show that, if it is neither $C^1$ nor strongly convex, the associated Heisenberg group does not satisfy $\mathsf{MCP}(K,N)$ for any pair of parameters $K \in \mathbb{R}$ and $N \in (1,\infty)$. On the contrary, we prove that the sub-Finsler Heisenberg group, equipped with a $C^{1,1}$ and strongly convex norm, and with the Lebesgue measure, satisfies $\mathsf{MCP}(0,N)$ for some $N \in (1,\infty)$. Additionally, we provide a lower bound on the optimal dimensional parameter, and we also study the case of $C^1$ and strongly convex norms. Secondly, we address the validity of the curvature-dimension condition pioneered by Sturm and Lott-Villani, in short $\mathsf{CD}(K,N)$. We show that the sub-Finsler Heisenberg group, equipped with a $C^1$ and strongly convex norm, and with a positive smooth measure, does not satisfy the $\mathsf{MCP}(K,N)$ condition for any pair of parameters $K \in \mathbb{R}$ and $N \in (1,\infty)$. Combining this result with our findings regarding the measure contraction property, we conclude the failure of the $\mathsf{CD}$ condition in the Heisenberg group for every sub-Finsler structure.


title: Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Models

abstract: Image customization has been extensively studied in text-to-image (T2I) diffusion models, leading to impressive outcomes and applications. With the emergence of text-to-video (T2V) diffusion models, its temporal counterpart, motion customization, has not yet been well investigated. To address the challenge of one-shot motion customization, we propose Customize-A-Video that models the motion from a single reference video and adapting it to new subjects and scenes with both spatial and temporal varieties. It leverages low-rank adaptation (LoRA) on temporal attention layers to tailor the pre-trained T2V diffusion model for specific motion modeling from the reference videos. To disentangle the spatial and temporal information during the training pipeline, we introduce a novel concept of appearance absorbers that detach the original appearance from the single reference video prior to motion learning. Our proposed method can be easily extended to various downstream tasks, including custom video generation and editing, video appearance customization, and multiple motion combination, in a plug-and-play fashion. Our project page can be found at https://anonymous-314.github.io.


title: Rao-Blackwellising Bayesian Causal Inference

abstract: Bayesian causal inference, i.e., inferring a posterior over causal models for the use in downstream causal reasoning tasks, poses a hard computational inference problem that is little explored in literature. In this work, we combine techniques from order-based MCMC structure learning with recent advances in gradient-based graph learning into an effective Bayesian causal inference framework. Specifically, we decompose the problem of inferring the causal structure into (i) inferring a topological order over variables and (ii) inferring the parent sets for each variable. When limiting the number of parents per variable, we can exactly marginalise over the parent sets in polynomial time. We further use Gaussian processes to model the unknown causal mechanisms, which also allows their exact marginalisation. This introduces a Rao-Blackwellization scheme, where all components are eliminated from the model, except for the causal order, for which we learn a distribution via gradient-based optimisation. The combination of Rao-Blackwellization with our sequential inference procedure for causal orders yields state-of-the-art on linear and non-linear additive noise benchmarks with scale-free and Erdos-Renyi graph structures.


title: Antisymmetric galaxy cross-correlations in and beyond $\Lambda$CDM

abstract: Many different techniques to analyze galaxy clustering data and obtain cosmological constraints have been proposed, tested and used. Given the large amount of data that will be available soon, it is worth investigating new observables and ways to extract information from such datasets. In this paper, we focus on antisymmetric correlations, that arise in the cross-correlation of different galaxy populations when the small-scale power spectrum is modulated by a long-wavelength field. In $\Lambda$CDM this happens because of nonlinear clustering of sources that trace the underlying matter distribution in different ways. Beyond the standard model, this observable is sourced naturally in various new physics scenarios. We derive, for the first time, its complete expression up to second order in redshift space, and show that this improves detectability compared to previous evaluations at first order in real space. Moreover, we explore a few potential applications to use this observable to detect models with vector modes, or where different types of sources respond in different ways to the underlying modulating long mode, and anisotropic models with privileged directions in the sky. This shows how antisymmetric correlations can be a useful tool for testing exotic cosmological models.


title: Solar Power Generation Profile Estimation for Lunar Surface Solar PV Systems

abstract: As NASA prepares to carry out its Artemis lunar missions, the design and planning of robust power systems tailored to the lunar environment become necessary and urgent. Solar photovoltaic (PV) systems are among the most suitable power generators for lunar applications given the abundant solar irradiance the lunar surface receives as a result of the lack of an atmosphere. However, the vastly different environmental conditions of the moon compared to those on Earth call for special reconsiderations to the traditional PV power output models used for terrestrial applications. The substantially wider range of temperatures on the moon combined with the absence of atmosphere implies the PV will operate at very different thermal conditions. Therefore, this paper proposes a PV power output model that determines PV cell temperature on the lunar surface based on lunar ambient temperature as well as solar irradiance, while also capturing these special lunar conditions. The model is based on thermal exchange via the three main heat transfer paths: heat radiation, absorption, and convection. Moreover, four different array configurations are presented and compared to determine the most suitable choice based on energy generation and complexity for different locations around the moon.


title: Automated chemical reaction network generation and its application to exoplanet atmospheres

abstract: With the advent of JWST and spectroscopic characterization of exoplanet atmospheres with unprecedented detail, there is a demand for a more complete picture of chemical and photochemical reactions and their impact on atmospheric composition. Traditionally, building reaction networks for (exo)planetary atmospheres involves manually tracking relevant species and reactions, a time-consuming and error-prone process. This approach's applicability is also often limited to specific conditions, making it less versatile for different planetary types. (i.e., photochemical networks for Jupiters may not be directly applicable to water-rich exoplanets). We introduce an automated approach using a computer-aided chemical reaction network generator, combined with a one-dimensional photochemical kinetic-transport model, offering significant advantages. This approach automatically selects reaction rates through a rate-based iterative algorithm and refinement steps, enhancing model reliability. Also, this approach allows for the efficient simulation of diverse chemical environments, from hydrogen to water, carbon dioxide, and nitrogen-dominated atmospheres. Using WASP-39b and WASP-80b as examples, we demonstrate our approach's effectiveness. Our WASP-39b model aligns with prior studies and JWST observations, capturing photochemically produced sulfur dioxide. The WASP-80b model reveals an atmosphere influenced by deep interior thermochemistry and vertical mixing, consistent with JWST NIRCam observations. Furthermore, our model identifies a novel initial step for the N2-NH3-HCN pathway that enhances the conversion efficiency in high-temperature/pressure environments. This automated chemical network generation offers a novel, efficient, and precise framework for studying exoplanetary atmospheres, marking a significant advancement over traditional modeling techniques.


title: Path integral and conformal instability in nonlocal quantum gravity

abstract: We introduce the Lorentzian path integral of nonlocal quantum gravity. After introducing the functional measure, the Faddeev--Popov sector, and the field correlators, we move to perturbation theory and describe Efimov analytic continuation of scattering amplitudes to Euclidean momenta and back to Lorentzian. We show that the conformal instability problem in the Euclidean path integral is solved by suitable gauge choices at the perturbative level. The four examples of Einstein gravity, Stelle gravity, minimally coupled nonlocal quantum gravity, and nonminimally coupled nonlocal quantum gravity are given.


title: Exclusion bounds for neutral gauge bosons

abstract: We study how the recent experimental results constrain the gauge sectors of U(1) extensions of the standard model using a novel representation of the parameter space. We determine the bounds on the mixing angle between the massive gauge bosons, or equivalently, the new gauge coupling as a function of the mass $M_{Z'}$ of the new neutral gauge boson $Z'$ in the approximate range $(10^{-2},10^4)\,$GeV/$c^2$. We consider the most stringent bounds obtained from direct searches for the $Z'$. We also exhibit the allowed parameter space by comparing the predicted and measured values of the $\rho$ parameter and those of the mass of the $W$ boson. Finally, we discuss the prospects of $Z'$ searches at future colliders.


title: Landau Singularities from Whitney Stratifications

abstract: We demonstrate that the complete and non-redundant set of Landau singularities of Feynman integrals may be explicitly obtained from the Whitney stratification of an algebraic map. As a proof of concept, we leverage recent theoretical and algorithmic advances in their computation, as well as their software implementation, in order to determine this set for several nontrivial examples of two-loop integrals. Interestingly, different strata of the Whitney stratification describe not only the singularities of a given integral, but also those of integrals obtained from kinematic limits, e.g.~by setting some of its masses or momenta to zero.


title: Expectation Values of Conserved Charges in Integrable Quantum Field Theories out of Thermal Equilibrium

abstract: In this work we present a computation of the averages of conserved charge densities and currents of (1+1)-dimensional Integrable Quantum Field Theories in Generalised Gibbs Ensembles. Our approach is based on the quasi-particle description provided by the Thermodynamic Bethe Ansatz combined with the principles of Generalised Hydrodynamics, and we focus on Non-Equilibrium Steady State averages. When considering the ultraviolet (i.e. high temperature) limit of such averages, we recover the famous result by Bernard and Doyon (2012) for the energy current and density in Conformal Field Theories, and we extend it to conserved quantities with spin $s > 1$. We show that their averages are proportional to $T_L^{s+1}\pm T_R^{s+1}$, with $T_L$, $T_R$ the temperatures of two asymptotic thermal reservoirs. The same power law is obtained when considering some non-thermal generalised Gibbs states. In Conformal Field Theory, the power law is a consequence of the transformation properties of conserved charge operators, while the proportionality coefficient depends on the spin of the operator and on the central charge of the theory. We present an exact analytic expression for this coefficient in the case of a massive free fermion. At equilibrium, proportionality of spin-$s$ density averages to $T^{s+1}$ can be thought of as a generalisation of Stefan-Boltzmann's law, which states that the energy per unit surface area radiated by a black body scales as $T^4$.


title: Self-Guided Masked Autoencoders for Domain-Agnostic Self-Supervised Learning

abstract: Self-supervised learning excels in learning representations from large amounts of unlabeled data, demonstrating success across multiple data modalities. Yet, extending self-supervised learning to new modalities is non-trivial because the specifics of existing methods are tailored to each domain, such as domain-specific augmentations which reflect the invariances in the target task. While masked modeling is promising as a domain-agnostic framework for self-supervised learning because it does not rely on input augmentations, its mask sampling procedure remains domain-specific. We present Self-guided Masked Autoencoders (SMA), a fully domain-agnostic masked modeling method. SMA trains an attention based model using a masked modeling objective, by learning masks to sample without any domain-specific assumptions. We evaluate SMA on three self-supervised learning benchmarks in protein biology, chemical property prediction, and particle physics. We find SMA is capable of learning representations without domain-specific knowledge and achieves state-of-the-art performance on these three benchmarks.


title: Measure structured deformations

abstract: Measure structured deformations are introduced to present a unified theory of deformations of continua. The energy associated with a measure structured deformation is defined via relaxation departing either from energies associated with classical deformations or from energies associated with structured deformations. A concise integral representation of the energy functional is provided both in the unconstrained case and under Dirichlet conditions on a part of the boundary.


title: Amplified Amplitude Estimation: Exploiting Prior Knowledge to Improve Estimates of Expectation Values

abstract: We provide a method for estimating the expectation value of an operator that can utilize prior knowledge to accelerate the learning process on a quantum computer. Specifically, suppose we have an operator that can be expressed as a concise sum of projectors whose expectation values we know a priori to be $O(\epsilon)$. In that case, we can estimate the expectation value of the entire operator within error $\epsilon$ using a number of quantum operations that scales as $O(1/\sqrt{\epsilon})$. We then show how this can be used to reduce the cost of learning a potential energy surface in quantum chemistry applications by exploiting information gained from the energy at nearby points. Furthermore, we show, using Newton-Cotes methods, how these ideas can be exploited to learn the energy via integration of derivatives that we can estimate using a priori knowledge. This allows us to reduce the cost of energy estimation if the block-encodings of directional derivative operators have a smaller normalization constant than the Hamiltonian of the system.


title: Consolidating Attention Features for Multi-view Image Editing

abstract: Large-scale text-to-image models enable a wide range of image editing techniques, using text prompts or even spatial controls. However, applying these editing methods to multi-view images depicting a single scene leads to 3D-inconsistent results. In this work, we focus on spatial control-based geometric manipulations and introduce a method to consolidate the editing process across various views. We build on two insights: (1) maintaining consistent features throughout the generative process helps attain consistency in multi-view editing, and (2) the queries in self-attention layers significantly influence the image structure. Hence, we propose to improve the geometric consistency of the edited images by enforcing the consistency of the queries. To do so, we introduce QNeRF, a neural radiance field trained on the internal query features of the edited images. Once trained, QNeRF can render 3D-consistent queries, which are then softly injected back into the self-attention layers during generation, greatly improving multi-view consistency. We refine the process through a progressive, iterative method that better consolidates queries across the diffusion timesteps. We compare our method to a range of existing techniques and demonstrate that it can achieve better multi-view consistency and higher fidelity to the input scene. These advantages allow us to train NeRFs with fewer visual artifacts, that are better aligned with the target geometry.


title: Adaptive hybrid density functionals

abstract: Exact exchange contributions are known to crucially affect electronic states, which in turn govern covalent bond formation and breaking in chemical species. Empirically averaging the exact exchange admixture over compositional degrees of freedom, hybrid density functional approximations have been widely successful, yet have fallen short to reach high level quantum chemistry accuracy, primarily due to delocalization errors. We propose to `adaptify` hybrid functionals by generating optimal admixture ratios of exact exchange on the fly, i.e. specifically for any chemical compound, using extremely data efficient quantum machine learning models that carry negligible overhead. The adaptive Perdew-Burke-Ernzerhof based hybrid density functional (aPBE0) is shown to yield atomization energies with sufficient accuracy to effectively cure the infamous spin gap problem in open shell systems, such as carbenes. aPBE0 further improves energetics, electron densities, and HOMO-LUMO gaps in organic molecules drawn from the QM9 and QM7b data set. Obtained with aPBE0 in a large basis, we present a revision of the entire QM9 data set (revQM9) with an estimated quality vastly superior to the original containing on average, stronger covalent binding, larger band-gaps, more localized electron densities, and larger dipole-moments. While aPBE0 is applicable in the equilibrium regime, outstanding limitations include covalent bond dissociation when going beyond the Coulson-Fisher point.


title: Disjointness of inertial KMS states and the role of Lorentz symmetry in thermalization

abstract: For any local, translation-covariant quantum field theory on Minkowski spacetime we prove that two distinct primary states that are invariant under the inertial time evolutions in different inertial reference frames and satisfy a timelike cluster property called the mixing property are disjoint, i.e. each state is not a perturbation of the other. These conditions are fulfilled by the inertial KMS states of the free scalar field, thus showing that a state satisfying the KMS condition relative to one reference frame is far from thermal equilibrium relative to other frames. We review the property of return to equilibrium in open quantum systems theory and discuss the implications of disjointness on the asymptotic behavior of detector systems coupled to states of a free massless scalar field. We argue that a coupled system consisting of an Unruh-DeWitt detector moving with constant velocity relative to the field in a thermal state, or an excitation thereof, cannot approach a KMS state at late times under generic conditions. This leads to an illustration of the physical differences between heat baths in inertial systems and the apparent "heat bath" of the Unruh effect from the viewpoint of moving detectors. The article also reviews, from a quantum field theoretical perspective, the quantum dynamical system of an Unruh-DeWitt detector coupled to a massless scalar field in a KMS state relative to the rest frame of the detector.


title: CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation

abstract: We introduce CyberDemo, a novel approach to robotic imitation learning that leverages simulated human demonstrations for real-world tasks. By incorporating extensive data augmentation in a simulated environment, CyberDemo outperforms traditional in-domain real-world demonstrations when transferred to the real world, handling diverse physical and visual conditions. Regardless of its affordability and convenience in data collection, CyberDemo outperforms baseline methods in terms of success rates across various tasks and exhibits generalizability with previously unseen objects. For example, it can rotate novel tetra-valve and penta-valve, despite human demonstrations only involving tri-valves. Our research demonstrates the significant potential of simulated human demonstrations for real-world dexterous manipulation tasks. More details can be found at https://cyber-demo.github.io


title: Explicit formulae for linear characters of $\Gamma_0(N)$

abstract: We give explicit formulae for a class of complex linear unitary characters of the congruence subgroups $\Gamma_0(N)$ which involve a variant of Rademacher's $\Psi$ function. We then prove that these characters cover all characters of $\Gamma_0(N)$ precisely when $N=1,2,3,4,5,6,7,8,10,12,13$.


title: Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesis

abstract: Contemporary models for generating images show remarkable quality and versatility. Swayed by these advantages, the research community repurposes them to generate videos. Since video content is highly redundant, we argue that naively bringing advances of image models to the video generation domain reduces motion fidelity, visual quality and impairs scalability. In this work, we build Snap Video, a video-first model that systematically addresses these challenges. To do that, we first extend the EDM framework to take into account spatially and temporally redundant pixels and naturally support video generation. Second, we show that a U-Net - a workhorse behind image generation - scales poorly when generating videos, requiring significant computational overhead. Hence, we propose a new transformer-based architecture that trains 3.31 times faster than U-Nets (and is ~4.5 faster at inference). This allows us to efficiently train a text-to-video model with billions of parameters for the first time, reach state-of-the-art results on a number of benchmarks, and generate videos with substantially higher quality, temporal consistency, and motion complexity. The user studies showed that our model was favored by a large margin over the most recent methods. See our website at https://snap-research.github.io/snapvideo/.


title: Enhancing Systematic Decompositional Natural Language Inference Using Informal Logic

abstract: Contemporary language models enable new opportunities for structured reasoning with text, such as the construction and evaluation of intuitive, proof-like textual entailment trees without relying on brittle formal logic. However, progress in this direction has been hampered by a long-standing lack of a clear protocol for determining what valid compositional entailment is. This absence causes noisy datasets and limited performance gains by modern neuro-symbolic engines. To address these problems, we formulate a consistent and theoretically grounded approach to annotating decompositional entailment datasets, and evaluate its impact on LLM-based textual inference. We find that our resulting dataset, RDTE (Recognizing Decompositional Textual Entailment), has a substantially higher internal consistency (+9%) than prior decompositional entailment datasets, suggesting that RDTE is a significant step forward in the long-standing problem of forming a clear protocol for discerning entailment. We also find that training an RDTE-oriented entailment classifier via knowledge distillation and employing it in a modern neuro-symbolic reasoning engine significantly improves results (both accuracy and proof quality) over other entailment classifier baselines, illustrating the practical benefit of this advance for textual inference.


title: Weak polynomial identities of small degree for the Weyl algebra

abstract: In this paper we investigate weak polynomial identities for the Weyl algebra $\mathsf{A}_1$ over an infinite field of arbitrary characteristic. Namely, we describe weak polynomial identities of the minimal degree, which is three, and of degrees 4 and 5. We also describe weak polynomial identities is two variables.


title: Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models

abstract: A pivotal advancement in the progress of large language models (LLMs) is the emergence of the Mixture-of-Experts (MoE) LLMs. Compared to traditional LLMs, MoE LLMs can achieve higher performance with fewer parameters, but it is still hard to deploy them due to their immense parameter sizes. Different from previous weight pruning methods that rely on specifically designed hardware, this paper mainly aims to enhance the deployment efficiency of MoE LLMs by introducing plug-and-play expert-level sparsification techniques. Specifically, we propose, for the first time to our best knowledge, post-training approaches for task-agnostic and task-specific expert pruning and skipping of MoE LLMs, tailored to improve deployment efficiency while maintaining model performance across a wide range of tasks. Extensive experiments show that our proposed methods can simultaneously reduce model sizes and increase the inference speed, while maintaining satisfactory performance. Data and code will be available at https://github.com/Lucky-Lance/Expert_Sparsity.


title: Mochi: Fast \& Exact Collision Detection

abstract: Collision Detection (CD) has several applications across the domains such as robotics, visual graphics, and fluid mechanics. Finding exact collisions between the objects in the scene is quite computationally intensive. To quickly filter the object pairs that do not result in a collision, bounding boxes are built on the objects, indexed using a Bounding Volume Hierarchy(BVH), and tested for intersection before performing the expensive object-object intersection tests. In state-of-the-art CD libraries, accelerators such as GPUs are used to accelerate BVH traversal by building specialized data structures. The recent addition of ray tracing architecture to GPU hardware is designed to do the same but in the context of implementing a Ray Tracing algorithm to render a graphical scene in real-time. We present Mochi, a fast and exact collision detection engine that accelerates both the broad and narrow phases by taking advantage of the capabilities of Ray Tracing cores. We introduce multiple new reductions to perform generic CD to support three types of objects for CD: simple spherical particles, objects describable by mathematical equations, and complex objects composed of a triangle mesh. By implementing our reductions, Mochi achieves several orders of magnitude speedups on synthetic datasets and 5x-28x speedups on real-world triangle mesh datasets. We further evaluate our reductions thoroughly and provide several architectural insights on the ray tracing cores that are otherwise unknown due to their proprietorship.


title: Link Prediction under Heterophily: A Physics-Inspired Graph Neural Network Approach

abstract: In the past years, Graph Neural Networks (GNNs) have become the `de facto' standard in various deep learning domains, thanks to their flexibility in modeling real-world phenomena represented as graphs. However, the message-passing mechanism of GNNs faces challenges in learnability and expressivity, hindering high performance on heterophilic graphs, where adjacent nodes frequently have different labels. Most existing solutions addressing these challenges are primarily confined to specific benchmarks focused on node classification tasks. This narrow focus restricts the potential impact that link prediction under heterophily could offer in several applications, including recommender systems. For example, in social networks, two users may be connected for some latent reason, making it challenging to predict such connections in advance. Physics-Inspired GNNs such as GRAFF provided a significant contribution to enhance node classification performance under heterophily, thanks to the adoption of physics biases in the message-passing. Drawing inspiration from these findings, we advocate that the methodology employed by GRAFF can improve link prediction performance as well. To further explore this hypothesis, we introduce GRAFF-LP, an extension of GRAFF to link prediction. We evaluate its efficacy within a recent collection of heterophilic graphs, establishing a new benchmark for link prediction under heterophily. Our approach surpasses previous methods, in most of the datasets, showcasing a strong flexibility in different contexts, and achieving relative AUROC improvements of up to 26.7%.


title: Pseudorandom unitaries with non-adaptive security

abstract: Pseudorandom unitaries (PRUs) are ensembles of efficiently implementable unitary operators that cannot be distinguished from Haar random unitaries by any quantum polynomial-time algorithm with query access to the unitary. We present a simple PRU construction that is a concatenation of a random Clifford unitary, a pseudorandom binary phase operator, and a pseudorandom permutation operator. We prove that this PRU construction is secure against non-adaptive distinguishers assuming the existence of quantum-secure one-way functions. This means that no efficient quantum query algorithm that is allowed a single application of $U^{\otimes \mathrm{poly}(n)}$ can distinguish whether an $n$-qubit unitary $U$ was drawn from the Haar measure or our PRU ensemble. We conjecture that our PRU construction remains secure against adaptive distinguishers, i.e. secure against distinguishers that can query the unitary polynomially many times in sequence, not just in parallel.


title: Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset

abstract: Recent advancements in Large Multimodal Models (LMMs) have shown promising results in mathematical reasoning within visual contexts, with models approaching human-level performance on existing benchmarks such as MathVista. However, we observe significant limitations in the diversity of questions and breadth of subjects covered by these benchmarks. To address this issue, we present the MATH-Vision (MATH-V) dataset, a meticulously curated collection of 3,040 high-quality mathematical problems with visual contexts sourced from real math competitions. Spanning 16 distinct mathematical disciplines and graded across 5 levels of difficulty, our dataset provides a comprehensive and diverse set of challenges for evaluating the mathematical reasoning abilities of LMMs. Through extensive experimentation, we unveil a notable performance gap between current LMMs and human performance on MATH-V, underscoring the imperative for further advancements in LMMs. Moreover, our detailed categorization allows for a thorough error analysis of LMMs, offering valuable insights to guide future research and development. The project is available at https://mathvision-cuhk.github.io


title: Identifying Multiple Personalities in Large Language Models with External Evaluation

abstract: As Large Language Models (LLMs) are integrated with human daily applications rapidly, many societal and ethical concerns are raised regarding the behavior of LLMs. One of the ways to comprehend LLMs' behavior is to analyze their personalities. Many recent studies quantify LLMs' personalities using self-assessment tests that are created for humans. Yet many critiques question the applicability and reliability of these self-assessment tests when applied to LLMs. In this paper, we investigate LLM personalities using an alternate personality measurement method, which we refer to as the external evaluation method, where instead of prompting LLMs with multiple-choice questions in the Likert scale, we evaluate LLMs' personalities by analyzing their responses toward open-ended situational questions using an external machine learning model. We first fine-tuned a Llama2-7B model as the MBTI personality predictor that outperforms the state-of-the-art models as the tool to analyze LLMs' responses. Then, we prompt the LLMs with situational questions and ask them to generate Twitter posts and comments, respectively, in order to assess their personalities when playing two different roles. Using the external personality evaluation method, we identify that the obtained personality types for LLMs are significantly different when generating posts versus comments, whereas humans show a consistent personality profile in these two different situations. This shows that LLMs can exhibit different personalities based on different scenarios, thus highlighting a fundamental difference between personality in LLMs and humans. With our work, we call for a re-evaluation of personality definition and measurement in LLMs.


title: Difference Learning for Air Quality Forecasting Transport Emulation

abstract: Human health is negatively impacted by poor air quality including increased risk for respiratory and cardiovascular disease. Due to a recent increase in extreme air quality events, both globally and locally in the United States, finer resolution air quality forecasting guidance is needed to effectively adapt to these events. The National Oceanic and Atmospheric Administration provides air quality forecasting guidance for the Continental United States. Their air quality forecasting model is based on a 15 km spatial resolution; however, the goal is to reach a three km spatial resolution. This is currently not feasible due in part to prohibitive computational requirements for modeling the transport of chemical species. In this work, we describe a deep learning transport emulator that is able to reduce computations while maintaining skill comparable with the existing numerical model. We show how this method maintains skill in the presence of extreme air quality events, making it a potential candidate for operational use. We also explore evaluating how well this model maintains the physical properties of the modeled transport for a given set of species.


title: A Decision-Language Model (DLM) for Dynamic Restless Multi-Armed Bandit Tasks in Public Health

abstract: Restless multi-armed bandits (RMAB) have demonstrated success in optimizing resource allocation for large beneficiary populations in public health settings. Unfortunately, RMAB models lack flexibility to adapt to evolving public health policy priorities. Concurrently, Large Language Models (LLMs) have emerged as adept automated planners across domains of robotic control and navigation. In this paper, we propose a Decision Language Model (DLM) for RMABs, enabling dynamic fine-tuning of RMAB policies in public health settings using human-language commands. We propose using LLMs as automated planners to (1) interpret human policy preference prompts, (2) propose reward functions as code for a multi-agent RMAB environment, and (3) iterate on the generated reward functions using feedback from grounded RMAB simulations. We illustrate the application of DLM in collaboration with ARMMAN, an India-based non-profit promoting preventative care for pregnant mothers, that currently relies on RMAB policies to optimally allocate health worker calls to low-resource populations. We conduct a technology demonstration in simulation using the Gemini Pro model, showing DLM can dynamically shape policy outcomes using only human prompts as input.


title: RelayAttention for Efficient Large Language Model Serving with Long System Prompts

abstract: A practical large language model (LLM) service may involve a long system prompt, which specifies the instructions, examples, and knowledge documents of the task and is reused across requests. However, the long system prompt causes throughput/latency bottlenecks as the cost of generating the next token grows w.r.t. the sequence length. This paper aims to improve the efficiency of LLM services that involve long system prompts. Our key observation is that handling these system prompts requires heavily redundant memory accesses in existing causal attention computation algorithms. Specifically, for batched requests, the cached hidden states (\ie, key-value pairs) of system prompts are transferred from off-chip DRAM to on-chip SRAM multiple times, each corresponding to an individual request. To eliminate such a redundancy, we propose RelayAttention, an attention algorithm that allows reading these hidden states from DRAM exactly once for a batch of input tokens. RelayAttention is a free lunch: it maintains the generation quality while requiring no model retraining, as it is based on a mathematical reformulation of causal attention. We have observed significant performance improvements to a production-level system, vLLM, through integration with RelayAttention. The improvements are even more profound with longer system prompts.


title: CriticBench: Benchmarking LLMs for Critique-Correct Reasoning

abstract: The ability of Large Language Models (LLMs) to critique and refine their reasoning is crucial for their application in evaluation, feedback provision, and self-improvement. This paper introduces CriticBench, a comprehensive benchmark designed to assess LLMs' abilities to critique and rectify their reasoning across a variety of tasks. CriticBench encompasses five reasoning domains: mathematical, commonsense, symbolic, coding, and algorithmic. It compiles 15 datasets and incorporates responses from three LLM families. Utilizing CriticBench, we evaluate and dissect the performance of 17 LLMs in generation, critique, and correction reasoning, i.e., GQC reasoning. Our findings reveal: (1) a linear relationship in GQC capabilities, with critique-focused training markedly enhancing performance; (2) a task-dependent variation in correction effectiveness, with logic-oriented tasks being more amenable to correction; (3) GQC knowledge inconsistencies that decrease as model size increases; and (4) an intriguing inter-model critiquing dynamic, where stronger models are better at critiquing weaker ones, while weaker models can surprisingly surpass stronger ones in their self-critique. We hope these insights into the nuanced critique-correct reasoning of LLMs will foster further research in LLM critique and self-improvement.


title: GeneOH Diffusion: Towards Generalizable Hand-Object Interaction Denoising via Denoising Diffusion

abstract: In this work, we tackle the challenging problem of denoising hand-object interactions (HOI). Given an erroneous interaction sequence, the objective is to refine the incorrect hand trajectory to remove interaction artifacts for a perceptually realistic sequence. This challenge involves intricate interaction noise, including unnatural hand poses and incorrect hand-object relations, alongside the necessity for robust generalization to new interactions and diverse noise patterns. We tackle those challenges through a novel approach, GeneOH Diffusion, incorporating two key designs: an innovative contact-centric HOI representation named GeneOH and a new domain-generalizable denoising scheme. The contact-centric representation GeneOH informatively parameterizes the HOI process, facilitating enhanced generalization across various HOI scenarios. The new denoising scheme consists of a canonical denoising model trained to project noisy data samples from a whitened noise space to a clean data manifold and a "denoising via diffusion" strategy which can handle input trajectories with various noise patterns by first diffusing them to align with the whitened noise space and cleaning via the canonical denoiser. Extensive experiments on four benchmarks with significant domain variations demonstrate the superior effectiveness of our method. GeneOH Diffusion also shows promise for various downstream applications. Project website: https://meowuu7.github.io/GeneOH-Diffusion/.


title: Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking

abstract: Fine-tuning on generalized tasks such as instruction following, code generation, and mathematics has been shown to enhance language models' performance on a range of tasks. Nevertheless, explanations of how such fine-tuning influences the internal computations in these models remain elusive. We study how fine-tuning affects the internal mechanisms implemented in language models. As a case study, we explore the property of entity tracking, a crucial facet of language comprehension, where models fine-tuned on mathematics have substantial performance gains. We identify the mechanism that enables entity tracking and show that (i) in both the original model and its fine-tuned versions primarily the same circuit implements entity tracking. In fact, the entity tracking circuit of the original model on the fine-tuned versions performs better than the full original model. (ii) The circuits of all the models implement roughly the same functionality: Entity tracking is performed by tracking the position of the correct entity in both the original model and its fine-tuned versions. (iii) Performance boost in the fine-tuned models is primarily attributed to its improved ability to handle the augmented positional information. To uncover these findings, we employ: Patch Patching, DCM, which automatically detects model components responsible for specific semantics, and CMAP, a new approach for patching activations across models to reveal improved mechanisms. Our findings suggest that fine-tuning enhances, rather than fundamentally alters, the mechanistic operation of the model.


title: WeakSAM: Segment Anything Meets Weakly-supervised Instance-level Recognition

abstract: Weakly supervised visual recognition using inexact supervision is a critical yet challenging learning problem. It significantly reduces human labeling costs and traditionally relies on multi-instance learning and pseudo-labeling. This paper introduces WeakSAM and solves the weakly-supervised object detection (WSOD) and segmentation by utilizing the pre-learned world knowledge contained in a vision foundation model, i.e., the Segment Anything Model (SAM). WeakSAM addresses two critical limitations in traditional WSOD retraining, i.e., pseudo ground truth (PGT) incompleteness and noisy PGT instances, through adaptive PGT generation and Region of Interest (RoI) drop regularization. It also addresses the SAM's problems of requiring prompts and category unawareness for automatic object detection and segmentation. Our results indicate that WeakSAM significantly surpasses previous state-of-the-art methods in WSOD and WSIS benchmarks with large margins, i.e. average improvements of 7.4% and 8.5%, respectively. The code is available at \url{https://github.com/hustvl/WeakSAM}.


title: SymTh for non-finite symmetries

abstract: Symmetry topological field theory (SymTFT) is a very convenient tool to study finite generalized symmetries of a given quantum field theory (QFT). In particular, SymTFTs encode all the symmetry structures and properties including anomalies. Recently this tool has been applied for non-finite symmetries as well. In this paper, we take a different route, which consists of considering a free theory rather than a topological field theory in the bulk. We call it Symmetry Theory (SymTh). We study its topological operators together with the free boundary conditions. We also propose a procedure that is analogous to the sandwich construction of symmetry TFTs and it allows us to obtain the physical QFT. We apply this to many examples, ranging from abelian $p$-form symmetries to 2-groups, and the (solvable) case of group-like symmetries in quantum mechanics. Finally, we provide a derivation for the SymTh of $\mathbb Q/ \mathbb Z$ non-invertible symmetries from the dimensional reduction of IIB supergravity on the conifold. In addition, we give an ultraviolet (UV) interpretation of the quantum Hall states dressing the non-invertible $\mathbb Q/ \mathbb Z$ topological operators, in terms of branes in the IIB supergravity background.


title: Realization of a Laughlin state of two rapidly rotating fermions

abstract: We realize a Laughlin state of two rapidly rotating fermionic atoms in an optical tweezer. By utilizing a single atom and spin resolved imaging technique, we sample the Laughlin wavefunction, thereby revealing its distinctive features, including a vortex distribution in the relative motion, correlations in the particles' relative angle, and suppression of the inter-particle interactions. Our work lays the foundation for atom-by-atom assembly of fractional quantum Hall states in rotating atomic gases.

categories: cond-mat.quant-gas cond-mat.str-el physics.atom-ph quant-ph


title: Demographic Bias of Expert-Level Vision-Language Foundation Models in Medical Imaging

abstract: Advances in artificial intelligence (AI) have achieved expert-level performance in medical imaging applications. Notably, self-supervised vision-language foundation models can detect a broad spectrum of pathologies without relying on explicit training annotations. However, it is crucial to ensure that these AI models do not mirror or amplify human biases, thereby disadvantaging historically marginalized groups such as females or Black patients. The manifestation of such biases could systematically delay essential medical care for certain patient subgroups. In this study, we investigate the algorithmic fairness of state-of-the-art vision-language foundation models in chest X-ray diagnosis across five globally-sourced datasets. Our findings reveal that compared to board-certified radiologists, these foundation models consistently underdiagnose marginalized groups, with even higher rates seen in intersectional subgroups, such as Black female patients. Such demographic biases present over a wide range of pathologies and demographic attributes. Further analysis of the model embedding uncovers its significant encoding of demographic information. Deploying AI systems with these biases in medical imaging can intensify pre-existing care disparities, posing potential challenges to equitable healthcare access and raising ethical questions about their clinical application.


title: Universal quantum dynamics of Bose polarons

abstract: Predicting the emergent properties of impurities immersed in a quantum bath is a fundamental challenge that can defy quasiparticle treatments. Here, we measure the spectral properties and real-time dynamics of mobile impurities injected into a homogeneous Bose--Einstein condensate, using two Feshbach resonances to tune both the impurity-bath and intrabath interactions. We map out both attractive and repulsive branches of polaron quasiparticles, resolving the repulsive polaron and the molecular state associated with the Feshbach resonance in the strongly interacting regime, and show that the latter also has a many-body character. Our measurements reveal remarkably universal behavior, controlled by the bath density and a single dimensionless interaction parameter; for near-resonant interactions the polarons are no longer well defined, but the universality still holds.


title: Cameras as Rays: Pose Estimation via Ray Diffusion

abstract: Estimating camera poses is a fundamental task for 3D reconstruction and remains challenging given sparsely sampled views (<10). In contrast to existing approaches that pursue top-down prediction of global parametrizations of camera extrinsics, we propose a distributed representation of camera pose that treats a camera as a bundle of rays. This representation allows for a tight coupling with spatial image features improving pose precision. We observe that this representation is naturally suited for set-level transformers and develop a regression-based approach that maps image patches to corresponding rays. To capture the inherent uncertainties in sparse-view pose inference, we adapt this approach to learn a denoising diffusion model which allows us to sample plausible modes while improving performance. Our proposed methods, both regression- and diffusion-based, demonstrate state-of-the-art performance on camera pose estimation on CO3D while generalizing to unseen object categories and in-the-wild captures.


title: PALO: A Polyglot Large Multimodal Model for 5B People

abstract: In pursuit of more inclusive Vision-Language Models (VLMs), this study introduces a Large Multilingual Multimodal Model called PALO. PALO offers visual reasoning capabilities in 10 major languages, including English, Chinese, Hindi, Spanish, French, Arabic, Bengali, Russian, Urdu, and Japanese, that span a total of ~5B people (65% of the world population). Our approach involves a semi-automated translation approach to adapt the multimodal instruction dataset from English to the target languages using a fine-tuned Large Language Model, thereby ensuring high linguistic fidelity while allowing scalability due to minimal manual effort. The incorporation of diverse instruction sets helps us boost overall performance across multiple languages especially those that are underrepresented like Hindi, Arabic, Bengali, and Urdu. The resulting models are trained across three scales (1.7B, 7B and 13B parameters) to show the generalization and scalability where we observe substantial improvements compared to strong baselines. We also propose the first multilingual multimodal benchmark for the forthcoming approaches to evaluate their vision-language reasoning capabilities across languages. Code: https://github.com/mbzuai-oryx/PALO.


title: A Novel method for Schizophrenia classification using nonlinear features and neural networks

abstract: One notable method for recording brainwaves to identify neurological problems is electroencephalography (hereafter EEG). A trained neuro physician can learn more about how the brain functions through the use of EEGs. However conventionally, EEGs are only used to examine neurological problems (Eg. Seizures). But abnormal links to neurological circuits can also exist in psychological illnesses like Schizophrenia. Hence EEGs can be an alternate source of data for detection and classification of psychological disorders. A study on the classification of EEG data obtained from healthy individuals and individuals experiencing schizophrenia is conducted. The inherent nonlinear nature of brain waves are made use for the dimensionality reduction of the data. Nonlinear parameters such as Lyapunov exponent (LE) and Hurst exponent (HE) were selected as essential features. The EEG data was obtained from the openly available EEG database of MV. Lomonosov Moscow State university. To perform Noise reduction of the data, a more recently developed Tunable Q factor based wavelet transform (TQWT) is used . Finally for the classification, the 16 channel EEG time series is converted into spatial heatmaps using the aforementioned features. A convolutional neural network (CNN) is designed and trained with the modified data format for classification


title: Modelling of the monthly global average temperature anomalies after the year 1900

abstract: Two ways of parameterising the temporal dependence of the global average temperature anomalies after 1900 are put forth in this technical note. The models are fitted to the data of the Berkeley Earth Group (up to the end of 2023), after the application of corrections which translate the input so that its average value over the last five decades of the $19$-th century vanishes; as the corrections are evaluated separately for each month of the year, the seasonal effects are removed from the data. The results are given in a convenient form for use.


title: Constraint Propagation on GPU: A Case Study for the Bin Packing Constraint

abstract: The Bin Packing Problem is one of the most important problems in discrete optimization, as it captures the requirements of many real-world problems. Because of its importance, it has been approached with the main theoretical and practical tools. Resolution approaches based on Linear Programming are the most effective, while Constraint Programming proves valuable when the Bin Packing Problem is a component of a larger problem. This work focuses on the Bin Packing constraint and explores how GPUs can be used to enhance its propagation algorithm. Two approaches are motivated and discussed, one based on knapsack reasoning and one using alternative lower bounds. The implementations are evaluated in comparison with state-of-the-art approaches on different benchmarks from the literature. The results indicate that the GPU-accelerated lower bounds offers a desirable alternative to tackle large instances.


title: Design of an Analog Memory Cell in 0.25 micron CMOS process

abstract: CMOS VLSI technology is the most dominant integration methodology prevailing in the world today. Various signal-processing blocks are made using analog or digital design techniques in MOS VLSI. An important component is the Memory unit used to store data. In the project a memory cell has been built up using analog design method. A capacitor is used as the basic storage device. The main idea behind analog memory is that the analog value of the charge or voltage stored in the capacitor is the data stored. So the dielectric quality of the capacitor becomes important here to determine how effectively it can store some charge. Analog memory is a trade off between hardware cost, chip area and accuracy or quality of storage. The circuit of analog memory cell was developed starting from the idea that required voltage will be stored in a capacitor and MOS transistors were used as switches. A given technology of integration was used and hence the dielectric property of the capacitor was fixed. By suitable circuit configuration the analog voltage value was written to the capacitor, read out when required and the charge loss was also refreshed. The results obtained are as given in the thesis.


title: Geothermal Energy in Sedimentary Basins: Assessing Techno-economic Viability for Sustainable Development

abstract: Drilling deep geothermal wells has proven to be a challenging endeavor, primarily due to issues such as loss circulation events, material limitations under high temperatures, and the production of corrosive fluids. Furthermore, the substantial upfront costs, coupled with geological and technical obstacles associated with drilling super-hot EGS wells in igneous rocks, hinder the widespread implementation of geothermal systems. Alternatively, geothermal energy development in sedimentary basins presents an opportunity for clean energy production with relatively lower investment costs compared to the development of super-hot EGS in igneous rocks. Sedimentary basins exhibit attractive temperatures for geothermal applications, and their wide distribution enhances the potential for nationwide deployment. Decades of drilling and development experience in oil and gas wells have yielded a wealth of data, knowledge, and expertise. Leveraging this experience and data for geothermal drilling can significantly reduce costs associated with subsurface data gathering, well drilling, and completion. This paper explores the economic viability of geothermal energy production systems in sedimentary basins. The study encompasses an analysis of time-to-hit-temperature (THT) and cost-to-hit-temperature (CHT) parameters, as well as Favorability maps across the United States. These maps are based on factors such as well depth, total drilling time, well cost, and subsurface temperature data. By integrating sedimentary basin maps and underground temperature maps, the THT and CHT maps can facilitate the strategic placement of EGS wells and other geothermal system applications in the most favorable locations across the United States.


title: Hard Rock Drilling for Super-hot Enhanced Geothermal System Development: Literature Review and Techno-Economic Analysis

abstract: The increasing global demand for electricity and the imperative of achieving sustainable and net-zero energy solutions have underscored the importance of exploring alternative sources. Enhanced Geothermal Systems (EGS) have emerged as a promising avenue for renewable and sustainable energy production. However, the development of EGS faces a significant challenge in drilling through hard rock formations at high temperatures, necessitating specialized drilling equipment and techniques. This study aims to investigate the current state-of-the-art technology for drilling in hard rock formations under elevated temperatures, specifically in the context of super-hot EGS development. It involves a comprehensive review of previous projects and a meticulous analysis of existing drilling technologies and techniques. Furthermore, a techno-economic evaluation will be conducted to assess the feasibility of super-hot EGS development in hard igneous formations, considering key factors such as drilling performance, operational challenges, and material costs. The outcomes of this study will enhance the understanding of the technical challenges associated with super-hot EGS development and facilitate the design of efficient and cost-effective drilling technologies for the geothermal energy industry. By improving the drilling process in EGS development, the full potential of geothermal energy can be harnessed as a viable and sustainable energy source to meet the growing global demand for electricity.


title: Deepfake Detection and the Impact of Limited Computing Capabilities

abstract: The rapid development of technologies and artificial intelligence makes deepfakes an increasingly sophisticated and challenging-to-identify technique. To ensure the accuracy of information and control misinformation and mass manipulation, it is of paramount importance to discover and develop artificial intelligence models that enable the generic detection of forged videos. This work aims to address the detection of deepfakes across various existing datasets in a scenario with limited computing resources. The goal is to analyze the applicability of different deep learning techniques under these restrictions and explore possible approaches to enhance their efficiency.


title: Morphotectonic Study of the Greater Antilles

abstract: The first morphotectonic model of the Greater Antilles is presented. The model is adjusted to the current dynamics between the Caribbean and North American plates. It is mainly elaborated by Rantsmans methodology. We determined 2 megablocks, 7 macroblocks, 42 mesoblocks, 653 microblocks and 1264 nanoblocks. They constitute a set of active blocks under rotation, uplifting and tilting movements. A total of 11 active knots of faults and 8 cells are the main articulation areas. The largest seismogenetic structures in the Northern Caribbean are an array of the active fault segments. The majority of them are in the Caribbean-North American Plate Boundary Zone, the Hispaniola has the most complex neotectonic structure associated with the central axis of the morphotectonic deformations in the region.


title: Optimizing Uterine Synchronization Analysis in Pregnancy and Labor through Window Selection and Node Optimization

abstract: Preterm labor (PL) has globally become the leading cause of death in children under the age of 5 years. To address this problem, this paper will provide a new approach by analyzing the EHG signals, which are recorded on the abdomen of the mother during labor and pregnancy. The EHG signal reflects the electrical activity that induces the mechanical contraction of the myometrium. Because EHGs are known to be non-stationary signals, and because we anticipate connectivity to alter during contraction, we applied the windowing approach on real signals to help us identify the best windows and the best nodes with the most significant data to be used for classification. The suggested pipeline includes i) divide the 16 EHG signals that are recorded from the abdomen of pregnant women in N windows; ii) apply the connectivity matrices on each window; iii) apply the Graph theory-based measures on the connectivity matrices on each window; iv) apply the consensus Matrix on each window in order to retrieve the best windows and the best nodes. Following that, several neural network and machine learning methods are applied to the best windows and best nodes to categorize pregnancy and labor contractions, based on the different input parameters (connectivity method alone, connectivity method plus graph parameters, best nodes, all nodes, best windows, all windows). Results showed that the best nodes are nodes 8, 9, 10, 11, and 12; while the best windows are 2, 4, and 5. The classification results obtained by using only these best nodes are better than when using the whole nodes. The results are always better when using the full burst, whatever the chosen nodes. Thus, the windowing approach proved to be an innovative technique that can improve the differentiation between labor and pregnancy EHG signals.


title: Modeling the crust and upper mantle in northern Beata Ridge (CARIBE NORTE Project)

abstract: The complex tectonic region of NE Caribbean, where Hispaniola and Puerto Rico are located, is bordered by subduction zone with oblique convergence in the north and by incipient subduction zone associated to Muertos Trough in the south. Central Caribbean basin is characterized by the presence of a prominent topographic structure known as Beata Ridge, whose oceanic crustal thickness is unusual. The northern part of Beata Ridge is colliding with the central part of Hispaniola along a transverse NE alignment, which constitutes a morphostructural limit, thus producing the interruption of the Cibao Valley and the divergence of the rivers and basins in opposite directions. The direction of this alignment coincides with the discontinuity that could explain the extreme difference between west and east seismicity of the island. Different studies have provided information about Beata Ridge, mainly about the shallow structure from MCS data. In this work, CARIBE NORTE (2009) wide-angle seismic data are analyzed along a WNW-ESE trending line in the northern flank of Beata Ridge, providing a complete tectonic view about shallow, middle and deep structures. The results show clear tectonic differences between west and east separated by Beata Island. In the Haiti Basin area, sedimentary cover is strongly influenced by the bathymetry and its thickness decreases toward to the island. In this area, the Upper Mantle reaches 20 km deep increasing up to 24 km below the island where the sedimentary cover disappears.


title: A Material Sensing-Assisted Initial Beam Establishment Method for JCAS Systems

abstract: Communication systems operating at high frequency bands must use narrow beams to compensate the high path loss. However, it is incredibly time-consuming to achieve beam alignment between the transmitter and receiver due to the large volume of beam space with narrow beams. The high latency of initial beam establishment will challenge the implementation of future 6G networks at high frequency bands. To tackle this problem, this paper proposes an initial beam establishment method using the material sensing results from joint communications and sensing (JCAS) systems. The reflection loss (RL) induced by each reflector can be predicted by exploiting the pre-identified material information of reflectors in the environment. The base station (BS) first scans the beam directions with low RL and establishes the connection immediately without sweeping the rest of the beam directions. In this way, the latency of initial beam establishment is significantly reduced.


title: Orca-Math: Unlocking the potential of SLMs in Grade School Math

abstract: Mathematical word problem-solving has long been recognized as a complex task for small language models (SLMs). A recent study hypothesized that the smallest model size, needed to achieve over 80% accuracy on the GSM8K benchmark, is 34 billion parameters. To reach this level of performance with smaller models, researcher often train SLMs to generate Python code or use tools to help avoid calculation errors. Additionally, they employ ensembling, where outputs of up to 100 model runs are combined to arrive at a more accurate result. Result selection is done using consensus, majority vote or a separate a verifier model used in conjunction with the SLM. Ensembling provides a substantial boost in accuracy but at a significant cost increase with multiple calls to the model (e.g., Phi-GSM uses top-48 to boost the performance from 68.2 to 81.5). In this work, we present Orca-Math, a 7-billion-parameter SLM based on the Mistral-7B, which achieves 86.81% on GSM8k without the need for multiple model calls or the use of verifiers, code execution or any other external tools. Our approach has the following key elements: (1) A high quality synthetic dataset of 200K math problems created using a multi-agent setup where agents collaborate to create the data, (2) An iterative learning techniques that enables the SLM to practice solving problems, receive feedback on its solutions and learn from preference pairs incorporating the SLM solutions and the feedback. When trained with Supervised Fine-Tuning alone, Orca-Math achieves 81.50% on GSM8k pass@1 metric. With iterative preference learning, Orca-Math achieves 86.81% pass@1. Orca-Math surpasses the performance of significantly larger models such as LLAMA-2-70B, WizardMath-70B, Gemini-Pro, ChatGPT-3.5. It also significantly outperforms other smaller models while using much smaller data (hundreds of thousands vs. millions of problems).


title: Roles of Energy and Entropy in Multiscale Dynamics and Thermodynamics

abstract: Multiscale thermodynamics is a theory of relations among levels of description. Energy and entropy are its two main ingredients. Their roles in the time evolution describing approach of a level (starting level) to another level involving less details (target level) is examined on several examples, including the level on which macroscopic systems are seen as composed of microscopic particles, mesoscopic levels as kinetic theory of ideal and van der Waals gases, fluid mechanics, the level of chemical kinetics, and the level of equilibrium thermodynamics. The entropy enters the emergence of the target level in two roles. It expresses internal energy, that is the part of the energy that cannot be expressed in terms of the state variables used on the starting level, and it reveals emerging features characterizing the target level by sweeping away unimportant details. In the case when the target level is a mesoscopic level involving time evolution the roles of the energy and the entropy is taken by two different potentials that are related to their rates.


title: Integrating Simulation Budget Management into Drum-Buffer-Rope: A Study on Parametrization and Reducing Computational Effort

abstract: In manufacturing, a bottleneck workstation frequently emerges, complicating production planning and escalating costs. To address this, Drum-Buffer-Rope (DBR) is a widely recognized production planning and control method that focuses on centralizing the bottleneck workstation, thereby improving production system performance. Although DBR is primarily focused on cre-ating a bottleneck schedule, the selection of planning parameters is crucial, as they significantly influence the scheduling process. Conducting a compre-hensive full factorial enumeration to identify the ideal planning parameters requires substantial computational effort. Simulation Budget Management (SBM) offers an effective concept to reduce this effort by skipping less promising parameter combinations. This publication introduces a method for integrating SBM into multi-stage multi-item DBR planned and controlled production system with limited capacity, aimed at determining the optimal planning parameters. Furthermore, we conduct a simulation study to analyze the effects of different production system environments, i.e., varying levels of shop load and process uncertainty, on both the performance and parame-terization of DBR and the efficacy of SBM. Our results show significant re-duction in simulation budget for identifying optimal planning parameters compared to traditional full factorial enumeration.


title: CliqueParcel: An Approach For Batching LLM Prompts That Jointly Optimizes Efficiency And Faithfulness

abstract: Large language models (LLMs) have become pivotal in recent research. However, during the inference process, LLMs still require substantial resources. In this paper, we propose CliqueParcel, a method designed to improve the efficiency of LLMs via prompt batching. Existing strategies to optimize inference efficiency often compromise on output quality, leading to a discounted output problem. This issue might result in reduced accuracy or outputs that are less detailed. CliqueParcel is our answer to this challenge. While ensuring accuracy and minimizing deviations from the original outputs (i.e., faithfulness), our method significantly improves efficiency during inference. To lay the groundwork, we first redefine efficiency measurements by excluding the reduction in running time due to shorter lengths. Then, we provide a comprehensive trade-off between efficiency and faithfulness to clarify the nature of the 'discounted output' problem. Within the CliqueParcel framework, we suggest multiple batching sub-methods and discuss the specific scenarios in which they can be applied. During evaluation, CliqueParcel is tested on eight widely recognized datasets, which can be classified into three types: reading comprehension, open-source question-answering, and reasoning. Our experiments explore the performance of CliqueParcel, including efficiency, faithfulness, and the trade-off between them. This work provides novel insights into inference efficiency and demonstrates promising performance.


title: MSynFD: Multi-hop Syntax aware Fake News Detection

abstract: The proliferation of social media platforms has fueled the rapid dissemination of fake news, posing threats to our real-life society. Existing methods use multimodal data or contextual information to enhance the detection of fake news by analyzing news content and/or its social context. However, these methods often overlook essential textual news content (articles) and heavily rely on sequential modeling and global attention to extract semantic information. These existing methods fail to handle the complex, subtle twists in news articles, such as syntax-semantics mismatches and prior biases, leading to lower performance and potential failure when modalities or social context are missing. To bridge these significant gaps, we propose a novel multi-hop syntax aware fake news detection (MSynFD) method, which incorporates complementary syntax information to deal with subtle twists in fake news. Specifically, we introduce a syntactical dependency graph and design a multi-hop subgraph aggregation mechanism to capture multi-hop syntax. It extends the effect of word perception, leading to effective noise filtering and adjacent relation enhancement. Subsequently, a sequential relative position-aware Transformer is designed to capture the sequential information, together with an elaborate keyword debiasing module to mitigate the prior bias. Extensive experimental results on two public benchmark datasets verify the effectiveness and superior performance of our proposed MSynFD over state-of-the-art detection models.


title: MIKE: A New Benchmark for Fine-grained Multimodal Entity Knowledge Editing

abstract: Multimodal knowledge editing represents a critical advancement in enhancing the capabilities of Multimodal Large Language Models (MLLMs). Despite its potential, current benchmarks predominantly focus on coarse-grained knowledge, leaving the intricacies of fine-grained (FG) multimodal entity knowledge largely unexplored. This gap presents a notable challenge, as FG entity recognition is pivotal for the practical deployment and effectiveness of MLLMs in diverse real-world scenarios. To bridge this gap, we introduce MIKE, a comprehensive benchmark and dataset specifically designed for the FG multimodal entity knowledge editing. MIKE encompasses a suite of tasks tailored to assess different perspectives, including Vanilla Name Answering, Entity-Level Caption, and Complex-Scenario Recognition. In addition, a new form of knowledge editing, Multi-step Editing, is introduced to evaluate the editing efficiency. Through our extensive evaluations, we demonstrate that the current state-of-the-art methods face significant challenges in tackling our proposed benchmark, underscoring the complexity of FG knowledge editing in MLLMs. Our findings spotlight the urgent need for novel approaches in this domain, setting a clear agenda for future research and development efforts within the community.


title: Stealthy Attack on Large Language Model based Recommendation

abstract: Recently, the powerful large language models (LLMs) have been instrumental in propelling the progress of recommender systems (RS). However, while these systems have flourished, their susceptibility to security threats has been largely overlooked. In this work, we reveal that the introduction of LLMs into recommendation models presents new security vulnerabilities due to their emphasis on the textual content of items. We demonstrate that attackers can significantly boost an item's exposure by merely altering its textual content during the testing phase, without requiring direct interference with the model's training process. Additionally, the attack is notably stealthy, as it does not affect the overall recommendation performance and the modifications to the text are subtle, making it difficult for users and platforms to detect. Our comprehensive experiments across four mainstream LLM-based recommendation models demonstrate the superior efficacy and stealthiness of our approach. Our work unveils a significant security gap in LLM-based recommendation systems and paves the way for future research on protecting these systems.


title: An Empirical Categorization of Prompting Techniques for Large Language Models: A Practitioner's Guide

abstract: Due to rapid advancements in the development of Large Language Models (LLMs), programming these models with prompts has recently gained significant attention. However, the sheer number of available prompt engineering techniques creates an overwhelming landscape for practitioners looking to utilize these tools. For the most efficient and effective use of LLMs, it is important to compile a comprehensive list of prompting techniques and establish a standardized, interdisciplinary categorization framework. In this survey, we examine some of the most well-known prompting techniques from both academic and practical viewpoints and classify them into seven distinct categories. We present an overview of each category, aiming to clarify their unique contributions and showcase their practical applications in real-world examples in order to equip fellow practitioners with a structured framework for understanding and categorizing prompting techniques tailored to their specific domains. We believe that this approach will help simplify the complex landscape of prompt engineering and enable more effective utilization of LLMs in various applications. By providing practitioners with a systematic approach to prompt categorization, we aim to assist in navigating the intricacies of effective prompt design for conversational pre-trained LLMs and inspire new possibilities in their respective fields.


title: RFBES at SemEval-2024 Task 8: Investigating Syntactic and Semantic Features for Distinguishing AI-Generated and Human-Written Texts

abstract: Nowadays, the usage of Large Language Models (LLMs) has increased, and LLMs have been used to generate texts in different languages and for different tasks. Additionally, due to the participation of remarkable companies such as Google and OpenAI, LLMs are now more accessible, and people can easily use them. However, an important issue is how we can detect AI-generated texts from human-written ones. In this article, we have investigated the problem of AI-generated text detection from two different aspects: semantics and syntax. Finally, we presented an AI model that can distinguish AI-generated texts from human-written ones with high accuracy on both multilingual and monolingual tasks using the M4 dataset. According to our results, using a semantic approach would be more helpful for detection. However, there is a lot of room for improvement in the syntactic approach, and it would be a good approach for future work.


title: Exact Evaluation and extrapolation of the divergent expansion for the Heisenberg-Euler Lagrangian II: Non-alternating Case

abstract: We applied the method of finite-part integration [Galapon E.A Proc.R.Soc A 473, 20160567(2017)] to evaluate in closed-form the exact one-loop integral representations of the Heisenberg-Euler Lagrangian from QED for a constant electric field and electric-like self-dual background. We also devise a prescription based on the finite-part integration of the Cauchy principal value integral to sum and extrapolate the non-alternating divergent weak-field expansions of the Heisenberg-Euler Lagrangians to recover the non-perturbative Schwinger effect well into the strong field limit.


title: RJUA-MedDQA: A Multimodal Benchmark for Medical Document Question Answering and Clinical Reasoning

abstract: Recent advancements in Large Language Models (LLMs) and Large Multi-modal Models (LMMs) have shown potential in various medical applications, such as Intelligent Medical Diagnosis. Although impressive results have been achieved, we find that existing benchmarks do not reflect the complexity of real medical reports and specialized in-depth reasoning capabilities. In this work, we introduced RJUA-MedDQA, a comprehensive benchmark in the field of medical specialization, which poses several challenges: comprehensively interpreting imgage content across diverse challenging layouts, possessing numerical reasoning ability to identify abnormal indicators and demonstrating clinical reasoning ability to provide statements of disease diagnosis, status and advice based on medical contexts. We carefully design the data generation pipeline and proposed the Efficient Structural Restoration Annotation (ESRA) Method, aimed at restoring textual and tabular content in medical report images. This method substantially enhances annotation efficiency, doubling the productivity of each annotator, and yields a 26.8% improvement in accuracy. We conduct extensive evaluations, including few-shot assessments of 5 LMMs which are capable of solving Chinese medical QA tasks. To further investigate the limitations and potential of current LMMs, we conduct comparative experiments on a set of strong LLMs by using image-text generated by ESRA method. We report the performance of baselines and offer several observations: (1) The overall performance of existing LMMs is still limited; however LMMs more robust to low-quality and diverse-structured images compared to LLMs. (3) Reasoning across context and image content present significant challenges. We hope this benchmark helps the community make progress on these challenging tasks in multi-modal medical document understanding and facilitate its application in healthcare.


abstract: Policy Brief on "Large Projects in Astronomy: An Indian Endeavour", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023. Cutting-edge astronomy initiatives often entail substantial investment and require a high level of expertise. Even the most technologically advanced nations recognize the value of establishing international partnerships to secure both financial resources and talent for these ambitious endeavours as they hold immense promise for catalysing transformative scientific discoveries, driving technological innovation, provide training opportunities for the next generation of scientists and engineers, and expanding our understanding of the cosmos that surrounds us. Crucially, large-scale multilateral collaborations serve as powerful agents for promoting unity and peace among the global population. Participants from various nations share a vested interest in the success of these projects and the wealth of knowledge they yield, fostering a sense of common purpose and shared goals. By utilizing astroinformatics capabilities, these initiatives are not merely enhancing our comprehension of the universe but are also actively contributing to the attainment of sustainable development objectives. In this discussion, we delve into the challenges faced, and prospects for substantial astronomical undertakings. Additionally, we present recommendations aimed at guaranteeing their effectiveness and optimizing their influence on both scientific advancement and society. The policy webinar took place during the G20 presidency in India (2023). A summary based on the seven panels can be found here: arxiv:2401.04623.


abstract: Policy Brief on "Regional and Global Collaborations in Astronomy", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023. Astronomy brings together advanced scientific research, state-of-the-art technology, and educational initiatives, all while captivating and stimulating people of all ages. By doing so, it possesses the potential to serve as a powerful catalyst for sustainable global development and the resolution of global societal issues. It attracts a diverse range of scientists and experts from various fields, fostering collaboration and innovation. By leveraging their resources, influence, and diplomatic initiatives, S20 academies can foster an enabling environment for international collaborations in astronomy, facilitate knowledge exchange, and drive scientific advancements that benefit humanity. This policy brief explores the opportunities and challenges presented by regional and global collaborations in astronomy. The policy webinar took place during the G20 presidency in India (2023). A summary based on the seven panels can be found here: arxiv:2401.04623.


title: Text Diffusion with Reinforced Conditioning

abstract: Diffusion models have demonstrated exceptional capability in generating high-quality images, videos, and audio. Due to their adaptiveness in iterative refinement, they provide a strong potential for achieving better non-autoregressive sequence generation. However, existing text diffusion models still fall short in their performance due to a challenge in handling the discreteness of language. This paper thoroughly analyzes text diffusion models and uncovers two significant limitations: degradation of self-conditioning during training and misalignment between training and sampling. Motivated by our findings, we propose a novel Text Diffusion model called TREC, which mitigates the degradation with Reinforced Conditioning and the misalignment by Time-Aware Variance Scaling. Our extensive experiments demonstrate the competitiveness of TREC against autoregressive, non-autoregressive, and diffusion baselines. Moreover, qualitative analysis shows its advanced ability to fully utilize the diffusion process in refining samples.


title: The New Era of Dynamic Pricing: Synergizing Supervised Learning and Quadratic Programming

abstract: In this paper, we explore a novel combination of supervised learning and quadratic programming to refine dynamic pricing models in the car rental industry. We utilize dynamic modeling of price elasticity, informed by ordinary least squares (OLS) metrics such as p-values, homoscedasticity, error normality. These metrics, when their underlying assumptions hold, are integral in guiding a quadratic programming agent. The program is tasked with optimizing margin for a given finite set target.


title: Purifying Large Language Models by Ensembling a Small Language Model

abstract: The emerging success of large language models (LLMs) heavily relies on collecting abundant training data from external (untrusted) sources. Despite substantial efforts devoted to data cleaning and curation, well-constructed LLMs have been reported to suffer from copyright infringement, data poisoning, and/or privacy violations, which would impede practical deployment of LLMs. In this study, we propose a simple and easily implementable method for purifying LLMs from the negative effects caused by uncurated data, namely, through ensembling LLMs with benign and small language models (SLMs). Aside from theoretical guarantees, we perform comprehensive experiments to empirically confirm the efficacy of ensembling LLMs with SLMs, which can effectively preserve the performance of LLMs while mitigating issues such as copyright infringement, data poisoning, and privacy violations.


title: Stick to Your Role! Context-dependence and Stability of Personal Value Expression in Large Language Models

abstract: The standard way to study Large Language Models (LLMs) with benchmarks or psychology questionnaires is to provide many different queries from similar minimal contexts (e.g. multiple choice questions). However, due to LLMs' highly context-dependent nature, conclusions from such minimal-context evaluations may be little informative about the model's behavior in deployment (where it will be exposed to many new contexts). We argue that context-dependence (specifically, value stability) should be studied a specific property of LLMs and used as another dimension of LLM comparison (alongside others such as cognitive abilities, knowledge, or model size). We present a case-study on the stability of value expression over different contexts (simulated conversations on different topics) as measured using a standard psychology questionnaire (PVQ) and on behavioral downstream tasks. Reusing methods from psychology, we study Rank-order stability on the population (interpersonal) level, and Ipsative stability on the individual (intrapersonal) level. We consider two settings (with and without instructing LLMs to simulate particular personas), two simulated populations, and three downstream tasks. We observe consistent trends in the stability of models and model families - Mixtral, Mistral, GPT-3.5 and Qwen families are more stable than LLaMa-2 and Phi. The consistency of these trends implies that some models exhibit higher value-stability than others, and that value stability can be estimated with the set of introduced methodological tools. When instructed to simulate particular personas, LLMs exhibit low Rank-Order stability, which further diminishes with conversation length. This highlights the need for future research on LLMs that coherently simulate different personas. This paper provides a foundational step in that direction, and, to our knowledge, it is the first study of value stability in LLMs.


title: Deep learning-driven scheduling algorithm for a single machine problem minimizing the total tardiness

abstract: In this paper, we investigate the use of the deep learning method for solving a well-known NP-hard single machine scheduling problem with the objective of minimizing the total tardiness. We propose a deep neural network that acts as a polynomial-time estimator of the criterion value used in a single-pass scheduling algorithm based on Lawler's decomposition and symmetric decomposition proposed by Della Croce et al. Essentially, the neural network guides the algorithm by estimating the best splitting of the problem into subproblems. The paper also describes a new method for generating the training data set, which speeds up the training dataset generation and reduces the average optimality gap of solutions. The experimental results show that our machine learning-driven approach can efficiently generalize information from the training phase to significantly larger instances. Even though the instances used in the training phase have from 75 to 100 jobs, the average optimality gap on instances with up to 800 jobs is 0.26%, which is almost five times less than the gap of the state-of-the-art heuristic.


title: Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Models

abstract: This paper explores the impact of extending input lengths on the capabilities of Large Language Models (LLMs). Despite LLMs advancements in recent times, their performance consistency across different input lengths is not well understood. We investigate this aspect by introducing a novel QA reasoning framework, specifically designed to assess the impact of input length. We isolate the effect of input length using multiple versions of the same sample, each being extended with padding of different lengths, types and locations. Our findings show a notable degradation in LLMs' reasoning performance at much shorter input lengths than their technical maximum. We show that the degradation trend appears in every version of our dataset, although at different intensities. Additionally, our study reveals that traditional perplexity metrics do not correlate with performance of LLMs' in long input reasoning tasks. We analyse our results and identify failure modes that can serve as useful guides for future research, potentially informing strategies to address the limitations observed in LLMs.


title: Asynchronous and Segmented Bidirectional Encoding for NMT

abstract: With the rapid advancement of Neural Machine Translation (NMT), enhancing translation efficiency and quality has become a focal point of research. Despite the commendable performance of general models such as the Transformer in various aspects, they still fall short in processing long sentences and fully leveraging bidirectional contextual information. This paper introduces an improved model based on the Transformer, implementing an asynchronous and segmented bidirectional decoding strategy aimed at elevating translation efficiency and accuracy. Compared to traditional unidirectional translations from left-to-right or right-to-left, our method demonstrates heightened efficiency and improved translation quality, particularly in handling long sentences. Experimental results on the IWSLT2017 dataset confirm the effectiveness of our approach in accelerating translation and increasing accuracy, especially surpassing traditional unidirectional strategies in long sentence translation. Furthermore, this study analyzes the impact of sentence length on decoding outcomes and explores the model's performance in various scenarios. The findings of this research not only provide an effective encoding strategy for the NMT field but also pave new avenues and directions for future studies.


title: CHATATC: Large Language Model-Driven Conversational Agents for Supporting Strategic Air Traffic Flow Management

abstract: Generative artificial intelligence (AI) and large language models (LLMs) have gained rapid popularity through publicly available tools such as ChatGPT. The adoption of LLMs for personal and professional use is fueled by the natural interactions between human users and computer applications such as ChatGPT, along with powerful summarization and text generation capabilities. Given the widespread use of such generative AI tools, in this work we investigate how these tools can be deployed in a non-safety critical, strategic traffic flow management setting. Specifically, we train an LLM, CHATATC, based on a large historical data set of Ground Delay Program (GDP) issuances, spanning 2000-2023 and consisting of over 80,000 GDP implementations, revisions, and cancellations. We test the query and response capabilities of CHATATC, documenting successes (e.g., providing correct GDP rates, durations, and reason) and shortcomings (e.g,. superlative questions). We also detail the design of a graphical user interface for future users to interact and collaborate with the CHATATC conversational agent.


title: SQL-CRAFT: Text-to-SQL through Interactive Refinement and Enhanced Reasoning

abstract: Modern LLMs have become increasingly powerful, but they are still facing challenges in specialized tasks such as Text-to-SQL. We propose SQL-CRAFT, a framework to advance LLMs' SQL generation Capabilities through inteRActive reFinemenT and enhanced reasoning. We leverage an Interactive Correction Loop (IC-Loop) for LLMs to interact with databases automatically, as well as Python-enhanced reasoning. We conduct experiments on two Text-to-SQL datasets, Spider and Bird, with performance improvements of up to 5.7% compared to the naive prompting method. Moreover, our method surpasses the current state-of-the-art on the Spider Leaderboard, demonstrating the effectiveness of our framework.