title: Aligning Neural Machine Translation Models: Human Feedback in Training and Inference

abstract: Reinforcement learning from human feedback (RLHF) is a recent technique to improve the quality of the text generated by a language model, making it closer to what humans would generate. A core ingredient in RLHF's success in aligning and improving large language models (LLMs) is its reward model, trained using human feedback on model outputs. In machine translation (MT), where metrics trained from human annotations can readily be used as reward models, recent methods using minimum Bayes risk decoding and reranking have succeeded in improving the final quality of translation. In this study, we comprehensively explore and compare techniques for integrating quality metrics as reward models into the MT pipeline. This includes using the reward model for data filtering, during the training phase through RL, and at inference time by employing reranking techniques, and we assess the effects of combining these in a unified approach. Our experimental results, conducted across multiple translation tasks, underscore the crucial role of effective data filtering, based on estimated quality, in harnessing the full potential of RL in enhancing MT quality. Furthermore, our findings demonstrate the effectiveness of combining RL training with reranking techniques, showcasing substantial improvements in translation quality.


title: Explainable Text Classification Techniques in Legal Document Review: Locating Rationales without Using Human Annotated Training Text Snippets

abstract: US corporations regularly spend millions of dollars reviewing electronically-stored documents in legal matters. Recently, attorneys apply text classification to efficiently cull massive volumes of data to identify responsive documents for use in these matters. While text classification is regularly used to reduce the discovery costs of legal matters, it also faces a perception challenge: amongst lawyers, this technology is sometimes looked upon as a "black box". Put simply, no extra information is provided for attorneys to understand why documents are classified as responsive. In recent years, explainable machine learning has emerged as an active research area. In an explainable machine learning system, predictions or decisions made by a machine learning model are human understandable. In legal 'document review' scenarios, a document is responsive, because one or more of its small text snippets are deemed responsive. In these scenarios, if these responsive snippets can be located, then attorneys could easily evaluate the model's document classification decisions - this is especially important in the field of responsible AI. Our prior research identified that predictive models created using annotated training text snippets improved the precision of a model when compared to a model created using all of a set of documents' text as training. While interesting, manually annotating training text snippets is not generally practical during a legal document review. However, small increases in precision can drastically decrease the cost of large document reviews. Automating the identification of training text snippets without human review could then make the application of training text snippet-based models a practical approach.


title: Scalable and Effective Generative Information Retrieval

abstract: Recent research has shown that transformer networks can be used as differentiable search indexes by representing each document as a sequences of document ID tokens. These generative retrieval models cast the retrieval problem to a document ID generation problem for each given query. Despite their elegant design, existing generative retrieval models only perform well on artificially-constructed and small-scale collections. This has led to serious skepticism in the research community on their real-world impact. This paper represents an important milestone in generative retrieval research by showing, for the first time, that generative retrieval models can be trained to perform effectively on large-scale standard retrieval benchmarks. For doing so, we propose RIPOR- an optimization framework for generative retrieval that can be adopted by any encoder-decoder architecture. RIPOR is designed based on two often-overlooked fundamental design considerations in generative retrieval. First, given the sequential decoding nature of document ID generation, assigning accurate relevance scores to documents based on the whole document ID sequence is not sufficient. To address this issue, RIPOR introduces a novel prefix-oriented ranking optimization algorithm. Second, initial document IDs should be constructed based on relevance associations between queries and documents, instead of the syntactic and semantic information in the documents. RIPOR addresses this issue using a relevance-based document ID construction approach that quantizes relevance-based representations learned for documents. Evaluation on MSMARCO and TREC Deep Learning Track reveals that RIPOR surpasses state-of-the-art generative retrieval models by a large margin (e.g., 30.5% MRR improvements on MS MARCO Dev Set), and perform better on par with popular dense retrieval models.


title: Scale-free chaos in the 2D harmonically confined Vicsek model

abstract: Animal motion and flocking are ubiquitous nonequilibrium phenomena that are often studied within active matter. In examples such as insect swarms, macroscopic quantities exhibit power laws with measurable critical exponents and ideas from phase transitions and statistical mechanics have been explored to explain them. The widely used Vicsek model with periodic boundary conditions has an ordering phase transition but the corresponding homogeneous ordered or disordered phases are different from observations of natural swarms. If a harmonic potential (instead of a periodic box) is used to confine particles, the numerical simulations of the Vicsek model display periodic, quasiperiodic and chaotic attractors. The latter are scale free on critical curves that produce power laws and critical exponents. Here we investigate the scale-free-chaos phase transition in two space dimensions. We show that the shape of the chaotic swarm on the critical curve reflects the split between core and vapor of insects observed in midge swarms and that the dynamic correlation function collapses only for a finite interval of small scaled times, as also observed. We explain the algorithms used to calculate the largest Lyapunov exponents, the static and dynamic critical exponents and compare them to those of the three-dimensional model.

categories: cond-mat.soft cond-mat.stat-mech math-ph math.MP nlin.CD physics.bio-ph


title: Rescue: Ranking LLM Responses with Partial Ordering to Improve Response Generation

abstract: Customizing LLMs for a specific task involves distinguishing effective responses from erroneous ones. This skill can be developed using supervised fine-tuning with extensive human preference data. However, obtaining expert-annotated preference data is expensive for most tasks. In this paper, we present a novel method to optimize LLMs using ranking metrics. This method trains the model to prioritize the best responses from a pool of candidates created for a particular task. Rather than a traditional full ordering, we advocate for a partial ordering, as achieving consensus on the perfect order of candidate responses can be challenging. Our partial ordering is more robust, less sensitive to noise, and can be achieved with limited human annotations or through heuristic methods. We test our system's improved response generation ability using benchmark datasets, including the latest multi-document question answering task. We conduct ablation studies to understand crucial factors, such as how to gather candidate responses for specific tasks, determine their most suitable order, and balance supervised fine-tuning with ranking metrics. Our approach, named \textsc{Rescue}, suggests a promising avenue for enhancing LLMs' contextual understanding via response ranking.


title: Causal prediction models for medication safety monitoring: The diagnosis of vancomycin-induced acute kidney injury

abstract: The current best practice approach for the retrospective diagnosis of adverse drug events (ADEs) in hospitalized patients relies on a full patient chart review and a formal causality assessment by multiple medical experts. This evaluation serves to qualitatively estimate the probability of causation (PC); the probability that a drug was a necessary cause of an adverse event. This practice is manual, resource intensive and prone to human biases, and may thus benefit from data-driven decision support. Here, we pioneer a causal modeling approach using observational data to estimate a lower bound of the PC (PC$_{low}$). This method includes two key causal inference components: (1) the target trial emulation framework and (2) estimation of individualized treatment effects using machine learning. We apply our method to the clinically relevant use-case of vancomycin-induced acute kidney injury in intensive care patients, and compare our causal model-based PC$_{low}$ estimates to qualitative estimates of the PC provided by a medical expert. Important limitations and potential improvements are discussed, and we conclude that future improved causal models could provide essential data-driven support for medication safety monitoring in hospitalized patients.


title: Degenerate Mean Field Type Control with Linear and Unbounded Diffusion, and their Associated Equations

abstract: We study the well-posedness of a system of forward-backward stochastic differential equations (FBSDEs) corresponding to a degenerate mean field type control problem, when the diffusion coefficient depends on the state together with its measure and also the control. Degenerate mean field type control problems are rarely studied in the literature. Our method is based on a lifting approach which embeds the control problem and the associated FBSDEs in Wasserstein spaces into certain Hilbert spaces. We use a continuation method to establish the solvability of the FBSDEs and that of the G\^ateaux derivatives of this FBSDEs. We then explore the regularity of the value function in time and in measure argument, and we also show that it is the unique classical solution of the associated Bellman equation. We also study the higher regularity of the linear functional derivative of the value function, by then, we obtain the classical solution of the mean field type master equation.


title: Skin modes in a nonlinear Hatano-Nelson model

abstract: Non-Hermitian lattices with non-reciprocal couplings under open boundary conditions are known to possess linear modes exponentially localized on one edge of the chain. This phenomenon, dubbed non-Hermitian skin effect, induces all input waves in the linearized limit of the system to unidirectionally propagate toward the system's preferred boundary. Here we investigate the fate of the non-Hermitian skin effect in the presence of Kerr-type nonlinearity within the well-established Hatano-Nelson lattice model. Our method is to probe the presence of nonlinear stationary modes which are localized at the favored edge, when the Hatano-Nelson model deviates from the linear regime. Based on perturbation theory, we show that families of nonlinear skin modes emerge from the linear ones at any non-reciprocal strength. Our findings reveal that, in the case of focusing nonlinearity, these families of nonlinear skin modes tend to exhibit enhanced localization, bridging the gap between weakly nonlinear modes and the highly nonlinear states (discrete solitons) when approaching the anti-continuum limit with vanishing couplings. Conversely, for defocusing nonlinearity, these nonlinear skin modes tend to become more extended than their linear counterpart. To assess the stability of these solutions, we conduct a linear stability analysis across the entire spectrum of obtained nonlinear modes and also explore representative examples of their evolution dynamics.


title: Rate-induced tipping in complex high-dimensional ecological networks

abstract: In an ecosystem, environmental changes as a result of natural and human processes can cause some key parameters of the system to change with time. Depending on how fast such a parameter changes, a tipping point can occur. Existing works on rate-induced tipping, or R-tipping, offered a theoretical way to study this phenomenon but from a local dynamical point of view, revealing, e.g., the existence of a critical rate for some specific initial condition above which a tipping point will occur. As ecosystems are subject to constant disturbances and can drift away from their equilibrium point, it is necessary to study R-tipping from a global perspective in terms of the initial conditions in the entire relevant phase space region. In particular, we introduce the notion of the probability of R-tipping defined for initial conditions taken from the whole relevant phase space. Using a number of real-world, complex mutualistic networks as a paradigm, we discover a scaling law between this probability and the rate of parameter change and provide a geometric theory to explain the law. The real-world implication is that even a slow parameter change can lead to a system collapse with catastrophic consequences. In fact, to mitigate the environmental changes by merely slowing down the parameter drift may not always be effective: only when the rate of parameter change is reduced to practically zero would the tipping be avoided. Our global dynamics approach offers a more complete and physically meaningful way to understand the important phenomenon of R-tipping.


title: Prophet Inequalities Require Only a Constant Number of Samples

abstract: In a prophet inequality problem, $n$ independent random variables are presented to a gambler one by one. The gambler decides when to stop the sequence and obtains the most recent value as reward. We evaluate a stopping rule by the worst-case ratio between its expected reward and the expectation of the maximum variable. In the classic setting, the order is fixed, and the optimal ratio is known to be 1/2. Three variants of this problem have been extensively studied: the prophet-secretary model, where variables arrive in uniformly random order; the free-order model, where the gambler chooses the arrival order; and the i.i.d. model, where the distributions are all the same, rendering the arrival order irrelevant. Most of the literature assumes that distributions are known to the gambler. Recent work has considered the question of what is achievable when the gambler has access only to a few samples per distribution. Surprisingly, in the fixed-order case, a single sample from each distribution is enough to approximate the optimal ratio, but this is not the case in any of the three variants. We provide a unified proof that for all three variants of the problem, a constant number of samples (independent of n) for each distribution is good enough to approximate the optimal ratios. Prior to our work, this was known to be the case only in the i.i.d. variant. We complement our result showing that our algorithms can be implemented in polynomial time. A key ingredient in our proof is an existential result based on a minimax argument, which states that there must exist an algorithm that attains the optimal ratio and does not rely on the knowledge of the upper tail of the distributions. A second key ingredient is a refined sample-based version of a decomposition of the instance into "small" and "large" variables, first introduced by Liu et al. [EC'21].


title: Machine-learning parameter tracking with partial state observation

abstract: Complex and nonlinear dynamical systems often involve parameters that change with time, accurate tracking of which is essential to tasks such as state estimation, prediction, and control. Existing machine-learning methods require full state observation of the underlying system and tacitly assume adiabatic changes in the parameter. Formulating an inverse problem and exploiting reservoir computing, we develop a model-free and fully data-driven framework to accurately track time-varying parameters from partial state observation in real time. In particular, with training data from a subset of the dynamical variables of the system for a small number of known parameter values, the framework is able to accurately predict the parameter variations in time. Low- and high-dimensional, Markovian and non-Markovian nonlinear dynamical systems are used to demonstrate the power of the machine-learning based parameter-tracking framework. Pertinent issues affecting the tracking performance are addressed.


title: Experimental Study of Condensation of Water on Polydimethylsiloxane-Coated Copper Surfaces

abstract: Modification of surfaces to enable dropwise condensation is a promising approach for achieving high condensation rates. In this work, we present an experimental study on condensation of water on copper surfaces coated with an ultrathin, 5 nm - 10 nm thick polydimethylsiloxane (PDMS) layer. This hydrophobic coating possesses a very low thermal resistance, which in combination with copper substrate enables achieving high condensation rates in heat transfer applications. The PDMS-coated copper substrates have been fabricated with a newly developed method, which involves turning, sanding, polishing, oxidation, and polymer coating steps. The measured static contact angle was 110{\deg}, and a the contact angle hysteresis was 2{\deg}. The achieved very low hysteresis is advantageous for promoting dropwise condensation. The surface showed no ageing effects during 100 repetitions of advancing and receding contact angle (ARCA) measurements. Condensation heat transfer on uncoated and PDMS-coated copper surfaces surfaces has been studied experimentally in a saturated water vapor atmosphere at 60{\deg}C. An enhancement factor for heat flux and heat transfer coefficient of up to 1.6 was found on PDMS-coated copper surfaces compared to uncoated surfaces, which decreased to 1.1 on second and third day of condensation operation. Images of the condensation surface were recorded while conducting condensation experiments and post processed to evaluate drop departure diameter and frequency of drop sweeping events. It has been shown that the behavior of the heat transfer coefficient correlates with the frequency of the sweeping events.


title: Grounding Gaps in Language Model Generations

abstract: Effective conversation requires common ground: a shared understanding between the participants. Common ground, however, does not emerge spontaneously in conversation. Speakers and listeners work together to both identify and construct a shared basis while avoiding misunderstanding. To accomplish grounding, humans rely on a range of dialogue acts, like clarification (What do you mean?) and acknowledgment (I understand.). However, it is unclear whether large language models (LLMs) generate text that reflects human grounding. To this end, we curate a set of grounding acts and propose corresponding metrics that quantify attempted grounding. We study whether LLM generations contain grounding acts, simulating turn-taking from several dialogue datasets and comparing results to humans. We find that -- compared to humans -- LLMs generate language with less conversational grounding, instead generating text that appears to simply presume common ground. To understand the roots of the identified grounding gap, we examine the role of instruction tuning and preference optimization, finding that training on contemporary preference data leads to a reduction in generated grounding acts. Altogether, we highlight the need for more research investigating conversational grounding in human-AI interaction.


title: Model Agnostic Explainable Selective Regression via Uncertainty Estimation

abstract: With the wide adoption of machine learning techniques, requirements have evolved beyond sheer high performance, often requiring models to be trustworthy. A common approach to increase the trustworthiness of such systems is to allow them to refrain from predicting. Such a framework is known as selective prediction. While selective prediction for classification tasks has been widely analyzed, the problem of selective regression is understudied. This paper presents a novel approach to selective regression that utilizes model-agnostic non-parametric uncertainty estimation. Our proposed framework showcases superior performance compared to state-of-the-art selective regressors, as demonstrated through comprehensive benchmarking on 69 datasets. Finally, we use explainable AI techniques to gain an understanding of the drivers behind selective regression. We implement our selective regression method in the open-source Python package doubt and release the code used to reproduce our experiments.


title: Breakdown of collinear factorization in the exclusive photoproduction of a $ \pi ^{0}\gamma $ pair with large invariant mass

abstract: We study the exclusive photoproduction of a $ \pi ^{0}\gamma $ pair with large invariant mass $ M_{\gamma \pi}^2 $, which is sensitive to the exchange of either two quarks or two gluons in the $ t $-channel. In this letter, we show that the process involving two-gluon exchanges does not factorize in the Bjorken limit at the leading twist. This can be explicitly demonstrated by the fact that there exist diagrams, which contribute at the leading twist, for which Glauber gluons remain trapped, due to the pinching of the contour integrations of both the plus and minus component of the Glauber gluon momentum. For the same reason, $\pi^0$-nucleon scattering to two photons also suffers from the same issue. On the other hand, we stress that there are no issues with respect to collinear factorization for the quark channels. By considering an analysis of all potential reduced diagrams of leading pinch surfaces, we argue that the quark channel is safe from Glauber pinches, and therefore, a collinear factorization in that case follows through without any problems. This means that processes where gluon exchanges are forbidden, such as the exclusive photoproduction of $ \pi ^{\pm}\gamma $ and $ \rho^{0,\,\pm} \gamma $, are unaffected by the factorization breaking effects we point out in this letter.


title: Physiological complexity of EEG as a proxy for dementia risk prediction: a review and preliminary cross-section analysis

abstract: The aim of this work is to give the readers a review (perspective) of prior work on this kind of complexity-based detection from resting-state EEG and present our preliminary cross-section analysis results on how EEG complexity of supposedly healthy senior persons can serve as an early warning to clinicians. Together with the use of wearables for health, this approach to early detection can be done out of clinical setting improving the chances of increasing the quality of life in seniors.


title: Predicting risk/reward ratio in financial markets for asset management using machine learning

abstract: Financial market forecasting remains a formidable challenge despite the surge in computational capabilities and machine learning advancements. While numerous studies have underscored the precision of computer-generated market predictions, many of these forecasts fail to yield profitable trading outcomes. This discrepancy often arises from the unpredictable nature of profit and loss ratios in the event of successful and unsuccessful predictions. In this study, we introduce a novel algorithm specifically designed for forecasting the profit and loss outcomes of trading activities. This is further augmented by an innovative approach for integrating these forecasts with previous predictions of market trends. This approach is designed for algorithmic trading, enabling traders to assess the profitability of each trade and calibrate the optimal trade size. Our findings indicate that this method significantly improves the performance of traditional trading strategies as well as algorithmic trading systems, offering a promising avenue for enhancing trading decisions.


title: Temporal Knowledge Question Answering via Abstract Reasoning Induction

abstract: In this study, we address the challenge of enhancing temporal knowledge reasoning in Large Language Models (LLMs). LLMs often struggle with this task, leading to the generation of inaccurate or misleading responses. This issue mainly arises from their limited ability to handle evolving factual knowledge and complex temporal logic. To overcome these limitations, we propose Abstract Reasoning Induction (ARI) framework, which divides temporal reasoning into two distinct phases: Knowledge-agnostic and Knowledge-based. This framework offers factual knowledge support to LLMs while minimizing the incorporation of extraneous noisy data. Concurrently, informed by the principles of constructivism, ARI provides LLMs the capability to engage in proactive, self-directed learning from both correct and incorrect historical reasoning samples. By teaching LLMs to actively construct knowledge and methods, it can significantly boosting their temporal reasoning abilities. Our approach achieves remarkable improvements, with relative gains of 29.7% and 9.27% on two temporal QA datasets, underscoring its efficacy in advancing temporal reasoning in LLMs. The code can be found at https://github.com/czy1999/ARI-QA


title: Quest for optimal quantum resetting: protocols for a particle on a chain

abstract: In the classical context, it is well known that, sometimes, if the search does not find its target, it is better to start the process anew again, known as resetting. The quantum counterpart of resetting also indicates speeding up the detection process by eliminating the dark states, i.e., situations where the particle avoids detection. In this work, we introduce a most probable position resetting (MPR) protocol in which we reset the particle in a position where the probability of finding the particle could have been maximum, provided one would let the system evolve Unitarily in a given time window. In a tight-binding lattice model, there exists a 2-fold degeneracy (left and right) of the positions of maximum probability. The survival probability with optimal restart rate approaches zero (detection probability approaches one) when the particle is reset with equal probability on both sides. This protocol significantly reduces the optimal mean first-detected-passage time (FDT) and performs better even if the detector is far apart compared to the usual resetting protocols where the particle is brought back to the initial position. We propose a modified protocol, adaptive two-stage MPR, by making the associated probabilities of resetting to the right and left a function of resetting steps. In this protocol, we see a further reduction of the optimal mean FDT and improvement in the search process when the detector is far apart.


title: KPZ equation limit of random walks in random environments

abstract: We show that under a certain moderate deviation scaling, the multiplicative-noise stochastic heat equation (SHE) arises as the fluctuations of the quenched density of a 1D random walk whose transition probabilities are iid [0,1]-valued random variables. In contrast to the case of directed polymers in the intermediate disorder regime, the variance of our weights is fixed rather than vanishing under the diffusive rescaling of space-time. Consequently, taking a naive limit of the chaos expansion fails for this model, and a nontrivial noise coefficient is observed in the limit. Rather than using chaos techniques, our proof instead uses the fact that in this regime the quenched density solves a discrete SPDE which resembles the SHE. As a byproduct of our techniques, it is shown that independent noise is generated in the limit.


title: Exclusive diffractive J/psi and Psi(2S) production in dipole model using a holographic AdS/QCD light front wavefunction with longitudinal confinement

abstract: We use an anti-de Sitter/Quantum Chromodynamics (AdS/QCD) based holographic light-front wavefunction (LFWF) for vector meson, in conjunction with the dipole model to investigate the cross-sections data for the diffractive and exclusive J/psi and Psi(2S) production. We confront the experimental data using a new explicit form of the holographic LFWF, where the longitudinal confinement dynamics in light-front Schrodinger equation is captured by 't Hooft equation of (1+1)-dim, in large Nc approximation, in addition to the transverse confinement dynamics governed by the confining mass scale parameter, kappa in vector mesons. We obtain the LFWF parameters from fitting to the exclusive J/psi electro production data from electron-proton collision at HERA collider for m_c = 1.27 GeV. Our results suggest that the dipole model together with holographic meson LFWFs with longitudinal confinement is able to give a successful description for differential scattering cross-section for exclusive J/psi electro production for H1 and ZEUS data. We also predict the rapidity distributions of differential scattering cross-section and total photo production of J/psi and Psi(2S) states in proton-proton ultra-peripheral collisions(UPCs) at center of mass energy sqrt s = 7, 13 TeV. Using the minimum set of parameters, our predictions for the UPCs are in good agreement with the recent experimental observations of UPCs at ALICE and LHCb Collaborations.


title: Exploring T-Duality for Self-Dual Fields

abstract: We study avatars of T-duality within Sen's formalism for self-dual field strengths in various dimensions. This formalism is shown to naturally accommodate the T-duality relation between Type IIA/IIB theories when compactified on a circle without the need for imposing the self-duality constraint by hand, as is usually done. We also continue our study of this formalism on two-dimensional target spacetimes and initiate its study as a worldsheet theory. In particular, we show that Sen's action provides a natural worldsheet-based understanding of twisted and asymmetrically twisted strings. Finally, we show that the $\mathrm{T}\bar{\mathrm{T}}$-deformed theory of left- and right-chiral bosons described in Sen's formalism possesses a scaling limit that is related via field-theoretic T-duality to a recently studied integrable deformation of quantum mechanics.


title: CLEAN-EVAL: Clean Evaluation on Contaminated Large Language Models

abstract: We are currently in an era of fierce competition among various large language models (LLMs) continuously pushing the boundaries of benchmark performance. However, genuinely assessing the capabilities of these LLMs has become a challenging and critical issue due to potential data contamination, and it wastes dozens of time and effort for researchers and engineers to download and try those contaminated models. To save our precious time, we propose a novel and useful method, Clean-Eval, which mitigates the issue of data contamination and evaluates the LLMs in a cleaner manner. Clean-Eval employs an LLM to paraphrase and back-translate the contaminated data into a candidate set, generating expressions with the same meaning but in different surface forms. A semantic detector is then used to filter the generated low-quality samples to narrow down this candidate set. The best candidate is finally selected from this set based on the BLEURT score. According to human assessment, this best candidate is semantically similar to the original contamination data but expressed differently. All candidates can form a new benchmark to evaluate the model. Our experiments illustrate that Clean-Eval substantially restores the actual evaluation results on contaminated LLMs under both few-shot learning and fine-tuning scenarios.


title: BPS Fivebrane Stars I: Expectation Values of Observables

abstract: We study ensembles of 1/2-BPS bound states of fundamental strings and NS-fivebranes (NS5-F1 states) in the AdS decoupling limit. We revisit a solution corresponding to an ensemble average of these bound states, and find that the appropriate duality frame for describing the near-source structure is the T-dual NS5-P frame, where the bound state is a collection of momentum waves on the fivebranes. We find that the fivebranes are generically well-separated; this property results in the applicability of perturbative string theory. The geometry sourced by the typical microstate is not close to that of an extremal non-rotating black hole; instead the fivebranes occupy a ball whose radius is parametrically much larger than the "stretched horizon" scale of the corresponding black hole. These microstates are thus better characterized as BPS fivebrane stars than as small black holes. When members of the ensemble spin with two fixed angular potentials about two orthogonal planes, we find that the spherical ball of the non-rotating ensemble average geometry deforms into an ellipsoid. This contrasts with ring structures obtained when fixing the angular momenta instead of the angular potentials; we trace this difference of ensembles to large fluctuations of the angular momentum in the ensemble of fixed angular potential.


title: Radiative Asymptotic Symmetries of 3D Einstein-Maxwell Theory

abstract: We study the null asymptotic structure of Einstein-Maxwell theory in three-dimensional (3D) spacetimes. Although devoid of bulk gravitational degrees of freedom, the system admits a massless photon and can therefore accommodate electromagnetic radiation. We derive fall-off conditions for the Maxwell field that contain both Coulombic and radiative modes with non-vanishing news. The latter produces non-integrability and fluxes in the asymptotic surface charges, and gives rise to a non-trivial 3D Bondi mass loss formula. The resulting solution space is thus analogous to a dimensional reduction of 4D pure gravity, with the role of gravitational radiation played by its electromagnetic cousin. We use this simplified setup to investigate choices of charge brackets in detail, and compute in particular the recently introduced Koszul bracket. When the latter is applied to Wald-Zoupas charges, which are conserved in the absence of news, it leads to the field-dependent central extension found earlier in [arXiv:1503.00856]. We also consider (Anti-)de Sitter asymptotics to further exhibit the analogy between this model and 4D gravity with leaky boundary conditions.


title: BPS Fivebrane Stars II: Fluctuations

abstract: We investigate quantum fluctuations of metric components in coherent 1/2-BPS bound states of $n_1$ fundamental strings and $n_5$ NS5-branes. The leading order contribution in an expansion in $1/(n_1n_5)$ is calculated via a combination of analytical and numerical methods. We find that the fluctuations are small away from a tiny distance from the source, comparable to the 6d Planck scale. Comparing this result with an analysis in the literature of fluctuations in the maximally mixed state, we conclude that the large fluctuations previously found for the latter are statistical rather than quantum in nature, and that perturbative string theory provides an accurate description of these backgrounds.


title: Differential Rotation in Compact Objects with Hyperons and Delta Isobars

abstract: Neutron stars may experience differential rotation on short, dynamical timescales following extreme astrophysical events like binary neutron star mergers. In this work, the masses and radii of differentially rotating neutron star models are computed. We employ a set of equations of states for dense hypernuclear and $\Delta$-admixed-hypernuclear matter obtained within the framework of CDF theory in the relativistic Hartree-Fock (RHF) approximation. Results are shown for varying meson-$\Delta$ couplings, or equivalently the $\Delta$-potential in nuclear matter. A comparison of our results with those obtained for non-rotating stars shows that the maximum mass difference between differentially rotating and static stars is independent of the underlying particle composition of the star. We further find that the decrease in the radii and increase in the maximum masses of stellar models when $\Delta$-isobars are added to hyperonuclear matter (as initially observed for static and uniformly rotating stars) persist also in the case of differentially rotating neutron stars.


title: Characterizing the efficacy of methods to subtract terrestrial transient noise near gravitational wave events and the effects on parameter estimation

abstract: We investigate the impact of transient noise artifacts, or {\it glitches}, on gravitational wave inference, and the efficacy of data cleaning procedures in recovering unbiased source properties. Due to their time-frequency morphology, broadband glitches demonstrate moderate to significant biasing of posterior distributions away from true values. In contrast, narrowband glitches have negligible biasing effects owing to distinct signal and glitch morphologies. We inject simulated binary black hole signals into data containing three common glitch types from past LIGO-Virgo observing runs, and reconstruct both signal and glitch waveforms using {\tt BayesWave}, a wavelet-based Bayesian analysis. We apply the standard LIGO-Virgo-KAGRA deglitching procedure to the detector data - we subtract the glitch waveform estimated by the joint {\tt BayesWave} inference before performing parameter estimation with detailed compact binary waveform models. We find that this deglitching effectively mitigates bias from broadband glitches, with posterior peaks aligning with true values post deglitching. This provides a baseline validation of existing techniques, while demonstrating waveform reconstruction improvements to the Bayesian algorithm for robust astrophysical characterization in glitch-prone detector data.


title: Characteristic classes for flat Diff(M)-foliations

abstract: In this work we relate the known results about the homotopy type of classifying spaces for smooth foliations, with the homology and cohomology of the discrete group of diffeomorphisms of a smooth compact connected oriented manifold. The Mather-Thurston Theorem forms a bridge between the results on the homotopy types of classifying spaces and the various homology and cohomology groups that are studied. We introduce the algebraic K-theory of a manifold M that is derived from the discrete group of diffeomorphisms of M, and observe that the calculations of homotopy groups in this work are about these K-theory groups. We include a variety of remarks and open problems related to the study of the diffeomorphism groups and their homological invariants using the Mather-Thurston Theorem.


title: The black hole occupation fraction of local dwarf galaxies with AXIS

abstract: The fraction of local dwarf galaxies that hosts massive black holes is arguably the cleanest diagnostic of the dominant seed formation mechanism of today's supermassive black holes. A 5 per cent constraint on this quantity can be achieved with AXIS observations of 3300 galaxies across the mass spectrum through a combination of serendipitous extra-galactic fields plus a dedicated 1 Msec GO program.


title: Leaving No Branches Behind: Predicting Baryonic Properties of Galaxies from Merger Trees

abstract: Galaxies play a key role in our endeavor to understand how structure formation proceeds in the Universe. For any precision study of cosmology or galaxy formation, there is a strong demand for huge sets of realistic mock galaxy catalogs, spanning cosmologically significant volumes. For such a daunting task, methods that can produce a direct mapping between dark matter halos from dark matter-only simulations and galaxies are strongly preferred, as producing mocks from full-fledged hydrodynamical simulations or semi-analytical models is too expensive. Here we present a Graph Neural Network-based model that is able to accurately predict key properties of galaxies such as stellar mass, $g-r$ color, star formation rate, gas mass, stellar metallicity, and gas metallicity, purely from dark matter properties extracted from halos along the full assembly history of the galaxies. Tests based on the TNG300 simulation of the IllustrisTNG project show that our model can recover the baryonic properties of galaxies to high accuracy, over a wide redshift range ($z = 0-5$), for all galaxies with stellar masses more massive than $10^9\,M_\odot$ and their progenitors, with strong improvements over the state-of-the-art methods. We further show that our method makes substantial strides toward providing an understanding of the implications of the IllustrisTNG galaxy formation model.


title: Identifying the spin trapped character of the $^{32}$Si isomeric state

abstract: The properties of a nanosecond isomer in $^{32}$Si, disputed in previous studies, depend on the evolution of proton and neutron shell gaps near the `island of inversion'. We have placed the isomer at 5505.2(2) keV with $J^{\pi} = 5^-$, decaying primarily via an $E3$ transition to the $2^+_1$ state. The $E3$ strength of 0.0841(10) W.u. is unusually small and suggests that this isomer is dominated by the $(\nu d_{3/2})^{-1} \otimes (\nu f_{7/2})^{1}$ configuration, which is sensitive to the $N=20$ shell gap. A newly observed $4^+_1$ state is placed at 5881.4(13) keV; its energy is enhanced by the $Z=14$ subshell closure. This indicates that the isomer is located in a `yrast trap', a feature rarely seen at low mass numbers.


title: Hybrid Quantum Cryptography from Communication Complexity

abstract: We introduce an explicit construction for a key distribution protocol in the Quantum Computational Timelock (QCT) security model, where one assumes that computationally secure encryption may only be broken after a time much longer than the coherence time of available quantum memories. Taking advantage of the QCT assumptions, we build a key distribution protocol called HM-QCT from the Hidden Matching problem for which there exists an exponential gap in one-way communication complexity between classical and quantum strategies. We establish that the security of HM-QCT against arbitrary i.i.d. attacks can be reduced to the difficulty of solving the underlying Hidden Matching problem with classical information. Legitimate users, on the other hand, can use quantum communication, which gives them the possibility of sending multiple copies of the same quantum state while retaining an information advantage. This leads to an everlasting secure key distribution scheme over $n$ bosonic modes. Such a level of security is unattainable with purely classical techniques. Remarkably, the scheme remains secure with up to $\mathcal{O}\big( \frac{\sqrt{n}}{\log(n)}\big)$ input photons for each channel use, extending the functionalities and potentially outperforming QKD rates by several orders of magnitudes.


title: Approaching adverse event detection utilizing transformers on clinical time-series

abstract: Patients being admitted to a hospital will most often be associated with a certain clinical development during their stay. However, there is always a risk of patients being subject to the wrong diagnosis or to a certain treatment not pertaining to the desired effect, potentially leading to adverse events. Our research aims to develop an anomaly detection system for identifying deviations from expected clinical trajectories. To address this goal we analyzed 16 months of vital sign recordings obtained from the Nordland Hospital Trust (NHT). We employed an self-supervised framework based on the STraTS transformer architecture to represent the time series data in a latent space. These representations were then subjected to various clustering techniques to explore potential patient phenotypes based on their clinical progress. While our preliminary results from this ongoing research are promising, they underscore the importance of enhancing the dataset with additional demographic information from patients. This additional data will be crucial for a more comprehensive evaluation of the method's performance.


title: Optimizing Fictitious States for Bell Inequality Violation in Bipartite Qubit Systems

abstract: There is a significant interest in testing quantum entanglement and Bell inequality violation in high-energy experiments. Since the analyses in high-energy experiments are performed with events statistically averaged over phase space, the states used to determine observables depend on the choice of coordinates through an event-dependent basis and are thus not genuine quantum states, but rather "fictitious states." We prove that if Bell inequality violation is observed with a fictitious state, then it implies the same for a quantum sub-state. We further show analytically that the basis which diagonalizes the spin-spin correlations is optimal for constructing fictitious states, and for maximizing the violation of Bell's inequality.


title: Thermal noise calibration of functionalized cantilevers for force microscopy: effects of the colloidal probe position

abstract: Colloidal probes are often used in force microscopy when the geometry of the tip-sample interaction should be well controlled. Their calibration requires the understanding of their mechanical response, which is very sensitive to the details of the force sensor consisting of a cantilever and the attached colloid. We present analytical models to describe the dynamics of the cantilever and its load positioned anywhere along its length. The thermal noise calibration of such probes is then studied from a practical point of view, leading to correction coefficients that can be applied in standard force microscope calibration routines. Experimental measurements of resonance frequencies and thermal noise profiles of raw and loaded cantilevers demonstrate the validity of the approach.


title: Arkade: k-Nearest Neighbor Search With Non-Euclidean Distances using GPU Ray Tracing

abstract: High-performance implementations of $k$-Nearest Neighbor Search ($k$NN) in low dimensions use tree-based data structures. Tree algorithms are hard to parallelize on GPUs due to their irregularity. However, newer Nvidia GPUs offer hardware support for tree operations through ray-tracing cores. Recent works have proposed using RT cores to implement $k$NN search, but they all have a hardware-imposed constraint on the distance metric used in the search -- the Euclidean distance. We propose and implement two reductions to support $k$NN for a broad range of distances other than the Euclidean distance: Arkade Filter-Refine and Arkade Monotone Transformation, each of which allows non-Euclidean distance-based nearest neighbor queries to be performed in terms of the Euclidean distance. With our reductions, we observe that $k$NN search time speedups range between $1.6$x-$200$x and $1.3$x-$33.1$x over various state-of-the-art GPU shader core and RT core baselines, respectively. In evaluation, we provide several insights on RT architectures' ability to efficiently build and traverse the tree by analyzing the $k$NN search time trends.


title: Measurement of the static Stark Shift of the $7s \ ^2S_{1/2}$ level in atomic cesium

abstract: We report a new precision measurement of the dc Stark shift of the $6s\hspace{1mm} ^2S_{1/2} \rightarrow 7s\hspace{1mm}^2S_{1/2}$ transition in atomic cesium-133. Our result is 0.72246 (29) $\textrm{Hz}(\textrm{V}/\textrm{cm})^{-2}$. This result differs from a previous measurement of the Stark shift by $\sim$0.5\%. We use this value to recalculate the magnitude of the reduced dipole matrix elements $\langle7s ||r||7p_{j}\rangle$, as well as the vector transition polarizability for the $6s \rightarrow 7s$ transition, $\tilde{\beta} = 27.043 \: (36) \ a_0^3$. This determination helps resolve a critical discrepancy between two techniques for determining the vector polarizability.


title: Generalised eigenfunction expansion and singularity expansion methods for canonical time-domain wave scattering problems

abstract: The generalised eigenfunction expansion method (GEM) and the singularity expansion method (SEM) are applied to solve the canonical problem of wave scattering on an infinite stretched string in the time domain. The GEM, which is shown to be equivalent to d'Alembert's formula when no scatterer is present, is also derived in the case of a point-mass scatterer coupled to a spring. The discrete GEM, which generalises the discrete Fourier transform, is shown to reduce to matrix multiplication. The SEM, which is derived from the Fourier transform and the residue theorem, is also applied to solve the problem of scattering by the mass-spring system. The GEM and SEM are also applied to the problem of scattering by a mass positioned a fixed distance from an anchor point, which supports more complicated resonant behavior.


title: Harada-Maxwell Static Spherically Symmetric Spacetimes

abstract: Very recently Harada has proposed a gravitational theory which is of third order in the derivatives of the metric tensor with the property that any solution of Einstein's field equations (EFEs) possibly with a cosmological constant is necessarily a solution of the new theory. Remarkably he showed that even in a matter-dominated universe with zero cosmological constant, there is a late-time transition from decelerating to accelerating expansion. Harada also derived an exact solution which is generalisation of the Schwarzschild solution. However, this was not the most general static spherically vacuum solution of the theory and the general solution was subsequently obtained by Barnes. Recently Tarciso et al. have considered regular black holes in Harada's theory coupled to non-linear electrodynamics and scalar fields. In particular they exhibit a four-parameter solution with a zero scalar field whose source is a Maxwell electromagnetic field. It is a straightforward generalisation of Harada's vacuum solution analagous to the Reissner-Nordstrom generalistaion of the Schwarzschild solution. However, this solution is not the most general static spherically symmetric solution of the Harada-Maxwell field equations (i.e.\ Harada gravitational fields with a Maxwell electromagnetic source). The most general such solution is obtained in this paper.


title: Enhancing AmBC Systems with Deep Learning for Joint Channel Estimation and Signal Detection

abstract: The era of ubiquitous, affordable wireless connectivity has opened doors to countless practical applications. In this context, ambient backscatter communication (AmBC) stands out, utilizing passive tags to establish connections with readers by harnessing reflected ambient radio frequency (RF) signals. However, conventional data detectors face limitations due to their inadequate knowledge of channel and RF-source parameters. To address this challenge, we propose an innovative approach using a deep neural network (DNN) for channel state estimation (CSI) and signal detection within AmBC systems. Unlike traditional methods that separate CSI estimation and data detection, our approach leverages a DNN to implicitly estimate CSI and simultaneously detect data. The DNN model, trained offline using simulated data derived from channel statistics, excels in online data recovery, ensuring robust performance in practical scenarios. Comprehensive evaluations validate the superiority of our proposed DNN method over traditional detectors, particularly in terms of bit error rate (BER). In high signal-to-noise ratio (SNR) conditions, our method exhibits an impressive approximately 20% improvement in BER performance compared to the maximum likelihood (ML) approach. These results underscore the effectiveness of our developed approach for AmBC channel estimation and signal detection. In summary, our method outperforms traditional detectors, bolstering the reliability and efficiency of AmBC systems, even in challenging channel conditions.


title: Design Theory for Societal Digital Transformation: The Case of Digital Global Health

abstract: With societal challenges, including but not limited to human development, equity, social justice, and climate change, societal-level digital transformation (SDT) is of imminent relevance and theoretical interest. While building on local-level efforts, societal-level transformation is a nonlinear extension of the local level. Unfortunately, academic discourse on digital transformation has largely left SDT unaccounted for. Drawing on more than 25 years of intensive, interventionist research engagement with the digital transformation of public healthcare information management and delivery in more than 80 countries in the Global South, we contribute to theorizing SDT in the form of a design theory consisting of six interconnected design principles. These design principles articulate the interplay and tensions of accommodating over time increased diversity and flexibility in digital solutions, while simultaneously connecting local, national, and regional/ global efforts.


title: AbsPyramid: Benchmarking the Abstraction Ability of Language Models with a Unified Entailment Graph

abstract: Cognitive research indicates that abstraction ability is essential in human intelligence, which remains under-explored in language models. In this paper, we present AbsPyramid, a unified entailment graph of 221K textual descriptions of abstraction knowledge. While existing resources only touch nouns or verbs within simplified events or specific domains, AbsPyramid collects abstract knowledge for three components of diverse events to comprehensively evaluate the abstraction ability of language models in the open domain. Experimental results demonstrate that current LLMs face challenges comprehending abstraction knowledge in zero-shot and few-shot settings. By training on our rich abstraction knowledge, we find LLMs can acquire basic abstraction abilities and generalize to unseen events. In the meantime, we empirically show that our benchmark is comprehensive to enhance LLMs across two previous abstraction tasks.


title: Can Query Expansion Improve Generalization of Strong Cross-Encoder Rankers?

abstract: Query expansion has been widely used to improve the search results of first-stage retrievers, yet its influence on second-stage, cross-encoder rankers remains under-explored. A recent work of Weller et al. [44] shows that current expansion techniques benefit weaker models such as DPR and BM25 but harm stronger rankers such as MonoT5. In this paper, we re-examine this conclusion and raise the following question: Can query expansion improve generalization of strong cross-encoder rankers? To answer this question, we first apply popular query expansion methods to state-of-the-art cross-encoder rankers and verify the deteriorated zero-shot performance. We identify two vital steps for cross-encoders in the experiment: high-quality keyword generation and minimal-disruptive query modification. We show that it is possible to improve the generalization of a strong neural ranker, by prompt engineering and aggregating the ranking results of each expanded query via fusion. Specifically, we first call an instruction-following language model to generate keywords through a reasoning chain. Leveraging self-consistency and reciprocal rank weighting, we further combine the ranking results of each expanded query dynamically. Experiments on BEIR and TREC Deep Learning 2019/2020 show that the nDCG@10 scores of both MonoT5 and RankT5 following these steps are improved, which points out a direction for applying query expansion to strong cross-encoder rankers.


title: Planetary nebulae as tracers of stellar population properties: unlocking their potential with integral-field spectroscopy

abstract: Planetary nebulae (PNe) are essential tracers of the kinematics of the diffuse halo and intracluster light where stellar spectroscopy is unfeasible, due to their strong emission lines. However, that is not all they can reveal about the underlying stellar population. In recent years, it has also been found that PNe in the metal-poor halos of galaxies have different properties (specific frequency, luminosity function), than PNe in the more metal-rich galaxy centers. A more quantitative understanding of the role of age and metallicity in these relations would turn PNe into valuable stellar-population tracers. In order to do that, a full characterization of PNe in regions where the stellar light can also be analysed in detail is necessary. In this work, we make use of integral-field spectroscopic data covering the central regions of galaxies, which allow us to measure both stellar ages and metallicities as well as to detect PNe. This analysis is fundamental to calibrate PNe as stellar population tracers and to push our understanding of galaxy properties at unprecedented galactocentric distances.


title: An Open-Source 3D FE Quench Simulation Tool for No-Insulation HTS Pancake Coils

abstract: A new module, Pancake3D, of the open-source Finite Element Quench Simulator (FiQuS) has been developed in order to perform transient simulations of no-insulation (NI) high-temperature superconducting (HTS) pancake coils in 3-dimensions. FiQuS/Pancake3D can perform magnetodynamic or coupled magneto-thermal simulations. Thanks to the use of thin shell approximations, an $\vec{H}-\phi$ formulation, and anisotropic homogenization techniques, each turn can be resolved on the mesh level in an efficient and robust manner. FiQuS/Pancake3D relies on pre-formulated finite-element (FE) formulations and numerical approaches that are programmatically adjusted based on a text input file. In this paper, the functionalities and capabilities of FiQuS/Pancake3D are presented. The challenges of FE simulation of NI coils and how FiQuS/Pancake3D addresses them are explained. To highlight the functionalities, the results of a magneto-thermal analysis of a double pancake coil with 40 turns per pancake with local degradation of the critical current density are conducted and discussed. Furthermore, a parameter sweep of the size of this local degradation is presented. All the FiQuS input files for reproducing the simulations are provided.


title: RBPGAN: Recurrent Back-Projection GAN for Video Super Resolution

abstract: Recently, video super resolution (VSR) has become a very impactful task in the area of Computer Vision due to its various applications. In this paper, we propose Recurrent Back-Projection Generative Adversarial Network (RBPGAN) for VSR in an attempt to generate temporally coherent solutions while preserving spatial details. RBPGAN integrates two state-of-the-art models to get the best in both worlds without compromising the accuracy of produced video. The generator of the model is inspired by RBPN system, while the discriminator is inspired by TecoGAN. We also utilize Ping-Pong loss to increase temporal consistency over time. Our contribution together results in a model that outperforms earlier work in terms of temporally consistent details, as we will demonstrate qualitatively and quantitatively using different datasets.


title: SiRA: Sparse Mixture of Low Rank Adaptation

abstract: Parameter Efficient Tuning has been an prominent approach to adapt the Large Language Model to downstream tasks. Most previous works considers adding the dense trainable parameters, where all parameters are used to adapt certain task. We found this less effective empirically using the example of LoRA that introducing more trainable parameters does not help. Motivated by this we investigate the importance of leveraging "sparse" computation and propose SiRA: sparse mixture of low rank adaption. SiRA leverages the Sparse Mixture of Expert(SMoE) to boost the performance of LoRA. Specifically it enforces the top $k$ experts routing with a capacity limit restricting the maximum number of tokens each expert can process. We propose a novel and simple expert dropout on top of gating network to reduce the over-fitting issue. Through extensive experiments, we verify SiRA performs better than LoRA and other mixture of expert approaches across different single tasks and multitask settings.


title: PEARL: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrievers

abstract: Powerful large language models have facilitated the development of writing assistants that promise to significantly improve the quality and efficiency of composition and communication. However, a barrier to effective assistance is the lack of personalization in LLM outputs to the author's communication style and specialized knowledge. In this paper, we address this challenge by proposing PEARL, a retrieval-augmented LLM writing assistant personalized with a generation-calibrated retriever. Our retriever is trained to select historic user-authored documents for prompt augmentation, such that they are likely to best personalize LLM generations for a user request. We propose two key novelties for training our retriever: 1) A training data selection method that identifies user requests likely to benefit from personalization and documents that provide that benefit; and 2) A scale-calibrating KL-divergence objective that ensures that our retriever closely tracks the benefit of a document for personalized generation. We demonstrate the effectiveness of PEARL in generating personalized workplace social media posts and Reddit comments. Finally, we showcase the potential of a generation-calibrated retriever to double as a performance predictor and further improve low-quality generations via LLM chaining.


title: The International Large Detector (ILD) for a future electron-positron collider: Status and Plans

abstract: This work presents the status and plans of the International Large Detector (ILD) concept, one of the most detailed and comprehensive detector concepts for a future Higgs factory. Most hardware groups have demonstrated ILD's performance targets and continue development with focus on improving further and making ILD fit for a circular collider. Their status, new developments and plans are elaborated. Two examples are given of new reconstruction methods that utilise hardware developments and contribute to advanced physics analyses prospects.


title: ContraDoc: Understanding Self-Contradictions in Documents with Large Language Models

abstract: In recent times, large language models (LLMs) have shown impressive performance on various document-level tasks such as document classification, summarization, and question-answering. However, research on understanding their capabilities on the task of self-contradictions in long documents has been very limited. In this work, we introduce ContraDoc, the first human-annotated dataset to study self-contradictions in long documents across multiple domains, varying document lengths, self-contradictions types, and scope. We then analyze the current capabilities of four state-of-the-art open-source and commercially available LLMs: GPT3.5, GPT4, PaLM2, and LLaMAv2 on this dataset. While GPT4 performs the best and can outperform humans on this task, we find that it is still unreliable and struggles with self-contradictions that require more nuance and context. We release the dataset and all the code associated with the experiments (https://github.com/ddhruvkr/CONTRADOC).


title: The union of independent USFs on $\mathbb{Z}^d$ is transient

abstract: We show that the union of two or more independent uniform spanning forests (USF) on $\mathbb{Z}^d$ with $d\geq 3$ almost surely forms a connected transient graph. In fact, this also holds when taking the union of a deterministic everywhere percolating set and an independent $\epsilon$-Bernoulli percolation on a single USF sample.


title: Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization

abstract: While large language models (LLMs) already achieve strong performance on standard generic summarization benchmarks, their performance on more complex summarization task settings is less studied. Therefore, we benchmark LLMs on instruction controllable text summarization, where the model input consists of both a source article and a natural language requirement for the desired summary characteristics. To this end, we curate an evaluation-only dataset for this task setting and conduct human evaluation on 5 LLM-based summarization systems. We then benchmark LLM-based automatic evaluation for this task with 4 different evaluation protocols and 11 LLMs, resulting in 40 evaluation methods in total. Our study reveals that instruction controllable text summarization remains a challenging task for LLMs, since (1) all LLMs evaluated still make factual and other types of errors in their summaries; (2) all LLM-based evaluation methods cannot achieve a strong alignment with human annotators when judging the quality of candidate summaries; (3) different LLMs show large performance gaps in summary generation and evaluation. We make our collected benchmark, InstruSum, publicly available to facilitate future research in this direction.


title: Unified incremental nonlinear controller for the transition control of a hybrid dual-axis tilting rotor quad-plane

abstract: Overactuated Tilt Rotor Unmanned Aerial Vehicles are renowned for exceptional wind resistance and a broad operational range, which poses complex control challenges due to non-affine dynamics. Traditional solutions employ multi-state switched logic controllers for transitions. Our study introduces a novel unified incremental nonlinear controller for overactuated dual-axis tilting rotor quad-planes, seamlessly managing pitch, roll, and physical actuator commands. The control allocation problem is addressed using a SQP iterative optimization algorithm, well-suited for nonlinear actuator effectiveness in thrust vectoring vehicles. The controller design integrates desired roll and pitch angle inputs. These desired attitude angles are autonomously managed by the controller and then conveyed to the vehicle during slow airspeed phases, when the vehicle maintains its 6 DOF. We incorporate an AoA protection logic to prevent wing stall and a yaw rate reference model for coordinated turns. Flight tests confirm the controller's effectiveness in transitioning from hovering to forward flight, achieving desired vertical and lateral accelerations, and reverting to hovering.


title: Structure responsible for the superconducting state in La3Ni2O7 at high pressure and low temperature conditions

abstract: Very recently, a new superconductor with Tc = 80 K was reported in nickelate (La3Ni2O7) at around 15 - 40 GPa conditions (Nature, 621, 493, 2023) [1], which is the second type of unconventional superconductor, beside the cuprates, with Tc above liquid nitrogen temperature. However, the phase diagram plotted in this report was mostly based on the transport measurement at low temperature and high pressure conditions, and the assumed corresponding X-ray diffraction (XRD) results was carried out at room temperature. This encouraged us to carry out in situ high pressure and low temperature synchrotron XRD experiments to determine which phase is responsible for the high Tc state. In addition to the phase transition from orthorhombic Amam structure to orthorhombic Fmmm structure, a tetragonal phase with space group of I4/mmm was discovered when the sample was compressed to 19 GPa at 40 K where the superconductivity takes palce in La3Ni2O7. The calculations based on this tetragonal structure reveal that the electronic states approached to the Fermi energy were mainly dominated by the eg orbitals (3dz2 and 3dx2-y2) of Ni atoms, which are located in the oxygen octahedral crystal field. The correlation between Tc and this structural evolution, especially Ni-O octahedra regularity and the in-plane Ni-O-Ni bonding angles, are analyzed. This work sheds new lights to identify what is the most likely phase responsible for superconductivity in the double layered nickelate.


title: Non-archimedean topological monoids

abstract: We say that a topological monoid $S$ is left non-archimedean (in short: l-NA) if the left action of $S$ on itself admits a proper $S$-compactification $\nu \colon S \hookrightarrow Y$ such that $Y$ is a Stone space. This provides a natural generalization of the well known concept of NA topological groups. The Stone and Pontryagin dualities play major role in achieving useful characterizations of NA monoids. We discuss universal NA monoids and show that many naturally defined topological monoids are NA. We show that many naturally defined topological monoids are NA and present universal NA monoids. Among others, we prove that the Polish monoid $C(2^{\omega},2^{\omega})$ is a universal separable metrizable l-NA monoid and the Polish monoid ${\mathbb N}^{\mathbb N}$ is universal for separable metrizable r-NA monoids.


title: Towards Verifiable Text Generation with Symbolic References

abstract: LLMs are vulnerable to hallucinations, and thus their outputs generally require laborious human verification for high-stakes applications. To this end, we propose symbolically grounded generation (SymGen) as a simple approach for enabling easier manual validation of an LLM's output. SymGen prompts an LLM to interleave its regular output text with explicit symbolic references to fields present in some conditioning data (e.g., a table in JSON format). The references can be used to display the provenance of different spans of text in the generation, reducing the effort required for manual verification. Across a range of data-to-text and question-answering experiments, we find that LLMs are able to directly output text that makes use of accurate symbolic references while maintaining fluency and factuality. In a human study we further find that such annotations can streamline human verification of machine-generated text. Our code will be available at http://symgen.github.io.


title: PsyEval: A Suite of Mental Health Related Tasks for Evaluating Large Language Models

abstract: Evaluating Large Language Models (LLMs) in the mental health domain poses distinct challenged from other domains, given the subtle and highly subjective nature of symptoms that exhibit significant variability among individuals. This paper presents PsyEval, the first comprehensive suite of mental health-related tasks for evaluating LLMs. PsyEval encompasses five sub-tasks that evaluate three critical dimensions of mental health. This comprehensive framework is designed to thoroughly assess the unique challenges and intricacies of mental health-related tasks, making PsyEval a highly specialized and valuable tool for evaluating LLM performance in this domain. We evaluate twelve advanced LLMs using PsyEval. Experiment results not only demonstrate significant room for improvement in current LLMs concerning mental health but also unveil potential directions for future model optimization.


title: On the Computation of the Gaussian Rate-Distortion-Perception Function

abstract: In this paper, we study the computation of the rate-distortion-perception function (RDPF) for a multivariate Gaussian source under mean squared error (MSE) distortion and, respectively, Kullback-Leibler divergence, geometric Jensen-Shannon divergence, squared Hellinger distance, and squared Wasserstein-2 distance perception metrics. To this end, we first characterize the analytical bounds of the scalar Gaussian RDPF for the aforementioned divergence functions, also providing the RDPF-achieving forward "test-channel" realization. Focusing on the multivariate case, we establish that, for tensorizable distortion and perception metrics, the optimal solution resides on the vector space spanned by the eigenvector of the source covariance matrix. Consequently, the multivariate optimization problem can be expressed as a function of the scalar Gaussian RDPFs of the source marginals, constrained by global distortion and perception levels. Leveraging this characterization, we design an alternating minimization scheme based on the block nonlinear Gauss-Seidel method, which optimally solves the problem while identifying the Gaussian RDPF-achieving realization. Furthermore, the associated algorithmic embodiment is provided, as well as the convergence and the rate of convergence characterization. Lastly, for the "perfect realism" regime, the analytical solution for the multivariate Gaussian RDPF is obtained. We corroborate our results with numerical simulations and draw connections to existing results.


title: Domain Aligned CLIP for Few-shot Classification

abstract: Large vision-language representation learning models like CLIP have demonstrated impressive performance for zero-shot transfer to downstream tasks while largely benefiting from inter-modal (image-text) alignment via contrastive objectives. This downstream performance can further be enhanced by full-scale fine-tuning which is often compute intensive, requires large labelled data, and can reduce out-of-distribution (OOD) robustness. Furthermore, sole reliance on inter-modal alignment might overlook the rich information embedded within each individual modality. In this work, we introduce a sample-efficient domain adaptation strategy for CLIP, termed Domain Aligned CLIP (DAC), which improves both intra-modal (image-image) and inter-modal alignment on target distributions without fine-tuning the main model. For intra-modal alignment, we introduce a lightweight adapter that is specifically trained with an intra-modal contrastive objective. To improve inter-modal alignment, we introduce a simple framework to modulate the precomputed class text embeddings. The proposed few-shot fine-tuning framework is computationally efficient, robust to distribution shifts, and does not alter CLIP's parameters. We study the effectiveness of DAC by benchmarking on 11 widely used image classification tasks with consistent improvements in 16-shot classification upon strong baselines by about 2.3% and demonstrate competitive performance on 4 OOD robustness benchmarks.


title: Infrared limit of left-handed string at genus one

abstract: We extend the left-handed string formalism at one-loop level to focus on only the infrared limit, where the Green's function for the left-handed string is expanded around the cusp of the modular parameter. This expansion leads to the separating degeneration limit of a Riemann surface corresponding to a sphere and a torus connected by a long tube. The well-behaved short-distance behavior of the Green's function requires all marked points to be inserted on the sphere. Analogous to the tree-level calculations, we obtain Dirac $\delta$-functions by integrating out the anti-holomorphic variables. The constraints embedded in these $\delta$-functions, associated with the marked points on the sphere part of the Riemann surface, are the same Scattering Equations at the tree-level. After the integration over the modular parameter, we observe the expected pattern of the infrared divergence, consistent with the one-loop results from the box diagram calculations in field theory.


title: The Role of Chain-of-Thought in Complex Vision-Language Reasoning Task

abstract: The study explores the effectiveness of the Chain-of-Thought approach, known for its proficiency in language tasks by breaking them down into sub-tasks and intermediate steps, in improving vision-language tasks that demand sophisticated perception and reasoning. We present the "Description then Decision" strategy, which is inspired by how humans process signals. This strategy significantly improves probing task performance by 50%, establishing the groundwork for future research on reasoning paradigms in complex vision-language tasks.


title: Structural Priming Demonstrates Abstract Grammatical Representations in Multilingual Language Models

abstract: Abstract grammatical knowledge - of parts of speech and grammatical patterns - is key to the capacity for linguistic generalization in humans. But how abstract is grammatical knowledge in large language models? In the human literature, compelling evidence for grammatical abstraction comes from structural priming. A sentence that shares the same grammatical structure as a preceding sentence is processed and produced more readily. Because confounds exist when using stimuli in a single language, evidence of abstraction is even more compelling from crosslingual structural priming, where use of a syntactic structure in one language primes an analogous structure in another language. We measure crosslingual structural priming in large language models, comparing model behavior to human experimental results from eight crosslingual experiments covering six languages, and four monolingual structural priming experiments in three non-English languages. We find evidence for abstract monolingual and crosslingual grammatical representations in the models that function similarly to those found in humans. These results demonstrate that grammatical representations in multilingual language models are not only similar across languages, but they can causally influence text produced in different languages.


title: Self-Supervised Curriculum Generation for Autonomous Reinforcement Learning without Task-Specific Knowledge

abstract: A significant bottleneck in applying current reinforcement learning algorithms to real-world scenarios is the need to reset the environment between every episode. This reset process demands substantial human intervention, making it difficult for the agent to learn continuously and autonomously. Several recent works have introduced autonomous reinforcement learning (ARL) algorithms that generate curricula for jointly training reset and forward policies. While their curricula can reduce the number of required manual resets by taking into account the agent's learning progress, they rely on task-specific knowledge, such as predefined initial states or reset reward functions. In this paper, we propose a novel ARL algorithm that can generate a curriculum adaptive to the agent's learning progress without task-specific knowledge. Our curriculum empowers the agent to autonomously reset to diverse and informative initial states. To achieve this, we introduce a success discriminator that estimates the success probability from each initial state when the agent follows the forward policy. The success discriminator is trained with relabeled transitions in a self-supervised manner. Our experimental results demonstrate that our ARL algorithm can generate an adaptive curriculum and enable the agent to efficiently bootstrap to solve sparse-reward maze navigation and manipulation tasks, outperforming baselines with significantly fewer manual resets.


title: Finding polarised communities and tracking information diffusion on Twitter: The Irish Abortion Referendum

abstract: The analysis of social networks enables the understanding of social interactions, polarisation of ideas, and the spread of information and therefore plays an important role in society. We use Twitter data - as it is a popular venue for the expression of opinion and dissemination of information - to identify opposing sides of a debate and, importantly, to observe how information spreads between these groups in our current polarised climate. To achieve this, we collected over 688,000 Tweets from the Irish Abortion Referendum of 2018 to build a conversation network from users mentions with sentiment-based homophily. From this network, community detection methods allow us to isolate yes- or no-aligned supporters with high accuracy (90.9%). We supplement this by tracking how information cascades spread via over 31,000 retweet-cascades. We found that very little information spread between polarised communities. This provides a valuable methodology for extracting and studying information diffusion on large networks by isolating ideologically polarised groups and exploring the propagation of information within and between these groups.


title: A Unified Approach to Learning Ising Models: Beyond Independence and Bounded Width

abstract: We revisit the problem of efficiently learning the underlying parameters of Ising models from data. Current algorithmic approaches achieve essentially optimal sample complexity when given i.i.d. samples from the stationary measure and the underlying model satisfies "width" bounds on the total $\ell_1$ interaction involving each node. We show that a simple existing approach based on node-wise logistic regression provably succeeds at recovering the underlying model in several new settings where these assumptions are violated: (1) Given dynamically generated data from a wide variety of local Markov chains, like block or round-robin dynamics, logistic regression recovers the parameters with optimal sample complexity up to $\log\log n$ factors. This generalizes the specialized algorithm of Bresler, Gamarnik, and Shah [IEEE Trans. Inf. Theory'18] for structure recovery in bounded degree graphs from Glauber dynamics. (2) For the Sherrington-Kirkpatrick model of spin glasses, given $\mathsf{poly}(n)$ independent samples, logistic regression recovers the parameters in most of the known high-temperature regime via a simple reduction to weaker structural properties of the measure. This improves on recent work of Anari, Jain, Koehler, Pham, and Vuong [ArXiv'23] which gives distribution learning at higher temperature. (3) As a simple byproduct of our techniques, logistic regression achieves an exponential improvement in learning from samples in the M-regime of data considered by Dutt, Lokhov, Vuffray, and Misra [ICML'21] as well as novel guarantees for learning from the adversarial Glauber dynamics of Chin, Moitra, Mossel, and Sandon [ArXiv'23]. Our approach thus significantly generalizes the elegant analysis of Wu, Sanghavi, and Dimakis [Neurips'19] without any algorithmic modification.


title: Never Lost in the Middle: Improving Large Language Models via Attention Strengthening Question Answering

abstract: While large language models (LLMs) are equipped with longer text input capabilities than before, they are struggling to seek correct information in long contexts. The "lost in the middle" problem challenges most LLMs, referring to the dramatic decline in accuracy when correct information is located in the middle. To overcome this crucial issue, this paper proposes to enhance the information searching and reflection ability of LLMs in long contexts via specially designed tasks called Attention Strengthening Multi-doc QA (ASM QA). Following these tasks, our model excels in focusing more precisely on the desired information. Experimental results show substantial improvement in Multi-doc QA and other benchmarks, superior to state-of-the-art models by 13.7% absolute gain in shuffled settings, by 21.5% in passage retrieval task. We release our model, Ziya-Reader to promote related research in the community.


title: Second cohomology space of $\frak {sl}(2)$ acting on the space of $n$-ary differential operators on $\mathbb{R}$

abstract: We consider the spaces $\mathcal{F}_\mu$ of polynomial $\mu$-densities on the line as $\mathfrak{sl}(2)$-modules and then we compute the cohomological spaces $\mathrm{H}^2_\mathrm{diff}(\mathfrak{sl}(2), \mathcal{D}_{\bar{\lambda},\mu})$, where $\mu\in \mathbb{R}$, $\bar{\lambda}=(\lambda_1,\dots,\lambda_n) \in\mathbb{R}^n$ and $\mathcal{D}_{\bar{\lambda},\mu}$ is the space of $n$-ary differential operators from $\mathcal{F}_{\lambda_1}\otimes\cdots\otimes \mathcal{F}_{\lambda_n}$ to $\mathcal{F}_\mu$.


title: Are Normalizing Flows the Key to Unlocking the Exponential Mechanism?

abstract: The Exponential Mechanism (ExpM), designed for private optimization, has been historically sidelined from use on continuous sample spaces, as it requires sampling from a generally intractable density, and, to a lesser extent, bounding the sensitivity of the objective function. Any differential privacy (DP) mechanism can be instantiated as ExpM, and ExpM poses an elegant solution for private machine learning (ML) that bypasses inherent inefficiencies of DPSGD. This paper seeks to operationalize ExpM for private optimization and ML by using an auxiliary Normalizing Flow (NF), an expressive deep network for density learning, to approximately sample from ExpM density. The method, ExpM+NF is an alternative to SGD methods for model training. We prove a sensitivity bound for the $\ell^2$ loss permitting ExpM use with any sampling method. To test feasibility, we present results on MIMIC-III health data comparing (non-private) SGD, DPSGD, and ExpM+NF training methods' accuracy and training time. We find that a model sampled from ExpM+NF is nearly as accurate as non-private SGD, more accurate than DPSGD, and ExpM+NF trains faster than Opacus' DPSGD implementation. Unable to provide a privacy proof for the NF approximation, we present empirical results to investigate privacy including the LiRA membership inference attack of Carlini et al. and the recent privacy auditing lower bound method of Steinke et al. Our findings suggest ExpM+NF provides more privacy than non-private SGD, but not as much as DPSGD, although many attacks are impotent against any model. Ancillary benefits of this work include pushing the SOTA of privacy and accuracy on MIMIC-III healthcare data, exhibiting the use of ExpM+NF for Bayesian inference, showing the limitations of empirical privacy auditing in practice, and providing several privacy theorems applicable to distribution learning.


title: Topology of Pulsar Profiles (ToPP). I. Graph theory method and classification of the EPN

abstract: Some of the most important information on a radio pulsar is derived from its average pulse profile. Many early pulsar studies were necessarily based on only few such profiles. There, discrete profile components were linked to emission mechanism models for individual stars through human interpretation. For the population as a whole, profiles morphology must reflect the geometry and overall evolution of the radio emitting regions. The problem, however, is that this population is becoming too large for intensive studies of all sources individually. Moreover, connecting profiles from a large collection of pulsars rapidly becomes cumbersome. In this article, we present ToPP, the first-ever unsupervised method to sort pulsars by profile-shape similarity, using graph topology. We apply ToPP to the publicly available European Pulsar Network profile database, providing the first organised visual overview of multi-frequency profiles representing 90 individual pulsars. We find discrete evolutionary tracks, varying from simple, single component profiles at all frequencies, towards diverse mixtures of more complex profiles with frequency evolution. The profile evolution is continuous, extending out to millisecond pulsars, and does not fall in sharp classes. We interpret the profiles as a mixture of pulsar core/cone emission type, spin-down energetics, and the line-of-sight impact angle towards the magnetic axis. We show how ToPP can systematically classify sources into the Rankin empirical profile scheme. ToPP forms one of the key unsupervised methods that will be essential to explore upcoming pulsar census data such as expected by the Square Kilometer Array.


title: Hyperlinear approximations to amenable groups come from sofic approximations

abstract: We provide a quantitative formulation of the equivalence between hyperlinearity and soficity for amenable groups, effectively showing how every hyperlinear approximation to such a group is simulated by a suitable sofic approximation. The proof is probabilistic, using the concentration of measure in high-dimensional spheres to control the deviation of an operator's matrix coefficients from its trace. As a corollary, we obtain a result connecting stability of sofic approximations with stability of hyperlinear approximations.


title: A Local Limit Theorem for Integer Partitions into Small Powers

abstract: The investigation of partitions of integers plays an important role in combinatorics and number theory. Among the many variations, partitions into powers $0<\alpha<1$ were of recent interest. In the present paper we want to extend our considerations of the length of a random partition by providing a local limit theorem.


title: Fusion-Eval: Integrating Assistant Evaluators with LLMs

abstract: Evaluating natural language systems poses significant challenges, particularly in the realms of natural language understanding and high-level reasoning. In this paper, we introduce 'Fusion-Eval', an innovative approach that leverages Large Language Models (LLMs) to integrate insights from various assistant evaluators. The LLM is given the example to evaluate along with scores from the assistant evaluators. Each of these evaluators specializes in assessing distinct aspects of responses. Fusion-Eval achieves a 0.962 system-level Kendall-Tau correlation with humans on SummEval and a 0.744 turn-level Spearman correlation on TopicalChat, which is significantly higher than baseline methods. These results highlight Fusion-Eval's significant potential in the realm of natural language system evaluation.


title: When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource Languages

abstract: Multilingual language models are widely used to extend NLP systems to low-resource languages. However, concrete evidence for the effects of multilinguality on language modeling performance in individual languages remains scarce. Here, we pre-train over 10,000 monolingual and multilingual language models for over 250 languages, including multiple language families that are under-studied in NLP. We assess how language modeling performance in each language varies as a function of (1) monolingual dataset size, (2) added multilingual dataset size, (3) linguistic similarity of the added languages, and (4) model size (up to 45M parameters). We find that in moderation, adding multilingual data improves low-resource language modeling performance, similar to increasing low-resource dataset sizes by up to 33%. Improvements depend on the syntactic similarity of the added multilingual data, with marginal additional effects of vocabulary overlap. However, high-resource languages consistently perform worse in multilingual pre-training scenarios. As dataset sizes increase, adding multilingual data begins to hurt performance for both low-resource and high-resource languages, likely due to limited model capacity (the "curse of multilinguality"). These results suggest that massively multilingual pre-training may not be optimal for any languages involved, but that more targeted models can significantly improve performance.


title: TableLlama: Towards Open Large Generalist Models for Tables

abstract: Semi-structured tables are ubiquitous. There has been a variety of tasks that aim to automatically interpret, augment, and query tables. Current methods often require pretraining on tables or special model architecture design, are restricted to specific table types, or have simplifying assumptions about tables and tasks. This paper makes the first step towards developing open-source large language models (LLMs) as generalists for a diversity of table-based tasks. Towards that end, we construct TableInstruct, a new dataset with a variety of realistic tables and tasks, for instruction tuning and evaluating LLMs. We further develop the first open-source generalist model for tables, TableLlama, by fine-tuning Llama 2 (7B) with LongLoRA to address the long context challenge. We experiment under both in-domain setting and out-of-domain setting. On 7 out of 8 in-domain tasks, TableLlama achieves comparable or better performance than the SOTA for each task, despite the latter often has task-specific design. On 6 out-of-domain datasets, it achieves 5-44 absolute point gains compared with the base model, showing that training on TableInstruct enhances the model's generalizability. We open-source our dataset and trained model to boost future work on developing open generalist models for tables.


title: An efficient and exact noncommutative quantum Gibbs sampler

abstract: Preparing thermal and ground states is an essential quantum algorithmic task for quantum simulation. In this work, we construct the first efficiently implementable and exactly detailed-balanced Lindbladian for Gibbs states of arbitrary noncommutative Hamiltonians. Our construction can also be regarded as a continuous-time quantum analog of the Metropolis-Hastings algorithm. To prepare the quantum Gibbs state, our algorithm invokes Hamiltonian simulation for a time proportional to the mixing time and the inverse temperature $\beta$, up to polylogarithmic factors. Moreover, the gate complexity reduces significantly for lattice Hamiltonians as the corresponding Lindblad operators are (quasi-) local (with radius $\sim\beta$) and only depend on local Hamiltonian patches. Meanwhile, purifying our Lindbladians yields a temperature-dependent family of frustration-free "parent Hamiltonians", prescribing an adiabatic path for the canonical purified Gibbs state (i.e., the Thermal Field Double state). These favorable features suggest that our construction is the ideal quantum algorithmic counterpart of classical Markov chain Monte Carlo sampling.

categories: quant-ph cond-mat.stat-mech math-ph math.FA math.MP


title: Absolute noetherian approximation of algebraic stacks

abstract: We show that every quasi-compact and quasi-separated algebraic stack can be approximated by a noetherian algebraic stack. We give several applications such as eliminating noetherian hypotheses in the theory of good moduli spaces.


title: Minimal skew semistandard tableaux and the Hillman--Grassl correspondence

abstract: Standard tableaux of skew shape are fundamental objects in enumerative and algebraic combinatorics and no product formula for the number is known. In 2014, Naruse gave a formula (NHLF) as a positive sum over excited diagrams of products of hook-lengths. Subsequently, Morales, Pak, and Panova gave a $q$-analogue of this formula in terms of skew semistandard tableaux (SSYT). They also showed, partly algebraically, that the Hillman--Grassl map, restricted to skew semistandard tableaux, is behind their $q$-analogue. We study the problem of circumventing the algebraic part and proving the bijection completely combinatorially, which we do for border strips. For a skew shape, we define minimal semistandard Young tableaux, that are in correspondence with excited diagrams via a new description of the Hillman--Grassl bijection and have an analogue of excited moves. Lastly, we relate the minimal skew SSYT with the terms of the Okounkov-Olshanski formula (OOF) for counting standard tableaux of skew shape. Our construction immediately implies that the summands in the NHLF are less than the summands in the OOF and we characterize the shapes where both formulas have the same number of summands.


title: Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Models

abstract: Retrieval-augmented language models (RALMs) represent a substantial advancement in the capabilities of large language models, notably in reducing factual hallucination by leveraging external knowledge sources. However, the reliability of the retrieved information is not always guaranteed. The retrieval of irrelevant data can lead to misguided responses, and potentially causing the model to overlook its inherent knowledge, even when it possesses adequate information to address the query. Moreover, standard RALMs often struggle to assess whether they possess adequate knowledge, both intrinsic and retrieved, to provide an accurate answer. In situations where knowledge is lacking, these systems should ideally respond with "unknown" when the answer is unattainable. In response to these challenges, we introduces Chain-of-Noting (CoN), a novel approach aimed at improving the robustness of RALMs in facing noisy, irrelevant documents and in handling unknown scenarios. The core idea of CoN is to generate sequential reading notes for retrieved documents, enabling a thorough evaluation of their relevance to the given question and integrating this information to formulate the final answer. We employed ChatGPT to create training data for CoN, which was subsequently trained on an LLaMa-2 7B model. Our experiments across four open-domain QA benchmarks show that RALMs equipped with CoN significantly outperform standard RALMs. Notably, CoN achieves an average improvement of +7.9 in EM score given entirely noisy retrieved documents and +10.5 in rejection rates for real-time questions that fall outside the pre-training knowledge scope.


title: Digitally reproducing the artistic style of XVI century artist Antonio Campelo in Alegoria Prudencia

abstract: In this work, the artistic style of the sixteenth century Portuguese artist Ant\'onio Campelo in Alegoria \`a Prud\^encia is analyzed in order to create a computational tool that allows one to transform any 3D digital sculpture model into an image that resembles the modeled style. From this analysis the problem is divided into two parts: detection and drawing of contour lines and the shading of the scene. Several techniques from Non Photorealistic Rendering (NPR) and from Photorealistic Rendering that can resolve the problem are presented and, based on this study, a possible solution is presented. Each modeled rendering component is then analyzed using image based methods against the proposed artistic style and parameters are adjusted for a closer match. In the final stage a group of people was asked to answer a questionnaire where the similarity between the renderings of different objects and the original style was classified according to their personal opinion. One of our findings is that although the source 3D objects cannot be readily found for a direct comparison, nor can the paper medium with centuries old damage be the same, the comparison of sub -parts of both images of the same topology was still possible validating our method and discarding other styles from the comparison.


title: Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Survey

abstract: Generic text summarization approaches often fail to address the specific intent and needs of individual users. Recently, scholarly attention has turned to the development of summarization methods that are more closely tailored and controlled to align with specific objectives and user needs. Despite a growing corpus of controllable summarization research, there is no comprehensive survey available that thoroughly explores the diverse controllable attributes employed in this context, delves into the associated challenges, and investigates the existing solutions. In this survey, we formalize the Controllable Text Summarization (CTS) task, categorize controllable attributes according to their shared characteristics and objectives, and present a thorough examination of existing datasets and methods within each category. Moreover, based on our findings, we uncover limitations and research gaps, while also exploring potential solutions and future directions for CTS. We release our detailed analysis of CTS papers at https://github.com/ashokurlana/controllable_text_summarization_survey.