title: Wellposedness of a nonlinear parabolic-dispersive coupled system modelling MEMS

abstract: In this paper we study the local wellposedness of the solution to a non-linear parabolic-dispersive coupled system which models a Micro-Electro-Mechanical System (MEMS). A simple electrostatically actuated MEMS capacitor device has two parallel plates separated by a gas-filled thin gap. The nonlinear parabolic-dispersive coupled system modelling the device consists of a quasilinear parabolic equation for the gas pressure and a semilinear plate equation for gap width. We show the local-in-time existence of strict solutions for the system, by combining a local-in-time existence result for the dispersive equation, H\"{o}lder continuous dependence of its solution on that of the parabolic equation, and then local-in-time existence for a resulting abstract parabolic problem. Semigroup approaches are vital for both main parts of the problem.


title: Transforming organic chemistry research paradigms: moving from manual efforts to the intersection of automation and artificial intelligence

abstract: Organic chemistry is undergoing a major paradigm shift, moving from a labor-intensive approach to a new era dominated by automation and artificial intelligence (AI). This transformative shift is being driven by technological advances, the ever-increasing demand for greater research efficiency and accuracy, and the burgeoning growth of interdisciplinary research. AI models, supported by computational power and algorithms, are drastically reshaping synthetic planning and introducing groundbreaking ways to tackle complex molecular synthesis. In addition, autonomous robotic systems are rapidly accelerating the pace of discovery by performing tedious tasks with unprecedented speed and precision. This article examines the multiple opportunities and challenges presented by this paradigm shift and explores its far-reaching implications. It provides valuable insights into the future trajectory of organic chemistry research, which is increasingly defined by the synergistic interaction of automation and AI.


title: Off-shell modifications of bound nucleons and parton distributions

abstract: We discuss results from our global QCD analyses including nuclear data off deuterium from various measurements, as well as off $^3$H and $^3$He targets from the MARATHON experiment. We simultaneously determine the parton distribution functions of the proton, the higher-twist terms, and the nucleon off-shell correction functions responsible for the modifications of the partonic structure in bound protons and neutrons. In particular, we study the neutron-proton asymmetry of the off-shell correction and its interplay with the treatment of the higher-twist terms. We observe that the data on the $^3$He/$^3$H cross section ratio are consistent with a single isoscalar off-shell function. We also provide our predictions on the ratio $F_2^n/F_2^p$ and on the $d$ and $u$ quark distributions in the proton and in the $^3$H and $^3$He nuclei.


title: Approximation by N\"orlund means with respect to Vilenkin system in Lebesgue spaces

abstract: In this paper we improve and complement a result by M\'oricz and Siddiqi \cite{Mor}. In particular, we prove that their estimate of the N\"orlund means with respect to the Vilenkin system holds also without their additional condition. Moreover, we prove a similar approximation result in Lebesgue spaces for any $1\leq p<\infty$.


title: Seizure detection from Electroencephalogram signals via Wavelets and Graph Theory metrics

abstract: Epilepsy is one of the most prevalent neurological conditions, where an epileptic seizure is a transient occurrence due to abnormal, excessive and synchronous activity in the brain. Electroencephalogram signals emanating from the brain may be captured, analysed and then play a significant role in detection and prediction of epileptic seizures. In this work we enhance upon a previous approach that relied on the differing properties of the wavelet transform. Here we apply the Maximum Overlap Discrete Wavelet Transform to both reduce signal \textit{noise} and use signal variance exhibited at differing inherent frequency levels to develop various metrics of connection between the electrodes placed upon the scalp. %The properties of both the noise reduced signal and the interconnected electrodes differ significantly during the different brain states. Using short duration epochs, to approximate close to real time monitoring, together with simple statistical parameters derived from the reconstructed noise reduced signals we initiate seizure detection. To further improve performance we utilise graph theoretic indicators from derived electrode connectivity. From there we build the attribute space. We utilise open-source software and publicly available data to highlight the superior Recall/Sensitivity performance of our approach, when compared to existing published methods.


title: Empowering Autonomous Driving with Large Language Models: A Safety Perspective

abstract: Autonomous Driving (AD) encounters significant safety hurdles in long-tail unforeseen driving scenarios, largely stemming from the non-interpretability and poor generalization of the deep neural networks within the AD system, particularly in out-of-distribution and uncertain data. To this end, this paper explores the integration of Large Language Models (LLMs) into AD systems, leveraging their robust common-sense knowledge and reasoning abilities. The proposed methodologies employ LLMs as intelligent decision-makers in behavioral planning, augmented with a safety verifier shield for contextual safety learning, for enhancing driving performance and safety. We present two key studies in a simulated environment: an adaptive LLM-conditioned Model Predictive Control (MPC) and an LLM-enabled interactive behavior planning scheme with a state machine. Demonstrating superior performance and safety metrics compared to state-of-the-art approaches, our approach shows the promising potential for using LLMs for autonomous vehicles.


title: Effect of thermal-bioconvection in a rotating phototactic medium

abstract: In this article, thermal bioconvection in a rotating phototactic medium is analyzed with a stress-free top and rigid upper boundary. The suspension rotates with a uniform angular velocity around a vertical axis. Utilizing MATLAB's bvp$4$c solver, neutral and growth rate curves are analyzed, emphasizing the impacts of parameters such as the Taylor number, thermal Rayleigh number, Lewis number, and critical total intensity. It is observed that generally critical bioconvection Rayleigh number increases with increasing Taylor number and Lewis number while decreasing with higher thermal Rayleigh number and critical total intensity. The critical thermal Rayleigh number appears to remain unaffected by variations in the critical total intensity and Lewis number. However, it is notably influenced by changes in the Taylor number.


title: Dark Matter Interpretation of Neutron Multiplicity Anomalies

abstract: Subterrestrial neutron spectra show weak but consistent anomalies at multiplicities ~100 and above [1-3]. The data of the available measurements are of low statistical significance [4] but indicate an excess of events not correlated with the muon flux. The origin of the anomalies remains ambiguous but could be a signature of WIMP annihilation-like interaction with a Pb target. In this paper, we outline a model consistent with this hypothesis, the extended Standard Model (SM) approach called the Radiation Gauge Model (RGM) [5]. The RGM identifies scalar neutrino-antineutrino wave function components of WIMP Dark Matter (DM) responsible for the weak interaction leading to annihilation with ordinary matter. The model assigns neutrino-nucleon(target) charged current (CC) transitions to the observed anomalies. If the existence of the anomalies is confirmed and the model interpretation is positively verified, this will be the first terrestrial indirect detection of DM.


title: On the smallness conditions for a PEMFC single cell problem

abstract: The aim of the present paper is to prove whose smallness conditions being necessary in order to get the final result of existence of a solution. In the first part, we present the model for a proton exchange membrane fuel cell (PEMFC) single cell and we clarify the interactions of the different components namely, velocity, pressure, density, temperature and potential. The final mathematical model is a quasilinear elliptic system where the cross effects have a strong interlink. It consists of the Stokes--Darcy system altogether with thermoelectrochemical system under some non-standard interface and boundary conditions. The proof of existence of weak solutions relies on the Tychonof fixed point theorem, by providing some regularity and some smallness conditions. The actual system is divided into two systems of equations and they are separately studied. The novelty of the present work is to establish quantitative estimates for improving the technical hypotheses and, in particular, the smallness conditions in the two-dimensional case. Indeed, the smallness conditions only can be explicit if quantitative estimates are established. To this aim, we establish quantitative estimates for the Poincar\'e and Sobolev inequalities and for some trilinear terms.


title: Relativistic two-particle problem in the Lagrange formalism

abstract: The relativistic two body problem is considered in terms of the action integral in the case of two interacting spinless particles and spin-$1/2$ fermions, interacting by means of vector and scalar fields. The Lagrangians governing the dynamics of such particles are derived in the momentum representation. In the Breit frame, when the two-body system is at rest as whole, the obtained Lagrangians generate the Klein-Gordon-like and Dirac-like equations in the (3+1) phase space. The derived equations are examined by studying a para-positronium in a strong magnetic field. It is shown that a strong magnetic fields result in essential decreasing the para-positronium life-time.


title: Extrapolatable Transformer Pre-training for Ultra Long Time-Series Forecasting

abstract: Large-scale pre-trained models (PTMs) such as BERT and GPT have recently achieved great success in Natural Language Processing and Computer Vision domains. However, the development of PTMs on time-series data is lagging behind. This underscores the limitations of the existing transformer-based architectures, particularly their scalability to handle large-scale data and ability to capture long-term temporal dependencies. In this study, we present Timely Generative Pre-trained Transformer (TimelyGPT). TimelyGPT employs an extrapolatable position (xPos) embedding to encode trend and periodic patterns into time-series representations. It also integrates recurrent attention and temporal convolution modules to effectively capture global-local temporal dependencies. Our experiments show that TimelyGPT excels in modeling continuously monitored biosignals and irregularly-sampled time series data commonly observed in longitudinal electronic health records (EHRs). In ultra-long-term forecasting experiment, TimelyGPT achieves accurate extrapolation up to 6,000 timesteps of body temperature during the sleep stage transition given a short look-up window (i.e., prompt) containing only 2,000 timesteps. We further demonstrated TimelyGPT's forecasting capabilities on a preprocessed longitudinal healthcare administrative database called PopHR consisting of 489,000 patients randomly sampled from Montreal population. Together, we envision TimelyGPT to be useful in a broad spectrum of health domains including long-term patient health state forecasting and patient risk trajectory prediction.


title: The perpetual motion machine of AI-generated data and the distraction of ChatGPT-as-scientist

abstract: Since ChatGPT works so well, are we on the cusp of solving science with AI? Is not AlphaFold2 suggestive that the potential of LLMs in biology and the sciences more broadly is limitless? Can we use AI itself to bridge the lack of data in the sciences in order to then train an AI? Herein we present a discussion of these topics.


title: Large Language Models for Travel Behavior Prediction

abstract: Travel behavior prediction is a fundamental task in transportation demand management. The conventional methods for travel behavior prediction rely on numerical data to construct mathematical models and calibrate model parameters to represent human preferences. Recent advancement in large language models (LLMs) has shown great reasoning abilities to solve complex problems. In this study, we propose to use LLMs to predict travel behavior with prompt engineering without data-based parameter learning. Specifically, we carefully design our prompts that include 1) task description, 2) travel characteristics, 3) individual attributes, and 4) guides of thinking with domain knowledge, and ask the LLMs to predict an individual's travel behavior and explain the results. We select the travel mode choice task as a case study. Results show that, though no training samples are provided, LLM-based predictions have competitive accuracy and F1-score as canonical supervised learning methods such as multinomial logit, random forest, and neural networks. LLMs can also output reasons that support their prediction. However, though in most of the cases, the output explanations are reasonable, we still observe cases that violate logic or with hallucinations.


title: Non-Cross Diffusion for Semantic Consistency

abstract: In diffusion models, deviations from a straight generative flow are a common issue, resulting in semantic inconsistencies and suboptimal generations. To address this challenge, we introduce `Non-Cross Diffusion', an innovative approach in generative modeling for learning ordinary differential equation (ODE) models. Our methodology strategically incorporates an ascending dimension of input to effectively connect points sampled from two distributions with uncrossed paths. This design is pivotal in ensuring enhanced semantic consistency throughout the inference process, which is especially critical for applications reliant on consistent generative flows, including various distillation methods and deterministic sampling, which are fundamental in image editing and interpolation tasks. Our empirical results demonstrate the effectiveness of Non-Cross Diffusion, showing a substantial reduction in semantic inconsistencies at different inference steps and a notable enhancement in the overall performance of diffusion models.


title: Global well-posedness of a two dimensional wave-Klein-Gordon system with small non-compactly supported data

abstract: In this paper we are interested in the coupled wave and Klein-Gordon equations in $\mathbb{R}^+\times\mathbb{R}^2$. We want to establish the global well-posedness of such system by showing the uniform boundedness of the energy for the global solution without any compactness assumptions on the initial data. In addition, we also demonstrate the pointwise asymptotic behavior of the solution pair. In order to achieve that we apply a modified Alinhac's ghost weight method together with a newly developed normal-form framework to remedy the lack of the space-time scaling vector field. Finally we show the global solutions scatter linearly strongly for the Klein-Gordon field $\phi$ and weakly for the wave field $n$ as $t\to+\infty$. To our best knowledge such scattering phenomenon is novel in the literature.


title: $M_{W_R}$ dependence of leptogenesis in Minimal Left-Right Symmetric Model with different strengths of Type-II seesaw mass

abstract: Left Right Symmetric Model (LRSM) being an extension of the Standard model of particle physics incorporates within itself Type-I and Type-II seesaw mass terms naturally. Both the mass terms can have significant amount of contribution to the resulting light neutrino mass within the model and hence on the different phenomenology associated within. In this paper, we have thoroughly analyzed and discussed the implications of specifying different weightages to the type-I and type-II mass terms and also the study has been carried out for different values of $M_{W_R}$ which is mass of the right-handed gauge boson. This paper also gives a deeper insight into the new physics contributions of Neutrinoless Double Beta Decay $(0\nu\beta\beta)$ and their variations with the net baryon asymmetry arising out of the model. Therefore, the main objective of the present paper rests on investigating the implications of imposing different weightage to the type-I and type-II seesaw terms and different values of $M_{W_R}$ on the new physics contributions of $0\nu\beta\beta$ and net baryon asymmetry arising out as a result of resonant leptogenesis. LRSM in this work has been realized using modular group of level 3, $\Gamma(3)$ which is isomorphic to non-abelian discrete symmetry group $A_4$, the advantage being the non-requirement of flavons within the model and hence maintaining the minimality of the model.


title: Adaptive Multi-Modality Prompt Learning

abstract: Although current prompt learning methods have successfully been designed to effectively reuse the large pre-trained models without fine-tuning their large number of parameters, they still have limitations to be addressed, i.e., without considering the adverse impact of meaningless patches in every image and without simultaneously considering in-sample generalization and out-of-sample generalization. In this paper, we propose an adaptive multi-modality prompt learning to address the above issues. To do this, we employ previous text prompt learning and propose a new image prompt learning. The image prompt learning achieves in-sample and out-of-sample generalization, by first masking meaningless patches and then padding them with the learnable parameters and the information from texts. Moreover, each of the prompts provides auxiliary information to each other, further strengthening these two kinds of generalization. Experimental results on real datasets demonstrate that our method outperforms SOTA methods, in terms of different downstream tasks.


title: Variational Self-Supervised Contrastive Learning Using Beta Divergence

abstract: Learning a discriminative semantic space using unlabelled and noisy data remains unaddressed in a multi-label setting. We present a contrastive self-supervised learning method which is robust to data noise, grounded in the domain of variational methods. The method (VCL) utilizes variational contrastive learning with beta-divergence to learn robustly from unlabelled datasets, including uncurated and noisy datasets. We demonstrate the effectiveness of the proposed method through rigorous experiments including linear evaluation and fine-tuning scenarios with multi-label datasets in the face understanding domain. In almost all tested scenarios, VCL surpasses the performance of state-of-the-art self-supervised methods, achieving a noteworthy increase in accuracy.


title: SocialCounterfactuals: Probing and Mitigating Intersectional Social Biases in Vision-Language Models with Counterfactual Examples

abstract: While vision-language models (VLMs) have achieved remarkable performance improvements recently, there is growing evidence that these models also posses harmful biases with respect to social attributes such as gender and race. Prior studies have primarily focused on probing such bias attributes individually while ignoring biases associated with intersections between social attributes. This could be due to the difficulty of collecting an exhaustive set of image-text pairs for various combinations of social attributes. To address this challenge, we employ text-to-image diffusion models to produce counterfactual examples for probing intersectional social biases at scale. Our approach utilizes Stable Diffusion with cross attention control to produce sets of counterfactual image-text pairs that are highly similar in their depiction of a subject (e.g., a given occupation) while differing only in their depiction of intersectional social attributes (e.g., race & gender). Through our over-generate-then-filter methodology, we produce SocialCounterfactuals, a high-quality dataset containing 171k image-text pairs for probing intersectional biases related to gender, race, and physical characteristics. We conduct extensive experiments to demonstrate the usefulness of our generated dataset for probing and mitigating intersectional social biases in state-of-the-art VLMs.


title: DEVIAS: Learning Disentangled Video Representations of Action and Scene for Holistic Video Understanding

abstract: When watching a video, humans can naturally extract human actions from the surrounding scene context, even when action-scene combinations are unusual. However, unlike humans, video action recognition models often learn scene-biased action representations from the spurious correlation in training data, leading to poor performance in out-of-context scenarios. While scene-debiased models achieve improved performance in out-of-context scenarios, they often overlook valuable scene information in the data. Addressing this challenge, we propose Disentangled VIdeo representations of Action and Scene (DEVIAS), which aims to achieve holistic video understanding. Disentangled action and scene representations with our method could provide flexibility to adjust the emphasis on action or scene information depending on downstream task and dataset characteristics. Disentangled action and scene representations could be beneficial for both in-context and out-of-context video understanding. To this end, we employ slot attention to learn disentangled action and scene representations with a single model, along with auxiliary tasks that further guide slot attention. We validate the proposed method on both in-context datasets: UCF-101 and Kinetics-400, and out-of-context datasets: SCUBA and HAT. Our proposed method shows favorable performance across different datasets compared to the baselines, demonstrating its effectiveness in diverse video understanding scenarios.


title: A Unified Framework for Connecting Noise Modeling to Boost Noise Detection

abstract: Noisy labels can impair model performance, making the study of learning with noisy labels an important topic. Two conventional approaches are noise modeling and noise detection. However, these two methods are typically studied independently, and there has been limited work on their collaboration. In this work, we explore the integration of these two approaches, proposing an interconnected structure with three crucial blocks: noise modeling, source knowledge identification, and enhanced noise detection using noise source-knowledge-integration methods. This collaboration structure offers advantages such as discriminating hard negatives and preserving genuinely clean labels that might be suspiciously noisy. Our experiments on four datasets, featuring three types of noise and different combinations of each block, demonstrate the efficacy of these components' collaboration. Our collaborative structure methods achieve up to a 10% increase in top-1 classification accuracy in synthesized noise datasets and 3-5% in real-world noisy datasets. The results also suggest that these components make distinct contributions to overall performance across various noise scenarios. These findings provide valuable insights for designing noisy label learning methods customized for specific noise scenarios in the future. Our code is accessible to the public.


title: From affine to barycentric coordinates in polytopes

abstract: Each point of a simplex is expressed as a unique convex combination of the vertices. The coefficients in the combination are the barycentric coordinates of the point. For each point in a general convex polytope, there may be multiple representations, so its barycentric coordinates are not necessarily unique. There are various schemes to fix particular barycentric coordinates: Gibbs, Wachspress, cartographic, etc. In this paper, a method for producing sparse barycentric coordinates in polytopes will be discussed. It uses a purely algebraic treatment of affine spaces and convex sets, with barycentric algebras. The method is based on a certain decomposition of each finite-dimensional convex polytope into a union of simplices of the same dimension.


title: Density of weak solutions of the fractional Navier-Stokes equations in the smooth divergence-free vector fields

abstract: In this paper, we consider the fractional Navier-Stokes equations. We extend a previous non-uniqueness result due to Cheskidov and Luo, found in [5], from Navier-Stokes to the fractional case, and from $L^1$-in-time, $W^{1,q}$-in-space solutions for every $q > 1$ to $L^s$-in-time, $W^{1,q}$-in-space solutions for appropriate ranges of $s,q$.


title: Asymmetric Duffing oscillator: the birth and build-up of period doubling

abstract: In this work, we investigate the period doubling phenomenon in the periodically forced asymmetric Duffing oscillator. We use the known steady-state asymptotic solution -- the amplitude-frequency implicit function -- and known criterion for the existence of period doubling. Working in the framework of differential properties of implicit functions we derive analytical formulas for the birth of period-doubled solutions.


abstract: The article proposes a method for constructing non-standard theories based on terms from partially existing sequences of elements. The method is illustrated by the example of the theory of monoids. Predicates and terms from non-standard sequences, 2023, udc: 510.65 msc: 03H05 Key words: monoid, term, ideal, category, isomorphizm, insignificant extension of the theory, non-standard theory


title: Optimized General Uniform Quantum State Preparation

abstract: Quantum algorithms for unstructured search problems rely on the preparation of a uniform superposition, traditionally achieved through Hadamard gates. However, this incidentally creates an auxiliary search space consisting of nonsensical answers that do not belong in the search space and reduce the efficiency of the algorithm due to the need to neglect, un-compute, or destructively interfere with them. Previous approaches to removing this auxiliary search space yielded large circuit depth and required the use of ancillary qubits. We have developed an optimized general solver for a circuit that prepares a uniform superposition of any N states while minimizing depth and without the use of ancillary qubits. We show that this algorithm is efficient, especially in its use of two wire gates, and that it has been verified on an IonQ quantum computer and through application to a quantum unstructured search algorithm.


title: Lasagna: Layered Score Distillation for Disentangled Object Relighting

abstract: Professional artists, photographers, and other visual content creators use object relighting to establish their photo's desired effect. Unfortunately, manual tools that allow relighting have a steep learning curve and are difficult to master. Although generative editing methods now enable some forms of image editing, relighting is still beyond today's capabilities; existing methods struggle to keep other aspects of the image -- colors, shapes, and textures -- consistent after the edit. We propose Lasagna, a method that enables intuitive text-guided relighting control. Lasagna learns a lighting prior by using score distillation sampling to distill the prior of a diffusion model, which has been finetuned on synthetic relighting data. To train Lasagna, we curate a new synthetic dataset ReLiT, which contains 3D object assets re-lit from multiple light source locations. Despite training on synthetic images, quantitative results show that Lasagna relights real-world images while preserving other aspects of the input image, outperforming state-of-the-art text-guided image editing methods. Lasagna enables realistic and controlled results on natural images and digital art pieces and is preferred by humans over other methods in over 91% of cases. Finally, we demonstrate the versatility of our learning objective by extending it to allow colorization, another form of image editing.


title: AV-RIR: Audio-Visual Room Impulse Response Estimation

abstract: Accurate estimation of Room Impulse Response (RIR), which captures an environment's acoustic properties, is important for speech processing and AR/VR applications. We propose AV-RIR, a novel multi-modal multi-task learning approach to accurately estimate the RIR from a given reverberant speech signal and the visual cues of its corresponding environment. AV-RIR builds on a novel neural codec-based architecture that effectively captures environment geometry and materials properties and solves speech dereverberation as an auxiliary task by using multi-task learning. We also propose Geo-Mat features that augment material information into visual cues and CRIP that improves late reverberation components in the estimated RIR via image-to-RIR retrieval by 86%. Empirical results show that AV-RIR quantitatively outperforms previous audio-only and visual-only approaches by achieving 36% - 63% improvement across various acoustic metrics in RIR estimation. Additionally, it also achieves higher preference scores in human evaluation. As an auxiliary benefit, dereverbed speech from AV-RIR shows competitive performance with the state-of-the-art in various spoken language processing tasks and outperforms reverberation time error score in the real-world AVSpeech dataset. Qualitative examples of both synthesized reverberant speech and enhanced speech can be found at https://www.youtube.com/watch?v=tTsKhviukAE.


title: Normal Frequency method for finding the existence of maximum clique of the clique-complex

abstract: Determining the existence of $k$-clique in the arbitrary graph is one of the NP problems. We suggest a novel way to determine the existence of $k$-clique in the clique complex $G$ under specific conditions, by using the normal mode and eigenvector of the Laplace matrix of $G$.


title: Heteroscedastic Uncertainty Estimation for Probabilistic Unsupervised Registration of Noisy Medical Images

abstract: This paper proposes a heteroscedastic uncertainty estimation framework for unsupervised medical image registration. Existing methods rely on objectives (e.g. mean-squared error) that assume a uniform noise level across the image, disregarding the heteroscedastic and input-dependent characteristics of noise distribution in real-world medical images. This further introduces noisy gradients due to undesired penalization on outliers, causing unnatural deformation and performance degradation. To mitigate this, we propose an adaptive weighting scheme with a relative $\gamma$-exponentiated signal-to-noise ratio (SNR) for the displacement estimator after modeling the heteroscedastic noise using a separate variance estimator to prevent the model from being driven away by spurious gradients from error residuals, leading to more accurate displacement estimation. To illustrate the versatility and effectiveness of the proposed method, we tested our framework on two representative registration architectures across three medical image datasets. Our proposed framework consistently outperforms other baselines both quantitatively and qualitatively while also providing accurate and sensible uncertainty measures. Paired t-tests show that our improvements in registration accuracy are statistically significant. The code will be publicly available at \url{https://voldemort108x.github.io/hetero_uncertainty/}.


title: An Adaptive Correspondence Scoring Framework for Unsupervised Image Registration of Medical Images

abstract: We propose an adaptive training scheme for unsupervised medical image registration. Existing methods rely on image reconstruction as the primary supervision signal. However, nuisance variables (e.g. noise and covisibility) often cause the loss of correspondence between medical images, violating the Lambertian assumption in physical waves (e.g. ultrasound) and consistent imaging acquisition. As the unsupervised learning scheme relies on intensity constancy to establish correspondence between images for reconstruction, this introduces spurious error residuals that are not modeled by the typical training objective. To mitigate this, we propose an adaptive framework that re-weights the error residuals with a correspondence scoring map during training, preventing the parametric displacement estimator from drifting away due to noisy gradients, which leads to performance degradations. To illustrate the versatility and effectiveness of our method, we tested our framework on three representative registration architectures across three medical image datasets along with other baselines. Our proposed adaptive framework consistently outperforms other methods both quantitatively and qualitatively. Paired t-tests show that our improvements are statistically significant. The code will be publicly available at \url{https://voldemort108x.github.io/AdaCS/}.


title: Perturbations of Dirac operators, spectral Einstein functionals and the Noncommutative residue

abstract: In this paper, we introduce the spectral Einstein functional for perturbations of Dirac operators on manifolds with boundary. Furthermore, we provide the proof of the Dabrowski-Sitarz-Zalecki type theorems associated with the spectral Einstein functionals for perturbations of Dirac operators, particularly in the cases of on 4-dimensional manifolds with boundary.


title: PipeOptim: Ensuring Effective 1F1B Schedule with Optimizer-Dependent Weight Prediction

abstract: Asynchronous pipeline model parallelism with a "1F1B" (one forward, one backward) schedule generates little bubble overhead and always provides quite a high throughput. However, the "1F1B" schedule inevitably leads to weight inconsistency and weight staleness issues due to the cross-training of different mini-batches across GPUs. To simultaneously address these two problems, in this paper, we propose an optimizer-dependent weight prediction strategy (a.k.a PipeOptim) for asynchronous pipeline training. The key insight of our proposal is that we employ a weight prediction strategy in the forward pass to ensure that each mini-batch uses consistent and staleness-free weights to compute the forward pass. To be concrete, we first construct the weight prediction scheme based on the update rule of the used optimizer when training the deep neural network models. Then throughout the "1F1B" pipelined training, each mini-batch is mandated to execute weight prediction ahead of the forward pass, subsequently employing the predicted weights to perform the forward pass. As a result, PipeOptim 1) inherits the advantage of the "1F1B" schedule and generates pretty high throughput, and 2) can ensure effective parameter learning regardless of the type of the used optimizer. To verify the effectiveness of our proposal, we conducted extensive experimental evaluations using eight different deep-learning models spanning three machine-learning tasks including image classification, sentiment analysis, and machine translation. The experiment results demonstrate that PipeOptim outperforms the popular pipelined approaches including GPipe, PipeDream, PipeDream-2BW, and SpecTrain. The code of PipeOptim can be accessible at https://github.com/guanleics/PipeOptim.


title: Towards Redundancy-Free Sub-networks in Continual Learning

abstract: Catastrophic Forgetting (CF) is a prominent issue in continual learning. Parameter isolation addresses this challenge by masking a sub-network for each task to mitigate interference with old tasks. However, these sub-networks are constructed relying on weight magnitude, which does not necessarily correspond to the importance of weights, resulting in maintaining unimportant weights and constructing redundant sub-networks. To overcome this limitation, inspired by information bottleneck, which removes redundancy between adjacent network layers, we propose \textbf{\underline{I}nformation \underline{B}ottleneck \underline{M}asked sub-network (IBM)} to eliminate redundancy within sub-networks. Specifically, IBM accumulates valuable information into essential weights to construct redundancy-free sub-networks, not only effectively mitigating CF by freezing the sub-networks but also facilitating new tasks training through the transfer of valuable knowledge. Additionally, IBM decomposes hidden representations to automate the construction process and make it flexible. Extensive experiments demonstrate that IBM consistently outperforms state-of-the-art methods. Notably, IBM surpasses the state-of-the-art parameter isolation method with a 70\% reduction in the number of parameters within sub-networks and an 80\% decrease in training time.


title: Do Black Holes have Singularities?

abstract: There is no proof that black holes contain singularities when they are generated by real physical bodies. Roger Penrose claimed sixty years ago that trapped surfaces inevitably lead to light rays of finite affine length (FALL's). Penrose and Stephen Hawking then asserted that these must end in actual singularities. When they could not prove this they decreed it to be self evident. It is shown that there are counterexamples through every point in the Kerr metric. These are asymptotic to at least one event horizon and do not end in singularities.


title: ESM-NBR: fast and accurate nucleic acid-binding residue prediction via protein language model feature representation and multi-task learning

abstract: Protein-nucleic acid interactions play a very important role in a variety of biological activities. Accurate identification of nucleic acid-binding residues is a critical step in understanding the interaction mechanisms. Although many computationally based methods have been developed to predict nucleic acid-binding residues, challenges remain. In this study, a fast and accurate sequence-based method, called ESM-NBR, is proposed. In ESM-NBR, we first use the large protein language model ESM2 to extract discriminative biological properties feature representation from protein primary sequences; then, a multi-task deep learning model composed of stacked bidirectional long short-term memory (BiLSTM) and multi-layer perceptron (MLP) networks is employed to explore common and private information of DNA- and RNA-binding residues with ESM2 feature as input. Experimental results on benchmark data sets demonstrate that the prediction performance of ESM2 feature representation comprehensively outperforms evolutionary information-based hidden Markov model (HMM) features. Meanwhile, the ESM-NBR obtains the MCC values for DNA-binding residues prediction of 0.427 and 0.391 on two independent test sets, which are 18.61 and 10.45% higher than those of the second-best methods, respectively. Moreover, by completely discarding the time-cost multiple sequence alignment process, the prediction speed of ESM-NBR far exceeds that of existing methods (5.52s for a protein sequence of length 500, which is about 16 times faster than the second-fastest method). A user-friendly standalone package and the data of ESM-NBR are freely available for academic use at: https://github.com/wwzll123/ESM-NBR.


title: Exploring the Robustness of Decentralized Training for Large Language Models

abstract: Decentralized training of large language models has emerged as an effective way to democratize this technology. However, the potential threats associated with this approach have not been carefully discussed, which would hinder the development of decentralized training infrastructures. This paper aims to initiate discussion towards this end by exploring the robustness of decentralized training from three main perspectives. First, we demonstrate the vulnerabilities inherent in decentralized training frameworks in terms of hardware, data, and models. Second, we highlight the fundamental difference between decentralized foundation model training and vanilla federated learning, where the security techniques employed in federated learning cannot be applied directly. Third, we discuss the essential components required for a robust and efficient decentralized training framework and present a case study by modeling a concrete threat model. Our objective in this vision paper is to emphasize the importance of addressing security concerns in the context of decentralized training for large language models.


title: Sparse Beats Dense: Rethinking Supervision in Radar-Camera Depth Completion

abstract: It is widely believed that the dense supervision is better than the sparse supervision in the field of depth completion, but the underlying reasons for this are rarely discussed. In this paper, we find that the challenge of using sparse supervision for training Radar-Camera depth prediction models is the Projection Transformation Collapse (PTC). The PTC implies that sparse supervision leads the model to learn unexpected collapsed projection transformations between Image/Radar/LiDAR spaces. Building on this insight, we propose a novel ``Disruption-Compensation" framework to handle the PTC, thereby relighting the use of sparse supervision in depth completion tasks. The disruption part deliberately discards position correspondences among Image/Radar/LiDAR, while the compensation part leverages 3D spatial and 2D semantic information to compensate for the discarded beneficial position correspondence. Extensive experimental results demonstrate that our framework (sparse supervision) outperforms the state-of-the-art (dense supervision) with 11.6$\%$ improvement in mean absolute error and $1.6 \times$ speedup. The code is available at ...


title: VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models

abstract: Text-to-video diffusion models have advanced video generation significantly. However, customizing these models to generate videos with tailored motions presents a substantial challenge. In specific, they encounter hurdles in (a) accurately reproducing motion from a target video, and (b) creating diverse visual variations. For example, straightforward extensions of static image customization methods to video often lead to intricate entanglements of appearance and motion data. To tackle this, here we present the Video Motion Customization (VMC) framework, a novel one-shot tuning approach crafted to adapt temporal attention layers within video diffusion models. Our approach introduces a novel motion distillation objective using residual vectors between consecutive frames as a motion reference. The diffusion process then preserves low-frequency motion trajectories while mitigating high-frequency motion-unrelated noise in image space. We validate our method against state-of-the-art video generative models across diverse real-world motions and contexts. Our codes, data and the project demo can be found at https://video-motion-customization.github.io


title: NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidance

abstract: Existing neural implicit surface reconstruction methods have achieved impressive performance in multi-view 3D reconstruction by leveraging explicit geometry priors such as depth maps or point clouds as regularization. However, the reconstruction results still lack fine details because of the over-smoothed depth map or sparse point cloud. In this work, we propose a neural implicit surface reconstruction pipeline with guidance from 3D Gaussian Splatting to recover highly detailed surfaces. The advantage of 3D Gaussian Splatting is that it can generate dense point clouds with detailed structure. Nonetheless, a naive adoption of 3D Gaussian Splatting can fail since the generated points are the centers of 3D Gaussians that do not necessarily lie on the surface. We thus introduce a scale regularizer to pull the centers close to the surface by enforcing the 3D Gaussians to be extremely thin. Moreover, we propose to refine the point cloud from 3D Gaussians Splatting with the normal priors from the surface predicted by neural implicit models instead of using a fixed set of points as guidance. Consequently, the quality of surface reconstruction improves from the guidance of the more accurate 3D Gaussian splatting. By jointly optimizing the 3D Gaussian Splatting and the neural implicit model, our approach benefits from both representations and generates complete surfaces with intricate details. Experiments on Tanks and Temples verify the effectiveness of our proposed method.


title: Handling nonlinearities and uncertainties of fed-batch cultivations with difference of convex functions tube MPC

abstract: Bioprocesses are often characterized by nonlinear and uncertain dynamics. This poses particular challenges in the context of model predictive control (MPC). Several approaches have been proposed to solve this problem, such as robust or stochastic MPC, but they can be computationally expensive when the system is nonlinear. Recent advances in optimal control theory have shown that concepts from convex optimization, tube-based MPC, and difference of convex functions (DC) enable stable and robust online process control. The approach is based on systematic DC decompositions of the dynamics and successive linearizations around feasible trajectories. By convexity, the linearization errors can be bounded tightly and treated as bounded disturbances in a robust tube-based MPC framework. However, finding the DC composition can be a difficult task. To overcome this problem, we used a neural network with special convex structure to learn the dynamics in DC form and express the uncertainty sets using simplices to maximize the product formation rate of a cultivation with uncertain substrate concentration in the feed. The results show that this is a promising approach for computationally tractable data-driven robust MPC of bioprocesses.


title: Perturbed utility stochastic traffic assignment

abstract: This paper develops a fast algorithm for computing the equilibrium assignment with the perturbed utility route choice (PURC) model. Without compromise, this allows the significant advantages of the PURC model to be used in large-scale applications. We formulate the PURC equilibrium assignment problem as a convex minimization problem and find a closed-form stochastic network loading expression that allows us to formulate the Lagrangian dual of the assignment problem as an unconstrained optimization problem. To solve this dual problem, we formulate a quasi-Newton accelerated gradient descent algorithm (qN-AGD*). Our numerical evidence shows that qN-AGD* clearly outperforms a conventional primal algorithm as well as a plain accelerated gradient descent algorithm. qN-AGD* is fast with a runtime that scales about linearly with the problem size, indicating that solving the perturbed utility assignment problem is feasible also with very large networks.


title: RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback

abstract: Multimodal Large Language Models (MLLMs) have recently demonstrated impressive capabilities in multimodal understanding, reasoning, and interaction. However, existing MLLMs prevalently suffer from serious hallucination problems, generating text that is not factually grounded in associated images. The problem makes existing MLLMs untrustworthy and thus impractical in real-world (especially high-stakes) applications. To address the challenge, we present RLHF-V, which enhances MLLM trustworthiness via behavior alignment from fine-grained correctional human feedback. Specifically, RLHF-V collects human preference in the form of segment-level corrections on hallucinations, and performs dense direct preference optimization over the human feedback. Comprehensive experiments on five benchmarks in both automatic and human evaluation show that, RLHF-V can enable substantially more trustworthy MLLM behaviors with promising data and computation efficiency. Remarkably, using 1.4k annotated data samples, RLHF-V significantly reduces the hallucination rate of the base MLLM by 34.8%, outperforming the concurrent LLaVA-RLHF trained on 10k annotated data. The final model achieves state-of-the-art performance in trustworthiness among open-source MLLMs, and shows better robustness than GPT-4V in preventing hallucinations aroused from over-generalization. We open-source our code, model, and data at https://github.com/RLHF-V/RLHF-V.


title: Modeling of Coupled Turbulent Channel Porous Media Flow through a Deep Autoencoder Echo State Network Framework

abstract: In this study, we propose a novel approach, namely the combined Convolutional Deep Autoencoder Echo State Network (CDAE ESN) model, for the analysis and forecasting of dynamics and low order statistics in coupled turbulent channel porous media flows. Such systems find wide applications in industrial settings, including transpiration cooling and smart interface engineering. However, the complex geometry of coupled flow systems presents additional challenges for purely data-driven models. Our results demonstrate that the integration of deep autoencoder and echo state network techniques enables effective modeling and prediction of dominant flow behaviors, particularly within the porous domain exhibiting laminar regimes. To enhance the model s applicability across a broader range of data domains, we further employ fine-tuning on a dataset encompassing varying porosities. The achieved average statistics exhibit a reasonable agreement, underscoring the efficacy of our proposed approach.


title: Physics Inspired Criterion for Pruning-Quantization Joint Learning

abstract: Pruning-quantization joint learning always facilitates the deployment of deep neural networks (DNNs) on resource-constrained edge devices. However, most existing methods do not jointly learn a global criterion for pruning and quantization in an interpretable way. In this paper, we propose a novel physics inspired criterion for pruning-quantization joint learning (PIC-PQ), which is explored from an analogy we first draw between elasticity dynamics (ED) and model compression (MC). Specifically, derived from Hooke's law in ED, we establish a linear relationship between the filters' importance distribution and the filter property (FP) by a learnable deformation scale in the physics inspired criterion (PIC). Furthermore, we extend PIC with a relative shift variable for a global view. To ensure feasibility and flexibility, available maximum bitwidth and penalty factor are introduced in quantization bitwidth assignment. Experiments on benchmarks of image classification demonstrate that PIC-PQ yields a good trade-off between accuracy and bit-operations (BOPs) compression ratio e.g., 54.96X BOPs compression ratio in ResNet56 on CIFAR10 with 0.10% accuracy drop and 53.24X in ResNet18 on ImageNet with 0.61% accuracy drop). The code will be available at https://github.com/fanxxxxyi/PIC-PQ.


title: Beyond First-Order Tweedie: Solving Inverse Problems using Latent Diffusion

abstract: Sampling from the posterior distribution poses a major computational challenge in solving inverse problems using latent diffusion models. Common methods rely on Tweedie's first-order moments, which are known to induce a quality-limiting bias. Existing second-order approximations are impractical due to prohibitive computational costs, making standard reverse diffusion processes intractable for posterior sampling. This paper introduces Second-order Tweedie sampler from Surrogate Loss (STSL), a novel sampler that offers efficiency comparable to first-order Tweedie with a tractable reverse process using second-order approximation. Our theoretical results reveal that the second-order approximation is lower bounded by our surrogate loss that only requires $O(1)$ compute using the trace of the Hessian, and by the lower bound we derive a new drift term to make the reverse process tractable. Our method surpasses SoTA solvers PSLD and P2L, achieving 4X and 8X reduction in neural function evaluations, respectively, while notably enhancing sampling quality on FFHQ, ImageNet, and COCO benchmarks. In addition, we show STSL extends to text-guided image editing and addresses residual distortions present from corrupted images in leading text-guided image editing methods. To our best knowledge, this is the first work to offer an efficient second-order approximation in solving inverse problems using latent diffusion and editing real-world images with corruptions.


title: Motion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolution

abstract: Real-world low-resolution (LR) videos have diverse and complex degradations, imposing great challenges on video super-resolution (VSR) algorithms to reproduce their high-resolution (HR) counterparts with high quality. Recently, the diffusion models have shown compelling performance in generating realistic details for image restoration tasks. However, the diffusion process has randomness, making it hard to control the contents of restored images. This issue becomes more serious when applying diffusion models to VSR tasks because temporal consistency is crucial to the perceptual quality of videos. In this paper, we propose an effective real-world VSR algorithm by leveraging the strength of pre-trained latent diffusion models. To ensure the content consistency among adjacent frames, we exploit the temporal dynamics in LR videos to guide the diffusion process by optimizing the latent sampling path with a motion-guided loss, ensuring that the generated HR video maintains a coherent and continuous visual flow. To further mitigate the discontinuity of generated details, we insert temporal module to the decoder and fine-tune it with an innovative sequence-oriented loss. The proposed motion-guided latent diffusion (MGLD) based VSR algorithm achieves significantly better perceptual quality than state-of-the-arts on real-world VSR benchmark datasets, validating the effectiveness of the proposed model design and training strategies.


title: A Probabilistic Neural Twin for Treatment Planning in Peripheral Pulmonary Artery Stenosis

abstract: The substantial computational cost of high-fidelity models in numerical hemodynamics has, so far, relegated their use mainly to offline treatment planning. New breakthroughs in data-driven architectures and optimization techniques for fast surrogate modeling provide an exciting opportunity to overcome these limitations, enabling the use of such technology for time-critical decisions. We discuss an application to the repair of multiple stenosis in peripheral pulmonary artery disease through either transcatheter pulmonary artery rehabilitation or surgery, where it is of interest to achieve desired pressures and flows at specific locations in the pulmonary artery tree, while minimizing the risk for the patient. Since different degrees of success can be achieved in practice during treatment, we formulate the problem in probability, and solve it through a sample-based approach. We propose a new offline-online pipeline for probabilsitic real-time treatment planning which combines offline assimilation of boundary conditions, model reduction, and training dataset generation with online estimation of marginal probabilities, possibly conditioned on the degree of augmentation observed in already repaired lesions. Moreover, we propose a new approach for the parametrization of arbitrarily shaped vascular repairs through iterative corrections of a zero-dimensional approximant. We demonstrate this pipeline for a diseased model of the pulmonary artery tree available through the Vascular Model Repository.

categories: physics.med-ph cs.AI cs.LG cs.NA math.NA stat.CO


title: Refine, Discriminate and Align: Stealing Encoders via Sample-Wise Prototypes and Multi-Relational Extraction

abstract: This paper introduces RDA, a pioneering approach designed to address two primary deficiencies prevalent in previous endeavors aiming at stealing pre-trained encoders: (1) suboptimal performances attributed to biased optimization objectives, and (2) elevated query costs stemming from the end-to-end paradigm that necessitates querying the target encoder every epoch. Specifically, we initially Refine the representations of the target encoder for each training sample, thereby establishing a less biased optimization objective before the steal-training phase. This is accomplished via a sample-wise prototype, which consolidates the target encoder's representations for a given sample's various perspectives. Demanding exponentially fewer queries compared to the end-to-end approach, prototypes can be instantiated to guide subsequent query-free training. For more potent efficacy, we develop a multi-relational extraction loss that trains the surrogate encoder to Discriminate mismatched embedding-prototype pairs while Aligning those matched ones in terms of both amplitude and angle. In this way, the trained surrogate encoder achieves state-of-the-art results across the board in various downstream datasets with limited queries. Moreover, RDA is shown to be robust to multiple widely-used defenses.


title: QAFE-Net: Quality Assessment of Facial Expressions with Landmark Heatmaps

abstract: Facial expression recognition (FER) methods have made great inroads in categorising moods and feelings in humans. Beyond FER, pain estimation methods assess levels of intensity in pain expressions, however assessing the quality of all facial expressions is of critical value in health-related applications. In this work, we address the quality of five different facial expressions in patients affected by Parkinson's disease. We propose a novel landmark-guided approach, QAFE-Net, that combines temporal landmark heatmaps with RGB data to capture small facial muscle movements that are encoded and mapped to severity scores. The proposed approach is evaluated on a new Parkinson's Disease Facial Expression dataset (PFED5), as well as on the pain estimation benchmark, the UNBC-McMaster Shoulder Pain Expression Archive Database. Our comparative experiments demonstrate that the proposed method outperforms SOTA action quality assessment works on PFED5 and achieves lower mean absolute error than the SOTA pain estimation methods on UNBC-McMaster. Our code and the new PFED5 dataset are available at https://github.com/shuchaoduan/QAFE-Net.


title: Latent Space Explorer: Visual Analytics for Multimodal Latent Space Exploration

abstract: Machine learning models built on training data with multiple modalities can reveal new insights that are not accessible through unimodal datasets. For example, cardiac magnetic resonance images (MRIs) and electrocardiograms (ECGs) are both known to capture useful information about subjects' cardiovascular health status. A multimodal machine learning model trained from large datasets can potentially predict the onset of heart-related diseases and provide novel medical insights about the cardiovascular system. Despite the potential benefits, it is difficult for medical experts to explore multimodal representation models without visual aids and to test the predictive performance of the models on various subpopulations. To address the challenges, we developed a visual analytics system called Latent Space Explorer. Latent Space Explorer provides interactive visualizations that enable users to explore the multimodal representation of subjects, define subgroups of interest, interactively decode data with different modalities with the selected subjects, and inspect the accuracy of the embedding in downstream prediction tasks. A user study was conducted with medical experts and their feedback provided useful insights into how Latent Space Explorer can help their analysis and possible new direction for further development in the medical domain.


title: DeepCache: Accelerating Diffusion Models for Free

abstract: Diffusion models have recently gained unprecedented attention in the field of image synthesis due to their remarkable generative capabilities. Notwithstanding their prowess, these models often incur substantial computational costs, primarily attributed to the sequential denoising process and cumbersome model size. Traditional methods for compressing diffusion models typically involve extensive retraining, presenting cost and feasibility challenges. In this paper, we introduce DeepCache, a novel training-free paradigm that accelerates diffusion models from the perspective of model architecture. DeepCache capitalizes on the inherent temporal redundancy observed in the sequential denoising steps of diffusion models, which caches and retrieves features across adjacent denoising stages, thereby curtailing redundant computations. Utilizing the property of the U-Net, we reuse the high-level features while updating the low-level features in a very cheap way. This innovative strategy, in turn, enables a speedup factor of 2.3$\times$ for Stable Diffusion v1.5 with only a 0.05 decline in CLIP Score, and 4.1$\times$ for LDM-4-G with a slight decrease of 0.22 in FID on ImageNet. Our experiments also demonstrate DeepCache's superiority over existing pruning and distillation methods that necessitate retraining and its compatibility with current sampling techniques. Furthermore, we find that under the same throughput, DeepCache effectively achieves comparable or even marginally improved results with DDIM or PLMS. The code is available at https://github.com/horseee/DeepCache


title: Random Walks Performed by Topologically-Specific Agents on Complex Networks

abstract: Random walks by single-node agents have been systematically conducted on various types of complex networks in order to investigate how their topologies can affect the dynamics of the agents. However, by fitting any network node, these agents do not engage in topological interactions with the network. In the present work, we describe random walks on complex networks performed by agents that are actually small graphs. These agents can only occupy admissible portions of the network onto which they fit topologically, hence their name being taken as topologically-specific agents. These agents are also allowed to move to adjacent subgraphs in the network, which have each node adjacent to the original respective node of the agent. Two types of random walks are considered here: uniformly random and influenced by an external field. The performance of the random walks performed by three types of topologically-specific agents is studied respectively to the obtained coverage considering three types of complex networks (geometrical, Erd\H{o}s-R\'enyi, and Barab\'asi-Albert). The number of nodes displaced at each random walk step is also obtained and analyzed. Several interesting results are reported and discussed, including the fact that, despite its intrinsic node degree heterogeneity, Barab\'asi-Albert networks tend to allow relatively smooth and effective coverage by all the considered topologically-specific agents. Erd\H{o}s-R\'enyi networks were also found to yield large dispersions of node coverage. In addition, the triangle agent was found to allow more effective random walks respectively to any of the three considered networks.


title: Segment Any 3D Gaussians

abstract: This paper presents SAGA (Segment Any 3D GAussians), a highly efficient 3D promptable segmentation method based on 3D Gaussian Splatting (3D-GS). Given 2D visual prompts as input, SAGA can segment the corresponding 3D target represented by 3D Gaussians within 4 ms. This is achieved by attaching an scale-gated affinity feature to each 3D Gaussian to endow it a new property towards multi-granularity segmentation. Specifically, a scale-aware contrastive training strategy is proposed for the scale-gated affinity feature learning. It 1) distills the segmentation capability of the Segment Anything Model (SAM) from 2D masks into the affinity features and 2) employs a soft scale gate mechanism to deal with multi-granularity ambiguity in 3D segmentation through adjusting the magnitude of each feature channel according to a specified 3D physical scale. Evaluations demonstrate that SAGA achieves real-time multi-granularity segmentation with quality comparable to state-of-the-art methods. As one of the first methods addressing promptable segmentation in 3D-GS, the simplicity and effectiveness of SAGA pave the way for future advancements in this field. Our code will be released.


title: Soft-gluon corrections in $t{\bar t}W$ production

abstract: We study higher-order QCD corrections for the associated production of a top-antitop quark pair and a $W$ boson ($t{\bar t}W$ production) in proton-proton collisions. We calculate approximate NNLO (aNNLO) and approximate N$^3$LO (aN$^3$LO) cross sections, with second-order and third-order soft-gluon corrections added to the exact NLO QCD result, and we also include electroweak (EW) corrections through NLO. We calculate uncertainties from scale dependence, which are reduced at higher orders, and from parton distributions, and we also provide separate results for $t{\bar t}W^+$ and $t{\bar t}W^-$ production. We compare our results to recent measurements from the LHC, and we find that the aN$^3$LO QCD + NLO EW predictions provide improved agreement with the data. We also calculate differential distributions in top-quark transverse momentum and rapidity and find significant enhancements from the higher-order corrections. This is the first calculation of soft-gluon corrections in single-particle-inclusive kinematics for a $2 \to 3$ process where all final-state particles are massive.


title: From Spin States to Socially Integrated Ising Models: Proposed Applications of Graph States, Stabilizer States, Toric States to Opinion Dynamics

abstract: Recent research has developed the Ising model from physics, especially statistical mechanics, and it plays an important role in quantum computing, especially quantum annealing and quantum Monte Carlo methods. The model has also been used in opinion dynamics as a powerful tool for simulating social interactions and opinion formation processes. Individual opinions and preferences correspond to spin states, and social pressure and communication dynamics are modeled through interactions between spins. Quantum computing makes it possible to efficiently simulate these interactions and analyze more complex social networks.Recent research has incorporated concepts from quantum information theory such as Graph State, Stabilizer State, and Surface Code (or Toric Code) into models of opinion dynamics. The incorporation of these concepts allows for a more detailed analysis of the process of opinion formation and the dynamics of social networks. The concepts lie at the intersection of graph theory and quantum theory, and the use of Graph State in opinion dynamics can represent the interdependence of opinions and networks of influence among individuals. It helps to represent the local stability of opinions and the mechanisms for correcting misunderstandings within a social network. It allows us to understand how individual opinions are subject to social pressures and cultural influences and how they change over time.Incorporating these quantum theory concepts into opinion dynamics allows for a deeper understanding of social interactions and opinion formation processes. Moreover, these concepts can provide new insights not only in the social sciences, but also in fields as diverse as political science, economics, marketing, and urban planning.


title: EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anything

abstract: Segment Anything Model (SAM) has emerged as a powerful tool for numerous vision applications. A key component that drives the impressive performance for zero-shot transfer and high versatility is a super large Transformer model trained on the extensive high-quality SA-1B dataset. While beneficial, the huge computation cost of SAM model has limited its applications to wider real-world applications. To address this limitation, we propose EfficientSAMs, light-weight SAM models that exhibits decent performance with largely reduced complexity. Our idea is based on leveraging masked image pretraining, SAMI, which learns to reconstruct features from SAM image encoder for effective visual representation learning. Further, we take SAMI-pretrained light-weight image encoders and mask decoder to build EfficientSAMs, and finetune the models on SA-1B for segment anything task. We perform evaluations on multiple vision tasks including image classification, object detection, instance segmentation, and semantic object detection, and find that our proposed pretraining method, SAMI, consistently outperforms other masked image pretraining methods. On segment anything task such as zero-shot instance segmentation, our EfficientSAMs with SAMI-pretrained lightweight image encoders perform favorably with a significant gain (e.g., ~4 AP on COCO/LVIS) over other fast SAM models.


title: Quantum Acceleration Limit

abstract: The speed limit provides an upper bound for the dynamical evolution time of a quantum system. Here, we introduce the notion of quantum acceleration limit for unitary time evolution of quantum systems under time-dependent Hamiltonian. We prove that the quantum acceleration is upper bounded by the fluctuation in the derivative of the Hamiltonian. This leads to a universal quantum acceleration limit (QAL) which answers the question: What is the minimum time required for a quantum system to be accelerated from arbitrary initial state to final state? We illustrate the quantum acceleration limit for a two-level quantum system and show that the bound is indeed tight. This notion can have important applications in adiabatic quantum computing, quantum control and quantum thermodynamics.


title: Equivalence principle and generalised accelerating black holes from binary systems

abstract: The Einstein equivalence principle in general relativity allows us to interpret accelerating black holes as a black hole immersed into the gravitational field of a larger companion black hole. Indeed it is demonstrated that C-metrics can be obtained as a limit of a binary system where one of the black holes grows indefinitely large, becoming a Rindler horizon. When the bigger black hole, before the limiting process, is of Schwarzschild type we recover usual accelerating black holes belonging to the Plebanski-Demianski class, thus type D. Whether the greater black hole carries some extra features, such as electric charges or rotations, we get generalised accelerating black holes which belong to a more general class, the type I. In that case the background has a richer structure, reminiscent of the physical features of the inflated companion, with respect to the standard Rindler spacetime. This insight allows us to build a general type D metric, describing an accelerating Kerr-NUT black hole. It has well defined limits to all the type-D black holes of general relativity, including the elusive (type-D) accelerating Taub-NUT spacetime. Extension to the presence of the cosmological constant is also provided.


title: Sub-MeV Dark Matter Detection with Bilayer Graphene

abstract: After decades of effort in a number of dark matter direct detection experiments, we still do not have any conclusive signal yet. Therefore it is high time we broaden our horizon by building experiments with increased sensitivity for light dark matter, specifically in the sub-MeV mass regime. In this paper, we propose a new detector material, a bilayer stack of graphene for this purpose. Its voltage-tunable low energy sub-eV electronic band gap makes it an excellent choice for the detector material of a light dark matter search experiment. We compute its dielectric function using the random phase approximation and estimate the projected sensitivity for sub-MeV dark matter-electron scattering and sub-eV dark matter absorption. We show that a bilayer graphene dark matter detector can have competitive sensitivity as other candidate target materials, like a superconductor, in this mass regime. The dark matter scattering rate in bilayer graphene is also characterized by a daily modulation from the rotation of the Earth which may help us mitigate the backgrounds in a future experiment.


title: A survey of Ly$\alpha$ emission around Damped Ly$\alpha$ absorbers at $z \approx 2$ with the Keck Cosmic Web Imager

abstract: We present Keck Cosmic Web Imager (KCWI) Ly$\alpha$ integral field spectroscopy of the fields surrounding 14 Damped Ly$\alpha$ absorbers (DLAs) at $z \approx 2$. Of these 14 DLAs, 9 have high metallicities ([M/H]$~> -0.3$), and 4 of those 9 feature a CO-emitting galaxy at an impact parameter $\lesssim 30$ kpc. Our search reaches median Ly$\alpha$ line flux sensitivities of $\sim 2 \times 10^{-17}$ erg s$^{-1}$ cm$^{-2}$ over apertures of $\sim6$ kpc and out to impact parameters of $\sim50$ kpc. We recover the Ly$\alpha$ flux of three known Ly$\alpha$-emitting H I-selected galaxies in our sample. In addition, we find two Ly$\alpha$ emitters at impact parameters of $\approx 50-70$ kpc from the high metallicity DLA at $z \approx 1.96$ toward QSO B0551-366. This field also contains a massive CO-emitting galaxy at an impact parameter of $\approx 15$ kpc. Apart from the field with QSO B0551-366, we do not detect significant Ly$\alpha$ emission in any of the remaining 8 high-metallicity DLA fields. Considering the depth of our observations and our ability to recover previously known Ly$\alpha$ emitters, we conclude that H I-selected galaxies associated with high-metallicity DLAs at $z \approx 2$ are dusty, and therefore might feature low Ly$\alpha$ escape fractions. Our results indicate that complementary approaches -- using Ly$\alpha$, CO, H$\alpha$, and [C II] 158$\mu$m emission -- are necessary to identify the wide range of galaxy types associated with $z \approx 2$ DLAs.


title: Modular extension of topological orders from congruence representations

abstract: We present an efficient method to compute the modular extension of both fermionic topological orders and $\mathbb{Z}_2$-symmetric bosonic topological orders in two spatial dimensions, basing on congruence representations of $\mathrm{SL}_2(\mathbb{Z})$ and its subgroups. To demonstrate the validity of our approach, we provide explicit calculations for topological orders with rank up to 10 for the fermionic cases and up to 6 for the bosonic cases. Along the way, we clarify the relation between fermionic rational conformal field theories, which live on the boundary of the corresponding fermionic topological orders, and modular extensions. In particular, we show that the $\mathrm{SL}_2(\mathbb{Z})$ representation of the R-R sector can be determined from the NS-NS sector using the modular extensions.


title: Segment and Caption Anything

abstract: We propose a method to efficiently equip the Segment Anything Model (SAM) with the ability to generate regional captions. SAM presents strong generalizability to segment anything while is short for semantic understanding. By introducing a lightweight query-based feature mixer, we align the region-specific features with the embedding space of language models for later caption generation. As the number of trainable parameters is small (typically in the order of tens of millions), it costs less computation, less memory usage, and less communication bandwidth, resulting in both fast and scalable training. To address the scarcity problem of regional caption data, we propose to first pre-train our model on objection detection and segmentation tasks. We call this step weak supervision pretraining since the pre-training data only contains category names instead of full-sentence descriptions. The weak supervision pretraining allows us to leverage many publicly available object detection and segmentation datasets. We conduct extensive experiments to demonstrate the superiority of our method and validate each design choice. This work serves as a stepping stone towards scaling up regional captioning data and sheds light on exploring efficient ways to augment SAM with regional semantics. The project page, along with the associated code, can be accessed via https://xk-huang.github.io/segment-caption-anything/.


title: 3DiFACE: Diffusion-based Speech-driven 3D Facial Animation and Editing

abstract: We present 3DiFACE, a novel method for personalized speech-driven 3D facial animation and editing. While existing methods deterministically predict facial animations from speech, they overlook the inherent one-to-many relationship between speech and facial expressions, i.e., there are multiple reasonable facial expression animations matching an audio input. It is especially important in content creation to be able to modify generated motion or to specify keyframes. To enable stochasticity as well as motion editing, we propose a lightweight audio-conditioned diffusion model for 3D facial motion. This diffusion model can be trained on a small 3D motion dataset, maintaining expressive lip motion output. In addition, it can be finetuned for specific subjects, requiring only a short video of the person. Through quantitative and qualitative evaluations, we show that our method outperforms existing state-of-the-art techniques and yields speech-driven animations with greater fidelity and diversity.


title: The q-Schwarzian and Liouville gravity

abstract: We present a new holographic duality between q-Schwarzian quantum mechanics and Liouville gravity. The q-Schwarzian is a one parameter deformation of the Schwarzian, which is dual to JT gravity and describes the low energy sector of SYK. We show that the q-Schwarzian in turn is dual to sinh dilaton gravity. This one parameter deformation of JT gravity can be rewritten as Liouville gravity. We match the thermodynamics and classical two point function between q-Schwarzian and Liouville gravity. We further prove the duality on the quantum level by rewriting sinh dilaton gravity as a topological gauge theory, and showing that the latter equals the q-Schwarzian. As the q-Schwarzian can be quantized exactly, this duality can be viewed as an exact solution of sinh dilaton gravity on the disk topology. For real q, this q-Schwarzian corresponds to double-scaled SYK and is dual to a sine dilaton gravity.


title: Precise tests of the axion coupling to tops

abstract: We present an in-depth analysis of axions and axion-like particles in top-pair production at the LHC. Our main goal is to probe the axion coupling to top quarks at high energies. To this end, we calculate the top-antitop cross section and differential distributions including ALP effects up to one-loop level. By comparing these predictions with LHC precision measurements, we constrain the top coupling of axion-like particles with masses below the top-antitop threshold. Our results apply to all UV completions of the ALP effective theory with dominant couplings to top quarks, in particular to DFSZ-like axion models.


title: Critical quantum dynamics of observables at eigenstate transitions

abstract: It is an outstanding goal to unveil the key features of quantum dynamics at eigenstate transitions. Focusing on quadratic fermionic Hamiltonians that exhibit localization transitions, we identify physical observables that exhibit scale-invariant critical dynamics at the transition when quenched from the initially localized charge density-wave states. The identification is based on two ingredients: (a) A relationship between the time evolution of observables in a many-body state and the transition probabilities of single-particle states, and (b) scale invariance of transition probabilities, which generalizes the corresponding recent result for survival probabilities [Phys. Rev. Lett. 131, 060404 (2023) and Phys. Rev. Res. 5, 043301 (2023)]. These properties suggest that the scale-invariant critical dynamics in the quantum-quench dynamics is also exhibited by the observables, which share the common eigenbasis with the Hamiltonian before the quench. Focusing on experimentally relevant observables such as site occupations and the particle imbalance, we numerically demonstrate their critical behavior at the eigenstate transitions in the three-dimensional Anderson model and the one-dimensional Aubry-Andr\'e model model.

categories: cond-mat.stat-mech cond-mat.dis-nn cond-mat.quant-gas quant-ph


title: Hi-ArG: Exploring the Integration of Hierarchical Argumentation Graphs in Language Pretraining

abstract: The knowledge graph is a structure to store and represent knowledge, and recent studies have discussed its capability to assist language models for various applications. Some variations of knowledge graphs aim to record arguments and their relations for computational argumentation tasks. However, many must simplify semantic types to fit specific schemas, thus losing flexibility and expression ability. In this paper, we propose the Hierarchical Argumentation Graph (Hi-ArG), a new structure to organize arguments. We also introduce two approaches to exploit Hi-ArG, including a text-graph multi-modal model GreaseArG and a new pre-training framework augmented with graph information. Experiments on two argumentation tasks have shown that after further pre-training and fine-tuning, GreaseArG supersedes same-scale language models on these tasks, while incorporating graph information during further pre-training can also improve the performance of vanilla language models. Code for this paper is available at https://github.com/ljcleo/Hi-ArG .


title: A perspective on protein structure prediction using quantum computers

abstract: Despite the recent advancements by deep learning methods such as AlphaFold2, \textit{in silico} protein structure prediction remains a challenging problem in biomedical research. With the rapid evolution of quantum computing, it is natural to ask whether quantum computers can offer some meaningful benefits for approaching this problem. Yet, identifying specific problem instances amenable to quantum advantage, and estimating quantum resources required are equally challenging tasks. Here, we share our perspective on how to create a framework for systematically selecting protein structure prediction problems that are amenable for quantum advantage, and estimate quantum resources for such problems on a utility-scale quantum computer. As a proof-of-concept, we validate our problem selection framework by accurately predicting the structure of a catalytic loop of the Zika Virus NS3 Helicase, on quantum hardware.


title: w(1+infinity) Algebra with a Cosmological Constant and the Celestial Sphere

abstract: It is shown that in the presence of a nonvanishing cosmological constant, Strominger's infinite-dimensional $\mathrm{w_{1+\infty}}$ algebra of soft graviton symmetries is modified in a simple way. The deformed algebra contains a subalgebra generating $ SO(1,4)$ or $SO(2,3)$ symmetry groups of $\text{dS}_4$ or $\text{AdS}_4$, depending on the sign of the cosmological constant. The transformation properties of soft gauge symmetry currents under the deformed $\mathrm{w_{1+\infty}}$ are also discussed.


title: Effective field theory of Berry Landau Fermi liquid from the coadjoint orbit method

abstract: We construct an effective field theory for an interacting Fermi liquid with nonzero Berry curvature at zero temperature, called the Berry Landau Fermi liquid. We start with the extended phase space formalism to include the physical time into the configuration space. In this way, the time dependence of the background gauge fields can be incorporated as a modification to the symplectic structure. Upon restricting to the physical hypersurface, the effective action that lives on the coadjoint orbit becomes the minus free energy on the extended phase space. We also derive a perturbative action using the canonical variables. For applications, we compute both linear and nonlinear electrical responses using the Kubo formula, and identify those underexplored magnetization-current contributions to the static ($\omega/q\to 0$) Hall conductivity. We determine the anomalous Hall effect caused by the Landau parameter that breaks parity and time-reversal symmetry. The (non)linear anomalous Hall effect in the free fermion limit is confirmed using the kinetic theory.


title: Grounding Everything: Emerging Localization Properties in Vision-Language Transformers

abstract: Vision-language foundation models have shown remarkable performance in various zero-shot settings such as image retrieval, classification, or captioning. But so far, those models seem to fall behind when it comes to zero-shot localization of referential expressions and objects in images. As a result, they need to be fine-tuned for this task. In this paper, we show that pretrained vision-language (VL) models allow for zero-shot open-vocabulary object localization without any fine-tuning. To leverage those capabilities, we propose a Grounding Everything Module (GEM) that generalizes the idea of value-value attention introduced by CLIPSurgery to a self-self attention path. We show that the concept of self-self attention corresponds to clustering, thus enforcing groups of tokens arising from the same object to be similar while preserving the alignment with the language space. To further guide the group formation, we propose a set of regularizations that allows the model to finally generalize across datasets and backbones. We evaluate the proposed GEM framework on various benchmark tasks and datasets for semantic segmentation. It shows that GEM not only outperforms other training-free open-vocabulary localization methods, but also achieves state-of-the-art results on the recently proposed OpenImagesV7 large-scale segmentation benchmark.


title: Kleinian black holes

abstract: We prove there is a unique vacuum solution in split-signature spacetimes with Kleinian SO(2,1) spherical symmetry. We extend our analysis to accommodate a positive or negative cosmological constant and we prove the Kleinian spherically symmetric solutions to Einstein's equation are locally isomorphic to the split-signature analogues of Schwarzschild-(Anti)-de Sitter or Nariai spacetimes. Our analysis provides a Kleinian extension of Birkhoff's theorem to metrics with split-signature. Axisymmetric vacuum solutions are also considered, including (2,2) signature formulations of the Kerr and Taub-NUT metrics.


title: Matter correlators through a wormhole in double-scaled SYK

abstract: We compute the two-point function of matter operators in the double-scaled SYK (DSSYK) model, where the two matter operators are inserted at each end of the cylindrical wormhole. We find that the wormhole amplitude in DSSYK is written as a trace over the chord Hilbert space. We also show that the length of the wormhole is stabilized in the semi-classical limit, by the same mechanism worked for the JT gravity case.


title: Walls, bubbles and doom -- the cosmology of HEFT

abstract: As experiment charts new territory at the electroweak scale, the enterprise to characterise all possible theories becomes all the more necessary. In the absence of new particles, this ambitious enterprise is attainable and has led to the Higgs Effective Field Theory (HEFT) as the most general characterising framework, containing the Standard Model Effective Field Theory (SMEFT) as a subspace. The characterisation of this theory space led to the dichotomy SMEFT vs. HEFT\SMEFT as the two possible realisations of symmetry breaking. The criterion to distinguish these two possibilities is non-local in field space, and phenomena which explore field space beyond the neighbourhood of the vacuum manifold are in a singular position to tell them apart. Cosmology allows for such phenomena, and this work focuses on HEFT\SMEFT, the less explored of the two options, to find that first order phase transitions with detectable gravitational wave remnants, domain wall formation and vacuum decay in the far, far distant future can take place and single out HEFT\SMEFT. Results in cosmology are put against LHC constraints, and the potential of future ground- and space-based experiments to cover parameter space is discussed.


title: Maximising CP Violation in Naturally Aligned Two-Higgs Doublet Models

abstract: The Two-Higgs Doublet Model (2HDM) is a well-motivated theoretical framework that provides additional sources of CP Violation (CPV) beyond the Standard Model (SM). After studying the vacuum topology of a general (convex) 2HDM potential, we unambiguously identify three origins of CPV: (I) Spontaneous CPV (SCPV), where the vacuum manifold has at least two degenerate CPV minima disconnected by domain walls, (ii) Explicit CPV (ECPV) with one single CPV ground state, and (iii) Mixed Spontaneous and Explicit CPV (MCPV), where the theory possesses more than one $non$-degenerate CPV local minimum. Most importantly, we define a novel complex parameter $r_{\rm CP}$ whose norm and phase control the three different realisations of CPV, at least at the tree level. In all these scenarios, only two CPV phases can be made independent, as any third CPV parameter will always be constrained via the CP-odd tadpole condition. Since ECPV vanishes in 2HDMs where SM Higgs alignment is achieved naturally through accidental continuous symmetries, we analyse the possibility of maximising CPV through soft and explicit breaking of these symmetries. We derive upper limits on key CPV parameters that quantify the degree of SM misalignment from constraints due to the non-observation of an electron Electric Dipole Moment (EDM). Finally, we delineate the CP-violating parameter space of the so-constrained naturally aligned 2HDMs that can further be probed at the CERN Large Hadron Collider (LHC).


title: \textit{Ab initio} calculations of the high-order harmonic enhancement in small noble gas clusters

abstract: We report calculations of the high-order harmonic spectra of few-atomic clusters of two noble gases, helium and krypton, subjected to laser pulses of intensities above $10^{13}$ W/cm\textsuperscript{2}. We employ a fully \textit{ab intio} framework, namely the real-time time-dependent configuration interaction singles coupled to a discrete Gaussian basis set. Our model reproduces the observed higher than quadratic dependence between the high-order harmonic yield and the number of atoms, and the obtained value of the enhancement rate is in quantitative agreement with experimental results. We suggest a mechanism responsible for the high-order harmonic enhancement, according to which, after the tunneling ionization, the residual ion polarizes the electron densities of surrounding atoms in the cluster, which leads to increased electron-electron repulsion during the recollision. The proposed mechanism is not only fully consistent with both our calculations and the experimental data, but can also explain the limitations of previous theoretical studies on high-order harmonic generation in clusters.


title: Modeling CN Zeeman Effect Observations of the Envelopes of a Low-Mass Protostellar Disk and a Massive Protostar

abstract: We use the POLARIS radiative transfer code to produce simulated circular polarization Zeeman emission maps of the CN $J = 1 - 0$ molecular line transition for two types of protostellar envelope magnetohydrodynamic simulations. Our first model is a low mass disk envelope system (box length $L = 200\text{ au}$), and our second model is the envelope of a massive protostar ($L = 10^4\text{ au}$) with a protostellar wind and a CN enhanced outflow shell. We compute the velocity-integrated Stokes $I$ and $V$, as well as the implied $V/I$ polarization percentage, for each detector pixel location in our simulated emission maps. Our results show that both types of protostellar environment are in principle accessible with current circular polarization instruments, with each containing swaths of envelope area that yield percentage polarizations that exceed the 1.8\% nominal sensitivity limit for circular polarization experiments with the Atacama Large Millimeter/submillimeter Array (ALMA). In both systems, high polarization ($\gtrsim$1.8\%) pixels tend to lie at an intermediate distance away from the central star and where the line-center opacity of the CN emission is moderately optically thin ($\tau_{LC} \sim 0.1-1$). Furthermore, our computed $V/I$ values scale roughly with the density weighted mean line-of-sight magnetic field strength, indicating that Zeeman observations can effectively diagnose the strength of envelope-scale magnetic fields. We also find that pixels with large $V/I$ are preferentially co-located where the absolute value of the velocity-integrated $V$ is also large, suggesting that locations with favorable percentage polarization are also favorable in terms of raw signal.


title: Divisible minimal codes

abstract: Minimal codes are linear codes where all non-zero codewords are minimal, i.e., whose support is not properly contained in the support of another codeword. The minimum possible length of such a $k$-dimensional linear code over $\mathbb{F}_q$ is denoted by $m(k,q)$. Here we determine $m(7,2)$, $m(8,2)$, and $m(9,2)$, as well as full classifications of all codes attaining $m(k,2)$ for $k\le 7$ and those attaining $m(9,2)$. For $m(11,2)$ and $m(12,2)$ we give improved upper bounds. It turns out that in many cases attaining extremal codes have the property that the weights of all codewords are divisible by some constant $\Delta>1$. So, here we study the minimum lengths of minimal codes where we additionally assume that the weights of the codewords are divisible by $\Delta$.


title: Nash Learning from Human Feedback

abstract: Reinforcement learning from human feedback (RLHF) has emerged as the main paradigm for aligning large language models (LLMs) with human preferences. Typically, RLHF involves the initial step of learning a reward model from human feedback, often expressed as preferences between pairs of text generations produced by a pre-trained LLM. Subsequently, the LLM's policy is fine-tuned by optimizing it to maximize the reward model through a reinforcement learning algorithm. However, an inherent limitation of current reward models is their inability to fully represent the richness of human preferences and their dependency on the sampling distribution. In this study, we introduce an alternative pipeline for the fine-tuning of LLMs using pairwise human feedback. Our approach entails the initial learning of a preference model, which is conditioned on two inputs given a prompt, followed by the pursuit of a policy that consistently generates responses preferred over those generated by any competing policy, thus defining the Nash equilibrium of this preference model. We term this approach Nash learning from human feedback (NLHF). In the context of a tabular policy representation, we present a novel algorithmic solution, Nash-MD, founded on the principles of mirror descent. This algorithm produces a sequence of policies, with the last iteration converging to the regularized Nash equilibrium. Additionally, we explore parametric representations of policies and introduce gradient descent algorithms for deep-learning architectures. To demonstrate the effectiveness of our approach, we present experimental results involving the fine-tuning of a LLM for a text summarization task. We believe NLHF offers a compelling avenue for preference learning and policy optimization with the potential of advancing the field of aligning LLMs with human preferences.


title: Some consequences of the $\mu$-constant condition for families of surfaces

abstract: Let $f : X\to \Delta$ be a $1$-parameter family of $2$-dimensional isolated hypersurface singularities. In this paper, we show that if the Milnor number is constant, then any semistable model, obtained from $f$ after a sufficiently large base change must satisfy non trivial restrictions. Those restrictions are in terms of the dual complex, Hodge structure and numerical invariants of the central fibre.


title: Modeling of high harmonic generation in the C\textsubscript{60} fullerene using \textit{ab initio}, DFT-based and semiempirical methods

abstract: We report calculations of the high harmonic generation spectra of the C\textsubscript{60} fullerene molecule, employing a diverse set of real-time time-dependent quantum chemical methods. All methodologies involve expanding the propagated electronic wavefunction in bases consisting of the ground and singly excited time-independent eigenstates obtained through the solution of the corresponding linear-response equations. We identify the correlation and exchange effect in the spectra by comparing the results from methods relying on the Hartree-Fock reference determinant with those obtained using approaches based on the density functional theory with different exchange-correlation functionals. The effect of the full random phase approximation treatment of the excited electronic states is also analyzed and compared with the configuration interaction singles and the Tamm-Dancoff approximation. We also showcase that the real-time extension of the semiempirical method INDO/S can be effectively applied for an approximate description of laser-driven dynamics in large systems.