title: Designing and Prototyping Extensions to MPI in MPICH

abstract: As HPC system architectures and the applications running on them continue to evolve, the MPI standard itself must evolve. The trend in current and future HPC systems toward powerful nodes with multiple CPU cores and multiple GPU accelerators makes efficient support for hybrid programming critical for applications to achieve high performance. However, the support for hybrid programming in the MPI standard has not kept up with recent trends. The MPICH implementation of MPI provides a platform for implementing and experimenting with new proposals and extensions to fill this gap and to gain valuable experience and feedback before the MPI Forum can consider them for standardization. In this work, we detail six extensions implemented in MPICH to increase MPI interoperability with other runtimes, with a specific focus on heterogeneous architectures. First, the extension to MPI generalized requests lets applications integrate asynchronous tasks into MPI's progress engine. Second, the iovec extension to datatypes lets applications use MPI datatypes as a general-purpose data layout API beyond just MPI communications. Third, a new MPI object, MPIX stream, can be used by applications to identify execution contexts beyond MPI processes, including threads and GPU streams. MPIX stream communicators can be created to make existing MPI functions thread-aware and GPU-aware, thus providing applications with explicit ways to achieve higher performance. Fourth, MPIX Streams are extended to support the enqueue semantics for offloading MPI communications onto a GPU stream context. Fifth, thread communicators allow MPI communicators to be constructed with individual threads, thus providing a new level of interoperability between MPI and on-node runtimes such as OpenMP. Lastly, we present an extension to invoke MPI progress, which lets users spawn progress threads with fine-grained control.


title: WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment

abstract: We give a model-based agent that builds a Python program representing its knowledge of the world based on its interactions with the environment. The world model tries to explain its interactions, while also being optimistic about what reward it can achieve. We define this optimism as a logical constraint between a program and a planner. We study our agent on gridworlds, and on task planning, finding our approach is more sample-efficient compared to deep RL, more compute-efficient compared to ReAct-style agents, and that it can transfer its knowledge across environments by editing its code.


title: Explain then Rank: Scale Calibration of Neural Rankers Using Natural Language Explanations from Large Language Models

abstract: The process of scale calibration in ranking systems involves adjusting the outputs of rankers to correspond with significant qualities like click-through rates or relevance, crucial for mirroring real-world value and thereby boosting the system's effectiveness and reliability. Although there has been research on calibrated ranking losses within learning-to-rank models, the particular issue of adjusting the scale for neural rankers, which excel in handling textual information, has not been thoroughly examined. Neural ranking models are adept at processing text data, yet the application of existing scale calibration techniques to these models poses significant challenges due to their complexity and the intensive training they require, often resulting in suboptimal outcomes. This study delves into the potential of large language models (LLMs) to provide uncertainty measurements for a query and document pair that correlate with the scale-calibrated scores. By employing Monte Carlo sampling to gauge relevance probabilities from LLMs and incorporating natural language explanations (NLEs) to articulate this uncertainty, we carry out comprehensive tests on two major document ranking datasets. Our findings reveal that the approach leveraging NLEs outperforms existing calibration methods under various training scenarios, leading to better calibrated neural rankers.


title: Correlations equalities and some upper bounds for the coupling constant implying area decay of Wilson loop for $Z_3$ lattice gauge theories

abstract: Correlation identities are obtained for $Z_3$ lattice gauge theory where the bonds of the plaquettes are decorated by generalized three-state Ising variables. Making use of correlation inequalities we obtain the area decay of the Wilson loop observable in a range of the coupling parameter larger than those obtained from mean field theory considerations.


title: Topological changes and deformation mechanisms of nanoporous Ta under compression

abstract: While the mechanical behavior of noble nanoporous metals has been the subject of numerous studies, less is known about their recently developed refractory-based counterparts. Here we report on the mechanical properties, deformation mechanisms and topological changes of nanoporous tantalum, a prototypical refractory metal, by means of atomistic simulations of compression tests. An open-source multi-cpu and gpu-capable software is presented and used for the generation of computational samples. The stress strain curves show a non-linear elastic response, with early yielding. The plastic regime is first characterized by a linear hardening followed by an exponential hardening at large strains, associated with a high degree of densification. Plasticity is dominated by dislocation activity, with twinning and vacancy formation appearing as complementary deformation mechanisms. In order to study the mechanical response from a topological perspective, we track the evolution of the genus throughout the tests, finding direct correlations with each regime of the stress strain curves. The results are in agreement with previous studies of plasticity in nanoporous metals and highlight the importance of using topological metrics, for gaining insights into complex aspects of the deformation of nanoporous metals.


title: Key ingredients for effective zero-shot cross-lingual knowledge transfer in generative tasks

abstract: Zero-shot cross-lingual knowledge transfer enables a multilingual pretrained language model, finetuned on a task in one language, make predictions for this task in other languages. While being broadly studied for natural language understanding tasks, the described setting is understudied for generation. Previous works notice a frequent problem of generation in a wrong language and propose approaches to address it, usually using mT5 as a backbone model. In this work we compare various approaches proposed from the literature in unified settings, also including alternative backbone models, namely mBART and NLLB-200. We first underline the importance of tuning learning rate used for finetuning, which helps to substantially alleviate the problem of generation in the wrong language. Then, we show that with careful learning rate tuning, the simple full finetuning of the model acts as a very strong baseline and alternative approaches bring only marginal improvements. Finally, we find that mBART performs similarly to mT5 of the same size, and NLLB-200 can be competitive in some cases. Our final zero-shot models reach the performance of the approach based on data translation which is usually considered as an upper baseline for zero-shot cross-lingual transfer in generation.


title: Adaptive Skeleton Graph Decoding

abstract: Large language models (LLMs) have seen significant adoption for natural language tasks, owing their success to massive numbers of model parameters (e.g., 70B+); however, LLM inference incurs significant computation and memory costs. Recent approaches propose parallel decoding strategies, such as Skeleton-of-Thought (SoT), to improve performance by breaking prompts down into sub-problems that can be decoded in parallel; however, they often suffer from reduced response quality. Our key insight is that we can request additional information, specifically dependencies and difficulty, when generating the sub-problems to improve both response quality and performance. In this paper, we propose Skeleton Graph Decoding (SGD), which uses dependencies exposed between sub-problems to support information forwarding between dependent sub-problems for improved quality while exposing parallelization opportunities for decoding independent sub-problems. Additionally, we leverage difficulty estimates for each sub-problem to select an appropriately-sized model, improving performance without significantly reducing quality. Compared to standard autoregressive generation and SoT, SGD achieves a 1.69x speedup while improving quality by up to 51%.


title: Challenges and Experiences of Iranian Developers with MLOps at Enterprise

abstract: Data is becoming more complex, and so are the approaches designed to process it. Enterprises have access to more data than ever, but many still struggle to glean the full potential of insights from what they have. This research explores the challenges and experiences of Iranian developers in implementing the MLOps paradigm within enterprise settings. MLOps, or Machine Learning Operations, is a discipline focused on automating the continuous delivery of machine learning models. In this study, we review the most popular MLOps tools used by leading technology enterprises. Additionally, we present the results of a questionnaire answered by over 110 Iranian Machine Learning experts and Software Developers, shedding light on MLOps tools and the primary obstacles faced. The findings reveal that data quality problems, a lack of resources, and difficulties in model deployment are among the primary challenges faced by practitioners. Collaboration between ML, DevOps, Ops, and Science teams is seen as a pivotal challenge in implementing MLOps effectively.


title: Ontology Enhanced Claim Detection

abstract: We propose an ontology enhanced model for sentence based claim detection. We fused ontology embeddings from a knowledge base with BERT sentence embeddings to perform claim detection for the ClaimBuster and the NewsClaims datasets. Our ontology enhanced approach showed the best results with these small-sized unbalanced datasets, compared to other statistical and neural machine learning models. The experiments demonstrate that adding domain specific features (either trained word embeddings or knowledge graph metadata) can improve traditional ML methods. In addition, adding domain knowledge in the form of ontology embeddings helps avoid the bias encountered in neural network based models, for example the pure BERT model bias towards larger classes in our small corpus.


title: Solution Polishing via Path Relinking for Continuous Black-Box Optimization

abstract: When faced with a limited budget of function evaluations, state-of-the-art black-box optimization (BBO) solvers struggle to obtain globally, or sometimes even locally, optimal solutions. In such cases, one may pursue solution polishing, i.e., a computational method to improve (or ``polish'') an incumbent solution, typically via some sort of evolutionary algorithm involving two or more solutions. While solution polishing in ``white-box'' optimization has existed for years, relatively little has been published regarding its application in costly-to-evaluate BBO. To fill this void, we explore two novel methods for performing solution polishing along one-dimensional curves rather than along straight lines. We introduce a convex quadratic program that can generate promising curves through multiple elite solutions, i.e., via path relinking, or around a single elite solution. In comparing four solution polishing techniques for continuous BBO, we show that solution polishing along a curve is competitive with solution polishing using a state-of-the-art BBO solver.


title: Refining Minimax Regret for Unsupervised Environment Design

abstract: In unsupervised environment design, reinforcement learning agents are trained on environment configurations (levels) generated by an adversary that maximises some objective. Regret is a commonly used objective that theoretically results in a minimax regret (MMR) policy with desirable robustness guarantees; in particular, the agent's maximum regret is bounded. However, once the agent reaches this regret bound on all levels, the adversary will only sample levels where regret cannot be further reduced. Although there are possible performance improvements to be made outside of these regret-maximising levels, learning stagnates. In this work, we introduce Bayesian level-perfect MMR (BLP), a refinement of the minimax regret objective that overcomes this limitation. We formally show that solving for this objective results in a subset of MMR policies, and that BLP policies act consistently with a Perfect Bayesian policy over all levels. We further introduce an algorithm, ReMiDi, that results in a BLP policy at convergence. We empirically demonstrate that training on levels from a minimax regret adversary causes learning to prematurely stagnate, but that ReMiDi continues learning.


title: Capturing the Shape of a Point Set with a Line Segment

abstract: Detecting location-correlated groups in point sets is an important task in a wide variety of applications areas. In addition to merely detecting such groups, the group's shape carries meaning as well. In this paper, we represent a group's shape using a simple geometric object, a line segment. Specifically, given a radius $r$, we say a line segment is representative of a point set $P$ if it is within distance $r$ of each point $p \in P$. We aim to find the shortest such line segment. This problem is equivalent to stabbing a set of circles of radius $r$ using the shortest line segment. We describe an algorithm to find the shortest representative segment in $O(n \log h + h \log^3 h)$ time. Additionally, we show how to maintain a stable approximation of the shortest representative segment when the points in $P$ move.


title: Character varieties of torus links

abstract: In this paper, we study the geometry of the moduli space of representations of the fundamental group of the complement of a torus link into an algebraic group G, an algebraic variety known as the G-character variety of the torus link. These torus links are a family of links in the 3-dimensional sphere formed by stacking several copies of torus knots. We develop an intrinsic stratification of the variety that allows us to relate its geometry with the one of the underlying torus knot. Using this information, we explicitly compute the E-polynomial associated to the Hodge structure of these varieties for $G=SL_2(\mathbb{C})$ and $SL_3(\mathbb{C})$, for an arbitrary torus link, showing an unexpected relation with the number of strands of the link.


title: Statistical evaluation and optimization of entanglement purification protocols

abstract: Quantitative characterization of two-qubit entanglement purification protocols is introduced. Our approach is based on the concurrence and the hit-and-run algorithm applied to the convex set of all two-qubit states. We demonstrate that pioneering protocols are unable to improve the estimated initial average concurrence of almost uniformly sampled density matrices, however, as it is known, they still generate pairs of qubits in a state that is close to a Bell state. We also develop a more efficient protocol and investigate it numerically together with a recent proposal based on an entangling rank-two projector. Furthermore, we present a class of variational purification protocols with continuous parameters and optimize their output concurrence. These optimized algorithms turn out to surpass former proposals and our new protocol by means of not wasting too many entangled states.


title: Revisiting registration-based synthesis: A focus on unsupervised MR image synthesis

abstract: Deep learning (DL) has led to significant improvements in medical image synthesis, enabling advanced image-to-image translation to generate synthetic images. However, DL methods face challenges such as domain shift and high demands for training data, limiting their generalizability and applicability. Historically, image synthesis was also carried out using deformable image registration (DIR), a method that warps moving images of a desired modality to match the anatomy of a fixed image. However, concerns about its speed and accuracy led to its decline in popularity. With the recent advances of DL-based DIR, we now revisit and reinvigorate this line of research. In this paper, we propose a fast and accurate synthesis method based on DIR. We use the task of synthesizing a rare magnetic resonance (MR) sequence, white matter nulled (WMn) T1-weighted (T1-w) images, to demonstrate the potential of our approach. During training, our method learns a DIR model based on the widely available MPRAGE sequence, which is a cerebrospinal fluid nulled (CSFn) T1-w inversion recovery gradient echo pulse sequence. During testing, the trained DIR model is first applied to estimate the deformation between moving and fixed CSFn images. Subsequently, this estimated deformation is applied to align the paired WMn counterpart of the moving CSFn image, yielding a synthetic WMn image for the fixed CSFn image. Our experiments demonstrate promising results for unsupervised image synthesis using DIR. These findings highlight the potential of our technique in contexts where supervised synthesis methods are constrained by limited training data.


title: DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Models

abstract: A primary hurdle of autonomous driving in urban environments is understanding complex and long-tail scenarios, such as challenging road conditions and delicate human behaviors. We introduce DriveVLM, an autonomous driving system leveraging Vision-Language Models (VLMs) for enhanced scene understanding and planning capabilities. DriveVLM integrates a unique combination of reasoning modules for scene description, scene analysis, and hierarchical planning. Furthermore, recognizing the limitations of VLMs in spatial reasoning and heavy computational requirements, we propose DriveVLM-Dual, a hybrid system that synergizes the strengths of DriveVLM with the traditional autonomous driving pipeline. Experiments on both the nuScenes dataset and our SUP-AD dataset demonstrate the efficacy of DriveVLM and DriveVLM-Dual in handling complex and unpredictable driving conditions. Finally, we deploy the DriveVLM-Dual on a production vehicle, verifying it is effective in real-world autonomous driving environments.


title: A Lower Bound for Estimating Fr\'echet Means

abstract: Fr\'echet means, conceptually appealing, generalize the Euclidean expectation to general metric spaces. We explore how well Fr\'echet means can be estimated from independent and identically distributed samples and uncover a fundamental limitation: In the vicinity of a probability distribution $P$ with nonunique means, independent of sample size, it is not possible to uniformly estimate Fr\'echet means below a precision determined by the diameter of the set of Fr\'echet means of $P$. Implications were previously identified for empirical plug-in estimators as part of the phenomenon \emph{finite sample smeariness}. Our findings thus confirm inevitable statistical challenges in the estimation of Fr\'echet means on metric spaces for which there exist distributions with nonunique means. Illustrating the relevance of our lower bound, examples of extrinsic, intrinsic, Procrustes, diffusion and Wasserstein means showcase either deteriorating constants or slow convergence rates of empirical Fr\'echet means for samples near the regime of nonunique means.


title: KARL: Knowledge-Aware Retrieval and Representations aid Retention and Learning in Students

abstract: Flashcard schedulers are tools that rely on 1) student models to predict the flashcards a student knows; and 2) teaching policies to schedule cards based on these predictions. Existing student models, however, only use flashcard-level features, like the student's past responses, ignoring the semantic ties of flashcards. Deep Knowledge Tracing (DKT) models can capture semantic relations with language models, but are inefficient, lack content-rich datasets for evaluation, and require robust teaching policies. To address these issues, we design KARL, a DKT-inspired student model that uses retrieval and BERT embeddings for efficient and accurate student recall predictions. To test KARL, we collect a new dataset of diverse study history on trivia questions. KARL bests existing student models in AUC and calibration error. Finally, we propose a novel teaching policy that exploits the predictive power of DKT models to deploy KARL online. Based on 27 learners and 32 6-day study trajectories, KARL shows the ability to enhance medium-term educational learning, proving its efficacy for scheduling.


title: Regularization by denoising: Bayesian model and Langevin-within-split Gibbs sampling

abstract: This paper introduces a Bayesian framework for image inversion by deriving a probabilistic counterpart to the regularization-by-denoising (RED) paradigm. It additionally implements a Monte Carlo algorithm specifically tailored for sampling from the resulting posterior distribution, based on an asymptotically exact data augmentation (AXDA). The proposed algorithm is an approximate instance of split Gibbs sampling (SGS) which embeds one Langevin Monte Carlo step. The proposed method is applied to common imaging tasks such as deblurring, inpainting and super-resolution, demonstrating its efficacy through extensive numerical experiments. These contributions advance Bayesian inference in imaging by leveraging data-driven regularization strategies within a probabilistic framework.


title: The multigraded BGG correspondence in Macaulay2

abstract: We give an overview of a Macaulay2 package for computing with the multigraded BGG correspondence. This software builds on the package BGG due to Abo-Decker-Eisenbud-Schreyer-Smith-Stillman, which concerns the standard graded BGG correspondence. In addition to implementing the multigraded BGG functors, this package includes an implementation of differential modules and their minimal free resolutions, and it contains a method for computing strongly linear strands of multigraded free resolutions.


title: Convex-cocompact representations into the isometry group of the infinite-dimensional hyperbolic space

abstract: We construct convex-cocompact representations of fundamental groups of closed hyperbolic surfaces into the isometry group of the infinite-dimensional hyperbolic space using bendings. We prove that convex-cocompact representations of finitely generated groups in the group of isometries of the infinite-dimensional hyperbolic space form an open set in the space of representations and that the space of deformations (up to conjugation) obtained by bending an irreducible representation of a surface group is infinite-dimensional.


title: Development of KI-TWPAs for the DARTWARS project

abstract: Noise at the quantum limit over a broad bandwidth is a fundamental requirement for future cryogenic experiments for neutrino mass measurements, dark matter searches and Cosmic Microwave Background (CMB) measurements as well as for fast high-fidelity read-out of superconducting qubits. In the last years, Josephson Parametric Amplifiers (JPA) have demonstrated noise levels close to the quantum limit, but due to their narrow bandwidth, only few detectors or qubits per line can be read out in parallel. An alternative and innovative solution is based on superconducting parametric amplification exploiting the travelling-wave concept. Within the DARTWARS (Detector Array Readout with Travelling Wave AmplifieRS) project, we develop Kinetic Inductance Travelling-Wave Parametric Amplifiers (KI-TWPAs) for low temperature detectors and qubit read-out. KI-TWPAs are typically operated in a threewave mixing (3WM) mode and are characterised by a high gain, a high saturation power, a large amplification bandwidth and nearly quantum limited noise performance. The goal of the DARTWARS project is to optimise the KI-TWPA design, explore new materials, and investigate alternative fabrication processes in order to enhance the overall performance of the amplifier. In this contribution we present the advancements made by the DARTWARS collaboration to produce a working prototype of a KI-TWPA, from the fabrication to the characterisation.


title: Cryo-Near-Field Photovoltage Microscopy of Heavy-Fermion Twisted Symmetric Trilayer Graphene

abstract: Ever since the initial experimental observation of correlated insulators and superconductivity in the flat Dirac bands of magic angle twisted bilayer graphene, a search for the microscopic description that explains its strong electronic interactions has begun. While the seemingly disagreeing electronic transport and scanning tunneling microscopy experiments suggest a dichotomy between local and extended electronic orbitals, definitive experimental evidence merging the two patterns together has been much sought after. Here, we report on the local photothermoelectric measurements in the flat electronic bands of twisted symmetric trilayer graphene (TSTG). We use a cryogenic scanning near-field optical microscope with an oscillating atomic force microscopy (AFM) tip irradiated by the infrared photons to create a nanoscopic hot spot in the planar samples, which generates a photocurrent that we probe globally. We observe a breakdown of the non-interacting Mott formalism at low temperatures (10K), signaling the importance of the electronic interactions. Our measurements reveal an overall negative offset of the Seebeck coefficient and significant peaks of the local photovoltage values at all positive integer fillings of the TSTG's moir\'e superlattice, further indicating a substantial deviation from the classical two-band semiconductor Seebeck response. We explain these observations using the interacting topological heavy-fermion model. In addition, our data reveal a spatial variation of the relative interaction strength dependent on the measured local twist angle (1.2{\deg} - 1.6{\deg}). Our findings provide experimental evidence of heavy fermion behaviour in the topological flat bands of moir\'e graphene and epitomize an avenue to apply local thermoelectric measurements to other strongly correlated materials in the disorder-free limit.


title: Is it possible to detect coronal mass ejections on solar-type stars through extreme-ultraviolet spectral observations?

abstract: Stellar coronal mass ejections (CMEs) from host stars are an important factor that affects the habitability of exoplanets. Although their solar counterparts have been well observed for decades, it is still very difficult to find solid evidence of stellar CMEs. Using the spectral line profile asymmetry caused by the Doppler shift of erupting plasma, several stellar CME candidates have been identified from spectral lines formed at chromospheric or transition region temperatures of the stars. However, a successful detection of stellar CME signals based on the profile asymmetries of coronal lines is still lacking. It is unclear whether we can detect such signals. Here we construct an analytical model for CMEs on solar-type stars, and derive an expression of stellar extreme-ultraviolet (EUV) line profiles during CME eruptions. For different instrumental parameters, exposure times, CME propagation directions and stellar activity levels, we synthesized the corresponding line profiles of Fe IX 171.07 \AA\ and Fe XV 284.16 \AA. Further investigations provide constraints on the instrumental requirements for successful detection and characterization of stellar CMEs. Our results show that it is possible to detect stellar CME signals and infer their velocities based on spectral profile asymmetries using an EUV spectrometer with a moderate spectral resolution and signal-to-noise ratio. Our work provides important references for the design of future EUV spectrometers for stellar CME detection and the development of observation strategies.


title: Is Open-Source There Yet? A Comparative Study on Commercial and Open-Source LLMs in Their Ability to Label Chest X-Ray Reports

abstract: Introduction: With the rapid advances in large language models (LLMs), there have been numerous new open source as well as commercial models. While recent publications have explored GPT-4 in its application to extracting information of interest from radiology reports, there has not been a real-world comparison of GPT-4 to different leading open-source models. Materials and Methods: Two different and independent datasets were used. The first dataset consists of 540 chest x-ray reports that were created at the Massachusetts General Hospital between July 2019 and July 2021. The second dataset consists of 500 chest x-ray reports from the ImaGenome dataset. We then compared the commercial models GPT-3.5 Turbo and GPT-4 from OpenAI to the open-source models Mistral-7B, Mixtral-8x7B, Llama2-13B, Llama2-70B, QWEN1.5-72B and CheXbert and CheXpert-labeler in their ability to accurately label the presence of multiple findings in x-ray text reports using different prompting techniques. Results: On the ImaGenome dataset, the best performing open-source model was Llama2-70B with micro F1-scores of 0.972 and 0.970 for zero- and few-shot prompts, respectively. GPT-4 achieved micro F1-scores of 0.975 and 0.984, respectively. On the institutional dataset, the best performing open-source model was QWEN1.5-72B with micro F1-scores of 0.952 and 0.965 for zero- and few-shot prompting, respectively. GPT-4 achieved micro F1-scores of 0.975 and 0.973, respectively. Conclusion: In this paper, we show that while GPT-4 is superior to open-source models in zero-shot report labeling, the implementation of few-shot prompting can bring open-source models on par with GPT-4. This shows that open-source models could be a performant and privacy preserving alternative to GPT-4 for the task of radiology report classification.


title: Search for Stellar Companions of Exoplanet Host Stars with AstraLux/CAHA 2.2 m

abstract: Stellar multiplicity is a key aspect of exoplanet diversity, as the presence of more than one star in a planetary system can have both devastating and positive effects on its formation and evolution. In this paper, we present the results of a Lucky Imaging survey of 212 exoplanet host stars performed with AstraLux at CAHA 2.2 m. The survey includes data from seven observing epochs between August 2015 and September 2020, and data for individual targets from four earlier observing epochs. The targets of this survey are nearby, bright, solar-like stars with high proper motions. In total, we detected 46 co-moving companions of 43 exoplanet host stars. Accordingly, this survey shows that the minimum multiplicity rate of exoplanet host stars is 20 $\pm$ 3 %. In total, 33 binary and ten hierarchical triple star systems with exoplanets have been identified. All companions were found to have a common proper motion with the observed exoplanet host stars, and with our astrometry we even find evidence of orbital motion for 28 companions. For all targets, we determined the detection limit and explore the detection space for possible additional companions of these stars. Based on the reached detection limit, additional co-moving companions beyond the detected ones can be excluded around all observed exoplanet host stars. The increasing number of exoplanets discovered in multiple stellar systems suggests that the formation of planets in such systems is by no means rare, but common. Therefore, our study highlights the need to consider stellar multiplicity in future studies of exoplanet habitability.


title: Time-periodic behaviour in one- and two-dimensional interacting particle systems

abstract: We provide a class of examples of interacting particle systems on $\mathbb{Z}^d$, for $d\in\{1,2\}$, that admit a unique translation-invariant stationary measure, which is not the long-time limit of all translation-invariant starting measures, due to the existence of time-periodic orbits in the associated measure-valued dynamics. This is the first such example and shows that even in low dimensions, not every limit point of the measure-valued dynamics needs to be a time-stationary measure.


title: Simple model for the kinetics of stimuli-responsive gels with porous structures

abstract: Stimuli-responsive gels are the gels that vary the volume depending on environmental conditions. It has been reported that the stimuli-responsive gel with an inhomogeneous structure exhibits faster volume change than the gel without it. It is understood as a difference in the transfer dynamics of the solvent, though, there are few models for discussing the effect of inhomogeneity explicitly. In this paper, we propose a simple model for the kinetics of volume change by introducing inhomogeneity as the probability distribution for a random variable that characterizes the structure. Under this framework, we demonstrate that inhomogeneity actually increases the rate of volume change. Furthermore, through analysis of a simplified example, we show that some features that are often seen in experiments can be reproduced by the model. This model provides a simple equation for the time series of volume change that can be used to characterize the experimental data based on a simple physical picture of the phenomenon.


title: Asymptotic Gaussian Fluctuations of Eigenvectors in Spectral Clustering

abstract: The performance of spectral clustering relies on the fluctuations of the entries of the eigenvectors of a similarity matrix, which has been left uncharacterized until now. In this letter, it is shown that the signal $+$ noise structure of a general spike random matrix model is transferred to the eigenvectors of the corresponding Gram kernel matrix and the fluctuations of their entries are Gaussian in the large-dimensional regime. This CLT-like result was the last missing piece to precisely predict the classification performance of spectral clustering. The proposed proof is very general and relies solely on the rotational invariance of the noise. Numerical experiments on synthetic and real data illustrate the universality of this phenomenon.


title: UncertaintyTrack: Exploiting Detection and Localization Uncertainty in Multi-Object Tracking

abstract: Multi-object tracking (MOT) methods have seen a significant boost in performance recently, due to strong interest from the research community and steadily improving object detection methods. The majority of tracking methods follow the tracking-by-detection (TBD) paradigm, blindly trust the incoming detections with no sense of their associated localization uncertainty. This lack of uncertainty awareness poses a problem in safety-critical tasks such as autonomous driving where passengers could be put at risk due to erroneous detections that have propagated to downstream tasks, including MOT. While there are existing works in probabilistic object detection that predict the localization uncertainty around the boxes, no work in 2D MOT for autonomous driving has studied whether these estimates are meaningful enough to be leveraged effectively in object tracking. We introduce UncertaintyTrack, a collection of extensions that can be applied to multiple TBD trackers to account for localization uncertainty estimates from probabilistic object detectors. Experiments on the Berkeley Deep Drive MOT dataset show that the combination of our method and informative uncertainty estimates reduces the number of ID switches by around 19\% and improves mMOTA by 2-3%. The source code is available at https://github.com/TRAILab/UncertaintyTrack


title: Analysis of the Picard-Newton iteration for the Navier-Stokes equations: global stability and quadratic convergence

abstract: We analyze and test a simple-to-implement two-step iteration for the incompressible Navier-Stokes equations that consists of first applying the Picard iteration and then applying the Newton iteration to the Picard output. We prove that this composition of Picard and Newton converges quadratically, and our analysis (which covers both the unique solution and non-unique solution cases) also suggests that this solver has a larger convergence basin than usual Newton because of the improved stability properties of Picard-Newton over Newton. Numerical tests show that Picard-Newton dramatically outperforms both the Picard and Newton iterations, especially as the Reynolds number increases. We also consider enhancing the Picard step with Anderson acceleration (AA), and find that the AAPicard-Newton iteration has even better convergence properties on several benchmark test problems.


title: A Digital Silicon Photomultiplier

abstract: Silicon Photomultipliers (SiPMs) are state-of-the-art photon detectors used in particle physics, medical imaging, and beyond. They are sensitive to individual photons in the optical wavelength regime and achieve time resolutions of a few tens of picoseconds, which makes them interesting candidates for timing detectors in tracking systems for particle physics experiments. The Geiger discharges triggered in the sensitive elements of a SiPM, Single-Photon Avalanche Diodes (SPADs), yield signal amplitudes independent of the energy deposited by a photon or ionizing particle. This intrinsically digital nature of the signal motivates its digitization already on SPAD level. A digital SiPM (dSiPM) was designed at Deutsches Elektronen Synchrotron (DESY), combining a SPAD array with embedded CMOS circuitry for on-chip signal processing. A key feature of the DESY dSiPM is its capability to provide hit-position information on pixel level, and one hit time stamp per quadrant at a 3 MHz readout-frame rate. The pixels comprise four SPADs and have a pitch of about 70 um. The four time stamps are provided by 12 bit Time-to-Digital Converters (TDCs) with a resolution better than 100 ps. The chip was characterized in the laboratory to determine dark count rate, breakdown voltage, and TDC characteristics. Test-beam measurements are analyzed to assess the DESY dSiPMs performance in the context of a 4D-tracking applications. The results demonstrate a spatial hit resolution on a pixel level, a minimum-ionizing particle detection efficiency of about 30 % and a time resolution in the order of 50 ps.


title: Sommerfeld Radiation Condition for Helmholtz Equations with long-range Potentials

abstract: We study the electric Helmholtz equation $\Delta u + Vu + \lambda u =f$ and show that, for certain potentials, the solution $u$ given by the limited absorption principle obeys a Sommerfeld radiation condition. We use a non-spherical approach based on the solution $K$ of the eikonal equation $|\nabla K|^2=1 + \frac{p}{\lambda}$ to improve previous results in that area and extend them to long-range potentials which decay like $|x|^{-2-\alpha}$ at infinity, with $\alpha > 0$.


title: Multi-View Conformal Learning for Heterogeneous Sensor Fusion

abstract: Being able to assess the confidence of individual predictions in machine learning models is crucial for decision making scenarios. Specially, in critical applications such as medical diagnosis, security, and unmanned vehicles, to name a few. In the last years, complex predictive models have had great success in solving hard tasks and new methods are being proposed every day. While the majority of new developments in machine learning models focus on improving the overall performance, less effort is put on assessing the trustworthiness of individual predictions, and even to a lesser extent, in the context of sensor fusion. To this end, we build and test multi-view and single-view conformal models for heterogeneous sensor fusion. Our models provide theoretical marginal confidence guarantees since they are based on the conformal prediction framework. We also propose a multi-view semi-conformal model based on sets intersection. Through comprehensive experimentation, we show that multi-view models perform better than single-view models not only in terms of accuracy-based performance metrics (as it has already been shown in several previous works) but also in conformal measures that provide uncertainty estimation. Our results also showed that multi-view models generate prediction sets with less uncertainty compared to single-view models.


title: Distribution of distance-based quantum resources outside a radiating Schwarzschild black hole

abstract: We obtain analytical expressions for distance-based quantum resources and examine their distribution in the proximity of a Schwarzschild black hole (SBH) within a curved background. For an observer in free fall and their stationary counterpart sharing the Gisin state, the quantum resources are degraded at an infinite Hawking temperature. The extent of this degradation that occurs as the SBH evaporates is contingent upon the fermionic frequency mode, Gisin state parameters, and the distance between the observer and the event horizon (EH). In the case of two accelerating detectors in Minkowski spacetime interacting with quantum fluctuating scalar fields (QFSF), we find that quantum coherence and discord exhibit sudden disappearance for certain initial states and sudden reappearance for others except entanglement, regardless of the Unruh temperature. We also discover that the quantum resources of one detector can be transferred to another in the case of two stationary detectors through a fluctuating quantum field outside the SBH. We demonstrate that, in contrast to coherence and discord, we are unable to regenerate entanglement for a given initial state and that they are equal for different vacuum states. In certain circumstances, the presence of EHs does not significantly reduce the available resources, as it turns out that all interesting phenomena occur within EHs. Since the world is basically non-inertial, it is necessary to understand the distribution of quantum resources within a relativistic framework.


title: TILP: Differentiable Learning of Temporal Logical Rules on Knowledge Graphs

abstract: Compared with static knowledge graphs, temporal knowledge graphs (tKG), which can capture the evolution and change of information over time, are more realistic and general. However, due to the complexity that the notion of time introduces to the learning of the rules, an accurate graph reasoning, e.g., predicting new links between entities, is still a difficult problem. In this paper, we propose TILP, a differentiable framework for temporal logical rules learning. By designing a constrained random walk mechanism and the introduction of temporal operators, we ensure the efficiency of our model. We present temporal features modeling in tKG, e.g., recurrence, temporal order, interval between pair of relations, and duration, and incorporate it into our learning process. We compare TILP with state-of-the-art methods on two benchmark datasets. We show that our proposed framework can improve upon the performance of baseline methods while providing interpretable results. In particular, we consider various scenarios in which training samples are limited, data is biased, and the time range between training and inference are different. In all these cases, TILP works much better than the state-of-the-art methods.


title: Cosmic dust fertilization of glacial prebiotic chemistry on early Earth

abstract: Earth's surface is deficient in available forms of many elements considered limiting for prebiotic chemistry. In contrast, many extraterrestrial rocky objects are rich in these same elements. Limiting prebiotic ingredients may, therefore, have been delivered by exogenous material; however, the mechanisms by which exogeneous material may be reliably and non-destructively supplied to a planetary surface remains unclear. Today, the flux of extraterrestrial matter to Earth is dominated by fine-grained cosmic dust. Although this material is rarely discussed in a prebiotic context due to its delivery over a large surface area, concentrated cosmic dust deposits are known to form on Earth today due to the action of sedimentary processes. Here we combine empirical constraints on dust sedimentation with dynamical simulations of dust formation and planetary accretion to show that localized sedimentary deposits of cosmic dust could have accumulated in arid environments on early Earth, in particular glacial settings that today produce cryoconite sediments. Our results challenge the widely held assumption that cosmic dust is incapable of fertilizing prebiotic chemistry. Cosmic dust deposits may have plausibly formed on early Earth and acted to fertilize prebiotic chemistry.


title: Free probability, path developments and signature kernels as universal scaling limits

abstract: Random developments of a path into a matrix Lie group $G_N$ have recently been used to construct signature-based kernels on path space. Two examples include developments into GL$(N;\mathbb{R})$ and $U(N;\mathbb{C})$, the general linear and unitary groups of dimension $N$. For the former, [MLS23] showed that the signature kernel is obtained via a scaling limit of developments with Gaussian vector fields. The second instance was used in [LLN23] to construct a metric between probability measures on path space. We present a unified treatment to obtaining large $N$ limits by leveraging the tools of free probability theory. An important conclusion is that the limiting kernels, while dependent on the choice of Lie group, are nonetheless universal limits with respect to how the development map is randomised. For unitary developments, the limiting kernel is given by the contraction of a signature against the monomials of freely independent semicircular random variables. Using the Schwinger-Dyson equations, we show that this kernel can be obtained by solving a novel quadratic functional equation. We provide a convergent numerical scheme for this equation, together with rates, which does not require computation of signatures themselves.


title: Derived equivalence of algebras induced by their trivial extensions

abstract: The bounded derived category of a finite dimensional algebra of finite global dimension is equivalent the stable category of $\mathbb{Z}$-graded modules over its trivial extension \cite{Happel}. In particular, given two derived equivalent finite dimensional algebras $\Lambda_{1}$ and $\Lambda_{2}$ of finite global dimension, their trivial extensions are stable equivalent. The converse is not true in general. The goal of this paper is to study cases where derived equivalences between $\Lambda_{1}$ and $\Lambda_{2}$ arise from an equivalence of categories involving their trivial extension. Thanks to a graded version of Happel's theorem, we show that one can construct a $\mathbb{Z}$-grading on the $\Lambda_{i}$ so that such an equivalence involving their trivial extension yield a derived equivalence between the category of $\mathbb{Z}$-graded module over $\Lambda_{i}$. We describe explicitly the tilting object associated to this derived equivalence (in the non-graded and in the graded case) for triangular matrix algebras. Finally, we apply these results to the particular case of gentle algebras. In this context, we study how one can obtain a derived equivalence between $\Lambda_{1}$ and $\Lambda_{2}$ (in the non-graded and the graded case) from graded generalized Kauer moves.


title: A new approach to universal $F$-inverse monoids in enriched signature

abstract: We show that the universal $X$-generated $F$-inverse monoid $F(G)$, where $G$ is an $X$-generated group, introduced by Auinger, Szendrei and the first-named author, arises as a quotient inverse monoid of the Margolis-Meakin expansion $M(G, X\cup \overline{G})$ of $G$, with respect to the extended generating set $X\cup \overline{G}$, where $\overline{G}$ is a bijective copy of $G$ which encodes the $m$-operation in $F(G)$. The construction relies on a certain closure operator on the semilattice of all finite and connected subgraphs containing the origin of the Cayley graph $Cay(G, X\cup {\overline{G}})$ and leads to a new and simpler proof of the universal property of $F(G)$.


title: Prescribed $L_p$ quotient curvature problem and related eigenvalue problem

abstract: In this paper, we investigate the existence of admissible (and strictly convex) smooth solutions to the prescribed $L_p$ quotient type curvature problem with $p>1$. For cases where $p=k-l+1$ and $p> k-l+1$, we obtain an admissible solution without any additional conditions, which is strictly spherically convex under a convexity condition. Under the same convexity condition, we establish the existence of a strictly spherically convex solution for the case $p<k-l+1$, provided that the prescribed function is even, a condition known to be necessary.


title: Cosserat Rod Modeling and Validation for a Soft Continuum Robot with Self-Controllable Variable Curvature

abstract: This paper introduces a Cosserat rod based mathematical model for modeling a self-controllable variable curvature soft continuum robot. This soft continuum robot has a hollow inner channel and was developed with the ability to perform variable curvature utilizing a growing spine. The growing spine is able to grow and retract while modifies its stiffness through milli-size particle (glass bubble) granular jamming. This soft continuum robot can then perform continuous curvature variation, unlike previous approaches whose curvature variation is discrete and depends on the number of locking mechanisms or manual configurations. The robot poses an emergent modeling problem due to the variable stiffness growing spine which is addressed in this paper. We investigate the property of growing spine stiffness and incorporate it into the Cosserat rod model by implementing a combined stiffness approach. We conduct experiments with the soft continuum robot in various configurations and compared the results with our developed mathematical model. The results show that the mathematical model based on the adapted Cosserat rod matches the experimental results with only a 3.3\% error with respect to the length of the soft continuum robot.


title: A note on the smash product and regular associativity

abstract: This note is about the smash product of pointed topological spaces, without relying on some convenient subcategory. We deal with its partial associativity properties and their connection with the function spaces, introducing a property of regular associativity related to the colax monoidal structure of the product. We also study a large class of triples of pointed spaces where associativity fails. Lax and colax monoidal structures are unusual and interesting, in category theory. Some parts of this note will be obvious to a topologist and others to a categorist, in order to take into account both backgrounds.


title: ARKS: Active Retrieval in Knowledge Soup for Code Generation

abstract: Recently the retrieval-augmented generation (RAG) paradigm has raised much attention for its potential in incorporating external knowledge into large language models (LLMs) without further training. While widely explored in natural language applications, its utilization in code generation remains under-explored. In this paper, we introduce Active Retrieval in Knowledge Soup (ARKS), an advanced strategy for generalizing large language models for code. In contrast to relying on a single source, we construct a knowledge soup integrating web search, documentation, execution feedback, and evolved code snippets. We employ an active retrieval strategy that iteratively refines the query and updates the knowledge soup. To assess the performance of ARKS, we compile a new benchmark comprising realistic coding problems associated with frequently updated libraries and long-tail programming languages. Experimental results on ChatGPT and CodeLlama demonstrate a substantial improvement in the average execution accuracy of ARKS on LLMs. The analysis confirms the effectiveness of our proposed knowledge soup and active retrieval strategies, offering rich insights into the construction of effective retrieval-augmented code generation (RACG) pipelines. Our model, code, and data are available at https://arks-codegen.github.io.


title: Memory attacks in network nonlocality and self-testing

abstract: We study what can or cannot be certified in communication scenarios where the assumption of independence and identical distribution (iid) between experimental rounds fails. In this respect, we prove that membership tests for non-convex sets of correlations cannot be formulated in the non-iid regime. Similarly, it is impossible to self-test non-extreme quantum operations, such as mixed states, or noisy quantum measurements, unless one allows more than a single use thereof within the same experimental round. One consequence of our results is that non-classicality in causal networks without inputs cannot be experimentally demonstrated. By analyzing optimal non-iid strategies in the triangle scenario, we raise the need to take into account the prior communication required to set up a causal network.


title: Dynamic Environment Responsive Online Meta-Learning with Fairness Awareness

abstract: The fairness-aware online learning framework has emerged as a potent tool within the context of continuous lifelong learning. In this scenario, the learner's objective is to progressively acquire new tasks as they arrive over time, while also guaranteeing statistical parity among various protected sub-populations, such as race and gender, when it comes to the newly introduced tasks. A significant limitation of current approaches lies in their heavy reliance on the i.i.d (independent and identically distributed) assumption concerning data, leading to a static regret analysis of the framework. Nevertheless, it's crucial to note that achieving low static regret does not necessarily translate to strong performance in dynamic environments characterized by tasks sampled from diverse distributions. In this paper, to tackle the fairness-aware online learning challenge in evolving settings, we introduce a unique regret measure, FairSAR, by incorporating long-term fairness constraints into a strongly adapted loss regret framework. Moreover, to determine an optimal model parameter at each time step, we introduce an innovative adaptive fairness-aware online meta-learning algorithm, referred to as FairSAOML. This algorithm possesses the ability to adjust to dynamic environments by effectively managing bias control and model accuracy. The problem is framed as a bi-level convex-concave optimization, considering both the model's primal and dual parameters, which pertain to its accuracy and fairness attributes, respectively. Theoretical analysis yields sub-linear upper bounds for both loss regret and the cumulative violation of fairness constraints. Our experimental evaluation on various real-world datasets in dynamic environments demonstrates that our proposed FairSAOML algorithm consistently outperforms alternative approaches rooted in the most advanced prior online learning methods.


title: Landmark Stereo Dataset for Landmark Recognition and Moving Node Localization in a Non-GPS Battlefield Environment

abstract: In this paper, we have proposed a new strategy of using the landmark anchor node instead of a radio-based anchor node to obtain the virtual coordinates (landmarkID, DISTANCE) of moving troops or defense forces that will help in tracking and maneuvering the troops along a safe path within a GPS-denied battlefield environment. The proposed strategy implements landmark recognition using the Yolov5 model and landmark distance estimation using an efficient Stereo Matching Algorithm. We consider that a moving node carrying a low-power mobile device facilitated with a calibrated stereo vision camera that captures stereo images of a scene containing landmarks within the battlefield region whose locations are stored in an offline server residing within the device itself. We created a custom landmark image dataset called MSTLandmarkv1 with 34 landmark classes and another landmark stereo dataset of those 34 landmark instances called MSTLandmarkStereov1. We trained the YOLOv5 model with MSTLandmarkv1 dataset and achieved 0.95 mAP @ 0.5 IoU and 0.767 mAP @ [0.5: 0.95] IoU. We calculated the distance from a node to the landmark utilizing the bounding box coordinates and the depth map generated by the improved SGM algorithm using MSTLandmarkStereov1. The tuple of landmark IDs obtained from the detection result and the distances calculated by the SGM algorithm are stored as the virtual coordinates of a node. In future work, we will use these virtual coordinates to obtain the location of a node using an efficient trilateration algorithm and optimize the node position using the appropriate optimization method.


title: Extrapolation on product Morrey-Herz spaces and applications

abstract: Recently, the extrapolation theory has become a mainsteam method to investigate some integral type operators, since it does not depend on the density of spaces. The purpose of this paper is threefold. The first is to establish product Morrey-Herz spaces and product block-Herz spaces, study the duality between them, and prove the boundedness of strong maximal operators product block-Herz spaces, which is ready for extrapolation. Secondly, we set up extrapolation on product Morrey-Herz spaces by the methods of Rubio de Francia. Finally, as applications, we prove some completely new boundedness and estimates for some operators on product Morrey-Herz spaces, such as Fefferman-Stein vector-valued strong maximal inequalities, John-Nirenberg inequality and a new characterization of bmo in terms of product Morrey-Herz spaces, and the boundedness of bi-parameter Calder\'on-Zygmund operators and their commutators.


title: Simultaneous reweighting of Transverse Momentum Dependent distributions

abstract: The Bayesian reweighting procedure is extended to the case of multiple independent extractions of transverse momentum dependent parton distributions (TMDs). By exploiting the data on transverse single spin asymmetries, $A_N$, for inclusive pion production in polarized proton-proton collisions measured at RHIC, we perform a simultaneous reweighting of the quark Sivers, transversity and Collins TMD functions extracted from semi-inclusive deep inelastic scattering (SIDIS) and $e^+ e^-$ annihilation into hadron pairs. The impact of the implementation of the Soffer bound, as well as the differences between older and newer $A_N$ data, are investigated. The agreement with $A_N$ data at large-$x_F$ values, a kinematical region complementary to those explored in SIDIS measurements, is enhanced, improving the knowledge of the polarized quark TMDs in the large-$x$ region.


title: Expressing and visualizing model uncertainty in Bayesian variable selection using Cartesian credible sets

abstract: Modern regression applications can involve hundreds or thousands of variables which motivates the use of variable selection methods. Bayesian variable selection defines a posterior distribution on the possible subsets of the variables (which are usually termed models) to express uncertainty about which variables are strongly linked to the response. This can be used to provide Bayesian model averaged predictions or inference, and to understand the relative importance of different variables. However, there has been little work on meaningful representations of this uncertainty beyond first order summaries. We introduce Cartesian credible sets to address this gap. The elements of these sets are formed by concatenating sub-models defined on each block of a partition of the variables. Investigating these sub-models allow us to understand whether the models in the Cartesian credible set always/never/sometimes include a particular variable or group of variables and provide a useful summary of model uncertainty. We introduce methods to find these sets that emphasize ease of understanding. The potential of the method is illustrated on regression problems with both small and large numbers of variables.


title: Investigating $\omega(z)$ Parametrizations in Horava-Lifshitz Gravity: Observational Constraints with Covariance Matrix Simulation

abstract: This study investigates accelerated cosmic expansion using various cosmological models within Horava-Lifshitz gravity, including BBCCFHKO, Seljak, ASSS, PADE-I, PADE-II, and BAZS, utilizing Equation of State Parametrization. To constrain the cosmological parameters of each model, we incorporate 24 Baryon Acoustic Oscillation points, 30 Cosmic Chronometer points, 40 Type Ia Supernovae points, 24 quasar Hubble diagram points, and 162 Gamma Ray Bursts points, along with the latest Hubble constant measurement (R22). We treat $r_{d}$ as a free parameter, aiming to extract $H_{0}$ and $r_{d}$ using late-time datasets and obtain optimal fitting values for each parameter in every model. The benefits of treating $r_{d}$ as a free parameter include reduced bias, improved precision, and enhanced dataset compatibility. The resulting values of $H_{0}$ and $r_{d}$ are relative to the $\Lambda$CDM model, showcasing alignment with early Planck and SDSS estimations. We additionally minimize errors by simulating random correlations in the covariance matrix. Furthermore, the Akaike Information Criterion (AIC) and Bayesian Information Criterion (BIC) support all models, with the $\Lambda$CDM model exhibiting the lowest AIC. Evaluation via reduced chi-square statistic confirms reasonable fits for all models. While $\Lambda$CDM remains favored, extensions warrant further investigation. This study underscores the importance of exploring alternative cosmological models to deepen our understanding of the universe's fundamental properties and evolution. Continued refinement of models is essential for advancing cosmological research.


title: What Is the Black Hole Spin in Cyg X-1?

abstract: We perform a detailed study of the black hole spin of Cyg X-1, using accurate broad-band X-ray data obtained in the soft spectral state by simultaneous NICER and NuSTAR observations, supplemented at high energies by INTEGRAL data. We use the relativistic disk model kerrbb together with different models of the Comptonization high energy tail and the relativistically-broadened reflection features. Unlike most previous studies, we tie the spin parameters of the disk and relativistic broadening models, thus combining the continuum and reflection methods of spin determination. We also consider a likely increase of the disk color correction due to a partial support of the disk by large scale magnetic fields. We find that such models yield the spin parameter of $a_*= 0.87^{+0.04}_{-0.03}$ if the disk inclination is allowed to be free, with $i= 39^{+1}_{-1}$ degree. Assuming $i=27.5$ degree, as determined by optical studies of the binary, worsens the fit, but leads to similar values of the spin, $a_*= 0.90^{+0.01}_{-0.01}$. In addition, we consider the presence of a warm Comptonization layer on top of the disk, motivated by successful modeling of soft X-ray excesses in other sources with such a model. This dramatically lowers the spin, to $a_*\lesssim 0.1$, consistent with the spin measurements from black-hole mergers. On the other hand, if the natal spin of Cyg X-1 was low but now $a_*\approx 0.9$, a period of effective super-critical accretion had to take place in the past. Such accretion could be facilitated by photon advection, as proposed for ultraluminous X-ray sources.


title: LLM Agents for Psychology: A Study on Gamified Assessments

abstract: Psychological measurement is essential for mental health, self-understanding, and personal development. Traditional methods, such as self-report scales and psychologist interviews, often face challenges with engagement and accessibility. While game-based and LLM-based tools have been explored to improve user interest and automate assessment, they struggle to balance engagement with generalizability. In this work, we propose PsychoGAT (Psychological Game AgenTs) to achieve a generic gamification of psychological assessment. The main insight is that powerful LLMs can function both as adept psychologists and innovative game designers. By incorporating LLM agents into designated roles and carefully managing their interactions, PsychoGAT can transform any standardized scales into personalized and engaging interactive fiction games. To validate the proposed method, we conduct psychometric evaluations to assess its effectiveness and employ human evaluators to examine the generated content across various psychological constructs, including depression, cognitive distortions, and personality traits. Results demonstrate that PsychoGAT serves as an effective assessment tool, achieving statistically significant excellence in psychometric metrics such as reliability, convergent validity, and discriminant validity. Moreover, human evaluations confirm PsychoGAT's enhancements in content coherence, interactivity, interest, immersion, and satisfaction.


title: Shall We Talk: Exploring Spontaneous Collaborations of Competing LLM Agents

abstract: Recent advancements have shown that agents powered by large language models (LLMs) possess capabilities to simulate human behaviors and societal dynamics. However, the potential for LLM agents to spontaneously establish collaborative relationships in the absence of explicit instructions has not been studied. To address this gap, we conduct three case studies, revealing that LLM agents are capable of spontaneously forming collaborations even within competitive settings. This finding not only demonstrates the capacity of LLM agents to mimic competition and cooperation in human societies but also validates a promising vision of computational social science. Specifically, it suggests that LLM agents could be utilized to model human social interactions, including those with spontaneous collaborations, thus offering insights into social phenomena. The source codes for this study are available at https://github.com/wuzengqing001225/SABM_ShallWeTalk .

categories: cs.AI cs.CL cs.CY cs.MA econ.GN q-fin.EC


title: Observations of compact stars and fermion-boson stars with a quartic self-interaction

abstract: We investigated the possibility that compact stars could be described by a fermion-boson star with a quartic self-interaction in the boson sector. Specifically, by varying the polytropic constant $K$ and adiabatic index $\Gamma$ in the polytropic equation of state, the boson mass $\mu$, and the self-interaction parameter $\Lambda$, we construct equilibrium configurations of these mixed-stars with total mass compatible with the mass constraints obtained from observational data of the collaborations NICE, NICER/XMN-Newton, and LIGO. Our work confirms that the addition of a boson sector eases the comparison of neutron star models with gravitational events related to compact objects and that in such a case observations may have preference for a positive self-interaction in the boson sector.


title: Query-Based Adversarial Prompt Generation

abstract: Recent work has shown it is possible to construct adversarial examples that cause an aligned language model to emit harmful strings or perform harmful behavior. Existing attacks work either in the white-box setting (with full access to the model weights), or through transferability: the phenomenon that adversarial examples crafted on one model often remain effective on other models. We improve on prior work with a query-based attack that leverages API access to a remote language model to construct adversarial examples that cause the model to emit harmful strings with (much) higher probability than with transfer-only attacks. We validate our attack on GPT-3.5 and OpenAI's safety classifier; we can cause GPT-3.5 to emit harmful strings that current transfer attacks fail at, and we can evade the safety classifier with nearly 100% probability.


title: On the Ocean Conditions of Hycean Worlds

abstract: Recent studies have suggested the possibility of Hycean worlds, characterised by deep liquid water oceans beneath H$_2$-rich atmospheres. These planets significantly widen the range of planetary properties over which habitable conditions could exist. We conduct internal structure modelling of Hycean worlds to investigate the range of interior compositions, ocean depths and atmospheric mass fractions possible. Our investigation explicitly considers habitable oceans, where the surface conditions are limited to those that can support potential life. The ocean depths depend on the surface gravity and temperature, confirming previous studies, and span 10s to $\sim$1000 km for Hycean conditions, reaching ocean base pressures up to $\sim$6$\times$10$^4$ bar before transitioning to high-pressure ice. We explore in detail test cases of five Hycean candidates, placing constraints on their possible ocean depths and interior compositions based on their bulk properties. We report limits on their atmospheric mass fractions admissible for Hycean conditions, as well as those allowed for other possible interior compositions. For the Hycean conditions considered, across these candidates we find the admissible mass fractions of the H/He envelopes to be $\lesssim$10$^{-3}$. At the other extreme, the maximum H/He mass fractions allowed for these planets can be up to $\sim$4-8$\%$, representing purely rocky interiors with no H$_2$O layer. These results highlight the diverse conditions possible among these planets and demonstrate their potential to host habitable conditions under vastly different circumstances to the Earth. Upcoming JWST observations of candidate Hycean worlds will allow for improved constraints on the nature of their atmospheres and interiors.


title: Generating Survival Interpretable Trajectories and Data

abstract: A new model for generating survival trajectories and data based on applying an autoencoder of a specific structure is proposed. It solves three tasks. First, it provides predictions in the form of the expected event time and the survival function for a new generated feature vector on the basis of the Beran estimator. Second, the model generates additional data based on a given training set that would supplement the original dataset. Third, the most important, it generates a prototype time-dependent trajectory for an object, which characterizes how features of the object could be changed to achieve a different time to an event. The trajectory can be viewed as a type of the counterfactual explanation. The proposed model is robust during training and inference due to a specific weighting scheme incorporating into the variational autoencoder. The model also determines the censored indicators of new generated data by solving a classification task. The paper demonstrates the efficiency and properties of the proposed model using numerical experiments on synthetic and real datasets. The code of the algorithm implementing the proposed model is publicly available.


title: Triple-Encoders: Representations That Fire Together, Wire Together

abstract: Search-based dialog models typically re-encode the dialog history at every turn, incurring high cost. Curved Contrastive Learning, a representation learning method that encodes relative distances between utterances into the embedding space via a bi-encoder, has recently shown promising results for dialog modeling at far superior efficiency. While high efficiency is achieved through independently encoding utterances, this ignores the importance of contextualization. To overcome this issue, this study introduces triple-encoders, which efficiently compute distributed utterance mixtures from these independently encoded utterances through a novel hebbian inspired co-occurrence learning objective without using any weights. Empirically, we find that triple-encoders lead to a substantial improvement over bi-encoders, and even to better zero-shot generalization than single-vector representation models without requiring re-encoding. Our code/model is publicly available.


title: An explicit result for short sums of positive arithmetic functions

abstract: We prove a totally explicit bound for short sums of certain non-negative arithmetic functions satisfying a general growth condition, and apply this result to derive two explicit estimates for the Erd\H{o}s-Hooley $\Delta$-function in short intervals.


title: Insights into the mechanics of pure and bacteria-laden sessile whole blood droplet evaporation

abstract: We study the mechanics of sessile blood drop evaporation using optical diagnostics, theoretical analysis, and micro/nano-characterization. The transient evaporation process has three major phases (A, B, and C) based on the evaporation rate. Phase A is the fastest, where edge evaporation dominates and forms a gelated three-phase contact line. Gelation results from sol-gel phase transition that occurs due to the accumulation of red blood cells, as they get transported due to outward capillary flow generated during drop evaporation. The intermediate phase B consists of a gelation front propagating radially inwards due to the combined effect of outward capillary flow and drop height reduction evaporating in pinned mode, forming a wet gel phase. We unearthed that the gelation of the entire droplet occurs in Phase B, and the gel formed contains trace amounts of water that are detectable in our experiments. Phase C is the final slowest stage of evaporation, where the wet gel transforms into a dry gel and leads to desiccation induced stress, forming diverse crack patterns in the dried blood drop precipitate. We observe radial and orthoradial cracks in the precipitate's thicker region, mud-flat cracks in the drop center, and the outer contact line where thickness and curvature are relatively small. We also study the evaporation of bacteria-laden droplets to simulate bacterial infection in human blood and show that the drop evaporation rate and final dried residue pattern do not change appreciably within the parameter variation of the bacterial concentration typically found in bacterial infection of living organisms.


title: Image Super-resolution Inspired Electron Density Prediction

abstract: Drawing inspiration from the domain of image super-resolution, we view the electron density as a 3D grayscale image and use a convolutional residual network to transform a crude and trivially generated guess of the molecular density into an accurate ground-state quantum mechanical density. We find that this model outperforms all prior density prediction approaches. Because the input is itself a real-space density, the predictions are equivariant to molecular symmetry transformations even though the model is not constructed to be. Due to its simplicity, the model is directly applicable to unseen molecular conformations and chemical elements. We show that fine-tuning on limited new data provides high accuracy even in challenging cases of exotic elements and charge states. Our work suggests new routes to learning real-space physical quantities drawing from the established ideas of image processing.


title: Robust CLIP: Unsupervised Adversarial Fine-Tuning of Vision Embeddings for Robust Large Vision-Language Models

abstract: Multi-modal foundation models like OpenFlamingo, LLaVA, and GPT-4 are increasingly used for various real-world tasks. Prior work has shown that these models are highly vulnerable to adversarial attacks on the vision modality. These attacks can be leveraged to spread fake information or defraud users, and thus pose a significant risk, which makes the robustness of large multi-modal foundation models a pressing problem. The CLIP model, or one of its variants, is used as a frozen vision encoder in many large vision-language models (LVLMs), e.g. LLaVA and OpenFlamingo. We propose an unsupervised adversarial fine-tuning scheme to obtain a robust CLIP vision encoder, which yields robustness on all vision down-stream tasks (LVLMs, zero-shot classification) that rely on CLIP. In particular, we show that stealth-attacks on users of LVLMs by a malicious third party providing manipulated images are no longer possible once one replaces the original CLIP model with our robust one. No retraining or fine-tuning of the down-stream LVLMs is required. The code and robust models are available at https://github.com/chs20/RobustVLM


title: Hot carrier distribution engineering by alloying: picking elements for the desired purposes

abstract: Metal alloys hold the promise of providing hot carrier generation distributions superior to pure metals in applications such as sensing, catalysis and solar energy harvesting. Guidelines for finding the optimal alloy configuration for a target application require understanding the connection between alloy composition and hot carrier distribution. Here we present a DFT-based computational approach to investigate the photo-generated hot carrier distribution of metal alloys based on the joint density of states and the electronic structure. We classified the metals by their electronic structure into closed d-shell, open d-shell, p-block and s-block elements. It is shown that combining closed d-shell elements enables modulating the distribution of highly energetic holes typical of pure metals but also leads to hot carrier production by IR light excitation and the appearance of highly energetic electrons due to band folding and splitting. This feature arises as an emergent property of alloying and is only unveiled when the hot carrier distribution computation takes momentum conservation into account. The combination of closed d-shell with open d-shell elements allows an abundant production of hot carriers in a broad energy range, while alloying a closed d-shell elements with an s-block element opens the door to hot electron distribution skewed toward high energy electrons. The combination of d-shell with p-block elements results in moderate hot carrier distribution whose asymmetry can be tuned by composition. Overall, the obtained insights that connect alloy composition, band structure and resulting carrier distribution provide a toolkit to match elements in an alloy for the deliberate engineering of hot carrier distribution.


title: An Adversarial Approach to Evaluating the Robustness of Event Identification Models

abstract: Intelligent machine learning approaches are finding active use for event detection and identification that allow real-time situational awareness. Yet, such machine learning algorithms have been shown to be susceptible to adversarial attacks on the incoming telemetry data. This paper considers a physics-based modal decomposition method to extract features for event classification and focuses on interpretable classifiers including logistic regression and gradient boosting to distinguish two types of events: load loss and generation loss. The resulting classifiers are then tested against an adversarial algorithm to evaluate their robustness. The adversarial attack is tested in two settings: the white box setting, wherein the attacker knows exactly the classification model; and the gray box setting, wherein the attacker has access to historical data from the same network as was used to train the classifier, but does not know the classification model. Thorough experiments on the synthetic South Carolina 500-bus system highlight that a relatively simpler model such as logistic regression is more susceptible to adversarial attacks than gradient boosting.


title: Path spaces of pushouts

abstract: Given a span of spaces, one can form the homotopy pushout and then take the homotopy pullback of the resulting cospan. We give a concrete description of this pullback as the colimit of a sequence of approximations, using what we call the zigzag construction. We also obtain a description of loop spaces of homotopy pushouts. Using the zigzag construction, we reproduce generalisations of the Blakers-Massey theorem and fundamental results from Bass-Serre theory. We also describe the loop space of a wedge and show that it splits after suspension. Our construction can be interpreted in a large class of $(\infty,1)$-categories and in homotopy type theory, where it resolves the long-standing open problem of showing that a pushout of 0-types is 1-truncated. The zigzag construction is closely related to the James construction, but works in greater generality.


title: Simple Mechanisms for Utility Maximization: Approximating Welfare in the I.I.D. Unit-Demand Setting

abstract: We investigate the objective of utility maximization from the perspective of Bayesian mechanism design, initiating this direction, and focus on the unit-demand setting where values are i.i.d. across both items and buyers. We take the approach of developing simple, approximately optimal mechanisms, targeting the simplest benchmark of optimal welfare. We give a $(1-1/e)$-approximation when there are more items than buyers, and an $O(\log(n/m))$-approximation when there are more buyers than items, which is tight up to constant factors. We also characterize complexities in this setting that defy our intuition from the welfare and revenue literature, and motivate why coming up with a better benchmark than welfare is a hard problem itself.


title: Designed spin-texture-lattice to control anisotropic magnon transport in antiferromagnets

abstract: Spin waves in magnetic materials are promising information carriers for future computing technologies due to their ultra-low energy dissipation and long coherence length. Antiferromagnets are strong candidate materials due, in part, to their stability to external fields and larger group velocities. Multiferroic aniferromagnets, such as BiFeO$_3$ (BFO), have an additional degree of freedom stemming from magnetoelectric coupling, allowing for control of the magnetic structure, and thus spin waves, with electric field. Unfortunately, spin-wave propagation in BFO is not well understood due to the complexity of the magnetic structure. In this work, we explore long-range spin transport within an epitaxially engineered, electrically tunable, one-dimensional (1D) magnonic crystal. We discover a striking anisotropy in the spin transport parallel and perpendicular to the 1D crystal axis. Multiscale theory and simulation suggests that this preferential magnon conduction emerges from a combination of a population imbalance in its dispersion, as well as anisotropic structural scattering. This work provides a pathway to electrically-reconfigurable magnonic crystals in antiferromagnets.


title: Post-Minkowskian Theory Meets the Spinning Effective-One-Body Approach for Two-Body Scattering

abstract: Effective-one-body (EOB) waveforms employed by the LIGO-Virgo-KAGRA Collaboration have primarily been developed by resumming the post-Newtonian expansion of the relativistic two-body problem. Given the recent significant advancements in post-Minkowskian (PM) theory and gravitational self-force formalism, there is considerable interest in creating waveform models that integrate information from various perturbative methods in innovative ways. This becomes particularly crucial when tackling the accuracy challenge posed by upcoming ground-based detectors (such as the Einstein Telescope and Cosmic Explorer) and space-based detectors (such as LISA, TianQin or Taiji) expected to operate in the next decade. In this context, we present the derivation of the first spinning EOB Hamiltonian that incorporates PM results up to three-loop order: the SEOB-PM model. The model accounts for the complete hyperbolic motion, encompassing nonlocal-in-time tails. To evaluate its accuracy, we compare its predictions for the conservative scattering angle, augmented with dissipative contributions, against numerical-relativity data of non-spinning and spinning equal-mass black holes. We observe very good agreement, comparable, and in some cases slightly better to the recently proposed $w_{\rm EOB}$-potential model, of which the SEOB-PM model is a resummation around the probe limit. Indeed, in the probe limit, the SEOB-PM Hamiltonian and scattering angles reduce to the one of a test mass in Kerr spacetime. Once complemented with nonlocal-in-time contributions for bound orbits, the SEOB-PM Hamiltonian can be utilized to generate waveform models for spinning black holes on quasi-circular orbits.


title: Emulated Disalignment: Safety Alignment for Large Language Models May Backfire!

abstract: Large language models (LLMs) undergo safety alignment to ensure safe conversations with humans. However, this paper introduces a training-free attack method capable of reversing safety alignment, converting the outcomes of stronger alignment into greater potential for harm by accessing only LLM output token distributions. Specifically, our method achieves this reversal by contrasting the output token distribution of a safety-aligned language model (e.g., Llama-2-chat) against its pre-trained version (e.g., Llama-2), so that the token predictions are shifted towards the opposite direction of safety alignment. We name this method emulated disalignment (ED) because sampling from this contrastive distribution provably emulates the result of fine-tuning to minimize a safety reward. Our experiments with ED across three evaluation datasets and four model families (Llama-1, Llama-2, Mistral, and Alpaca) show that ED doubles the harmfulness of pre-trained models and outperforms strong baselines, achieving the highest harmful rates in 43 out of 48 evaluation subsets by a large margin. Eventually, given ED's reliance on language model output token distributions, which particularly compromises open-source models, our findings highlight the need to reassess the open accessibility of language models, even if they have been safety-aligned. Code is available at https://github.com/ZHZisZZ/emulated-disalignment.


title: Quantum Sabidussi's Theorem

abstract: Sabidussi's theorem [Duke Math. J. 28, 1961] gives necessary and sufficient conditions under which the automorphism group of a lexicographic product of two graphs is a wreath product of the respective automorphism groups. We prove a quantum version of Sabidussi's theorem for finite graphs, with the automorphism groups replaced by quantum automorphism groups and the wreath product replaced by the free wreath product of quantum groups. This extends the result of Chassaniol [J. Algebra 456, 2016], who proved it for regular graphs. Moreover, we apply our result to lexicographic products of quantum vertex transitive graphs, determining their quantum automorphism groups even when Sabidussi's conditions do not apply.


title: Homoclinic Floer homology via direct limits

abstract: Let $(M \omega)$ be a two dimensional symplectic manifold, $\phi: M \to M$ a symplectomorphism with hyperbolic fixed point $x$ and transversely intersecting stable and unstable manifolds $W^s(\phi, x) \cap\ W^u(\phi, x)=:\mathcal{H}(\phi, x)$. The intersection points are called homoclinic points, and the stable and unstable manifold are in this situation Lagrangian submanifolds. For this Lagrangian intersection problem with its infinite number of intersection points and wild oscillation behavior, we first define a Floer homology generated by finite sets of so-called contractible homoclinic points. This generalizes very significantly the Floer homologies generated by (semi)primary points defined by us in earlier works. Nevertheless these Floer homologies only consider quite `local' aspects of $W^s(\phi, x) \cap\ W^u(\phi, x)$ since their generator sets are finite, but the number of all contractible homoclinic points is infinite. To overcome this issue, we construct a direct limit of these `local' homoclinic Floer homologies over suitable index sets. These direct limits thus accumulate the information gathered by the finitely generated local' homoclinic Floer homologies.


title: Proving security of BB84 under source correlations

abstract: Device imperfections and memory effects can result in undesired correlations among the states generated by a realistic quantum source. These correlations are called source correlations. Proving the security of quantum key distribution (QKD) protocols in the presence of these correlations has been a persistent challenge. We present a simple and general method to reduce the security proof of the BB84 protocol with source correlations to one with an almost perfect source, for which security can be proven using previously known techniques. For this purpose, we introduce a simple source test, which randomly tests the output of the QKD source and provides a bound on the source correlations. We then use the recently proven entropic triangle inequality for the smooth min-entropy to carry out the reduction to the protocol with the almost perfect source.


title: SymTFTs for Continuous non-Abelian Symmetries

abstract: Topological defects and operators give a far-reaching generalization of symmetries of quantum fields. An auxiliary topological field theory in one dimension higher than the QFT of interest, known as the SymTFT, provides a natural way for capturing such operators. This gives a new perspective on several applications of symmetries, but fails to capture continuous non-Abelian symmetries. The main aim of this work is to fill this gap. Guided by geometric engineering and holography, we recover various known features of representation theory of the non-Abelian symmetry from a SymTFT viewpoint. Central to our approach is a duality between (flat) free Yang-Mills and non-Abelian BF theories. Our results extend naturally to models without supersymmetry.


title: GTBench: Uncovering the Strategic Reasoning Limitations of LLMs via Game-Theoretic Evaluations

abstract: As Large Language Models (LLMs) are integrated into critical real-world applications, their strategic and logical reasoning abilities are increasingly crucial. This paper evaluates LLMs' reasoning abilities in competitive environments through game-theoretic tasks, e.g., board and card games that require pure logic and strategic reasoning to compete with opponents. We first propose GTBench, a language-driven environment composing 10 widely recognized tasks, across a comprehensive game taxonomy: complete versus incomplete information, dynamic versus static, and probabilistic versus deterministic scenarios. Then, we (1) Characterize the game-theoretic reasoning of LLMs; and (2) Perform LLM-vs.-LLM competitions as reasoning evaluation. We observe that (1) LLMs have distinct behaviors regarding various gaming scenarios; for example, LLMs fail in complete and deterministic games yet they are competitive in probabilistic gaming scenarios; (2) Most open-source LLMs, e.g., CodeLlama-34b-Instruct and Llama-2-70b-chat, are less competitive than commercial LLMs, e.g., GPT-4, in complex games, yet the recently released Llama-3-70b-Instruct makes up for this shortcoming. In addition, code-pretraining greatly benefits strategic reasoning, while advanced reasoning methods such as Chain-of-Thought (CoT) and Tree-of-Thought (ToT) do not always help. We further characterize the game-theoretic properties of LLMs, such as equilibrium and Pareto Efficiency in repeated games. Detailed error profiles are provided for a better understanding of LLMs' behavior. We hope our research provides standardized protocols and serves as a foundation to spur further explorations in the strategic reasoning of LLMs.


title: An optimal replacement policy under variable shocks and self-healing patterns

abstract: We study a system that experiences damaging external shocks at stochastic intervals, continuous degradation, and self-healing. The motivation for such a system comes from real-life applications based on micro-electro-mechanical systems (MEMS). The system fails if the cumulative damage exceeds a time-dependent threshold. We develop a preventive maintenance policy to replace the system such that its lifetime is prudently utilized. Further, three variations on the healing pattern have been considered: (i) shocks heal for a fixed duration $\tau$; (ii) a fixed proportion of shocks are non-healable (that is, $\tau=0$); (iii) there are two types of shocks -- self healable shocks heal for a finite duration, and nonhealable shocks inflict a random system degradation. We implement a proposed preventive maintenance policy and compare the optimal replacement times in these new cases to that of the original case where all shocks heal indefinitely and thereby enable the system manager to take necessary decisions in generalized system set-ups.


title: Rational powers, invariant ideals, and the summation formula

abstract: We study the Rees valuations and rational powers of several classes of invariant ideals, providing explicit descriptions in terms of certain polyhedra. This allows us to show that a version of Musta\c{t}\u{a}-Takagi's summation formula for rational powers holds for these ideals. Moreover, for arbitrary ideals over the complex numbers, we prove a weaker version of this formula that holds for high enough rational numbers. Our methods lead to a definition of rational powers of ideal sheaves in normal complex varieties inspired by work of Lejeune-Jalabert-Teissier and Lazarsfeld.


title: Constraining tachyonic inflationary \beta-exponential model with Continuous Spontaneous Localization collapse scheme

abstract: In this work, we consider the dynamics of the self-induced collapse of the tachyon wave function in inflationary scenarios. We analyze the modifications on the power spectrum by considering the \beta-exponential potential, whose parameters have updated constraints by the Planck 2018 baseline data. Moreover, we show that for this kind of potential, just for a narrow range of \beta-parameter, there is agreement between the theoretical predictions and the current observational data. Considering the proposal for a collapse scheme that leads to the modification of Schr\"odinger evolution of the inflaton wave function from the employment of a Continuous Spontaneous Localization (CSL) approach, we derive the scalar spectral index and tensor-to-scalar ratio. We then obtained the constraints on both collapse and \beta-parameters that, in turn, yield deviations in the n_{s} vs. r plane when compared to the \beta-exponential potential standard estimate. The CSL scheme applied to tachyonic inflation driven by a \beta-potential offers an adequate description of the recent data.


title: Graph-Based Retriever Captures the Long Tail of Biomedical Knowledge

abstract: Large language models (LLMs) are transforming the way information is retrieved with vast amounts of knowledge being summarized and presented via natural language conversations. Yet, LLMs are prone to highlight the most frequently seen pieces of information from the training set and to neglect the rare ones. In the field of biomedical research, latest discoveries are key to academic and industrial actors and are obscured by the abundance of an ever-increasing literature corpus (the information overload problem). Surfacing new associations between biomedical entities, e.g., drugs, genes, diseases, with LLMs becomes a challenge of capturing the long-tail knowledge of the biomedical scientific production. To overcome this challenge, Retrieval Augmented Generation (RAG) has been proposed to alleviate some of the shortcomings of LLMs by augmenting the prompts with context retrieved from external datasets. RAG methods typically select the context via maximum similarity search over text embeddings. In this study, we show that RAG methods leave out a significant proportion of relevant information due to clusters of over-represented concepts in the biomedical literature. We introduce a novel information-retrieval method that leverages a knowledge graph to downsample these clusters and mitigate the information overload problem. Its retrieval performance is about twice better than embedding similarity alternatives on both precision and recall. Finally, we demonstrate that both embedding similarity and knowledge graph retrieval methods can be advantageously combined into a hybrid model that outperforms both, enabling potential improvements to biomedical question-answering models.


title: Emergence of radial Rashba spin-orbit fields in twisted van der Waals heterostructures

abstract: Rashba spin-orbit coupling is a quintessential spin interaction appearing in virtually any electronic heterostructure. Its paradigmatic spin texture in the momentum space forms a tangential vector field. Using first-principles investigations, we demonstrate that in twisted homobilayers and hetero-multilayers, the Rashba coupling can be predominantly radial, parallel to the momentum. Specifically, we study four experimentally relevant structures: twisted bilayer graphene (Gr), twisted bilayer WSe$_2$, and twisted multilayers WSe$_2$/Gr/WSe$_2$ and WSe$_2$/Gr/Gr/WSe$_2$. We show, that the Rashba spin-orbit field texture in such structures can be controlled by an electric field, allowing to tune it from radial to tangential. Such spin-orbit engineering should be useful for designing novel spin-charge conversion and spin-orbit torque schemes, as well as for controlling correlated phases and superconductivity in van der Waals materials.


title: LoRA+: Efficient Low Rank Adaptation of Large Models

abstract: In this paper, we show that Low Rank Adaptation (LoRA) as originally introduced in Hu et al. (2021) leads to suboptimal finetuning of models with large width (embedding dimension). This is due to the fact that adapter matrices A and B in LoRA are updated with the same learning rate. Using scaling arguments for large width networks, we demonstrate that using the same learning rate for A and B does not allow efficient feature learning. We then show that this suboptimality of LoRA can be corrected simply by setting different learning rates for the LoRA adapter matrices A and B with a well-chosen ratio. We call this proposed algorithm LoRA$+$. In our extensive experiments, LoRA$+$ improves performance (1-2 $\%$ improvements) and finetuning speed (up to $\sim$ 2X SpeedUp), at the same computational cost as LoRA.