title: Conformalized Tensor Completion with Riemannian Optimization

abstract: Tensor data, or multi-dimensional array, is a data format popular in multiple fields such as social network analysis, recommender systems, and brain imaging. It is not uncommon to observe tensor data containing missing values and tensor completion aims at estimating the missing values given the partially observed tensor. Sufficient efforts have been spared on devising scalable tensor completion algorithms but few on quantifying the uncertainty of the estimator. In this paper, we nest the uncertainty quantification (UQ) of tensor completion under a split conformal prediction framework and establish the connection of the UQ problem to a problem of estimating the missing propensity of each tensor entry. We model the data missingness of the tensor with a tensor Ising model parameterized by a low-rank tensor parameter. We propose to estimate the tensor parameter by maximum pseudo-likelihood estimation (MPLE) with a Riemannian gradient descent algorithm. Extensive simulation studies have been conducted to justify the validity of the resulting conformal interval. We apply our method to the regional total electron content (TEC) reconstruction problem.


title: Implementing Bayesian inference on a stochastic CO2-based grey-box model for assessing indoor air quality in Canadian primary schools

abstract: The COVID-19 pandemic brought global attention to indoor air quality (IAQ), which is intrinsically linked to clean air change rates. Estimating the air change rate in indoor environments, however, remains challenging. It is primarily due to the uncertainties associated with the air change rate estimation, such as pollutant generation rates, dynamics including weather and occupancies, and the limitations of deterministic approaches to accommodate these factors. In this study, Bayesian inference was implemented on a stochastic CO2-based grey-box model to infer modeled parameters and quantify uncertainties. The accuracy and robustness of the ventilation rate and CO2 emission rate estimated by the model were confirmed with CO2 tracer gas experiments conducted in an airtight chamber. Both prior and posterior predictive checks (PPC) were performed to demonstrate the advantage of this approach. In addition, uncertainties in real-life contexts were quantified with an incremental variance {\sigma} for the Wiener process. This approach was later applied to evaluate the ventilation conditions within two primary school classrooms in Montreal. The Equivalent Clean Airflow Rate (ECAi) was calculated following ASHRAE 241, and an insufficient clean air supply within both classrooms was identified. A supplement of 800 cfm clear air delivery rate (CADR) from air-cleaning devices is recommended for a sufficient ECAi. Finally, steady-state CO2 thresholds (Climit, Ctarget, and Cideal) were carried out to indicate when ECAi requirements could be achieved under various mitigation strategies, such as portable air cleaners and in-room ultraviolet light, with CADR values ranging from 200 to 1000 cfm.


title: Periodic nonlinear Schr\"odinger equation with distributional potential and invariant measures

abstract: In this paper, we continue some investigations on the periodic NLSE started by Lebowitz, Rose and Speer and by Bourgain with the addition of a distributional multiplicative potential. We prove that the equation is globally wellposed for a set of data of full normalized Gibbs measure, after suitable truncation in the focusing case. The set and the measure are invariant under the flow. The main ingredients used are Strichartz estimates on periodic NLS with distributional potential to obtain local well-posedness for low regularity initial data.


title: Construction of extremal Type II $\mathbb{Z}_{8}$-codes via doubling method

abstract: Extremal Type II $\mathbb{Z}_{8}$-codes are a class of self-dual $\mathbb{Z}_{8}$-codes with Euclidean weights divisible by $16$ and the largest possible minimum Euclidean weight for a given length. We introduce a doubling method for constructing a Type II $\mathbb{Z}_{2k}$-code of length $n$ from a known Type II $\mathbb{Z}_{2k}$-code of length $n$. Based on this method, we develop an algorithm to construct new extremal Type II $\mathbb{Z}_8$-codes starting from an extremal Type II $\mathbb{Z}_8$-code of type $(\frac{n}{2},0,0)$ with an extremal $\mathbb{Z}_4$-residue code and length $24, 32$ or $40$. We construct at least ten new extremal Type II $\mathbb{Z}_8$-codes of length $32$ and type $(15,1,1)$. Extremal Type II $\mathbb{Z}_8$-codes of length $32$ of this type were not known before. Moreover, the binary residue codes of the constructed extremal $\mathbb{Z}_8$-codes are optimal $[32,15]$ binary codes.


title: The Hobby-Eberly Telescope VIRUS Parallel Survey (HETVIPS)

abstract: The Hobby-Eberly Telescope (HET) VIRUS Parallel Survey (HETVIPS) is a blind spectroscopic program that sparsely covers approximately two-thirds of the celestial sphere and consists of roughly 252 million fiber spectra. The spectra were taken in parallel mode with the Visible Integral-field Replicable Unit Spectrograph (VIRUS) instrument when the HET was observing a primary target with other HET facility instruments. VIRUS can simultaneously obtain approximately 35,000 spectra covering 3470A to 5540A at a spectral resolution of ~800. Although the vast majority of these spectra cover blank sky, we used the Pan-STARRS1 Data Release 2 Stacked Catalog to identify objects encompassed in the HETVIPS pointings and extract their spectra. This paper presents the first HETVIPS data release, containing 493,012 flux-calibrated spectra obtained through 31 March 2023, as well as a description of the data processing technique. Each of the object spectra were classified, resulting in a catalog of 74,196 galaxies, 4,087 quasars, 259,396 stars, and 154,543 unknown sources.


title: Multi-Robot Strategies for Communication-Constrained Exploration and Electrostatic Anomaly Characterization

abstract: Exploration of extreme or remote environments such as Mars is often recognized as an opportunity for multi-robot systems. However, this poses challenges for maintaining robust inter-robot communication without preexisting infrastructure. It may be that robots can only share information when they are physically in close proximity with each other. At the same time, atmospheric phenomena such as dust devils are poorly understood and characterization of their electrostatic properties is of scientific interest. We perform a comparative analysis of two multi-robot communication strategies: a distributed approach, with pairwise intermittent rendezvous, and a centralized, fixed base station approach. We also introduce and evaluate the effectiveness of an algorithm designed to predict the location and strength of electrostatic anomalies, assuming robot proximity. Using an agent-based simulation, we assess the performance of these strategies in a 2D grid cell representation of a Martian environment. Results indicate that a decentralized rendezvous system consistently outperforms a fixed base station system in terms of exploration speed and in reducing the risk of data loss. We also find that inter-robot data sharing improves performance when trying to predict the location and strength of an electrostatic anomaly. These findings indicate the importance of appropriate communication strategies for efficient multi-robot science missions.


title: GraCo: Granularity-Controllable Interactive Segmentation

abstract: Interactive Segmentation (IS) segments specific objects or parts in the image according to user input. Current IS pipelines fall into two categories: single-granularity output and multi-granularity output. The latter aims to alleviate the spatial ambiguity present in the former. However, the multi-granularity output pipeline suffers from limited interaction flexibility and produces redundant results. In this work, we introduce Granularity-Controllable Interactive Segmentation (GraCo), a novel approach that allows precise control of prediction granularity by introducing additional parameters to input. This enhances the customization of the interactive system and eliminates redundancy while resolving ambiguity. Nevertheless, the exorbitant cost of annotating multi-granularity masks and the lack of available datasets with granularity annotations make it difficult for models to acquire the necessary guidance to control output granularity. To address this problem, we design an any-granularity mask generator that exploits the semantic property of the pre-trained IS model to automatically generate abundant mask-granularity pairs without requiring additional manual annotation. Based on these pairs, we propose a granularity-controllable learning strategy that efficiently imparts the granularity controllability to the IS model. Extensive experiments on intricate scenarios at object and part levels demonstrate that our GraCo has significant advantages over previous methods. This highlights the potential of GraCo to be a flexible annotation tool, capable of adapting to diverse segmentation scenarios. The project page: https://zhao-yian.github.io/GraCo.


title: Are Models Biased on Text without Gender-related Language?

abstract: Gender bias research has been pivotal in revealing undesirable behaviors in large language models, exposing serious gender stereotypes associated with occupations, and emotions. A key observation in prior work is that models reinforce stereotypes as a consequence of the gendered correlations that are present in the training data. In this paper, we focus on bias where the effect from training data is unclear, and instead address the question: Do language models still exhibit gender bias in non-stereotypical settings? To do so, we introduce UnStereoEval (USE), a novel framework tailored for investigating gender bias in stereotype-free scenarios. USE defines a sentence-level score based on pretraining data statistics to determine if the sentence contain minimal word-gender associations. To systematically benchmark the fairness of popular language models in stereotype-free scenarios, we utilize USE to automatically generate benchmarks without any gender-related language. By leveraging USE's sentence-level score, we also repurpose prior gender bias benchmarks (Winobias and Winogender) for non-stereotypical evaluation. Surprisingly, we find low fairness across all 28 tested models. Concretely, models demonstrate fair behavior in only 9%-41% of stereotype-free sentences, suggesting that bias does not solely stem from the presence of gender-related words. These results raise important questions about where underlying model biases come from and highlight the need for more systematic and comprehensive bias evaluation. We release the full dataset and code at https://ucinlp.github.io/unstereo-eval.


title: Pretzel monoids

abstract: We introduce an interesting class of left adequate monoids which we call pretzel monoids. These, on the one hand, are monoids of birooted graphs with respect to a natural `glue-and-fold' operation, and on the other hand, are shown to be defined in the category of left adequate monoids by a natural class of presentations. They are also shown to be the free idempotent-pure expansions of right cancellative monoids, making them, in some sense, the left adequate analogues of Margolis-Meakin expansions for inverse monoids. The construction recovers the second author's geometric model of free left adequate monoids when the right cancellative monoid is free.


title: Nonlinear Poisson effect in affine semiflexible polymer networks

abstract: Stretching an elastic material along one axis typically induces contraction along the transverse axes, a phenomenon known as the Poisson effect. From these strains, one can compute the specific volume, which generally either increases or, in the incompressible limit, remains constant as the material is stretched. However, in networks of semiflexible or stiff polymers, which are typically highly compressible yet stiffen significantly when stretched, one instead sees a significant reduction in specific volume under finite strains. This volume reduction is accompanied by increasing alignment of filaments along the strain axis and a nonlinear elastic response, with stiffening of the apparent Young's modulus. For semiflexible networks, in which entropic bending elasticity governs the linear elastic regime, the nonlinear Poisson effect is caused by the nonlinear force-extension relationship of the constituent filaments, which produces a highly asymmetric response of the constituent polymers to stretching and compression. The details of this relationship depend on the geometric and elastic properties of the underlying filaments, which can vary greatly in experimental systems. Here, we provide a comprehensive characterization of the nonlinear Poisson effect in an affine network model and explore the influence of filament properties on essential features of the macroscopic response, including strain-driven alignment and volume reduction.


title: The origin of wall-shear stress fluctuations in wall-bounded turbulence

abstract: The origin of wall shear-stress fluctuations in wall turbulence was studied through energy dissipation at the wall. While confirming the universality in wall dissipation at small inner scales, the dissipation at larger scales is a consequence of near-wall scale interactions. In particular, the energy transport from the universal small to larger scale strengthens with Reynolds number due to the growing number of intermediate scales associated with the log layer. We anticipate that these insights broadly apply to all canonical wall-bounded turbulence for sufficiently high Reynolds numbers.


title: Scaling and renormalization in high-dimensional regression

abstract: This paper presents a succinct derivation of the training and generalization performance of a variety of high-dimensional ridge regression models using the basic tools of random matrix theory and free probability. We provide an introduction and review of recent results on these topics, aimed at readers with backgrounds in physics and deep learning. Analytic formulas for the training and generalization errors are obtained in a few lines of algebra directly from the properties of the $S$-transform of free probability. This allows for a straightforward identification of the sources of power-law scaling in model performance. We compute the generalization error of a broad class of random feature models. We find that in all models, the $S$-transform corresponds to the train-test generalization gap, and yields an analogue of the generalized-cross-validation estimator. Using these techniques, we derive fine-grained bias-variance decompositions for a very general class of random feature models with structured covariates. These novel results allow us to discover a scaling regime for random feature models where the variance due to the features limits performance in the overparameterized setting. We also demonstrate how anisotropic weight structure in random feature models can limit performance and lead to nontrivial exponents for finite-width corrections in the overparameterized setting. Our results extend and provide a unifying perspective on earlier models of neural scaling laws.


title: Silting reduction and picture categories of 0-Auslander extriangulated categories

abstract: Let $\mathcal{C}$ be an extriangulated category and let $\mathcal{R}\subseteq \mathcal{C}$ be a rigid subcategory. Generalizing Iyama--Yang silting reduction, we devise a technical condition $\textbf{(gCP)}$ on $\mathcal{R}$ which is sufficient for the Verdier quotient $\mathcal{C}/\mathrm{thick}(\mathcal{R})$ to be equivalent to an ideal quotient. In particular, the Verdier quotient $\mathcal{C}/\mathrm{thick}(\mathcal{R})$ will admit an extriangulation in such a way that the localization functor $L_{\mathcal{R}}\colon \mathcal{C} \rightarrow \mathcal{C}/\mathrm{thick}(\mathcal{R})$ is extriangulated. When $\mathcal{C}$ is 0-Auslander, the condition $\textbf{(gCP)}$ holds for all rigid subcategories $\mathcal{R}$ admitting Bongartz completions. Furthermore, we prove that the Verdier quotient $\mathcal{C}/\mathrm{thick}(\mathcal{R})$ then remains 0-Auslander. As an application, we define the picture category of a connective $0$-Auslander exact dg category $\mathscr{A}$ with Bongartz completions, which generalizes the notion of $\tau$-cluster morphism category. We show that the picture category of $\mathscr{A}$ is a cubical category, in the sense of Igusa. The picture group of $\mathscr{A}$ is defined as the fundamental group of its picture category. When $H_0\mathscr{A}$ is $\mathbf{g}$-finite, the picture group of $\mathscr{A}$ is finitely presented.


title: Anomalous diffusion and factor ordering in (1+1)-dimensional Lorentzian quantum gravity

abstract: Using properties of diffusion according to a quantum heat kernel constructed as an expectation over classical heat kernels on $S^1$, we probe the non-manifold-like nature of quantized space in a model of (1+1)-dimensional quantum gravity. By computing the mean squared displacement of a diffusing particle, we find that diffusion is anomalous, behaving similarly to that on a porous substrate, network, or fractal over short distances. The walk dimension of the path for a particle diffusing in quantized space is calculated to have an infimum of 4, rising to arbitrarily large values depending on a parameter labeling the choice of factor ordering in the quantum Hamiltonian for our model and figuring in the asymptotic behavior of the wavefunction used to construct the quantum heat kernel. Additionally, we derive an expansion for return probability of a diffusing particle, whose modifications from the classical power-series form depend on the factor-ordering parameter.


title: Infinitely Many Half-Volume Constant Mean Curvature Hypersurfaces via Min-Max Theory

abstract: Let $(M^{n+1},g)$ be a closed Riemannian manifold of dimension $3\le n+1\le 5$. We show that, if the metric $g$ is generic, then $M$ contains infinitely many geometrically distinct constant mean curvature hypersurfaces, each enclosing half the volume of $M$. As an essential part of the proof, we develop an Almgren-Pitts type min-max theory for certain non-local functionals of the general form $$\Omega \mapsto \operatorname{Area}(\partial \Omega) - \int_\Omega h + f(\operatorname{Vol}(\Omega)).$$


title: Unbundle-Rewrite-Rebundle: Runtime Detection and Rewriting of Privacy-Harming Code in JavaScript Bundles

abstract: This work presents Unbundle-Rewrite-Rebundle (URR), a system for detecting privacy-harming portions of bundled JavaScript code, and rewriting that code at runtime to remove the privacy harming behavior without breaking the surrounding code or overall application. URR is a novel solution to the problem of JavaScript bundles, where websites pre-compile multiple code units into a single file, making it impossible for content filters and ad-blockers to differentiate between desired and unwanted resources. Where traditional content filtering tools rely on URLs, URR analyzes the code at the AST level, and replaces harmful AST sub-trees with privacy-and-functionality maintaining alternatives. We present an open-sourced implementation of URR as a Firefox extension, and evaluate it against JavaScript bundles generated by the most popular bundling system (Webpack) deployed on the Tranco 10k. We measure the performance, measured by precision (1.00), recall (0.95), and speed (0.43s per-script) when detecting and rewriting three representative privacy harming libraries often included in JavaScript bundles, and find URR to be an effective approach to a large-and-growing blind spot unaddressed by current privacy tools.


title: Non-abelian symmetry-resolved entanglement entropy

abstract: We introduce a mathematical framework for symmetry-resolved entanglement entropy with a non-abelian symmetry group. To obtain a reduced density matrix that is block-diagonal in the non-abelian charges, we define subsystems operationally in terms of subalgebras of invariant observables. We derive exact formulas for the average and the variance of the typical entanglement entropy for the ensemble of random pure states with fixed non-abelian charges. We focus on compact, semisimple Lie groups. We show that, compared to the abelian case, new phenomena arise from the interplay of locality and non-abelian symmetry, such as the asymmetry of the entanglement entropy under subsystem exchange, which we show in detail by computing the Page curve of a many-body system with $SU(2)$ symmetry.

categories: quant-ph cond-mat.stat-mech cond-mat.str-el gr-qc hep-th


title: Pseudo-noise pulse-compression thermography: a powerful tool for time-domain thermography analysis

abstract: Pulse-compression is a correlation-based measurement technique successfully used in many NDE applications to increase the SNR in the presence of huge noise, strong signal attenuation or when high excitation levels must be avoided. In thermography, the pulse-compression approach was firstly introduced in 2005 by Mulavesaala and co-workers, and then further developed by Mandelis and co-authors that applied to thermography the concept of the thermal-wave radar developed for photothermal measurements. Since then, many measurement schemes and applications have been reported in the literature by several groups by using various heating sources, coded excitation signals, and processing algorithms. The variety of such techniques is known as pulse-compression thermography or thermal-wave radar imaging. Even despite the continuous improvement of these techniques during these years, the advantages of using a correlation-based approach in thermography are still not fully exploited and recognized by the community. This is because up to now the reconstructed thermograms' time sequences after pulse-compression were affected by the so-called sidelobes. This is a severe drawback since it hampers an easy interpretation of the data and their comparison with other thermography techniques. To overcome this issue and unleash the full potential of the approach, this paper shows how it is possible to implement a pulse-compression thermography procedure capable of suppressing any sidelobe by using a pseudo-noise excitation and a proper processing algorithm.


title: Some remarks on periodic gradings

abstract: Let $\mathfrak q$ be a finite-dimensional Lie algebra, $\vartheta\in Aut(\mathfrak q)$ a finite order automorphism, and $\mathfrak q_0$ the subalgebra of fixed points of $\vartheta$. Using $\vartheta$ one can construct a pencil $\mathcal P$ of compatible Poisson brackets on $S(\mathfrak q)$, and thereby a `large' Poisson-commutative subalgebra $Z(\mathfrak q,\vartheta)$ consisting of $\mathfrak q_0$-invariants in $S(\mathfrak q)$. We study one particular bracket $\{\,\,,\,\}_{\infty}\in\mathcal P$ and the related Poisson centre ${\mathcal Z}_\infty$. It is shown that ${\mathcal Z}_\infty$ is a polynomial ring, if $\mathfrak q$ is reductive.


title: Radar-Based Localization For Autonomous Ground Vehicles In Suburban Neighborhoods

abstract: For autonomous ground vehicles (AGVs) deployed in suburban neighborhoods and other human-centric environments the problem of localization remains a fundamental challenge. There are well established methods for localization with GPS, lidar, and cameras. But even in ideal conditions these have limitations. GPS is not always available and is often not accurate enough on its own, visual methods have difficulty coping with appearance changes due to weather and other factors, and lidar methods are prone to defective solutions due to ambiguous scene geometry. Radar on the other hand is not highly susceptible to these problems, owing in part to its longer range. Further, radar is also robust to challenging conditions that interfere with vision and lidar including fog, smoke, rain, and darkness. We present a radar-based localization system that includes a novel method for highly-accurate radar odometry for smooth, high-frequency relative pose estimation and a novel method for radar-based place recognition and relocalization. We present experiments demonstrating our methods' accuracy and reliability, which are comparable with \new{other methods' published results for radar localization and we find outperform a similar method as ours applied to lidar measurements}. Further, we show our methods are lightweight enough to run on common low-power embedded hardware with ample headroom for other autonomy functions.


title: How founder motivations, goals, and actions influence early trajectories of online communities

abstract: Online communities offer their members various benefits, such as information access, social and emotional support, and entertainment. Despite the important role that founders play in shaping communities, prior research has focused primarily on what drives users to participate and contribute; the motivations and goals of founders remain underexplored. To uncover how and why online communities get started, we present findings from a survey of 951 recent founders of Reddit communities. We find that topical interest is the most common motivation for community creation, followed by motivations to exchange information, connect with others, and self-promote. Founders have heterogeneous goals for their nascent communities, but they tend to privilege community quality and engagement over sheer growth. These differences in founders' early attitudes towards their communities help predict not only the community-building actions that they pursue, but also the ability of their communities to attract visitors, contributors, and subscribers over the first 28 days. We end with a discussion of the implications for researchers, designers, and founders of online communities.


title: Investigating Automatic Scoring and Feedback using Large Language Models

abstract: Automatic grading and feedback have been long studied using traditional machine learning and deep learning techniques using language models. With the recent accessibility to high performing large language models (LLMs) like LLaMA-2, there is an opportunity to investigate the use of these LLMs for automatic grading and feedback generation. Despite the increase in performance, LLMs require significant computational resources for fine-tuning and additional specific adjustments to enhance their performance for such tasks. To address these issues, Parameter Efficient Fine-tuning (PEFT) methods, such as LoRA and QLoRA, have been adopted to decrease memory and computational requirements in model fine-tuning. This paper explores the efficacy of PEFT-based quantized models, employing classification or regression head, to fine-tune LLMs for automatically assigning continuous numerical grades to short answers and essays, as well as generating corresponding feedback. We conducted experiments on both proprietary and open-source datasets for our tasks. The results show that prediction of grade scores via finetuned LLMs are highly accurate, achieving less than 3% error in grade percentage on average. For providing graded feedback fine-tuned 4-bit quantized LLaMA-2 13B models outperform competitive base models and achieve high similarity with subject matter expert feedback in terms of high BLEU and ROUGE scores and qualitatively in terms of feedback. The findings from this study provide important insights into the impacts of the emerging capabilities of using quantization approaches to fine-tune LLMs for various downstream tasks, such as automatic short answer scoring and feedback generation at comparatively lower costs and latency.


title: Learning Expressive Disentangled Speech Representations with Soft Speech Units and Adversarial Style Augmentation

abstract: Voice conversion is the task to transform voice characteristics of source speech while preserving content information. Nowadays, self-supervised representation learning models are increasingly utilized in content extraction. However, in these representations, a lot of hidden speaker information leads to timbre leakage while the prosodic information of hidden units lacks use. To address these issues, we propose a novel framework for expressive voice conversion called "SAVC" based on soft speech units from HuBert-soft. Taking soft speech units as input, we design an attribute encoder to extract content and prosody features respectively. Specifically, we first introduce statistic perturbation imposed by adversarial style augmentation to eliminate speaker information. Then the prosody is implicitly modeled on soft speech units with knowledge distillation. Experiment results show that the intelligibility and naturalness of converted speech outperform previous work.


title: A Preprocessing and Evaluation Toolbox for Trajectory Prediction Research on the Drone Datasets

abstract: The availability of high-quality datasets is crucial for the development of behavior prediction algorithms in autonomous vehicles. This paper highlights the need for standardizing the use of certain datasets for motion forecasting research to simplify comparative analysis and proposes a set of tools and practices to achieve this. Drawing on extensive experience and a comprehensive review of current literature, we summarize our proposals for preprocessing, visualizing, and evaluation in the form of an open-sourced toolbox designed for researchers working on trajectory prediction problems. The clear specification of necessary preprocessing steps and evaluation metrics is intended to alleviate development efforts and facilitate the comparison of results across different studies. The toolbox is available at: https://github.com/westny/dronalize.


title: Preperiodic points of polynomial dynamical systems over finite fields

abstract: For a prime $p$, positive integers $r,n$, and a polynomial $f$ with coefficients in $\mathbb{F}_{p^r}$, let $W_{p,r,n}(f)=f^n\left(\mathbb{F}_{p^r}\right)\setminus f^{n+1}\left(\mathbb{F}_{p^r}\right)$. As $n$ varies, the $W_{p,r,n}(f)$ partition the set of strictly preperiodic points of the dynamical system induced by the action of $f$ on $\mathbb{F}_{p^r}$. In this paper we compute statistics of strictly preperiodic points of dynamical systems induced by unicritical polynomials over finite fields by obtaining effective upper bounds for the proportion of $\mathbb{F}_{p^r}$ lying in a given $W_{p,r,n}(f)$. Moreover, when we generalize our definition of $W_{p,r,n}(f)$, we obtain both upper and lower bounds for the resulting averages.


title: Some properties of Euler capital allocation

abstract: The paper discusses capital allocation using the Euler formula and focuses on the risk measures Value-at-Risk (VaR) and Expected shortfall (ES). Some new results connected to this capital allocation is known. Two examples illustrate that capital allocation with VaR is not monotonous which may be surprising since VaR is monotonous. A third example illustrates why the same risk measure should be used in capital allocation as in the evaluation of the total portfolio. We show how simulation may be used in order to estimate the expected Return on risk adjusted capital in the commitment period of an asset. Finally, we show how Markov chain Monte Carlo may be used in the estimation of the capital allocation.


title: Inverse images of a positive closed current for a holomorphic endomorphism of a compact K\"ahler manifold

abstract: In this paper, we prove that for a given surjective holomorphic endomorphism $f$ of a compact K\"ahler manifold $X$ and for some integer $p$ with $1\le p\le k$, there exists a proper invariant analytic subset $E$ for $f$ such that if $S$ is smooth in a neighborhood of $E$, the sequence $d_p^{-n}(f^n)^*(S-\alpha_S)$ converges to $0$ exponentially fast in the sense of currents where $d_p$ denotes the dynamical degree of order $p$ and $\alpha_S$ is a closed smooth form in the de Rham cohomology class of $S$.


title: $f(T)$ gravity after DESI Baryon Acoustic Oscillation and DES Supernovae 2024 data

abstract: In this work, we investigate new constraints on $f(T)$ gravity using the recent Baryon Acoustic Oscillation (BAO) data released by the Dark Energy Spectroscopic Instrument (DESI) and the Type Ia supernovae (SNIa) catalog from the full 5-years of the Dark Energy Survey Supernova Program (DES-SN5YR). The $f(T)$ cosmological models considered are characterised by power law late-time accelerated expansion. Our results show that the combination DESI BAO +$r_d$ CMB Planck suggests a Bayesian preference for late-time $f(T)$ cosmological models over $\Lambda$CDM, obtaining a value of $H_0= 68.3^{+3.0}_{-3.5}$[km/s/Mpc] in agreement with SH0ES collaboration, however, due to a bigger uncertainty.


title: Capillary-Assisted Printing of Droplets at a Solid-Like Liquid-Liquid Interface

abstract: Capillary forces guide the motion of biomolecular condensates, water-borne insects, and breakfast cereal. These surface-mediated interactions can be harnessed to build units into materials with exotic properties deriving from mesoscale structure. Droplets are promising building blocks for these materials, finding applications in tissue engineering, adaptive optics, and structural colour. However, the instability of water droplets at many liquid-liquid interfaces hampers the use of capillarity for the assembly of droplet-based materials. Here, we use nanoparticle surfactants to form solid-like oil-water interfaces at which aqueous droplets sit for extended periods. We find that microlitre-sized droplets at these interfaces attract each other over millimetric scales. We rationalize this interaction with a modified theory of capillarity. Applying printing methods allows us to finely control initial droplet positions, from which they self-assemble into cellular materials. Finally, by functionalising the interface with gold nanoparticles, we use plasmon-assisted optofluidics to manipulate these droplet-based materials with temperature gradients.


title: Growth in products of matrices: fastest, average, and generic

abstract: The problems that we consider in this paper are as follows. Let A and B be 2x2 matrices (over reals). Let w(A, B) be a word of length n. After evaluating w(A, B) as a product of matrices, we get a 2x2 matrix, call it W. What is the largest (by the absolute value) possible entry of W, over all w(A, B) of length n, as a function of n? What is the expected absolute value of the largest (by the absolute value) entry in a random product of n matrices, where each matrix is A or B with probability 0.5? What is the Lyapunov exponent for a random matrix product like that? We give partial answer to the first of these questions and an essentially complete answer to the second question. For the third question (the most difficult of the three), we offer a very simple method to produce an upper bound on the Lyapunov exponent in the case where all entries of the matrices A and B are nonnegative.


title: Addressing Topic Granularity and Hallucination in Large Language Models for Topic Modelling

abstract: Large language models (LLMs) with their strong zero-shot topic extraction capabilities offer an alternative to probabilistic topic modelling and closed-set topic classification approaches. As zero-shot topic extractors, LLMs are expected to understand human instructions to generate relevant and non-hallucinated topics based on the given documents. However, LLM-based topic modelling approaches often face difficulties in generating topics with adherence to granularity as specified in human instructions, often resulting in many near-duplicate topics. Furthermore, methods for addressing hallucinated topics generated by LLMs have not yet been investigated. In this paper, we focus on addressing the issues of topic granularity and hallucinations for better LLM-based topic modelling. To this end, we introduce a novel approach that leverages Direct Preference Optimisation (DPO) to fine-tune open-source LLMs, such as Mistral-7B. Our approach does not rely on traditional human annotation to rank preferred answers but employs a reconstruction pipeline to modify raw topics generated by LLMs, thus enabling a fast and efficient training and inference framework. Comparative experiments show that our fine-tuning approach not only significantly improves the LLM's capability to produce more coherent, relevant, and precise topics, but also reduces the number of hallucinated topics.


title: Two-loop mixed QCD-EW corrections to charged current Drell-Yan

abstract: We present the two-loop mixed strong-electroweak virtual corrections to the charged current Drell-Yan process. The final-state collinear singularities are regularised by the lepton mass. The evaluation of all the relevant Feynman integrals, including those with up to two different internal massive lines, has been worked out relying on semi-analytical techniques, using complex-valued masses. We can provide, at any arbitrary phase-space point, the solution as a power series in the $W$-boson mass, around a reference value. Starting from these expansions, we can prepare a numerical grid for any value of the $W$-boson mass within their radius of convergence in a negligible amount of time.


title: X-ray spectral properties of dust-obscured galaxies in the XMM-SERVS coverage of the XMM-LSS field

abstract: With an aim to unveil the population of obscured AGN hosted in high-$z$ dust-obscured galaxies (DOGs), we performed X-ray spectral study of $34$ DOGs ($0.59$ $\leq$ $z$ $\leq$ $4.65$) lying within $5.3$ deg$^{2}$ of the XMM-SERVS coverage in the XMM-LSS field. To improve the spectral quality of individual sources, we combined all the existing $\textit{XMM-Newton}$ data and also included $\textit{Chandra}$/ACIS data, whenever available. We find that the X-ray spectra of our DOGs can be fitted with a simple absorbed power law or with a physically-motivated BORUS02 model. The line-of-sight column densities ($N_{\textrm{H}}$) in our sources span across a wide range ($1.02$ $\times$ $10^{22}$ cm$^{-2}$ $\leq$ $N_{\textrm{H}}$ $\leq$ $1.21$ $\times$ $10^{24}$ cm$^{-2}$), with a substantial fraction ($\sim$ $17.6$ per cent) of them being heavily obscured ($N_{\textrm{H}}$ $\geq$ $10^{23}$ cm$^{-2}$). We also identified one new CT-AGN candidate, yielding the CT-AGN fraction in our sample to be only $3$ per cent. The absorption-corrected $2.0-10$ keV X-ray luminosities of our sources ($2.00~\times~10^{43}$ erg s$^{-1}$ $\leq$ $L_{\textrm{2-10 keV}}^{\textrm{int}}$ $\leq$ $6.17~\times~10^{45}$ erg s$^{-1}$) suggest them to be luminous quasars. The $N_{\textrm{H}}$ versus Eddington ratio diagnostic plot infers that our sample consists of a heterogeneous population that includes a small fraction ($\sim$ $12$ per cent) of DOGs belonging to an early phase (Hot DOGs) during which accretion and obscuration peaks, while the remaining DOGs belong to an intermediate or late phase during which radiative feedback from the dominant AGN blows away surrounding obscuring material.


title: Multigroup Robustness

abstract: To address the shortcomings of real-world datasets, robust learning algorithms have been designed to overcome arbitrary and indiscriminate data corruption. However, practical processes of gathering data may lead to patterns of data corruption that are localized to specific partitions of the training dataset. Motivated by critical applications where the learned model is deployed to make predictions about people from a rich collection of overlapping subpopulations, we initiate the study of multigroup robust algorithms whose robustness guarantees for each subpopulation only degrade with the amount of data corruption inside that subpopulation. When the data corruption is not distributed uniformly over subpopulations, our algorithms provide more meaningful robustness guarantees than standard guarantees that are oblivious to how the data corruption and the affected subpopulations are related. Our techniques establish a new connection between multigroup fairness and robustness.


title: Chemistry in externally FUV irradiated disks in the outskirts of the Orion Nebula

abstract: Most stars are born in stellar clusters and their protoplanetary disks, which are the birthplaces of planets, can therefore be affected by the radiation of nearby massive stars. However, little is known about the chemistry of externally irradiated disks, including whether or not their properties are similar to the so-far better-studied isolated disks. Motivated by this question, we present ALMA Band 6 observations of two irradiated Class II protoplanetary disks in the outskirts of the Orion Nebula Cluster (ONC) to explore the chemical composition of disks exposed to (external) FUV radiation fields: the 216-0939 disk and the binary system 253-1536A/B, which are exposed to radiation fields of $10^2-10^3$ times the average interstellar radiation field. We detect lines from CO isotopologues, HCN, H$_2$CO, and C$_2$H toward both protoplanetary disks. Based on the observed disk-integrated line fluxes and flux ratios, we do not find significant differences between isolated and irradiated disks. The observed differences seem to be more closely related to the different stellar masses than to the external radiation field. This suggests that these disks are far enough away from the massive Trapezium stars, that their chemistry is no longer affected by external FUV radiation. Additional observations towards lower-mass disks and disks closer to the massive Trapezium stars are required to elucidate the level of external radiation required to make an impact on the chemistry of planet formation in different kinds of disks.


title: An Expectation-Maximization Relaxed Method for Privacy Funnel

abstract: The privacy funnel (PF) gives a framework of privacy-preserving data release, where the goal is to release useful data while also limiting the exposure of associated sensitive information. This framework has garnered significant interest due to its broad applications in characterization of the privacy-utility tradeoff. Hence, there is a strong motivation to develop numerical methods with high precision and theoretical convergence guarantees. In this paper, we propose a novel relaxation variant based on Jensen's inequality of the objective function for the computation of the PF problem. This model is proved to be equivalent to the original in terms of optimal solutions and optimal values. Based on our proposed model, we develop an accurate algorithm which only involves closed-form iterations. The convergence of our algorithm is theoretically guaranteed through descent estimation and Pinsker's inequality. Numerical results demonstrate the effectiveness of our proposed algorithm.


title: Universality of the second correlation function of the deformed Ginibre ensemble

abstract: We study the deformed complex Ginibre ensemble $H=A_0+H_0$, where $H_0$ is the complex matrix with iid Gaussian entries, and $A_0$ is some general $n\times n$ matrix (it can be random and in this case it is independent of $H_0$). Assuming rather general assumptions on $A_0$, we prove that the asymptotic local behavior of the second correlation function of the eigenvalues of such matrices in the bulk coincides with that for the pure complex Ginibre ensemble.


title: An axiomatisation of the temporal logic of two dimensional Minkowski spacetime

abstract: We define temporal axioms that are sound and complete for the temporal validities over $(\reals^2, <)$.


title: One-Bit Total Variation Denoising over Networks with Applications to Partially Observed Epidemics

abstract: This paper introduces a novel approach for epidemic nowcasting and forecasting over networks using total variation (TV) denoising, a method inspired by classical signal processing techniques. Considering a network that models a population as a set of $n$ nodes characterized by their infection statuses $Y_i$ and that represents contacts as edges, we prove the consistency of graph-TV denoising for estimating the underlying infection probabilities $\{p_i\}_{ i \in \{1,\cdots, n\}}$ in the presence of Bernoulli noise. Our results provide an important extension of existing bounds derived in the Gaussian case to the study of binary variables -- an approach hereafter referred to as one-bit total variation denoising. The methodology is further extended to handle incomplete observations, thereby expanding its relevance to various real-world situations where observations over the full graph may not be accessible. Focusing on the context of epidemics, we establish that one-bit total variation denoising enhances both nowcasting and forecasting accuracy in networks, as further evidenced by comprehensive numerical experiments and two real-world examples. The contributions of this paper lie in its theoretical developments, particularly in addressing the incomplete data case, thereby paving the way for more precise epidemic modelling and enhanced surveillance strategies in practical settings.


title: Lane Segmentation Refinement with Diffusion Models

abstract: The lane graph is a key component for building high-definition (HD) maps and crucial for downstream tasks such as autonomous driving or navigation planning. Previously, He et al. (2022) explored the extraction of the lane-level graph from aerial imagery utilizing a segmentation based approach. However, segmentation networks struggle to achieve perfect segmentation masks resulting in inaccurate lane graph extraction. We explore additional enhancements to refine this segmentation-based approach and extend it with a diffusion probabilistic model (DPM) component. This combination further improves the GEO F1 and TOPO F1 scores, which are crucial indicators of the quality of a lane graph, in the undirected graph in non-intersection areas. We conduct experiments on a publicly available dataset, demonstrating that our method outperforms the previous approach, particularly in enhancing the connectivity of such a graph, as measured by the TOPO F1 score. Moreover, we perform ablation studies on the individual components of our method to understand their contribution and evaluate their effectiveness.


title: Multi-level Nonstandard Analysis and the Axiom of Choice

abstract: Model-theoretic frameworks for Nonstandard Analysis depend on the existence of nonprincipal ultrafilters, a strong form of the Axiom of Choice (AC). Hrbacek and Katz, APAL 72 (2021) formulate axiomatic nonstandard set theories SPOT and SCOT that are conservative extensions of respectively ZF and ZF + ADC (the Axiom of Dependent Choice), and in which a significant part of Nonstandard Analysis can be developed. The present paper extends these theories to theories with many levels of standardness, called respectively SPOTS and SCOTS. It shows that Jin's recent nonstandard proof of Szemer\'{e}di's Theorem can be carried out in SPOTS, which is conservative over ZF + ACC (the Axiom of Countable Choice). The theory SCOTS is a conservative extension of ZF + ADC.


title: Causal Evaluation of Language Models

abstract: Causal reasoning is viewed as crucial for achieving human-level machine intelligence. Recent advances in language models have expanded the horizons of artificial intelligence across various domains, sparking inquiries into their potential for causal reasoning. In this work, we introduce Causal evaluation of Language Models (CaLM), which, to the best of our knowledge, is the first comprehensive benchmark for evaluating the causal reasoning capabilities of language models. First, we propose the CaLM framework, which establishes a foundational taxonomy consisting of four modules: causal target (i.e., what to evaluate), adaptation (i.e., how to obtain the results), metric (i.e., how to measure the results), and error (i.e., how to analyze the bad results). This taxonomy defines a broad evaluation design space while systematically selecting criteria and priorities. Second, we compose the CaLM dataset, comprising 126,334 data samples, to provide curated sets of causal targets, adaptations, metrics, and errors, offering extensive coverage for diverse research pursuits. Third, we conduct an extensive evaluation of 28 leading language models on a core set of 92 causal targets, 9 adaptations, 7 metrics, and 12 error types. Fourth, we perform detailed analyses of the evaluation results across various dimensions (e.g., adaptation, scale). Fifth, we present 50 high-level empirical findings across 9 dimensions (e.g., model), providing valuable guidance for future language model development. Finally, we develop a multifaceted platform, including a website, leaderboards, datasets, and toolkits, to support scalable and adaptable assessments. We envision CaLM as an ever-evolving benchmark for the community, systematically updated with new causal targets, adaptations, models, metrics, and error types to reflect ongoing research advancements. Project website is at https://opencausalab.github.io/CaLM.


title: "I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust

abstract: Widely deployed large language models (LLMs) can produce convincing yet incorrect outputs, potentially misleading users who may rely on them as if they were correct. To reduce such overreliance, there have been calls for LLMs to communicate their uncertainty to end users. However, there has been little empirical work examining how users perceive and act upon LLMs' expressions of uncertainty. We explore this question through a large-scale, pre-registered, human-subject experiment (N=404) in which participants answer medical questions with or without access to responses from a fictional LLM-infused search engine. Using both behavioral and self-reported measures, we examine how different natural language expressions of uncertainty impact participants' reliance, trust, and overall task performance. We find that first-person expressions (e.g., "I'm not sure, but...") decrease participants' confidence in the system and tendency to agree with the system's answers, while increasing participants' accuracy. An exploratory analysis suggests that this increase can be attributed to reduced (but not fully eliminated) overreliance on incorrect answers. While we observe similar effects for uncertainty expressed from a general perspective (e.g., "It's not clear, but..."), these effects are weaker and not statistically significant. Our findings suggest that using natural language expressions of uncertainty may be an effective approach for reducing overreliance on LLMs, but that the precise language used matters. This highlights the importance of user testing before deploying LLMs at scale.


title: Hysteresis and Self-Oscillations in an Artificial Memristive Quantum Neuron

abstract: We theoretically study an artificial neuron circuit containing a quantum memristor in the presence of relaxation and dephasing. The charge transport in the quantum element is realized via tunneling of a charge through a quantum particle which shuttles between two terminals -- a functionality reminiscent of classical diffusive memristors. We demonstrate that this physical principle enables hysteretic behavior of the current-voltage characteristics of the quantum device. In addition, being used in artificial neural circuit, the quantum switcher is able to generate self-sustained current oscillations. Our analysis reveals that these self-oscillations are triggered only in quantum regime with a moderate rate of relaxation, and cannot exist either in a purely coherent regime or at a very high decoherence. We investigate the hysteresis and instability leading to the onset of current self-oscillations and analyze their properties depending on the circuit parameters. Our results provide a generic approach to the use of quantum regimes for controlling hysteresis and generating self-oscillations.


title: Queue-based Eco-Driving at Roundabouts with Reinforcement Learning

abstract: We address eco-driving at roundabouts in mixed traffic to enhance traffic flow and traffic efficiency in urban areas. The aim is to proactively optimize speed of automated or non-automated connected vehicles (CVs), ensuring both an efficient approach and smooth entry into roundabouts. We incorporate the traffic situation ahead, i.e. preceding vehicles and waiting queues. Further, we develop two approaches: a rule-based and an Reinforcement Learning (RL) based eco-driving system, with both using the approach link and information from conflicting CVs for speed optimization. A fair comparison of rule-based and RL-based approaches is performed to explore RL as a viable alternative to classical optimization. Results show that both approaches outperform the baseline. Improvements significantly increase with growing traffic volumes, leading to best results on average being obtained at high volumes. Near capacity, performance deteriorates, indicating limited applicability at capacity limits. Examining different CV penetration rates, a decline in performance is observed, but with substantial results still being achieved at lower CV rates. RL agents can discover effective policies for speed optimization in dynamic roundabout settings, but they do not offer a substantial advantage over classical approaches, especially at higher traffic volumes or lower CV penetration rates.


title: SARMA: Scalable Low-Rank High-Dimensional Autoregressive Moving Averages via Tensor Decomposition

abstract: Existing models for high-dimensional time series are overwhelmingly developed within the finite-order vector autoregressive (VAR) framework, whereas the more flexible vector autoregressive moving averages (VARMA) have been much less considered. This paper introduces a high-dimensional model for capturing VARMA dynamics, namely the Scalable ARMA (SARMA) model, by combining novel reparameterization and tensor decomposition techniques. To ensure identifiability and computational tractability, we first consider a reparameterization of the VARMA model and discover that this interestingly amounts to a Tucker-low-rank structure for the AR coefficient tensor along the temporal dimension. Motivated by this finding, we further consider Tucker decomposition across the response and predictor dimensions of the AR coefficient tensor, enabling factor extraction across variables and time lags. Additionally, we consider sparsity assumptions on the factor loadings to accomplish automatic variable selection and greater estimation efficiency. For the proposed model, we develop both rank-constrained and sparsity-inducing estimators. Algorithms and model selection methods are also provided. Simulation studies and empirical examples confirm the validity of our theory and advantages of our approaches over existing competitors.


title: Koopman-based Deep Learning for Nonlinear System Estimation

abstract: Nonlinear differential equations are encountered as models of fluid flow, spiking neurons, and many other systems of interest in the real world. Common features of these systems are that their behaviors are difficult to describe exactly and invariably unmodeled dynamics present challenges in making precise predictions. In many cases the models exhibit extremely complicated behavior due to bifurcations and chaotic regimes. In this paper, we present a novel data-driven linear estimator that uses Koopman operator theory to extract finite-dimensional representations of complex nonlinear systems. The extracted model is used together with a deep reinforcement learning network that learns the optimal stepwise actions to predict future states of the original nonlinear system. Our estimator is also adaptive to a diffeomorphic transformation of the nonlinear system which enables transfer learning to compute state estimates of the transformed system without relearning from scratch.


title: Metamagnetism and anomalous magnetotransport properties in rare-earth-based polar semimetals $R$AuGe ($R =$ Dy, Ho, and Gd)

abstract: We report the magnetic, magnetoelastic, and magnetotransport properties of single crystals of polar magnets $R$AuGe ($R=$ Dy, Ho, and Gd), grown by Au-Ge self-flux. Magnetization and magnetostriction measurements reveal multi-step metamagnetic transitions for the $c$-axis magnetic field ($H\parallel c$) for DyAuGe and HoAuGe, suggesting magnetic frustration in the triangular lattice of $R$ ions. The magnetic phase diagrams have clarified a close connection between the magnetoelastic property and the emergence of the intermediate metamagentic phase. The magnetic-field dependence of the resistivity and Hall resistivity reveal the semimetallic transport dominated by hole-type carriers, consistent with the behavior in a nonmagnetic analogue YAuGe. We also identify a signature of an anomalous Hall effect (AHE) proportional to the field-induced magnetization in $R=$ Dy, Ho, and Gd. GdAuGe shows magnetic and transport behavior as reported in a previous study using Bi-flux grown single crystals, while the self-flux grown crystal shows larger magnetoresistance ($\sim$ 345\%, at 1.8 K and 9 T) due to higher hole-type carrier mobility ($\sim$ 6400 cm$^2$/Vs). Using the two-band model analysis considering the mobility change during the magnetization process, we extract the anomalous Hall conductivity: $\sim 1200$ S/cm and $\sim 530$ S/cm for $R=$ Dy and Ho, respectively, at 1.8 K with 9 T for $H\parallel c$. The magnitude of conductivity suggests a contribution of intrinsic origin, possibly related to the Berry curvature in the electron bands induced by the time-reversal symmetry breaking and the polar lattice.


title: HUGO -- Highlighting Unseen Grid Options: Combining Deep Reinforcement Learning with a Heuristic Target Topology Approach

abstract: With the growth of Renewable Energy (RE) generation, the operation of power grids has become increasingly complex. One solution could be automated grid operation, where Deep Reinforcement Learning (DRL) has repeatedly shown significant potential in Learning to Run a Power Network (L2RPN) challenges. However, only individual actions at the substation level have been subjected to topology optimization by most existing DRL algorithms. In contrast, we propose a more holistic approach by proposing specific Target Topologies (TTs) as actions. These topologies are selected based on their robustness. As part of this paper, we present a search algorithm to find the TTs and upgrade our previously developed DRL agent CurriculumAgent (CAgent) to a novel topology agent. We compare the upgrade to the previous CAgent and can increase their L2RPN score significantly by 10%. Further, we achieve a 25% better median survival time with our TTs included. Later analysis shows that almost all TTs are close to the base topology, explaining their robustness


title: Depth Priors in Removal Neural Radiance Fields

abstract: Neural Radiance Fields have achieved impressive results in 3D reconstruction and novel view generation. A significant challenge within NeRF involves editing reconstructed 3D scenes, such as object removal, which demands consistency across multiple views and the synthesis of high-quality perspectives. Previous studies have integrated depth priors, typically sourced from LiDAR or sparse depth estimates from COLMAP, to enhance NeRF's performance in object removal. However, these methods are either expensive or time-consuming. This paper proposes a new pipeline that leverages SpinNeRF and monocular depth estimation models like ZoeDepth to enhance NeRF's performance in complex object removal with improved efficiency. A thorough evaluation of COLMAP's dense depth reconstruction on the KITTI dataset is conducted to demonstrate that COLMAP can be viewed as a cost-effective and scalable alternative for acquiring depth ground truth compared to traditional methods like LiDAR. This serves as the basis for evaluating the performance of monocular depth estimation models to determine the best one for generating depth priors for SpinNeRF. The new pipeline is tested in various scenarios involving 3D reconstruction and object removal, and the results indicate that our pipeline significantly reduces the time required for depth prior acquisition for object removal and enhances the fidelity of the synthesized views, suggesting substantial potential for building high-fidelity digital twin systems with increased efficiency in the future.


title: Deep Metric Learning-Based Out-of-Distribution Detection with Synthetic Outlier Exposure

abstract: In this paper, we present a novel approach that combines deep metric learning and synthetic data generation using diffusion models for out-of-distribution (OOD) detection. One popular approach for OOD detection is outlier exposure, where models are trained using a mixture of in-distribution (ID) samples and ``seen" OOD samples. For the OOD samples, the model is trained to minimize the KL divergence between the output probability and the uniform distribution while correctly classifying the in-distribution (ID) data. In this paper, we propose a label-mixup approach to generate synthetic OOD data using Denoising Diffusion Probabilistic Models (DDPMs). Additionally, we explore recent advancements in metric learning to train our models. In the experiments, we found that metric learning-based loss functions perform better than the softmax. Furthermore, the baseline models (including softmax, and metric learning) show a significant improvement when trained with the generated OOD data. Our approach outperforms strong baselines in conventional OOD detection metrics.


title: When Quantization Affects Confidence of Large Language Models?

abstract: Recent studies introduced effective compression techniques for Large Language Models (LLMs) via post-training quantization or low-bit weight representation. Although quantized weights offer storage efficiency and allow for faster inference, existing works have indicated that quantization might compromise performance and exacerbate biases in LLMs. This study investigates the confidence and calibration of quantized models, considering factors such as language model type and scale as contributors to quantization loss. Firstly, we reveal that quantization with GPTQ to 4-bit results in a decrease in confidence regarding true labels, with varying impacts observed among different language models. Secondly, we observe fluctuations in the impact on confidence across different scales. Finally, we propose an explanation for quantization loss based on confidence levels, indicating that quantization disproportionately affects samples where the full model exhibited low confidence levels in the first place.


title: Predictions for Composite Higgs models from gauge/gravity dualities

abstract: Gauge/gravity dualities provide a very useful approach into solving strongly coupled systems. We apply this to Composite Higgs models and determine the mass hierarchies of the corresponding bound states. As a cross check we apply this to QCD and compare the results to existing lattice calculations for which we find good agreement. We then focus on a particular example whose phenomenology has recently been studied in the literature in a generic way and outline first phenomenological implications of our findings for the spectrum.


title: Observational constraints on the stellar recycled gas in active galactic nuclei feeding

abstract: Near-infrared long-slit spectroscopy has been used to study the stellar population (SP) of the low luminosity active galactic nuclei (AGN) and matched analogues (LLAMA) sample. To perform the SP fits we have employed the X-shooter simple stellar population models together with the \st\ code. Our main conclusions are: The star formation history of the AGNs is very complex, presenting many episodes of star formation during their lifetimes. In general, AGN hosts have higher fractions of intermediate-age SP (light-weighted mean ages, $<t>_L\lesssim$ 4.5 Gyr) when compared with their analogues ($<t>_L\lesssim$ 8.0 Gyr). AGN are more affected by reddening and require significant fractions of featureless continuum and hot dust components. The ratio between the AGN radiated energy and the gravitational potential energy of the molecular gas ($E_{Rad}$/$E_{PG}$) for the AGN is compared with the \maL\ and a possible anti-correlation is observed. This suggests that the AGN is affecting the star formation in these galaxies, in the sense that more energetic AGN (log$(E_{Rad}$/$E_{PG}) \gtrsim 3$) tend to host nuclear younger SP ($ <t>_L \lesssim$4Gyr). We found that the recent ($t<$2~Gyr) returned (recycled) stellar mass is higher in AGN than in the controls. We also provide evidence that the mass loss of stars would be enough to feed the AGN, thus providing observational constraints for models that predict that AGN feeding is partially due to the recycled gas from dying stars.


title: Bye bye, local bias: the statistics of the halo field are poorly determined by the local mass density

abstract: Bias models relating the dark matter field to the spatial distribution of halos are widely used in current cosmological analyses. Many models predict halos purely from the local Eulerian matter density, yet bias models in perturbation theory require the inclusion of other local properties. We assess the validity of assuming that only the local dark matter density can be used to predict the number density of halos in a model-independent way and in the non-perturbative regime. Utilising $N$-body simulations, we study the properties of the halo counts field after spatial voxels with near-equal dark matter density have been permuted. If local-in-matter-density biasing were valid, the statistical properties of the permuted and un-permuted fields would be indistinguishable since both represent equally fair draws of the stochastic biasing model. For voxels of side length $\sim4-30\,h^{-1}{\rm\,Mpc}$ and for halos less massive than $\sim10^{15}\,h^{-1}{\rm\,M_\odot}$, we find that the permuted halo field has a scale-dependent bias with greater than 25% more power on scales relevant for current surveys. These bias models remove small-scale power by not modelling correlations between neighbouring voxels, which substantially boosts large-scale power to conserve the field's total variance. This conclusion is robust to the choice of initial conditions and cosmology. Assuming local-in-matter-density halo biasing cannot, therefore, reproduce the distribution of halos across a large range of scales and halo masses, no matter how complex the model. One must either allow the biasing to be a function of other quantities and/or remove the assumption that neighbouring voxels are statistically independent.


title: Robustness of graph embedding methods for community detection

abstract: This study investigates the robustness of graph embedding methods for community detection in the face of network perturbations, specifically edge deletions. Graph embedding techniques, which represent nodes as low-dimensional vectors, are widely used for various graph machine learning tasks due to their ability to capture structural properties of networks effectively. However, the impact of perturbations on the performance of these methods remains relatively understudied. The research considers state-of-the-art graph embedding methods from two families: matrix factorization (e.g., LE, LLE, HOPE, M-NMF) and random walk-based (e.g., DeepWalk, LINE, node2vec). Through experiments conducted on both synthetic and real-world networks, the study reveals varying degrees of robustness within each family of graph embedding methods. The robustness is found to be influenced by factors such as network size, initial community partition strength, and the type of perturbation. Notably, node2vec and LLE consistently demonstrate higher robustness for community detection across different scenarios, including networks with degree and community size heterogeneity. These findings highlight the importance of selecting an appropriate graph embedding method based on the specific characteristics of the network and the task at hand, particularly in scenarios where robustness to perturbations is crucial.

categories: physics.soc-ph cs.LG cs.SI physics.data-an


title: A Distributed Model Identification Algorithm for Multi-Agent Systems

abstract: In this study, we investigate agent-based approach for system model identification with an emphasis on power distribution system applications. Departing from conventional practices of relying on historical data for offline model identification, we adopt an online update approach utilizing real-time data by employing the latest data points for gradient computation. This methodology offers advantages including a large reduction in the communication network's bandwidth requirements by minimizing the data exchanged at each iteration and enabling the model to adapt in real-time to disturbances. Furthermore, we extend our model identification process from linear frameworks to more complex non-linear convex models. This extension is validated through numerical studies demonstrating improved control performance for a synthetic IEEE test case.


title: Engine-fed Kilonovae (Mergernovae) -- II. Radiation

abstract: The radioactive power generated by materials within the ejecta of a binary-neutron-star (BNS) merger powers an optical transient known as a kilonova. When the central remnant of a BNS merger is a long-lived magnetar, it continuously produces a highly magnetized wind, altering both the dynamics and temperature of the ejecta, leading to the expected emergence of an engine-fed kilonova. In the first paper of this series, we conducted a detailed study of the dynamics of wind-ejecta interaction and the efficiency of energy injection through shocks. In this work, we combine this dynamical evolution with both shock-heating and additional X-ray irradiation to model photon diffusion within a constant-opacity ejecta. By calculating the radiation, we obtain the light curve and spectral energy distribution (SED). Our findings reveal that, with energy injection, a blue bump typically appears in the early stages ($\lesssim 1$ day). Furthermore, if the magnetar has not spun down by that time, a brightening in the later stages occurs. Despite this, in a large parameter space, the expected luminosity of the engine-fed kilonova is not significantly higher than the typical r-process kilonova due to limited heating efficiency. The SED of engine-fed kilonovae peaks in the relatively blue band in the early stages and evolves towards the red, but at a slower rate compared to the typical r-process kilonova.


title: Vacancy-mediated transport and segregation tendencies of solutes in FCC nickel under diffusional creep: A density functional theory study

abstract: The Nabarro-Herring (N-H) diffusional creep theory postulates the vacancy-mediated transport of atoms under a stress gradient as the creep mechanism under low-stress and high-temperature conditions. In multicomponent alloys, we premise that this stress-assisted flow of vacancies to and from grain boundaries will produce elemental segregation. An observation of such segregation, validated with theoretical predictions, can provide the necessary experimental evidence for the occurrence of N-H creep. Theoretical calculations of the segregation tendencies via analyzing the dominant solute diffusion mechanisms and the difference in diffusivities of the elements are therefore essential. To this end, this study applies density functional theory calculations of migration barriers and solute-vacancy binding energies as input to the self-consistent mean field theory to assess the vacancy-mediated diffusion mechanisms, transport coefficients, and segregation tendencies of Co, Cr, Mo, Re, Ta, and W solutes in face-centered cubic Ni. We find Co, Re, and W to be slow diffusers at high temperatures and Cr, Mo, and Ta to be fast diffusers. Further analysis shows that the slow diffusers tend to always enrich at vacancy sinks over a wide range of temperatures. In contrast, the fast diffusers show a transition from depletion to enrichment as the temperature lowers. Furthermore, our analysis of the segregation tendencies under tensile hydrostatic strains shows that slow diffusers are largely unaffected by the strain and favor enrichment. On the other hand, the fast diffusers exhibit high sensitivity to strain and their segregation tendency can transition from depletion to enrichment at a given temperature. The transport coefficients calculated in this work are expected to serve as input to mesoscale microstructure models to provide a more rigorous assessment of solute segregation under N-H creep conditions.


title: Stochastic fluids with transport noise: Approximating diffusion from data using SVD and ensemble forecast back-propagation

abstract: We introduce and test methods for the calibration of the diffusion term in Stochastic Partial Differential Equations (SPDEs) describing fluids. We take two approaches, one uses ideas from the singular value decomposition and the Biot-Savart law. The other backpropagates through an ensemble forecast, with respect to diffusion parameters, to minimise a probabilistic ensemble forecasting metric. We describe the approaches in the specific context of solutions to SPDEs describing the evolution of fluid particles, sometimes called inviscid vortex methods. The methods are tested in an idealised setting in which the reference data is a known realisation of the parameterised SPDE, and also using a forecast verification metric known as the Continuous Rank Probability Score (CRPS).


title: Tomography of flavoured leptogenesis with primordial blue gravitational waves

abstract: We explore a scenario where an early epoch of matter domination is driven by the mass scale $M_N$ of the right-handed neutrinos, which also characterizes the different flavour regimes of leptogenesis. Such a matter-domination epoch gives rise to peculiar spectral imprints on primordial Gravitational Waves (GWs) produced during inflation. We point out that the characteristic spectral features are detectable in multiple frequency bands with current and future GW experiments in case of Blue GWs (BGWs) described by a power-law with a positive spectral index $(n_T >0)$ and an amplitude compatible with Cosmic Microwave Background (CMB) measurements. We find that the three-flavour leptogenesis regime with $M_N \lesssim 10^9~{\rm GeV}$ imprints BGWs more prominently than the two-flavour and one-flavour regimes characterized by a higher right-neutrino mass scale. In particular, a two-flavour (three-flavour) leptogenesis regime is expected to leave distinct imprints in the mHz ($\mu$Hz) band. Moreover, we translate the current Big Bang Nucleosynthesis (BBN) and LIGO limits on the GW energy density into constraints on the flavour leptogenesis parameter space for different GW spectral index $n_T$. Interestingly, a three-flavour leptogenesis regime can offer a unique signal testable in the next LIGO run with a correlated signature in the PTA frequency band with an amplitude comparable to the one expected from supermassive black holes.


title: From Empirical Observations to Universality: Dynamics of Deep Learning with Inputs Built on Gaussian mixture

abstract: This study broadens the scope of theoretical frameworks in deep learning by delving into the dynamics of neural networks with inputs that demonstrate the structural characteristics to Gaussian Mixture (GM). We analyzed how the dynamics of neural networks under GM-structured inputs diverge from the predictions of conventional theories based on simple Gaussian structures. A revelation of our work is the observed convergence of neural network dynamics towards conventional theory even with standardized GM inputs, highlighting an unexpected universality. We found that standardization, especially in conjunction with certain nonlinear functions, plays a critical role in this phenomena. Consequently, despite the complex and varied nature of GM distributions, we demonstrate that neural networks exhibit asymptotic behaviors in line with predictions under simple Gaussian frameworks.

categories: stat.ML cond-mat.dis-nn cond-mat.stat-mech cs.LG


title: Electronic and Optical Excitations in van der Waals Materials from a Non-Empirical Wannier-Localized Optimally-Tuned Screened Range-Separated Hybrid Functional

abstract: Accurate prediction of electronic and optical excitations in van der Waals (vdW) materials is a long-standing challenge for density functional theory. The recently proposed Wannier-localized optimally-tuned screened range-separated hybrid (WOT-SRSH) functional has proven successful in non-empirical determination of electronic band gaps and optical absorption spectra for various covalent and ionic crystals. However, for vdW materials the tuning of the material- and structure-dependent functional parameters has, until now, only been attained semi-empirically. Here, we present a non-empirical WOT-SRSH approach applicable to vdW materials, with the optimal functional parameters transferable between monolayer and bulk. We apply this methodology to prototypical vdW materials: black phosphorus, molybdenum disulfide, and hexagonal boron nitride (in the latter case including zero-point renormalization). We show that the WOT-SRSH approach consistently achieves accuracy levels comparable to experiments and ab initio many-body perturbation theory (MBPT) calculations for band structures and optical absorption spectra, both on its own and as an optimal starting point for MBPT calculations.


title: ConstrainedZero: Chance-Constrained POMDP Planning using Learned Probabilistic Failure Surrogates and Adaptive Safety Constraints

abstract: To plan safely in uncertain environments, agents must balance utility with safety constraints. Safe planning problems can be modeled as a chance-constrained partially observable Markov decision process (CC-POMDP) and solutions often use expensive rollouts or heuristics to estimate the optimal value and action-selection policy. This work introduces the ConstrainedZero policy iteration algorithm that solves CC-POMDPs in belief space by learning neural network approximations of the optimal value and policy with an additional network head that estimates the failure probability given a belief. This failure probability guides safe action selection during online Monte Carlo tree search (MCTS). To avoid overemphasizing search based on the failure estimates, we introduce $\Delta$-MCTS, which uses adaptive conformal inference to update the failure threshold during planning. The approach is tested on a safety-critical POMDP benchmark, an aircraft collision avoidance system, and the sustainability problem of safe CO$_2$ storage. Results show that by separating safety constraints from the objective we can achieve a target level of safety without optimizing the balance between rewards and costs.


title: Gradient-based Automatic Per-Weight Mixed Precision Quantization for Neural Networks On-Chip

abstract: Model size and inference speed at deployment time, are major challenges in many deep learning applications. A promising strategy to overcome these challenges is quantization. However, a straightforward uniform quantization to very low precision can result in significant accuracy loss. Mixed-precision quantization, based on the idea that certain parts of the network can accommodate lower precision without compromising performance compared to other parts, offers a potential solution. In this work, we present High Granularity Quantization (HGQ), an innovative quantization-aware training method designed to fine-tune the per-weight and per-activation precision in an automatic way for ultra-low latency and low power neural networks which are to be deployed on FPGAs. We demonstrate that HGQ can outperform existing methods by a substantial margin, achieving resource reduction by up to a factor of 20 and latency improvement by a factor of 5 while preserving accuracy.


title: Learning to Compose: Improving Object Centric Learning by Injecting Compositionality

abstract: Learning compositional representation is a key aspect of object-centric learning as it enables flexible systematic generalization and supports complex visual reasoning. However, most of the existing approaches rely on auto-encoding objective, while the compositionality is implicitly imposed by the architectural or algorithmic bias in the encoder. This misalignment between auto-encoding objective and learning compositionality often results in failure of capturing meaningful object representations. In this study, we propose a novel objective that explicitly encourages compositionality of the representations. Built upon the existing object-centric learning framework (e.g., slot attention), our method incorporates additional constraints that an arbitrary mixture of object representations from two images should be valid by maximizing the likelihood of the composite data. We demonstrate that incorporating our objective to the existing framework consistently improves the objective-centric learning and enhances the robustness to the architectural choices.


title: Screening of BindingDB database ligands against EGFR, HER2, Estrogen, Progesterone and NF-kB receptors based on machine learning and molecular docking

abstract: Breast cancer, the second most prevalent cancer among women worldwide, necessitates the exploration of novel therapeutic approaches. To target the four subgroups of breast cancer "hormone receptor-positive and HER2-negative, hormone receptor-positive and HER2-positive, hormone receptor-negative and HER2-positive, and hormone receptor-negative and HER2-negative" it is crucial to inhibit specific targets such as EGFR, HER2, ER, NF-kB, and PR. In this study, we evaluated various methods for binary and multiclass classification. Among them, the GA-SVM-SVM:GA-SVM-SVM model was selected with an accuracy of 0.74, an F1-score of 0.73, and an AUC of 0.94 for virtual screening of ligands from the BindingDB database. This model successfully identified 4454, 803, 438, and 378 ligands with over 90% precision in both active/inactive and target prediction for the classes of EGFR+HER2, ER, NF-kB, and PR, respectively, from the BindingDB database. Based on to the selected ligands, we created a dendrogram that categorizes different ligands based on their targets. This dendrogram aims to facilitate the exploration of chemical space for various therapeutic targets. Ligands that surpassed a 90% threshold in the product of activity probability and correct target selection probability were chosen for further investigation using molecular docking. The binding energy range for these ligands against their respective targets was calculated to be between -15 and -5 kcal/mol. Finally, based on general and common rules in medicinal chemistry, we selected 2, 3, 3, and 8 new ligands with high priority for further studies in the EGFR+HER2, ER, NF-kB, and PR classes, respectively.


title: HalluVault: A Novel Logic Programming-aided Metamorphic Testing Framework for Detecting Fact-Conflicting Hallucinations in Large Language Models

abstract: Large language models (LLMs) have transformed the landscape of language processing, yet struggle with significant challenges in terms of security, privacy, and the generation of seemingly coherent but factually inaccurate outputs, commonly referred to as hallucinations. Among these challenges, one particularly pressing issue is Fact-Conflicting Hallucination (FCH), where LLMs generate content that directly contradicts established facts. Tackling FCH poses a formidable task due to two primary obstacles: Firstly, automating the construction and updating of benchmark datasets is challenging, as current methods rely on static benchmarks that don't cover the diverse range of FCH scenarios. Secondly, validating LLM outputs' reasoning process is inherently complex, especially with intricate logical relations involved. In addressing these obstacles, we propose an innovative approach leveraging logic programming to enhance metamorphic testing for detecting Fact-Conflicting Hallucinations (FCH). Our method gathers data from sources like Wikipedia, expands it with logical reasoning to create diverse test cases, assesses LLMs through structured prompts, and validates their coherence using semantic-aware assessment mechanisms. Our method generates test cases and detects hallucinations across six different LLMs spanning nine domains, revealing hallucination rates ranging from 24.7% to 59.8%. Key observations indicate that LLMs encounter challenges, particularly with temporal concepts, handling out-of-distribution knowledge, and exhibiting deficiencies in logical reasoning capabilities. The outcomes underscore the efficacy of logic-based test cases generated by our tool in both triggering and identifying hallucinations. These findings underscore the imperative for ongoing collaborative endeavors within the community to detect and address LLM hallucinations.


title: Electronic Coherences in Molecules: The Projected Nuclear Quantum Momentum as a Hidden Agent

abstract: Electronic coherences are key to understanding and controlling photo-induced molecular transformations. We identify a crucial quantum-mechanical feature of electron-nuclear correlation, the projected nuclear quantum momenta, essential to capture the correct coherence behavior. In simulations, we show that, unlike traditional trajectory-based schemes, exact-factorization-based methods approximate these correlation terms, and correctly capture electronic coherences in a range of situations, including their spatial dependence, an important aspect that influences subsequent electron dynamics and that is becoming accessible in more experiments.


title: Grains of Saliency: Optimizing Saliency-based Training of Biometric Attack Detection Models

abstract: Incorporating human-perceptual intelligence into model training has shown to increase the generalization capability of models in several difficult biometric tasks, such as presentation attack detection (PAD) and detection of synthetic samples. After the initial collection phase, human visual saliency (e.g., eye-tracking data, or handwritten annotations) can be integrated into model training through attention mechanisms, augmented training samples, or through human perception-related components of loss functions. Despite their successes, a vital, but seemingly neglected, aspect of any saliency-based training is the level of salience granularity (e.g., bounding boxes, single saliency maps, or saliency aggregated from multiple subjects) necessary to find a balance between reaping the full benefits of human saliency and the cost of its collection. In this paper, we explore several different levels of salience granularity and demonstrate that increased generalization capabilities of PAD and synthetic face detection can be achieved by using simple yet effective saliency post-processing techniques across several different CNNs.


title: The Geometry of Loop Spaces II: Corrections

abstract: This paper contains corrections to Madea, Rosenberg, Torres-Ardila, "The Geometry of Loop Spaces II: Characteristic Classes," Advances in Math. (287), 2016, 485-518. The main change is that results about $\pi_1({\rm Diff}(M))$ are replaced by results about $\pi_1({\rm Isom}(M))$, where Diff$(M)$, Isom$(M)$ refer to the diffeomorphism and isometry group of the manifold $M$.


title: Interplay between domain walls and magnetization curling induced by chemical modulations in cylindrical nanowires

abstract: Cylindrical magnetic nanowires have been proposed as a means of storing and processing information in a 3D medium, based on the motion of domain walls~(DWs). Introducing short chemical modulations in such wires would allow for reliable digital control of DWs. Here, we outline the intricate physics of the interaction of domain walls with modulations to control their motion, combining micromagnetic simulations and experimental evidence. This interaction combines a long-range moderate magnetostatic repulsion with a local energy well. The latter depends on the respective circulation sense of magnetization in the domain wall and modulation. We also show that a modulation has the ability to switch the internal circulation of a DW upon its propagation, thereby acting as a polarizing component and opening the possibility to exploit not only the position of walls, but also their internal structure.


title: Particle scale anisotropy controls bulk properties in sheared granular materials

abstract: The bulk dynamics of dense granular materials arise through a combination of particle-scale and mesoscale effects. Theoretical and numerical studies have shown that collective effects are created by particle-scale anisotropic structures such as grain connectivity (fabric), force transmission, and frictional mobilization, all of which influence bulk properties like bulk friction and the stress tensor through the Stress-Force-Fabric (SFF) relationship. To date, establishing the relevance of these effects to laboratory systems has remained elusive due to the challenge of measuring both normal and frictional contact forces at the particle scale. In this study, we perform experiments on a sheared photoelastic granular system in an quasi-2D annular (Couette) cell. During these experiments, we measure particle locations, contacts, and normal and frictional forces vectors during loading. We reconstruct the angular distributions of the contact and force vectors, and extract the corresponding emergent anisotropies for each of these metrics. Finally, we show that the SFF relation quantitatively predicts the relationship between particle scale anisotropies, the stress tensor components, and the bulk friction coefficient, capturing even transient behaviors. As such, this method shows promise for application to other dense particulate systems where fabric anisotropy can provide a useful measure of bulk friction.


title: Large deviations of current for the symmetric simple exclusion process on a semi-infinite line and on an infinite line with a slow bond

abstract: Two of the most influential exact results in classical one-dimensional diffusive transport are about current statistics for the symmetric simple exclusion process in the stationary state on a finite line coupled with two unequal reservoirs at the boundary, and in the non-stationary state on an infinite line. We present the corresponding result for the intermediate geometry of a semi-infinite line coupled with a single reservoir. This result is obtained using the fluctuating hydrodynamics approach of macroscopic fluctuation theory and confirmed by rare event simulations using a cloning algorithm. Our exact result enables us to address the corresponding problem on an infinite line in the presence of a slow bond and several related problems.


title: Linearly simplified QAOA parameters and transferability

abstract: Quantum Approximate Optimization Algorithm (QAOA) provides a way to solve combinatorial optimization problems using quantum computers. QAOA circuits consist of time evolution operators by the cost Hamiltonian and of state mixing operators, and embedded variational parameter for each operator is tuned so that the expectation value of the cost function is minimized. The optimization of the variational parameters is taken place on classical devices while the cost function is measured in the sense of quantum. To facilitate the classical optimization, there are several previous works on making decision strategies for optimal/initial parameters and on extracting similarities among instances. In our current work, we consider simplified QAOA parameters that take linear forms along with the depth in the circuit. Such a simplification, which would be suggested from an analogy to quantum annealing, leads to a drastic reduction of the parameter space from 2p to 4 dimensions with the any number of QAOA layers p. In addition, cost landscapes in the reduced parameter space have some stability on differing instances. This fact suggests that an optimal parameter set for a given instance can be transferred to other instances. In this paper we present some numerical results that are obtained for instances of the random Ising model and of the max-cut problem. The transferability of linearized parameters is demonstrated for randomly generated source and destination instances, and its dependence on features of the instances are investigated.


title: Shape optimization of slip-driven axisymmetric microswimmers

abstract: In this work, we develop a computational framework that aims at simultaneously optimizing the shape and the slip velocity of an axisymmetric microswimmer suspended in a viscous fluid. We consider shapes of a given reduced volume that maximize the swimming efficiency, i.e., the (size-independent) ratio of the power loss arising from towing the rigid body of the same shape and size at the same translation velocity to the actual power loss incurred by swimming via the slip velocity. The optimal slip and efficiency (with shape fixed) are here given in terms of two Stokes flow solutions, and we then establish shape sensitivity formulas of adjoint-solution that provide objective function derivatives with respect to any set of shape parameters on the sole basis of the above two flow solutions. Our computational treatment relies on a fast and accurate boundary integral solver for solving all Stokes flow problems. We validate our analytic shape derivative formulas via comparisons against finite-difference gradient evaluations, and present several shape optimization examples.


title: RST-LoRA: A Discourse-Aware Low-Rank Adaptation for Long Document Abstractive Summarization

abstract: For long document summarization, discourse structure is important to discern the key content of the text and the differences in importance level between sentences. Unfortunately, the integration of rhetorical structure theory (RST) into parameter-efficient fine-tuning strategies for long document summarization remains unexplored. Therefore, this paper introduces RST-LoRA and proposes four RST-aware variants to explicitly incorporate RST into the LoRA model. Our empirical evaluation demonstrates that incorporating the type and uncertainty of rhetorical relations can complementarily enhance the performance of LoRA in summarization tasks. Furthermore, the best-performing variant we introduced outperforms the vanilla LoRA and full-parameter fine-tuning models, as confirmed by multiple automatic and human evaluations, and even surpasses previous state-of-the-art methods.


title: A Note on Large Sums of Divisor-Bounded Multiplicative Functions

abstract: Given a multiplicative function $f$, we let $S(x,f)=\sum_{n\leq x}f(n)$ be the associated partial sum. In this note, we show that lower bounds on partial sums of divisor-bounded functions result in lower bounds on the partial sums associated to their products. More precisely, we let $f_j$, $j=1,2$ be such that $|f_j(n)|\leq \tau(n)^\kappa$ for some $\kappa\in\mathbb{N}$, and assume their partial sums satisfy $\left|S(x_j,f_j)\right|\geq \eta x_j (\log x_j)^{2^\kappa-1}$ for some $x_1, x_2\gg 1$ and $\eta>\max_j\{(\log x_j)^{-1/100}\}$. We then show that there exists $x\geq \min\{x_1, x_2\}^{\xi^2}$ such that $\left|S(x,f_1f_2)\right|\geq \xi x (\log x)^{2^{2\kappa}-1}$, where $\xi=C\eta^{1+2^{\kappa+3}}$ for some absolute constant $C>0$.


title: NLU-STR at SemEval-2024 Task 1: Generative-based Augmentation and Encoder-based Scoring for Semantic Textual Relatedness

abstract: Semantic textual relatedness is a broader concept of semantic similarity. It measures the extent to which two chunks of text convey similar meaning or topics, or share related concepts or contexts. This notion of relatedness can be applied in various applications, such as document clustering and summarizing. SemRel-2024, a shared task in SemEval-2024, aims at reducing the gap in the semantic relatedness task by providing datasets for fourteen languages and dialects including Arabic. This paper reports on our participation in Track A (Algerian and Moroccan dialects) and Track B (Modern Standard Arabic). A BERT-based model is augmented and fine-tuned for regression scoring in supervised track (A), while BERT-based cosine similarity is employed for unsupervised track (B). Our system ranked 1st in SemRel-2024 for MSA with a Spearman correlation score of 0.49. We ranked 5th for Moroccan and 12th for Algerian with scores of 0.83 and 0.53, respectively.


title: Connecting Infinity to Soft Factors

abstract: In this note we study tree-level scattering amplitudes of gravitons under a natural deformation which in the large $z$ limit can be interpreted either as a $k$-hard-particle limit or as a $(n-k)$-soft-particle limit. When $k=2$ this becomes the standard BCFW deformation while for $k=3$ it leads to the Risager deformation. The hard- to soft-limit map we define motivates a way of computing the leading order behavior of amplitudes for large $z$ directly from soft limits. We check the proposal by applying the $k=3$ and $k=4$ versions to NMHV and N$^2$MHV gravity amplitudes respectively. The former reproduces in a few lines the result recently obtained by using CHY-like techniques in \cite{BCL}. The N$^2$MHV formula is also remarkably simple and we give support for it using a CHY-like computation. In the $k=2$ case applied to any gravity amplitude, the multiple soft-limit analysis reproduces the correct ${\cal O}(z^{-2})$ behavior while explicitly showing the source of the mysterious cancellation among Feynman diagrams that tames the behavior from the ${\cal O}(z^{n-5})$ of individual Feynman diagrams down to the ${\cal O}(z^{-2})$ of the amplitude.


title: Towards quantum gravity with neural networks: Solving quantum Hamilton constraints of 3d Euclidean gravity in the weak coupling limit

abstract: We consider 3-dimensional Euclidean gravity in the weak coupling limit of Smolin and show that it is BF-theory with $\text{U(1)}^3$ as a Lie group. The theory is quantised using loop quantum gravity methods. The kinematical degrees of freedom are truncated, on account of computational feasibility, by fixing a graph and deforming the algebra of the holonomies to impose a cutoff on the charge vectors. This leads to a quantum theory related to $\text{U}_q \text{(1)}^3$ BF-theory. The effect of imposing the cutoff on the charges is examined. We also implement the quantum volume operator of 3d loop quantum gravity. Most importantly we compare two constraints for the quantum model obtained: a master constraint enforcing curvature and Gauss constraint, as well as a combination of a quantum Hamilton constraint constructed using Thiemann's strategy and the Gauss master constraint. The two constraints are solved using the neural network quantum state ansatz, demonstrating its ability to explore models which are out of reach for exact numerical methods. The solutions spaces are quantitatively compared and although the forms of the constraints are radically different, the solutions turn out to have a surprisingly large overlap. We also investigate the behavior of the quantum volume in solutions to the constraints.