title: Large language models and linguistic intentionality

abstract: Do large language models like Chat-GPT or LLaMa meaningfully use the words they produce? Or are they merely clever prediction machines, simulating language use by producing statistically plausible text? There have already been some initial attempts to answer this question by showing that these models meet the criteria for entering meaningful states according to metasemantic theories of mental content. In this paper, I will argue for a different approach - that we should instead consider whether language models meet the criteria given by our best metasemantic theories of linguistic content. In that vein, I will illustrate how this can be done by applying two such theories to the case of language models: Gareth Evans' (1982) account of naming practices and Ruth Millikan's (1984, 2004, 2005) teleosemantics. In doing so, I will argue that it is a mistake to think that the failure of LLMs to meet plausible conditions for mental intentionality thereby renders their outputs meaningless, and that a distinguishing feature of linguistic intentionality - dependency on a pre-existing linguistic system - allows for the plausible result LLM outputs are meaningful.


title: Transformers, Contextualism, and Polysemy

abstract: The transformer architecture, introduced by Vaswani et al. (2017), is at the heart of the remarkable recent progress in the development of language models, including famous chatbots such as Chat-gpt and Bard. In this paper, I argue that we an extract from the way the transformer architecture works a picture of the relationship between context and meaning. I call this the transformer picture, and I argue that it is a novel with regard to two related philosophical debates: the contextualism debate regarding the extent of context-sensitivity across natural language, and the polysemy debate regarding how polysemy should be captured within an account of word meaning. Although much of the paper merely tries to position the transformer picture with respect to these two debates, I will also begin to make the case for the transformer picture.


title: Recall-Augmented Ranking: Enhancing Click-Through Rate Prediction Accuracy with Cross-Stage Data

abstract: Click-through rate (CTR) prediction plays an indispensable role in online platforms. Numerous models have been proposed to capture users' shifting preferences by leveraging user behavior sequences. However, these historical sequences often suffer from severe homogeneity and scarcity compared to the extensive item pool. Relying solely on such sequences for user representations is inherently restrictive, as user interests extend beyond the scope of items they have previously engaged with. To address this challenge, we propose a data-driven approach to enrich user representations. We recognize user profiling and recall items as two ideal data sources within the cross-stage framework, encompassing the u2u (user-to-user) and i2i (item-to-item) aspects respectively. In this paper, we propose a novel architecture named Recall-Augmented Ranking (RAR). RAR consists of two key sub-modules, which synergistically gather information from a vast pool of look-alike users and recall items, resulting in enriched user representations. Notably, RAR is orthogonal to many existing CTR models, allowing for consistent performance improvements in a plug-and-play manner. Extensive experiments are conducted, which verify the efficacy and compatibility of RAR against the SOTA methods.


title: Modelling Language

abstract: This paper argues that large language models have a valuable scientific role to play in serving as scientific models of a language. Linguistic study should not only be concerned with the cognitive processes behind linguistic competence, but also with language understood as an external, social entity. Once this is recognized, the value of large language models as scientific models becomes clear. This paper defends this position against a number of arguments to the effect that language models provide no linguistic insight. It also draws upon recent work in philosophy of science to show how large language models could serve as scientific models.


title: The metric for matrix degenerate Kato square root operators

abstract: We prove a Kato square root estimate with anisotropically degenerate matrix coefficients. We do so by doing the harmonic analysis using an auxiliary Riemannian metric adapted to the operator. We also derive $L^2$-solvability estimates for boundary value problems for divergence form elliptic equations with matrix degenerate coefficients. Main tools are chain rules and Piola transformations for fields in matrix weighted $L^2$ spaces, under $W^{1,1}$ homeomorphism.


title: The central limit theorem for sum-functions of m-tuples of spacings

abstract: Let n points be taken at random on a circle of unit circumference and clockwise ordered. Uniform spacings are defined as the clockwise arc-lengths between the successive points from this sample. We are interested in the asymptotic behavior of the sum of functions of the m-tuples of successive spacings under the assumption that m can grow together with n. Asymptotic formulas for the expectation and variance of the sum and its asymptotic normality are established.


title: Stokes phenomenon of Kloosterman and Airy connections

abstract: We define categories of Stokes filtered and Stokes graded $G$-local systems for reductive groups $G$ and use the formalism of Tannakian categories to show that they are equivalent to the category of $G$-connections. We then use the interpretation of moduli spaces of Stokes filtered $G$-local systems as braid varieties to prove physical rigidity of two well-known families of cohomologically rigid connections, the Kloosterman and Airy connections. In the Kloosterman case, our proof relies on Steinberg's cross-section.


title: Dispersionless Flat Mode and Vibrational Anomaly in Active Brownian Vibrators Induced by String-like Dynamical Defects

abstract: In recent years, active Brownian particles have emerged as a prominent model system for comprehending the behaviors of active matter, wherein particles demonstrate self-propelled motion by harnessing energy from the surrounding environment. A fundamental objective of studying active matter is to elucidate the physical mechanisms underlying its collective behaviors. Drawing inspiration from advancements in molecular glasses, our study unveils a low-energy ``flat mode" within the transverse spectrum of active Brownian vibrators -- a nearly two-dimensional, bi-disperse granular assembly. We demonstrate that this collective excitation induces an anomalous excess in the vibrational density of states (VDOS) beyond the phononic Debye contribution. Additionally, we establish through empirical evidence that string-like dynamical defects, discerned via the spatial distribution of each particle's contribution to the reduced transverse VDOS, serve as the microscopic origin of the flat mode and its associated anomalies. These findings underscore the pivotal role of string-like dynamical defects in elucidating the vibrational and mechanical properties of active Brownian particles.


title: GeoSACS: Geometric Shared Autonomy via Canal Surfaces

abstract: We introduce GeoSACS, a geometric framework for shared autonomy (SA). In variable environments, SA methods can be used to combine robotic capabilities with real-time human input in a way that offloads the physical task from the human. To remain intuitive, it can be helpful to simplify requirements for human input (i.e., reduce the dimensionality), which create challenges for to map low-dimensional human inputs to the higher dimensional control space of robots without requiring large amounts of data. We built GeoSACS on canal surfaces, a geometric framework that represents potential robot trajectories as a canal from as few as two demonstrations. GeoSACS maps user corrections on the cross-sections of this canal to provide an efficient SA framework. We extend canal surfaces to consider orientation and update the control frames to support intuitive mapping from user input to robot motions. Finally, we demonstrate GeoSACS in two preliminary studies, including a complex manipulation task where a robot loads laundry into a washer.


title: Pseudo-label Learning with Calibrated Confidence Using an Energy-based Model

abstract: In pseudo-labeling (PL), which is a type of semi-supervised learning, pseudo-labels are assigned based on the confidence scores provided by the classifier; therefore, accurate confidence is important for successful PL. In this study, we propose a PL algorithm based on an energy-based model (EBM), which is referred to as the energy-based PL (EBPL). In EBPL, a neural network-based classifier and an EBM are jointly trained by sharing their feature extraction parts. This approach enables the model to learn both the class decision boundary and input data distribution, enhancing confidence calibration during network training. The experimental results demonstrate that EBPL outperforms the existing PL method in semi-supervised image classification tasks, with superior confidence calibration error and recognition accuracy.


title: Mitigating the Curse of Dimensionality for Certified Robustness via Dual Randomized Smoothing

abstract: Randomized Smoothing (RS) has been proven a promising method for endowing an arbitrary image classifier with certified robustness. However, the substantial uncertainty inherent in the high-dimensional isotropic Gaussian noise imposes the curse of dimensionality on RS. Specifically, the upper bound of ${\ell_2}$ certified robustness radius provided by RS exhibits a diminishing trend with the expansion of the input dimension $d$, proportionally decreasing at a rate of $1/\sqrt{d}$. This paper explores the feasibility of providing ${\ell_2}$ certified robustness for high-dimensional input through the utilization of dual smoothing in the lower-dimensional space. The proposed Dual Randomized Smoothing (DRS) down-samples the input image into two sub-images and smooths the two sub-images in lower dimensions. Theoretically, we prove that DRS guarantees a tight ${\ell_2}$ certified robustness radius for the original input and reveal that DRS attains a superior upper bound on the ${\ell_2}$ robustness radius, which decreases proportionally at a rate of $(1/\sqrt m + 1/\sqrt n )$ with $m+n=d$. Extensive experiments demonstrate the generalizability and effectiveness of DRS, which exhibits a notable capability to integrate with established methodologies, yielding substantial improvements in both accuracy and ${\ell_2}$ certified robustness baselines of RS on the CIFAR-10 and ImageNet datasets. Code is available at https://github.com/xiasong0501/DRS.


title: German Tourism Knowledge Graph

abstract: Tourism is one of the most critical sectors of the global economy. Due to its heterogeneous and fragmented nature, it provides one of the most suitable use cases for knowledge graphs. In this poster, we introduce the German Tourism Knowledge Graph that integrates tourism-related data from 16 federal states of Germany and various other sources to provide a curated knowledge source for various applications. It is publicly available through GUIs and an API.


title: On variable Lebesgue spaces and generalized nonlinear heat equations

abstract: In this work we address some questions concerning the Cauchy problem for a generalized nonlinear heat equations considering as functional framework the variable Lebesgue spaces $L^{p(\cdot)}(\mathbb{R}^n)$. More precisely, by mixing some structural properties of these spaces with decay estimates of the fractional heat kernel, we were able to prove two well-posedness results for these equations. In a first theorem, we prove the existence and uniqueness of global-in-time mild solutions in the mixed-space $\mathcal{L}^{p(\cdot)}_{ \frac{nb}{2\alpha - \langle 1 \rangle_\gamma} } (\mathbb{R}^n,L^\infty([0,T[ ))$. On the other hand, by introducing a new class of variable exponents, we demonstrate the existence of an unique local-in-time mild solution in the space $L^{p(\cdot)} \left( [0,T], L^{q} (\mathbb{R}^3) \right)$.


title: Large deviation principle at speed $n^d$ for the random metric in first-passage percolation

abstract: We consider the standard first passage percolation model on $\mathbb Z^d$ with bounded and bounded away from zero weights. We show that the rescaled passage time $\widetilde{\mathbf T}_{n,X}$ restricted to a compact set $X$ satisfies a large deviation principle (LDP) at speed $n^d$ in a space of geodesic metrics, i.e. an estimation of the form $\mathbb P\left( \widetilde {\mathbf T}_{n,X } \approx D \right)\approx\exp\left(-I(D)n^d \right)$ for any metric $D$. Moreover, $I(D)$ can be written as the integral over $X$ of an elementary cost. Consequences include LDPs at speed $n^d$ for the point--point passage time, the face--face passage time and the random ball of radius $n$. Our strategy consists in proving the existence of $\lim_{n\to\infty}-\frac{1}{n^d}\log \mathbb P \left(\widetilde{\mathbf T}_{n,[0,1]^d} \approx g \right)$ for any norm $g$ with a multidimensional subaddivity argument, then using this result as an elementary building block to estimate $\mathbb P \left( \widetilde{\mathbf T}_{n,X} \approx D \right) $ for any metric $D$.


title: On Models and Approaches for Human Vital Signs Extraction from Short Range Radar Signals

abstract: The paper centres on an assessment of the modelling approaches for the processing of signals in CW and FMCW radar-based systems for the detection of vital signs. It is shown that the use of the widely adopted phase extraction method, which relies on the approximation of the target as a single point scatterer, has limitations in respect of the simultaneous estimation of both respiratory and heart rates. A method based on a velocity spectrum is proposed as an alternative with the ability to treat a wider range of application scenarios.


title: 3D Gaussian Splatting as Markov Chain Monte Carlo

abstract: While 3D Gaussian Splatting has recently become popular for neural rendering, current methods rely on carefully engineered cloning and splitting strategies for placing Gaussians, which can lead to poor-quality renderings, and reliance on a good initialization. In this work, we rethink the set of 3D Gaussians as a random sample drawn from an underlying probability distribution describing the physical representation of the scene-in other words, Markov Chain Monte Carlo (MCMC) samples. Under this view, we show that the 3D Gaussian updates can be converted as Stochastic Gradient Langevin Dynamics (SGLD) updates by simply introducing noise. We then rewrite the densification and pruning strategies in 3D Gaussian Splatting as simply a deterministic state transition of MCMC samples, removing these heuristics from the framework. To do so, we revise the 'cloning' of Gaussians into a relocalization scheme that approximately preserves sample probability. To encourage efficient use of Gaussians, we introduce a regularizer that promotes the removal of unused Gaussians. On various standard evaluation scenes, we show that our method provides improved rendering quality, easy control over the number of Gaussians, and robustness to initialization.


title: The "C": The large Chameleon-Musca-Coalsack cloud

abstract: Recent advancements in 3D dust mapping have transformed our understanding of the Milky Way's local interstellar medium (ISM), enabling us to explore its structure in three spatial dimensions for the first time. In this letter, we use the Edenhofer et al. (2023) 3D dust map to study the well-known Chameleon, Musca, and Coalsack cloud complexes, located about 200 pc from the Sun. We find that these three complexes are not isolated but rather connect to form a surprisingly well-defined half-ring, constituting a single "C"-shaped cloud with a radius of about 50 pc, a thickness of about 45 pc, and a total mass of about $9 \times 10^{4}~\mathrm{M}_{\odot}$. Despite the absence of an evident feedback source at its center, the dynamics of young stellar clusters associated with the "C" structure suggest that a single supernova explosion about 4 Myr to 10 Myr ago likely shaped this structure. Our findings support a single origin story for these cloud complexes, suggesting that they were formed by feedback-driven gas compression. This interpretation challenges scenarios in which magnetic fields are the primary drivers behind the formation of star-forming molecular clouds in this region, offering new insights into the processes that govern the birth of star-forming clouds in feedback-dominated regions, such as Sco-Cen.


title: Improving Recall of Large Language Models: A Model Collaboration Approach for Relational Triple Extraction

abstract: Relation triple extraction, which outputs a set of triples from long sentences, plays a vital role in knowledge acquisition. Large language models can accurately extract triples from simple sentences through few-shot learning or fine-tuning when given appropriate instructions. However, they often miss out when extracting from complex sentences. In this paper, we design an evaluation-filtering framework that integrates large language models with small models for relational triple extraction tasks. The framework includes an evaluation model that can extract related entity pairs with high precision. We propose a simple labeling principle and a deep neural network to build the model, embedding the outputs as prompts into the extraction process of the large model. We conduct extensive experiments to demonstrate that the proposed method can assist large language models in obtaining more accurate extraction results, especially from complex sentences containing multiple relational triples. Our evaluation model can also be embedded into traditional extraction models to enhance their extraction precision from complex sentences.


title: Trinomials with high differential uniformity

abstract: The context of this work is the study of the differential uniformity of polynomials defined over finite fields of even characteristic. We provide infinite families of trinomials with high differential uniformity when the base field is large enough. It means in particular that these trinomials are not exceptional almost perfect nonlinear.


title: Building Semantic Communication System via Molecules: An End-to-End Training Approach

abstract: The concept of semantic communication provides a novel approach for applications in scenarios with limited communication resources. In this paper, we propose an end-to-end (E2E) semantic molecular communication system, aiming to enhance the efficiency of molecular communication systems by reducing the transmitted information. Specifically, following the joint source channel coding paradigm, the network is designed to encode the task-relevant information into the concentration of the information molecules, which is robust to the degradation of the molecular communication channel. Furthermore, we propose a channel network to enable the E2E learning over the non-differentiable molecular channel. Experimental results demonstrate the superior performance of the semantic molecular communication system over the conventional methods in classification tasks.


title: About some properties of the canonical density matrix versus the canonical Bloch equation

abstract: We examine some properties of the non-normalized (or canonical) density matrix in the coherent states representation, by two equivalent ways. On the one hand by its definition, and on the other hand as a solution to Bloch's canonical equation. It is concluded that, since in many cases Bloch's differential equation is difficult to solve, in applications it is preferable to use the expression obtained directly from the definition of the canonical density matrix in the coherent states representation. This conclusion is verified by examining several cases of quantum systems with linear or quadratic energy spectrum.


title: Using Tangible Interaction to Design Musicking Artifacts for Non-musicians

abstract: This paper presents a Research through Design exploration of the potential for using tangible interactions to enable active music experiences - musicking - for non-musicians. We present the Tubularium prototype, which aims to help non-musicians play music without requiring any initial skill. We present the initial design of the prototype and the features implemented in order to enable music-making by non-musicians, and offer some reflections based on observations of informal initial user explorations of the prototype.


title: Non-invasive Diver Respiration Rate Monitoring in Hyperbaric Lifeboat Environments using Short-Range Radar

abstract: The monitoring of diver health during emergency events is crucial to ensuring the safety of personnel. A non-invasive system continuously providing a measure of the respiration rate of individual divers is exceedingly beneficial in this context. The paper reports on the application of short-range radar to record the respiration rate of divers within hyperbaric lifeboat environments. Results demonstrate that the respiratory motion can be extracted from the radar return signal applying routine signal processing. Further, evidence is provided that the radar-based approach yields a more accurate measure of respiration rate than an audio signal from a headset microphone. The system promotes an improvement in evacuation protocols under critical operational scenarios.


title: Enhancing Code Vulnerability Detection via Vulnerability-Preserving Data Augmentation

abstract: Source code vulnerability detection aims to identify inherent vulnerabilities to safeguard software systems from potential attacks. Many prior studies overlook diverse vulnerability characteristics, simplifying the problem into a binary (0-1) classification task for example determining whether it is vulnerable or not. This poses a challenge for a single deep learning-based model to effectively learn the wide array of vulnerability characteristics. Furthermore, due to the challenges associated with collecting large-scale vulnerability data, these detectors often overfit limited training datasets, resulting in lower model generalization performance. To address the aforementioned challenges, in this work, we introduce a fine-grained vulnerability detector namely FGVulDet. Unlike previous approaches, FGVulDet employs multiple classifiers to discern characteristics of various vulnerability types and combines their outputs to identify the specific type of vulnerability. Each classifier is designed to learn type-specific vulnerability semantics. Additionally, to address the scarcity of data for some vulnerability types and enhance data diversity for learning better vulnerability semantics, we propose a novel vulnerability-preserving data augmentation technique to augment the number of vulnerabilities. Taking inspiration from recent advancements in graph neural networks for learning program semantics, we incorporate a Gated Graph Neural Network (GGNN) and extend it to an edge-aware GGNN to capture edge-type information. FGVulDet is trained on a large-scale dataset from GitHub, encompassing five different types of vulnerabilities. Extensive experiments compared with static-analysis-based approaches and learning-based approaches have demonstrated the effectiveness of FGVulDet.


title: Curvature of Gaussian quantum states

abstract: The space of quantum states can be endowed with a metric structure using the second order derivatives of the relative entropy, giving rise to the so-called Kubo-Mori-Bogoliubov inner product. We explore its geometric properties on the submanifold of faithful, zero-displacement Gaussian states parameterised by their covariance matrices, deriving expressions for the geodesic equations, curvature tensors and scalar curvature. Our analysis suggests that the curvature of the manifold is strictly monotonic with respect to the von Neumann entropy, and thus can be interpreted as a measure of state uncertainty. This provides supporting evidence for the Petz conjecture in continuous variable systems.


title: Reactive Model Correction: Mitigating Harm to Task-Relevant Features via Conditional Bias Suppression

abstract: Deep Neural Networks are prone to learning and relying on spurious correlations in the training data, which, for high-risk applications, can have fatal consequences. Various approaches to suppress model reliance on harmful features have been proposed that can be applied post-hoc without additional training. Whereas those methods can be applied with efficiency, they also tend to harm model performance by globally shifting the distribution of latent features. To mitigate unintended overcorrection of model behavior, we propose a reactive approach conditioned on model-derived knowledge and eXplainable Artificial Intelligence (XAI) insights. While the reactive approach can be applied to many post-hoc methods, we demonstrate the incorporation of reactivity in particular for P-ClArC (Projective Class Artifact Compensation), introducing a new method called R-ClArC (Reactive Class Artifact Compensation). Through rigorous experiments in controlled settings (FunnyBirds) and with a real-world dataset (ISIC2019), we show that introducing reactivity can minimize the detrimental effect of the applied correction while simultaneously ensuring low reliance on spurious features.


title: Guidelines for accurate and efficient calculations of mobilities in two-dimensional materials

abstract: Emerging two-dimensional (2D) materials bring unprecedented opportunities for electronic applications. The design of high-performance devices requires an accurate prediction of carrier mobility in 2D materials, which can be obtained using state-of-the-art $ab~initio$ calculations. However, various factors impact the computational accuracy, leading to contradictory estimations for the mobility. In this work, targeting accurate and efficient $ab~initio$ calculations, transport properties in III-V monolayers are reported using the Boltzmann transport equation, and the influences of pseudopotential, quadrupole correction, Berry connection, and spin-orbit coupling (SOC) on mobilities are systematically investigated. Our findings are as follows: (1) The inclusion of semi-core states in pseudopotentials is important to obtain accurate calculations. (2) The variations induced by dynamical quadrupole and Berry connection when treating long range fields can be respectively 40% and 10%. (3) The impact of SOC can reach up to 100% for materials with multi-peak bands. Importantly, although SOC notably modifies the electronic wavefunctions, it negligibly impacts the dynamical matrices and scattering potential variations. As a result, the combination of fully-relativistic electron calculation and scalar-relativistic phonon calculation can strike a good balance between accuracy and cost. This work compares computational methodologies, providing guidelines for accurate and efficient calculations of mobilities in 2D semiconductors.


title: Construction of smooth chiral finite-time blow-up solutions to Calogero--Moser derivative nonlinear Schr\"odinger equation

abstract: We consider the Calogero--Moser derivative nonlinear Schr\"odinger equation (CM-DNLS), which is an $L^{2}$-critical nonlinear Schr\"odinger equation with explicit solitons, self-duality, and pseudo-conformal symmetry. More importantly, this equation is known to be completely integrable in the Hardy space $L_{+}^{2}$ and the solutions in this class are referred to as \emph{chiral} solutions. A rigorous PDE analysis of this equation with complete integrability was recently initiated by G\'erard and Lenzmann. Our main result constructs smooth, chiral, and finite energy finite-time blow-up solutions with mass arbitrarily close to that of soliton, answering the global regularity question for chiral solutions raised by G\'erard and Lenzmann. The blow-up rate obtained for these solutions is different from the pseudo-conformal rate. Our proof also gives a construction of a codimension one set of smooth finite energy initial data (but without addressing chirality) leading to the same blow-up dynamics. Our blow-up construction in the Hardy space might also be contrasted with the global well-posedness of the derivative nonlinear Schr\"odinger equation (DNLS), which is another integrable $L^{2}$-critical Schr\"odinger equation. The overall scheme of our proof is the forward construction of blow-up dynamics with modulation analysis and is not reliant on complete integrability. We begin with developing a linear theory for the near soliton dynamics. We discover a nontrivial conjugation identity, which unveils a surprising connection from the linearized (CM-DNLS) to the 1D free Schr\"odinger equation, which is a crucial ingredient for overcoming the difficulties from the non-local nonlinearity. Another principal challenge in this work, the slow decay of soliton, is overcome by introducing a trick of decomposing solutions depending on topologies, which we believe is of independent interest.


title: Machine learning-based optimization workflow of the homogeneity of spunbond nonwovens with human validation

abstract: In the last ten years, the average annual growth rate of nonwoven production was 4%. In 2020 and 2021, nonwoven production has increased even further due to the huge demand for nonwoven products needed for protective clothing such as FFP2 masks to combat the COVID19 pandemic. Optimizing the production process is still a challenge due to its high nonlinearity. In this paper, we present a machine learning-based optimization workflow aimed at improving the homogeneity of spunbond nonwovens. The optimization workflow is based on a mathematical model that simulates the microstructures of nonwovens. Based on trainingy data coming from this simulator, different machine learning algorithms are trained in order to find a surrogate model for the time-consuming simulator. Human validation is employed to verify the outputs of machine learning algorithms by assessing the aesthetics of the nonwovens. We include scientific and expert knowledge into the training data to reduce the computational costs involved in the optimization process. We demonstrate the necessity and effectiveness of our workflow in optimizing the homogeneity of nonwovens.


title: Finite-sample expansions for the optimal error probability in asymmetric binary hypothesis testing

abstract: The problem of binary hypothesis testing between two probability measures is considered. New sharp bounds are derived for the best achievable error probability of such tests based on independent and identically distributed observations. Specifically, the asymmetric version of the problem is examined, where different requirements are placed on the two error probabilities. Accurate nonasymptotic expansions with explicit constants are obtained for the error probability, using tools from large deviations and Gaussian approximation. Examples are shown indicating that, in the asymmetric regime, the approximations suggested by the new bounds are significantly more accurate than the approximations provided by either of the two main earlier approaches -- normal approximation and error exponents.


title: A Self-feedback Knowledge Elicitation Approach for Chemical Reaction Predictions

abstract: The task of chemical reaction predictions (CRPs) plays a pivotal role in advancing drug discovery and material science. However, its effectiveness is constrained by the vast and uncertain chemical reaction space and challenges in capturing reaction selectivity, particularly due to existing methods' limitations in exploiting the data's inherent knowledge. To address these challenges, we introduce a data-curated self-feedback knowledge elicitation approach. This method starts from iterative optimization of molecular representations and facilitates the extraction of knowledge on chemical reaction types (RTs). Then, we employ adaptive prompt learning to infuse the prior knowledge into the large language model (LLM). As a result, we achieve significant enhancements: a 14.2% increase in retrosynthesis prediction accuracy, a 74.2% rise in reagent prediction accuracy, and an expansion in the model's capability for handling multi-task chemical reactions. This research offers a novel paradigm for knowledge elicitation in scientific research and showcases the untapped potential of LLMs in CRPs.


title: Better space-time-robustness trade-offs for set reconciliation

abstract: We consider the problem of reconstructing the symmetric difference between similar sets from their representations (sketches) of size linear in the number of differences. Exact solutions to this problem are based on error-correcting coding techniques and suffer from a large decoding time. Existing probabilistic solutions based on Invertible Bloom Lookup Tables (IBLTs) are time-efficient but offer insufficient success guarantees for many applications. Here we propose a tunable trade-off between the two approaches combining the efficiency of IBLTs with exponentially decreasing failure probability. The proof relies on a refined analysis of IBLTs proposed in (Baek Tejs Houen et al. SOSA 2023) which has an independent interest. We also propose a modification of our algorithm that enables telling apart the elements of each set in the symmetric difference.


title: Quantum Principle of Least Action in Dynamic Theories With Higher Derivatives

abstract: A generalized canonical form of action of dynamic theories with higher derivatives is proposed, which does not require the introduction of additional dynamic variables. This form is the initial point for the construction of quantum theory, in which the state of motion of the system is described by the wave functional on its trajectories in the configuration space, and the functional itself is an eigenvector of the action operator. The Pais-Uhlenbeck oscillator is considered as the simplest model. For this case, the correspondence between the new form of quantum theory and "ordinary" quantum mechanics has been established in the local limit, when the Pais-Uhlenbeck oscillator is reduced to the "ordinary" harmonic oscillator.


title: Neutrino dipole portal at a high energy $\mu-$collider

abstract: We study the phenomenology of $d=6$ dipole portal operators connecting active and sterile neutrinos at a futuristic muon collider. These operators can be the dominant portal between the Standard Model and the New Physics sector in scenarios in which the active-sterile mixing is suppressed. We identify two production modes for sterile neutrinos: one proceeding through the exchange of an $s-$channel electroweak boson and one arising from the fusion of an electroweak boson with a Standard Model lepton. We study the expected reach on the operators suppression scale for these different production mechanisms, showing that the latter offers the best sensitivity and allowing to test a New Physics scale in the $\sim 10\;$TeV range.


title: LoRA Dropout as a Sparsity Regularizer for Overfitting Control

abstract: Parameter-efficient fine-tuning methods, represented by LoRA, play an essential role in adapting large-scale pre-trained models to downstream tasks. However, fine-tuning LoRA-series models also faces the risk of overfitting on the training dataset, and yet there's still a lack of theoretical guidance and practical mechanism to control overfitting on LoRA-based PEFT methods. In this paper, we propose a LoRA Dropout mechanism for the LoRA-based methods by introducing random noises to the learnable low-rank matrices and increasing parameter sparsity. We then demonstrate the theoretical mechanism of our LoRA Dropout mechanism from the perspective of sparsity regularization by providing a generalization error bound under this framework. Theoretical results show that appropriate sparsity would help tighten the gap between empirical and generalization risks and thereby control overfitting. Furthermore, based on the LoRA Dropout framework, we introduce a test-time ensemble strategy and provide theoretical evidence demonstrating that the ensemble method can further compress the error bound, and lead to better performance during inference time. Extensive experiments on various NLP tasks provide practical validations of the effectiveness of our LoRA Dropout framework in improving model accuracy and calibration.


title: Well-Posedness for Quintic Energy Critical Wave in 3D Cylindrical Convex Domains

abstract: In this paper, we establish the well-posedness in energy space for the quintic energy critical wave inside a cylindrical convex domain $\Omega\subset\mathbb{R}^3$ with smooth boundary $\partial\Omega\neq\emptyset$. The key tools to prove local well-posedness are the dispersive estimates obtained in \cite{L,L1,L3} and the Strichartz estimates in \cite{L2}. We point out that our result on the local and global existence of the solution to the wave equation in the cylindrical domain setting interpolates between that of in Euclidean space $\mathbb{R}^3$ (see \cite{MG}) and in any bounded domains in $\mathbb{R}^3$ (see \cite{BLP}). Moreover, the result of the Strichartz estimates in our setting is strong enough when combined with the arguments in \cite{BLP,SS2} so that we can extend local to global well-posedness.


title: A new class of separable Lagrangian systems generalizing Sawada-Kotera

abstract: Some characteristics of the Sawada-Kotera Lagrangian system lend themselves to generalization, producing a large class of separable Lagrangian systems with two degrees of freedom.


title: Efficient and accurate neural field reconstruction using resistive memory

abstract: Human beings construct perception of space by integrating sparse observations into massively interconnected synapses and neurons, offering a superior parallelism and efficiency. Replicating this capability in AI finds wide applications in medical imaging, AR/VR, and embodied AI, where input data is often sparse and computing resources are limited. However, traditional signal reconstruction methods on digital computers face both software and hardware challenges. On the software front, difficulties arise from storage inefficiencies in conventional explicit signal representation. Hardware obstacles include the von Neumann bottleneck, which limits data transfer between the CPU and memory, and the limitations of CMOS circuits in supporting parallel processing. We propose a systematic approach with software-hardware co-optimizations for signal reconstruction from sparse inputs. Software-wise, we employ neural field to implicitly represent signals via neural networks, which is further compressed using low-rank decomposition and structured pruning. Hardware-wise, we design a resistive memory-based computing-in-memory (CIM) platform, featuring a Gaussian Encoder (GE) and an MLP Processing Engine (PE). The GE harnesses the intrinsic stochasticity of resistive memory for efficient input encoding, while the PE achieves precise weight mapping through a Hardware-Aware Quantization (HAQ) circuit. We demonstrate the system's efficacy on a 40nm 256Kb resistive memory-based in-memory computing macro, achieving huge energy efficiency and parallelism improvements without compromising reconstruction quality in tasks like 3D CT sparse reconstruction, novel view synthesis, and novel view synthesis for dynamic scenes. This work advances the AI-driven signal restoration technology and paves the way for future efficient and robust medical AI and 3D vision applications.


title: Distinguishing subsampled power laws from other heavy-tailed distributions

abstract: Distinguishing power-law distributions from other heavy-tailed distributions is challenging, and this task is often further complicated by subsampling effects. In this work, we evaluate the performance of two commonly used methods for detecting power-law distributions - the maximum likelihood method of Clauset et al. and the extreme value method of Voitalov et al. - in distinguishing subsampled power laws from two other heavy-tailed distributions, the lognormal and the stretched exponential distributions. We focus on a random subsampling method commonly applied in network science and biological sciences. In this subsampling scheme, we are ultimately interested in the frequency distribution of elements with a certain number of constituent parts, and each part is selected to the subsample with an equal probability. We investigate how well the results obtained from subsamples generalize to the original distribution. Our results show that the power-law exponent of the original distribution can be estimated fairly accurately from subsamples, but classifying the distribution correctly is more challenging. The maximum likelihood method falsely rejects the power-law hypothesis for a large fraction of subsamples from power-law distributions. While the extreme value method correctly recognizes subsampled power-law distributions with all tested subsampling depths, its capacity to distinguish power laws from the heavy-tailed alternatives is limited. However, these false positives tend to result not from the subsampling itself but from the estimators' inability to classify the original sample correctly. In fact, we show that the extreme value method can sometimes be expected to perform better on subsamples than on the original samples from the lognormal and the stretched exponential distributions, while the contrary is true for the main tests included in the maximum likelihood method.


title: If there's a Trigger Warning, then where's the Trigger? Investigating Trigger Warnings at the Passage Level

abstract: Trigger warnings are labels that preface documents with sensitive content if this content could be perceived as harmful by certain groups of readers. Since warnings about a document intuitively need to be shown before reading it, authors usually assign trigger warnings at the document level. What parts of their writing prompted them to assign a warning, however, remains unclear. We investigate for the first time the feasibility of identifying the triggering passages of a document, both manually and computationally. We create a dataset of 4,135 English passages, each annotated with one of eight common trigger warnings. In a large-scale evaluation, we then systematically evaluate the effectiveness of fine-tuned and few-shot classifiers, and their generalizability. We find that trigger annotation belongs to the group of subjective annotation tasks in NLP, and that automatic trigger classification remains challenging but feasible.


title: A Review and Efficient Implementation of Scene Graph Generation Metrics

abstract: Scene graph generation has emerged as a prominent research field in computer vision, witnessing significant advancements in the recent years. However, despite these strides, precise and thorough definitions for the metrics used to evaluate scene graph generation models are lacking. In this paper, we address this gap in the literature by providing a review and precise definition of commonly used metrics in scene graph generation. Our comprehensive examination clarifies the underlying principles of these metrics and can serve as a reference or introduction to scene graph metrics. Furthermore, to facilitate the usage of these metrics, we introduce a standalone Python package called SGBench that efficiently implements all defined metrics, ensuring their accessibility to the research community. Additionally, we present a scene graph benchmarking web service, that enables researchers to compare scene graph generation methods and increase visibility of new methods in a central place. All of our code can be found at https://lorjul.github.io/sgbench/.


title: Safeguarding adaptive methods: global convergence of Barzilai-Borwein and other stepsize choices

abstract: Leveraging on recent advancements on adaptive methods for convex minimization problems, this paper provides a linesearch-free proximal gradient framework for globalizing the convergence of popular stepsize choices such as Barzilai-Borwein and one-dimensional Anderson acceleration. This framework can cope with problems in which the gradient of the differentiable function is merely locally H\"older continuous. Our analysis not only encompasses but also refines existing results upon which it builds. The theory is corroborated by numerical evidence that showcases the synergetic interplay between fast stepsize selections and adaptive methods.


title: On the experimental properties of the TS defect in 4H-SiC

abstract: When annealing a 4H silicon carbide (SiC) crystal, a sequence of optically active defect centers occurs among which the TS center is a prominent example. Here, we present low-temperature photoluminescence analyses on the single defect level. They reveal that the three occurring spectral signatures TS1, TS2 and TS3 originate from one single defect. Their polarization dependences expose three different crystallographic orientations in the basal plane, which relate to the projections of the nearest neighbor directions. Accordingly, we find a three-fold level-splitting in ensemble studies, when applying mechanical strain. This dependency is quantitatively calibrated. A complementary electrical measurement, deep level transient spectroscopy, reveals a charge transition level of the TS defect at 0.6 eV above the valence band. For a future identification, this accurate characterization of its optical and electronic properties along with their response to mechanical strain is a milestone.


title: UNIAA: A Unified Multi-modal Image Aesthetic Assessment Baseline and Benchmark

abstract: As an alternative to expensive expert evaluation, Image Aesthetic Assessment (IAA) stands out as a crucial task in computer vision. However, traditional IAA methods are typically constrained to a single data source or task, restricting the universality and broader application. In this work, to better align with human aesthetics, we propose a Unified Multi-modal Image Aesthetic Assessment (UNIAA) framework, including a Multi-modal Large Language Model (MLLM) named UNIAA-LLaVA and a comprehensive benchmark named UNIAA-Bench. We choose MLLMs with both visual perception and language ability for IAA and establish a low-cost paradigm for transforming the existing datasets into unified and high-quality visual instruction tuning data, from which the UNIAA-LLaVA is trained. To further evaluate the IAA capability of MLLMs, we construct the UNIAA-Bench, which consists of three aesthetic levels: Perception, Description, and Assessment. Extensive experiments validate the effectiveness and rationality of UNIAA. UNIAA-LLaVA achieves competitive performance on all levels of UNIAA-Bench, compared with existing MLLMs. Specifically, our model performs better than GPT-4V in aesthetic perception and even approaches the junior-level human. We find MLLMs have great potential in IAA, yet there remains plenty of room for further improvement. The UNIAA-LLaVA and UNIAA-Bench will be released.


title: Leveraging the Doppler Effect for Channel Charting

abstract: Channel Charting is a dimensionality reduction technique that reconstructs a map of the radio environment from similarity relationships found in channel state information. Distances in the channel chart are often computed based on some dissimilarity metric, which can be derived from angular-domain information, channel impulse responses, measured phase differences or simply timestamps. Using such information implicitly makes strong assumptions about the level of phase and time synchronization between base station antennas or assumes approximately constant transmitter velocity. Many practical systems, however, may not provide phase and time synchronization and single-antenna base stations may not even have angular-domain information. We propose a Doppler effect-based loss function for Channel Charting that only requires frequency synchronization between spatially distributed base station antennas, which is a much weaker assumption. We use a dataset measured in an indoor environment to demonstrate that the proposed method is practically feasible with just four base station antennas, that it produces a channel chart that is suitable for localization in the global coordinate frame and that it outperforms other state-of-the-art methods under the given limitations.


title: AAM-VDT: Vehicle Digital Twin for Tele-Operations in Advanced Air Mobility

abstract: This study advanced tele-operations in Advanced Air Mobility (AAM) through the creation of a Vehicle Digital Twin (VDT) system for eVTOL aircraft, tailored to enhance remote control safety and efficiency, especially for Beyond Visual Line of Sight (BVLOS) operations. By synergizing digital twin technology with immersive Virtual Reality (VR) interfaces, we notably elevate situational awareness and control precision for remote operators. Our VDT framework integrates immersive tele-operation with a high-fidelity aerodynamic database, essential for authentically simulating flight dynamics and control tactics. At the heart of our methodology lies an eVTOL's high-fidelity digital replica, placed within a simulated reality that accurately reflects physical laws, enabling operators to manage the aircraft via a master-slave dynamic, substantially outperforming traditional 2D interfaces. The architecture of the designed system ensures seamless interaction between the operator, the digital twin, and the actual aircraft, facilitating exact, instantaneous feedback. Experimental assessments, involving propulsion data gathering, simulation database fidelity verification, and tele-operation testing, verify the system's capability in precise control command transmission and maintaining the digital-physical eVTOL synchronization. Our findings underscore the VDT system's potential in augmenting AAM efficiency and safety, paving the way for broader digital twin application in autonomous aerial vehicles.


title: DIDLM:A Comprehensive Multi-Sensor Dataset with Infrared Cameras, Depth Cameras, LiDAR, and 4D Millimeter-Wave Radar in Challenging Scenarios for 3D Mapping

abstract: This study presents a comprehensive multi-sensor dataset designed for 3D mapping in challenging indoor and outdoor environments. The dataset comprises data from infrared cameras, depth cameras, LiDAR, and 4D millimeter-wave radar, facilitating exploration of advanced perception and mapping techniques. Integration of diverse sensor data enhances perceptual capabilities in extreme conditions such as rain, snow, and uneven road surfaces. The dataset also includes interactive robot data at different speeds indoors and outdoors, providing a realistic background environment. Slam comparisons between similar routes are conducted, analyzing the influence of different complex scenes on various sensors. Various SLAM algorithms are employed to process the dataset, revealing performance differences among algorithms in different scenarios. In summary, this dataset addresses the problem of data scarcity in special environments, fostering the development of perception and mapping algorithms for extreme conditions. Leveraging multi-sensor data including infrared, depth cameras, LiDAR, 4D millimeter-wave radar, and robot interactions, the dataset advances intelligent mapping and perception capabilities.Our dataset is available at https://github.com/GongWeiSheng/DIDLM.


title: Skew two-sided bracoids

abstract: Isabel Martin-Lyons and Paul J.Truman generalized the definition of a skew brace to give a new algebraic object, which they termed a skew bracoid. Their construction involves two groups interacting in a manner analogous to the compatibility condition found in the definition of a skew brace. They formulated tools for characterizing and classifying skew bracoids, and studied substructures and quotients of skew bracoids. In this paper we study two-sided bracoids. In \cite{WR07} Rump showed that if a left brace $(B, \star ,\cdot )$ is a two-sided brace and the operation $\ast : B \times B \longrightarrow B$ is defined by $a \ast b = a\cdot b \star \overline{a} \star \overline{b}$ for all $a, b \in B$ then $(B, \star ,\ast )$ is a Jacobson radical ring. Lau showed that if $(B, \star ,\cdot )$ is a left brace and the operation is asssociative, then $B$ is a two-sided brace. We will prove bracoid versions of this results.


title: AesExpert: Towards Multi-modality Foundation Model for Image Aesthetics Perception

abstract: The highly abstract nature of image aesthetics perception (IAP) poses significant challenge for current multimodal large language models (MLLMs). The lack of human-annotated multi-modality aesthetic data further exacerbates this dilemma, resulting in MLLMs falling short of aesthetics perception capabilities. To address the above challenge, we first introduce a comprehensively annotated Aesthetic Multi-Modality Instruction Tuning (AesMMIT) dataset, which serves as the footstone for building multi-modality aesthetics foundation models. Specifically, to align MLLMs with human aesthetics perception, we construct a corpus-rich aesthetic critique database with 21,904 diverse-sourced images and 88K human natural language feedbacks, which are collected via progressive questions, ranging from coarse-grained aesthetic grades to fine-grained aesthetic descriptions. To ensure that MLLMs can handle diverse queries, we further prompt GPT to refine the aesthetic critiques and assemble the large-scale aesthetic instruction tuning dataset, i.e. AesMMIT, which consists of 409K multi-typed instructions to activate stronger aesthetic capabilities. Based on the AesMMIT database, we fine-tune the open-sourced general foundation models, achieving multi-modality Aesthetic Expert models, dubbed AesExpert. Extensive experiments demonstrate that the proposed AesExpert models deliver significantly better aesthetic perception performances than the state-of-the-art MLLMs, including the most advanced GPT-4V and Gemini-Pro-Vision. Source data will be available at https://github.com/yipoh/AesExpert.


title: Privacy-Preserving Intrusion Detection using Convolutional Neural Networks

abstract: Privacy-preserving analytics is designed to protect valuable assets. A common service provision involves the input data from the client and the model on the analyst's side. The importance of the privacy preservation is fuelled by legal obligations and intellectual property concerns. We explore the use case of a model owner providing an analytic service on customer's private data. No information about the data shall be revealed to the analyst and no information about the model shall be leaked to the customer. Current methods involve costs: accuracy deterioration and computational complexity. The complexity, in turn, results in a longer processing time, increased requirement on computing resources, and involves data communication between the client and the server. In order to deploy such service architecture, we need to evaluate the optimal setting that fits the constraints. And that is what this paper addresses. In this work, we enhance an attack detection system based on Convolutional Neural Networks with privacy-preserving technology based on PriMIA framework that is initially designed for medical data.


title: Hot Jupiter Diversity and the Onset of TiO/VO Revealed by a Large Grid of Non-Grey Global Circulation Models

abstract: The population of hot Jupiters is extremely diverse, with large variations in their irradiation, period, gravity and chemical composition. To understand the intrinsic planet diversity through the observed population level trends, we explore the a-priori scatter in the population created by the different responses of atmospheric circulation to planetary parameters. We use the SPARC/MITgcm 3D global circulation model to simulate 345 planets spanning a wide range of instellation, metallicity, gravity and rotation periods typical for hot Jupiters, while differentiating between models with and without TiO/VO in their atmosphere. We show that the combined effect of the planetary parameters leads to a large diversity in the ability of atmospheres to transport heat from day-side to night-side at a given equilibrium temperature. We further show that the hot-spot offset is a non-monotonic function of planetary rotation period and explain our findings by a competition between the rotational and divergent parts of the circulation. As a consequence, hot-spot offset and phase curve amplitude are not necessarily correlated. Finally, we compare the observables from our grid to the population of Spitzer and Hubble observations of hot Jupiters. We find that the sudden jump in brightness temperature observed in the Spitzer secondary eclipse measurements can be naturally explained by the cold-trapping of TiO/VO at approximately 1800K. The grid of modelled spectra, phase curves and thermal structures are made available to the community, together with a python code for visualization of the grid properties, at https://doi.org/10.5281/zenodo.10785321 and http://sim3d.oca.eu/.


title: Centralization in Proof-of-Stake Blockchains: A Game-Theoretic Analysis of Bootstrapping Protocols

abstract: Proof-of-stake (PoS) has emerged as a natural alternative to the resource-intensive Proof-of-Work (PoW) blockchain, as was recently seen with the Ethereum Merge. PoS-based blockchains require an initial stake distribution among the participants. Typically, this initial stake distribution is called bootstrapping. This paper argues that existing bootstrapping protocols are prone to centralization. To address centralization due to bootstrapping, we propose a novel game $\Gamma_\textsf{bootstrap}$. Next, we define three conditions: (i) Individual Rationality (IR), (ii) Incentive Compatibility (IC), and (iii) $(\tau,\delta,\epsilon)-$ Decentralization that an \emph{ideal} bootstrapping protocol must satisfy. $(\tau,\delta,\epsilon)$ are certain parameters to quantify decentralization. Towards this, we propose a novel centralization metric, C-NORM, to measure centralization in a PoS System. We define a centralization game -- $\Gamma_\textsf{cent}$, to analyze the efficacy of centralization metrics. We show that C-NORM effectively captures centralization in the presence of strategic players capable of launching Sybil attacks. With C-NORM, we analyze popular bootstrapping protocols such as Airdrop and Proof-of-Burn (PoB) and prove that they do not satisfy IC and IR, respectively. Motivated by the Ethereum Merge, we study W2SB (a PoW-based bootstrapping protocol) and prove it is ideal. In addition, we conduct synthetic simulations to empirically validate that W2SB bootstrapped PoS is decentralized.


title: Coerciveness and Morrey Inequalities for Elliptic Operators with Natural Boundary Conditions via Weitzenb\"ock Identities

abstract: We prove a Weitzenb\"ock identity for general pairs of constant coefficient homogeneous first order partial differential operators, and deduce from it sufficient algebraic conditions for coerciveness and Morrey estimates under the natural 1/2 boundary conditions. Our proof of the $W^{1,2}$ elliptic estimate relies on the Aronszajn-Necas-Smith coercive estimate. For generalized strongly pseudoconvex domains, we improve the Morrey estimate to a weighted $W^{1,2}$ square function estimate, using a generalized Cauchy-Pompieu reproducing formula and the T1 theorem for singular integrals. We use Van Schaftingen's notion of cocanceling to study the generalized Levi forms appearing.


title: Quantifying fair income distribution in Thailand

abstract: Given a vast concern about high income inequality in Thailand as opposed to empirical findings around the world showing people's preference for fair income inequality over unfair income equality, it is therefore important to examine whether inequality in income distribution in Thailand over the past three decades is fair, and what fair inequality in income distribution in Thailand should be. To quantitatively measure fair income distribution, this study employs the fairness benchmarks that are derived from the distributions of athletes' salaries in professional sports which satisfy the concepts of distributive justice and procedural justice, the no-envy principle of fair allocation, and the general consensus or the international norm criterion of a meaningful benchmark. By using the data on quintile income shares and the income Gini index of Thailand from the National Social and Economic Development Council, this study finds that, throughout the period from 1988 to 2021, the Thai income earners in the bottom 20%, the second 20%, and the top 20% receive income shares more than the fair shares whereas those in the third 20% and the fourth 20% receive income shares less than the fair shares. Provided that there are infinite combinations of quintile income shares that can have the same value of income Gini index but only one of them is regarded as fair, this study demonstrates the use of fairness benchmarks as a practical guideline for designing policies with an aim to achieve fair income distribution in Thailand. Moreover, a comparative analysis is conducted by employing the method for estimating optimal (fair) income distribution representing feasible income equality in order to provide an alternative recommendation on what optimal (fair) income distribution characterizing feasible income equality in Thailand should be.


title: Optimal design of ride-pooling as on-demand feeder services

abstract: The technology-enabled ride-pooling (RP) is designed as an on-demand feeder service to connect remote areas to transit terminals (or activity centers). We propose the so-called ``hold-dispatch'' operation strategy, which imposes a target number of shared rides (termed the ride-pooling size) for each vehicle to enhance RP's transportation efficiency. Analytical models are formulated at the planning level to estimate the costs of the RP operator and the patrons. Accordingly, the design problem is constructed to minimize the total system cost concerning the system layout (i.e., in terms of service zone partitioning), resource deployment (i.e., fleet size), and operational decision (i.e., ride-pooling size). The proposed models admit spatial heterogeneity arising from the non-uniformity of demand distributions and service locations, and can furnish heterogeneous designs. Closed-form formulas for the optimal zoning and fleet size are developed, which unveil fundamental insights regarding the impacts of key operating factors (e.g., demand density and distance to the terminal). Extensive numerical experiments demonstrate (i) the effectiveness of heterogeneous service designs and (ii) the advantage of the proposed RP service with hold-dispatch strategy over alternative designs studied in the literature, i.e., RP with a ``quick-dispatch'' strategy and flexible-route transit, in a wide range of operating scenarios. These findings can assist transportation network companies and transit agencies in successfully integrating RP and transit services.


title: Action Model Learning with Guarantees

abstract: This paper studies the problem of action model learning with full observability. Following the learning by search paradigm by Mitchell, we develop a theory for action model learning based on version spaces that interprets the task as search for hypothesis that are consistent with the learning examples. Our theoretical findings are instantiated in an online algorithm that maintains a compact representation of all solutions of the problem. Among these range of solutions, we bring attention to actions models approximating the actual transition system from below (sound models) and from above (complete models). We show how to manipulate the output of our learning algorithm to build deterministic and non-deterministic formulations of the sound and complete models and prove that, given enough examples, both formulations converge into the very same true model. Our experiments reveal their usefulness over a range of planning domains.


title: Bridging Vision and Language Spaces with Assignment Prediction

abstract: This paper introduces VLAP, a novel approach that bridges pretrained vision models and large language models (LLMs) to make frozen LLMs understand the visual world. VLAP transforms the embedding space of pretrained vision models into the LLMs' word embedding space using a single linear layer for efficient and general-purpose visual and language understanding. Specifically, we harness well-established word embeddings to bridge two modality embedding spaces. The visual and text representations are simultaneously assigned to a set of word embeddings within pretrained LLMs by formulating the assigning procedure as an optimal transport problem. We predict the assignment of one modality from the representation of another modality data, enforcing consistent assignments for paired multimodal data. This allows vision and language representations to contain the same information, grounding the frozen LLMs' word embedding space in visual data. Moreover, a robust semantic taxonomy of LLMs can be preserved with visual data since the LLMs interpret and reason linguistic information from correlations between word embeddings. Experimental results show that VLAP achieves substantial improvements over the previous linear transformation-based approaches across a range of vision-language tasks, including image captioning, visual question answering, and cross-modal retrieval. We also demonstrate the learned visual representations hold a semantic taxonomy of LLMs, making visual semantic arithmetic possible.


title: In-Context Translation: Towards Unifying Image Recognition, Processing, and Generation

abstract: We propose In-Context Translation (ICT), a general learning framework to unify visual recognition (e.g., semantic segmentation), low-level image processing (e.g., denoising), and conditional image generation (e.g., edge-to-image synthesis). Thanks to unification, ICT significantly reduces the inherent inductive bias that comes with designing models for specific tasks, and it maximizes mutual enhancement across similar tasks. However, the unification across a large number of tasks is non-trivial due to various data formats and training pipelines. To this end, ICT introduces two designs. Firstly, it standardizes input-output data of different tasks into RGB image pairs, e.g., semantic segmentation data pairs an RGB image with its segmentation mask in the same RGB format. This turns different tasks into a general translation task between two RGB images. Secondly, it standardizes the training of different tasks into a general in-context learning, where "in-context" means the input comprises an example input-output pair of the target task and a query image. The learning objective is to generate the "missing" data paired with the query. The implicit translation process is thus between the query and the generated image. In experiments, ICT unifies ten vision tasks and showcases impressive performance on their respective benchmarks. Notably, compared to its competitors, e.g., Painter and PromptDiffusion, ICT trained on only 4 RTX 3090 GPUs is shown to be more efficient and less costly in training.


title: A Weitzenb\"ock formula on Sasakian holomorphic bundles

abstract: This work seeks to advance the understanding of the smooth structure of the moduli space of self-dual contact instantons (SDCI) on Sasakian 7-manifolds M. A neighborhood of a smooth point of M is locally modeled on the first cohomological group of an elliptic complex (1.4). There is a cohomological obstruction to the smoothness for the moduli space, in terms of a second basic cohomological group, in this paper we study conditions under which this obstruction disappears, by computing a Weitzenb\"ock formula and using a Bochner-type method to obtain a vanishing theorem. Given an SDCI on a Sasakian bundle E, we find sufficient conditions for the vanishing of the obstruction in the positivity of a couple of operators R and F depending on the curvatures of the connection and the Riemann curvature of the Sasakian metric g. In particular, we find that if M is transversely Ricci positive and F positive, the moduli space of SDCI must be smooth. However, in general, the operator F is not positive definite and we describe bundles over the Stiefel manifold for which it is the case. Finally, we show that when the energy of the curvature is less than the first non-zero eigenvalue of RicT the obstruction vanishes.


title: Pair statistics of anisotropic particles settling in a turbulent flow

abstract: We perform direct numerical simulations of sub-Kolmogorov, inertial spheroids settling under gravity in homogeneous, isotropic turbulence and find that small-scale clustering, measured via the correlation dimension, depends sensitively on their aspect ratios. In particular, such particles are shown to cluster more as their anisotropy increases. Further, the approach rate for pairs of spheroids are calculated and found to deviate significantly from the spherical-particle limit. Our study, spanning a range of Stokes numbers and aspect ratios, provides critical inputs for developing collision models to understand the dynamics of sedimenting, anisotropic particles in general and ice crystals in clouds in particular.


title: All-in-one simulation-based inference

abstract: Amortized Bayesian inference trains neural networks to solve stochastic inference problems using model simulations, thereby making it possible to rapidly perform Bayesian inference for any newly observed data. However, current simulation-based amortized inference methods are simulation-hungry and inflexible: They require the specification of a fixed parametric prior, simulator, and inference tasks ahead of time. Here, we present a new amortized inference method -- the Simformer -- which overcomes these limitations. By training a probabilistic diffusion model with transformer architectures, the Simformer outperforms current state-of-the-art amortized inference approaches on benchmark tasks and is substantially more flexible: It can be applied to models with function-valued parameters, it can handle inference scenarios with missing or unstructured data, and it can sample arbitrary conditionals of the joint distribution of parameters and data, including both posterior and likelihood. We showcase the performance and flexibility of the Simformer on simulators from ecology, epidemiology, and neuroscience, and demonstrate that it opens up new possibilities and application domains for amortized Bayesian inference on simulation-based models.


title: climber++: Pivot-Based Approximate Similarity Search over Big Data Series

abstract: The generation and collection of big data series are becoming an integral part of many emerging applications in sciences, IoT, finance, and web applications among several others. The terabyte-scale of data series has motivated recent efforts to design fully distributed techniques for supporting operations such as approximate kNN similarity search, which is a building block operation in most analytics services on data series. Unfortunately, these techniques are heavily geared towards achieving scalability at the cost of sacrificing the results' accuracy. State-of-the-art systems report accuracy below 10% and 40%, respectively, which is not practical for many real-world applications. In this paper, we investigate the root problems in these existing techniques that limit their ability to achieve better a trade-off between scalability and accuracy. Then, we propose a framework, called CLIMBER, that encompasses a novel feature extraction mechanism, indexing scheme, and query processing algorithms for supporting approximate similarity search in big data series. For CLIMBER, we propose a new loss-resistant dual representation composed of rank-sensitive and ranking-insensitive signatures capturing data series objects. Based on this representation, we devise a distributed two-level index structure supported by an efficient data partitioning scheme. Our similarity metrics tailored for this dual representation enables meaningful comparison and distance evaluation between the rank-sensitive and ranking-insensitive signatures. Finally, we propose two efficient query processing algorithms, CLIMBER-kNN and CLIMBER-kNN-Adaptive, for answering approximate kNN similarity queries. Our experimental study on real-world and benchmark datasets demonstrates that CLIMBER, unlike existing techniques, features results' accuracy above 80% while retaining the desired scalability to terabytes of data.


title: Gluing algebraic quantum field theories on manifolds

abstract: It has been observed that, given an algebraic quantum field theory (AQFT) on a manifold $M$ and an open cover $\{M_\alpha\}$ of $M$, it is typically not possible to recover the global algebra of observables on $M$ by simply gluing the underlying local algebras subordinate to $\{M_\alpha\}$. Instead of gluing local algebras, we introduce a gluing construction of AQFTs subordinate to $\{M_\alpha\}$ and we show that for simple examples of AQFTs, constructed out for geometric data, gluing the local AQFTs subordinate to $\{M_\alpha\}$ recovers the global AQFT on $M$. This result implies that the local AQFTs contain more information than the local algebras.


title: Improved Exponent for Marton's Conjecture in $\mathbb{F}_2^n$

abstract: A conjecture of Marton, widely known as the polynomial Freiman-Ruzsa conjecture, was recently proved by Gowers, Green, Manners and Tao for any bounded-torsion Abelian group $G$. In this paper we show a few simple modifications that improve their bound in $G=\mathbb{F}_2^n$. Specifically, for $G=\mathbb{F}_2^n$, they proved that any set $A\subseteq G$ with $|A+A|\le K|A|$ can be covered by at most $2K^C$ cosets of a subgroup $H$ of $G$ of cardinality at most $|A|$, with $C=12$. In this paper we prove the same statement for $C=9$.


title: CREST: Cross-modal Resonance through Evidential Deep Learning for Enhanced Zero-Shot Learning

abstract: Zero-shot learning (ZSL) enables the recognition of novel classes by leveraging semantic knowledge transfer from known to unknown categories. This knowledge, typically encapsulated in attribute descriptions, aids in identifying class-specific visual features, thus facilitating visual-semantic alignment and improving ZSL performance. However, real-world challenges such as distribution imbalances and attribute co-occurrence among instances often hinder the discernment of local variances in images, a problem exacerbated by the scarcity of fine-grained, region-specific attribute annotations. Moreover, the variability in visual presentation within categories can also skew attribute-category associations. In response, we propose a bidirectional cross-modal ZSL approach CREST. It begins by extracting representations for attribute and visual localization and employs Evidential Deep Learning (EDL) to measure underlying epistemic uncertainty, thereby enhancing the model's resilience against hard negatives. CREST incorporates dual learning pathways, focusing on both visual-category and attribute-category alignments, to ensure robust correlation between latent and observable spaces. Moreover, we introduce an uncertainty-informed cross-modal fusion technique to refine visual-attribute inference. Extensive experiments demonstrate our model's effectiveness and unique explainability across multiple datasets. Our code and data are available at: https://github.com/JethroJames/CREST


title: Multiple single-photon generations in three-level atoms coupled to cavity with non-Markovian effects

abstract: In this paper, we show how to generate the multiple single-photon wavepackets of arbitrary temporal shape from an optical cavity coupled with $N$ three-level atoms driven by a driving field in the non-Markovian regime. We derive an exact analytical expression of the optimal driving field for generating such wavepackets, which depends on two detunings of the cavity and driving field with respect to the three-level atoms. The cavity we used consists of two mirrors facing each other, where one is perfect and the other exists the dissipation (one-sided cavity), which couples with the corresponding non-Markovian input-output fields. If the first single-photon wavepacket generated by the Markovian system is the same as the non-Markovian case, the Markovian system cannot generate the same multiple single-photon wavepackets as the non-Markovian one when the spectral widths of the other environments taking values different from the spectral width of the first environment, while setting the equal spectral widths for the different environments can generate this. The generated multiple different single-photon wavepackets are not independent of each other, which satisfy certain relations with non-Markovian spectral parameters. We analyse the transition from Markovian to non-Markovian regimes and compare the differences between them, where the cavity interacts simultaneously with the multiple non-Markovian environments. Finally, we extend the above results to a general non-Markovian quantum network involving many cavities coupled with driven three-level atoms.


title: Indirect constraints on third generation baryon number violation

abstract: The non-observation of baryon number violation suggests that the scale of baryon-number violating interactions at zero temperature is comparable to the GUT scale. However, the pertinent measurements involve hadrons made of the first-generation quarks, such as protons and neutrons. One may therefore entertain the idea that new flavour physics breaks baryon number at a much lower scale, but only in the coupling to a third generation quark, leading to observable baryon-number violating $b$-hadron decay rates. In this paper we show that indirect constraints on the new physics scale $\Lambda_{\rm BNV}$ from the existing bounds on the proton lifetime do not allow for this possibility. For this purpose we consider the three dominant proton decay channels $p \to \ell^+ \nu_\ell \bar{\nu}$, $p \to \pi^+ \bar{\nu}$ and $p \to \pi^0 \ell^+$ mediated by a virtual bottom quark.


title: Constraining accretion-ejection parameters of a newly discovered Galactic transient Swift\,J151857.0-572147 using {\it IXPE} and {\it NuSTAR} observations

abstract: We study the spectro-polarimetric properties of a newly discovered black hole X-ray binary Swift\,J151857.0-572147 jointly using {\it IXPE} and {\it NuSTAR} observations during March 2024. The analysis of {\it IXPE} data reports mode-independent polarization degree (PD) $1.34\pm0.27$ and polarization angle (PA) $-13.69^\circ\pm5.85^\circ$, while the model-dependent analysis gives PD $1.18\pm0.23$ and PA $-14.01^\circ\pm5.80^\circ$. The joint spectral analysis of the broadband data and {\it NuSTAR} analysis in isolation constrain the mass of the central black hole between $\sim 9.2\pm1.6-10.5\pm1.8 M_\odot$ and a moderate spin parameter of $\sim0.6\pm0.2-0.7\pm0.2$ with disk inclination $\sim 38^\circ\pm9^\circ-47^\circ\pm15^\circ$. The power-law photon index and cutoff energy are $2.27\pm0.03-2.42\pm0.05$ and $\sim 40\pm7-62\pm8$ keV, suggesting a transition to the soft spectral state of the source during the observation period. Additionally, the best-fitted halo mass accretion is less compared to the disk mass accretion rate, and a relatively lower corona size of 6-9 r$_g$ indicates the same spectral state. The mass outflow rate was also low ($<3$\% $\dot M_{\rm Edd}$) during these epochs. The hydrogen column density obtained from the fit is relatively high $\sim 4-5\times 10^{22}$ cm$^{-2}$.


title: An Origami-Inspired Variable Friction Surface for Increasing the Dexterity of Robotic Grippers

abstract: While the grasping capability of robotic grippers has shown significant development, the ability to manipulate objects within the hand is still limited. One explanation for this limitation is the lack of controlled contact variation between the grasped object and the gripper. For instance, human hands have the ability to firmly grip object surfaces, as well as slide over object faces, an aspect that aids the enhanced manipulation of objects within the hand without losing contact. In this letter, we present a parametric, origami-inspired thin surface capable of transitioning between a high friction and a low friction state, suitable for implementation as an epidermis in robotic fingers. A numerical analysis of the proposed surface based on its design parameters, force analysis, and performance in in-hand manipulation tasks is presented. Through the development of a simple two-fingered two-degree-of-freedom gripper utilizing the proposed variable-friction surfaces with different parameters, we experimentally demonstrate the improved manipulation capabilities of the hand when compared to the same gripper without changeable friction. Results show that the pattern density and valley gap are the main parameters that effect the in-hand manipulation performance. The origami-inspired thin surface with a higher pattern density generated a smaller valley gap and smaller height change, producing a more stable improvement of the manipulation capabilities of the hand.


title: Real-world Instance-specific Image Goal Navigation for Service Robots: Bridging the Domain Gap with Contrastive Learning

abstract: Improving instance-specific image goal navigation (InstanceImageNav), which locates the identical object in a real-world environment from a query image, is essential for robotic systems to assist users in finding desired objects. The challenge lies in the domain gap between low-quality images observed by the moving robot, characterized by motion blur and low-resolution, and high-quality query images provided by the user. Such domain gaps could significantly reduce the task success rate but have not been the focus of previous work. To address this, we propose a novel method called Few-shot Cross-quality Instance-aware Adaptation (CrossIA), which employs contrastive learning with an instance classifier to align features between massive low- and few high-quality images. This approach effectively reduces the domain gap by bringing the latent representations of cross-quality images closer on an instance basis. Additionally, the system integrates an object image collection with a pre-trained deblurring model to enhance the observed image quality. Our method fine-tunes the SimSiam model, pre-trained on ImageNet, using CrossIA. We evaluated our method's effectiveness through an InstanceImageNav task with 20 different types of instances, where the robot identifies the same instance in a real-world environment as a high-quality query image. Our experiments showed that our method improves the task success rate by up to three times compared to the baseline, a conventional approach based on SuperGlue. These findings highlight the potential of leveraging contrastive learning and image enhancement techniques to bridge the domain gap and improve object localization in robotic applications. The project website is https://emergentsystemlabstudent.github.io/DomainBridgingNav/.


title: Derivatives of Risk Measures

abstract: This paper provides the first and second order derivatives of any risk measures, including VaR and ES for continuous and discrete portfolio loss random variable variables. Also, we give asymptotic results of the first and second order conditional moments for heavy-tailed portfolio loss random variable.


title: Object Instance Retrieval in Assistive Robotics: Leveraging Fine-Tuned SimSiam with Multi-View Images Based on 3D Semantic Map

abstract: Robots that assist in daily life are required to locate specific instances of objects that match the user's desired object in the environment. This task is known as Instance-Specific Image Goal Navigation (InstanceImageNav), which requires a model capable of distinguishing between different instances within the same class. One significant challenge in robotics is that when a robot observes the same object from various 3D viewpoints, its appearance may differ greatly, making it difficult to recognize and locate the object accurately. In this study, we introduce a method, SimView, that leverages multi-view images based on a 3D semantic map of the environment and self-supervised learning by SimSiam to train an instance identification model on-site. The effectiveness of our approach is validated using a photorealistic simulator, Habitat Matterport 3D, created by scanning real home environments. Our results demonstrate a 1.7-fold improvement in task accuracy compared to CLIP, which is pre-trained multimodal contrastive learning for object search. This improvement highlights the benefits of our proposed fine-tuning method in enhancing the performance of assistive robots in InstanceImageNav tasks. The project website is https://emergentsystemlabstudent.github.io/MultiViewRetrieve/.


title: Closing Optical Bloch Equations in waveguide QED: Dynamics, Energetics

abstract: Optical Bloch Equations (OBE) model the dynamics of a classically driven two-level atom coupled to a thermal electromagnetic field. From a global viewpoint, they derive from the unitary evolution of a closed, isolated atom-field system. We study the emergence of the OBE in the case where the driving and the thermal fields are confined in one spatial dimension -- a situation usually found in waveguide-QED. The joint atom-field system forms a "one-dimensional atom" (1D atom) whose closed dynamics can be solved, providing access to light-matter correlations. Such closure of the OBE unveils a new term capturing the driving of the atom by itself, or self-drive, which is proportional to the atom coherences in the energy basis. A 1D atom also constitutes an autonomous, energy-conserving system. Hence, energy exchanges between the atom and the field can be conveniently analyzed as closed first laws, where work-like (heat-like) flows stem from effective unitaries (correlations) exerted by one system on the other. We show that the closed and the open approaches only differ by the atom self-work, which yields a tighter expression of the second law. We quantitatively relate this tightening to the extra-knowledge acquired by closing the OBE. The concepts and effects we introduce deepen our understanding of thermodynamics in the quantum regime and its potential for energy management at quantum scales. They can be probed in state-of-the-art quantum hardware, e.g. superconducting and photonic circuits.


title: Writhe invariants of 3-regular spatial graphs

abstract: We give a necessary condition for two diagrams of $3$-regular spatial graphs with the same underlying abstract graph $G$ to represent isotopic spatial graphs. The test works by reading off the writhes of the knot diagrams coming from a collection of cycles in $G$ in each diagram, and checking whether the writhe tuples differ by an element in the image of a certain map of $\mathbb{Z}$-modules determined by $G$. We exemplify by using our result to distinguish, for each $n \ge 3$, all elements in a certain infinite family of embeddings of the M\"obius ladder $\mathrm{M}_n$ into $\mathbb{R}^3$ . We also connect these writhe tuples to a classical invariant of spatial graphs due to Wu and Taniyama.


title: Impact of chirality on active Brownian particle: Exact moments in two and three dimensions

abstract: In this work, we investigate the effects of chirality, accounting for translational diffusion, on active Brownian particles in two and three dimensions. Despite the inherent complexity in solving the Fokker-Planck equation, we demonstrate a Laplace transform method for precisely calculating the temporal evolution of various dynamic moments. Our analysis yields explicit expressions for multiple moments, such as the second and fourth moments of displacement, revealing the impact of persistence and chirality. These moments exhibit oscillatory behaviour, and excess kurtosis indicates deviations from the Gaussian distribution during intermediate time intervals.


title: Coherent control of levitated nanoparticles via dipole-dipole interaction

abstract: We propose a scheme to create and transfer thermal squeezed states and random-phase coherent states in a system of two interacting levitated nanoparticles. In this coupled levitated system, we create a thermal squeezed state of motion in one of the nanoparticles by parametrically driving it and then transferring the state to the other nanoparticle with high fidelity. The transfer mechanism is based on inducing a non-reciprocal type of coupling in the system by suitably modulating the phases of the trapping lasers and the inter-particle distance between the levitated nanoparticles. This non-reciprocal coupling creates a unidirectional channel where information flows from one nanoparticle to the other nanoparticle but not vice versa, thereby allowing for transfer of mechanical states between the nanoparticles with high fidelity. We also affirm this transfer mechanism by creating and efficiently transferring a random-phase coherent state in the coupled levitated system. Further, we make use of the feedback nonlinearity and parametric driving to create simultaneous bistability in the coupled levitated system. Our results may have potential applications in quantum information processing, quantum metrology, and in exploring many-body physics under a controlled environment.


title: Monitoring Second-Order Hyperproperties

abstract: Hyperproperties express the relationship between multiple executions of a system. This is needed in many AI-related fields, such as knowledge representation and planning, to capture system properties related to knowledge, information flow, and privacy. In this paper, we study the monitoring of complex hyperproperties at runtime. Previous work in this area has either focused on the simpler problem of monitoring trace properties (which are sets of traces, while hyperproperties are sets of sets of traces) or on monitoring first-order hyperproperties, which are expressible in temporal logics with first-order quantification over traces, such as HyperLTL. We present the first monitoring algorithm for the much more expressive class of second-order hyperproperties. Second-order hyperproperties include system properties like common knowledge, which cannot be expressed in first-order logics like HyperLTL. We introduce Hyper$^2$LTL$_f$, a temporal logic over finite traces that allows for second-order quantification over sets of traces. We study the monitoring problem in two fundamental execution models: (1) the parallel model, where a fixed number of traces is monitored in parallel, and (2) the sequential model, where an unbounded number of traces is observed sequentially, one trace after the other. For the parallel model, we show that the monitoring of the second-order hyperproperties of Hyper$^2$LTL$_f$ can be reduced to monitoring first-order hyperproperties. For the sequential model, we present a monitoring algorithm that handles second-order quantification efficiently, exploiting optimizations based on the monotonicity of subformulas, graph-based storing of executions, and fixpoint hashing. We present experimental results from a range of benchmarks, including examples from common knowledge and planning.


title: Stiffness-Tuneable Limb Segment with Flexible Spine for Malleable Robots

abstract: Robotic arms built from stiffness-adjustable, continuously bending segments serially connected with revolute joints have the ability to change their mechanical architecture and workspace, thus allowing high flexibility and adaptation to different tasks with less than six degrees of freedom, a concept that we call malleable robots. Known stiffening mechanisms may be used to implement suitable links for these novel robotic manipulators; however, these solutions usually show a reduced performance when bending due to structural deformation. By including an inner support structure this deformation can be minimised, resulting in an increased stiffening performance. This paper presents a new multi-material spine-inspired flexible structure for providing support in stiffness-controllable layer-jamming-based robotic links of large diameter. The proposed spine mechanism is highly movable with type and range of motions that match those of a robotic link using solely layer jamming, whilst maintaining a hollow and light structure. The mechanics and design of the flexible spine are explored, and a prototype of a link utilising it is developed and compared with limb segments based on granular jamming and layer jamming without support structure. Results of experiments verify the advantages of the proposed design, demonstrating that it maintains a constant central diameter across bending angles and presents an improvement of more than 203% of resisting force at 180 degrees.


title: Do LLMs Understand Visual Anomalies? Uncovering LLM Capabilities in Zero-shot Anomaly Detection

abstract: Large vision-language models (LVLMs) are markedly proficient in deriving visual representations guided by natural language. Recent explorations have utilized LVLMs to tackle zero-shot visual anomaly detection (VAD) challenges by pairing images with textual descriptions indicative of normal and abnormal conditions, referred to as anomaly prompts. However, existing approaches depend on static anomaly prompts that are prone to cross-semantic ambiguity, and prioritize global image-level representations over crucial local pixel-level image-to-text alignment that is necessary for accurate anomaly localization. In this paper, we present ALFA, a training-free approach designed to address these challenges via a unified model. We propose a run-time prompt adaptation strategy, which first generates informative anomaly prompts to leverage the capabilities of a large language model (LLM). This strategy is enhanced by a contextual scoring mechanism for per-image anomaly prompt adaptation and cross-semantic ambiguity mitigation. We further introduce a novel fine-grained aligner to fuse local pixel-level semantics for precise anomaly localization, by projecting the image-text alignment from global to local semantic spaces. Extensive evaluations on the challenging MVTec and VisA datasets confirm ALFA's effectiveness in harnessing the language potential for zero-shot VAD, achieving significant PRO improvements of 12.1% on MVTec AD and 8.9% on VisA compared to state-of-the-art zero-shot VAD approaches.


title: An $S^3\times S^3$ bundle over $S^4$ and new supergravity solutions

abstract: The metric of $S^7$ can be written as an $SU(2)$-instanton bundle over $S^4$. It is also possible to write it differently as an anti-instanton bundle. We use this observation to construct an instanton--anti-instanton, $SU(2)\times SU(2)$, bundle over $S^4$. We show that this 10d manifold admits two Einstein metrics. We then rewrite the metric to isolate two $U(1)$ directions of the fibre and dimensionally reduce along them to get an eight dimensional metric describing an $S^2\times S^2$ bundle over $S^4$. This metric allows a harmonic 4-form which we use to derive new supergravity solutions in eleven and ten dimensions as $AdS_3\times M_8$ and $AdS_2\times M_8$, respectively.


title: Learn Your Reference Model for Real Good Alignment

abstract: The complexity of the alignment problem stems from the fact that existing methods are considered unstable. Reinforcement Learning from Human Feedback (RLHF) addresses this issue by minimizing the KL divergence between the trained policy and the initial supervised fine-tuned policy (SFT) to avoid generating out-of-domain samples for the reward model (RM). Recently, many methods have emerged that shift from online to offline optimization, reformulating the RLHF objective and removing the reward model (DPO, IPO, KTO). Despite eliminating the reward model and the challenges it posed, these algorithms are still constrained in terms of closeness of the trained policy to the SFT one. In our paper, we argue that this implicit limitation in the offline optimization methods leads to suboptimal results. To address this issue, we propose a class of new methods called Trust Region (TR-DPO, TR-IPO, TR-KTO), which update the reference policy during training. With this straightforward update approach, we demonstrate the effectiveness of the new paradigm of language model alignment against the classical one on the Anthropic-HH and Reddit TL;DR datasets. Most notably, when automatically comparing TR methods and baselines side by side using pretrained Pythia 6.9B models on the Reddit TL;DR task, the difference in win rates reaches 8.4% for DPO, 14.3% for IPO, and 15% for KTO. Finally, by assessing model response ratings grounded on criteria such as coherence, correctness, helpfulness, and harmlessness, we demonstrate that our proposed methods significantly outperform existing techniques.


title: Sampling for Model Predictive Trajectory Planning in Autonomous Driving using Normalizing Flows

abstract: Alongside optimization-based planners, sampling-based approaches are often used in trajectory planning for autonomous driving due to their simplicity. Model predictive path integral control is a framework that builds upon optimization principles while incorporating stochastic sampling of input trajectories. This paper investigates several sampling approaches for trajectory generation. In this context, normalizing flows originating from the field of variational inference are considered for the generation of sampling distributions, as they model transformations of simple to more complex distributions. Accordingly, learning-based normalizing flow models are trained for a more efficient exploration of the input domain for the task at hand. The developed algorithm and the proposed sampling distributions are evaluated in two simulation scenarios.


title: Scattering on the supermembrane

abstract: We compute the one-loop $2 \rightarrow 2$ scattering amplitude of massless scalars on the world volume of an infinite $D = 11$ supermembrane quantized in the static gauge. The resulting expression is manifestly finite and turns out to be much simpler than in the bosonic membrane case in arXiv:2308.12189 being simply proportional to the tree-level scattering amplitude. We also consider the case of $\mathbb{R}^{1,1} \times S^1$ membrane with one dimension compactified on a circle of radius R and demonstrate how the supermembrane scattering amplitude reduces to the one on an infinite $D = 10$ Green-Schwarz superstring in the limit of R $\rightarrow 0$.