title: Weyl Fermion Creation by Cosmological Gravitational Wave Background at 1-loop

abstract: Weyl fermions of spin $\frac12$ minimally coupled to Einstein's gravity in 4 dimensions cannot be produced purely gravitationally in an expanding Universe at tree level. Surprisingly, as we showed in a recent letter [1], this changes at gravitational 1-loop when cosmic perturbations, like a gravitational wave background, are present. Such a background introduces a new scale, thereby breaking the fermions' conformal invariance. This leads to a non-vanishing gravitational self-energy for Weyl fermions at 1-loop and induces their production. In this paper, we present an extended study of this new mechanism, explicitly computing this effect using the in-in formalism. We work in an expanding Universe in the radiation-dominated era as a fixed background. Gravitational wave-induced fermion production has rich phenomenological consequences. Notably, if Weyl fermions eventually acquire mass, and assuming realistic - and potentially detectable - gravitational wave backgrounds, the mechanism can explain the abundance of dark matter in the Universe. More generally, gravitational-wave induced freeze-in is a new purely gravitational mechanism for generating other feebly interacting fermions, e.g. right-handed neutrinos. We show that this loop level effect can dominate over the conventional - tree-level - gravitational production of superheavy fermions in a sizable part of the parameter space.


title: Towards latent space evolution of spatiotemporal dynamics of six-dimensional phase space of charged particle beams

abstract: Addressing the charged particle beam diagnostics in accelerators poses a formidable challenge, demanding high-fidelity simulations in limited computational time. Machine learning (ML) based surrogate models have emerged as a promising tool for non-invasive charged particle beam diagnostics. Trained ML models can make predictions much faster than computationally expensive physics simulations. In this work, we have proposed a temporally structured variational autoencoder model to autoregressively forecast the spatiotemporal dynamics of the 15 unique 2D projections of 6D phase space of charged particle beam as it travels through the LANSCE linear accelerator. In the model, VAE embeds the phase space projections into a lower dimensional latent space. A long-short-term memory network then learns the temporal correlations in the latent space. The trained network can evolve the phase space projections across further modules provided the first few modules as inputs. The model predicts all the projections across different modules with low mean squared error and high structural similarity index.


title: Observational tests in scale invariance III: wide binary stars

abstract: Recent studies of wide binary stars based on Gaia DR3 suggest that the relative orbital velocities of objects with separations s > 3'000 astronomical units are statistically larger than the standard Newtonian predictions. Obviously there is no Dark Matter halo arround binary stars that could be invoked to explain these high velocities. However, we explore the properties of two-body systems in the framework of scale invariant vacuum theory, focusing on the case of objects with extreme separations. In this regime, the additional acceleration term present in the modified Newton equation with scale invariance becomes important, and may even dominate the dynamical evolution at very low gravities. Comparisons with Gaia DR3 observations of wide binaries are performed and suggest that binaries with separations s > 3'000 astronomical units have experienced such an evolution for a few Gyr, accounting well for the observed velocity excesses.


title: Interplay between ferroelectricity and metallicity in hexagonal YMnO$_3$

abstract: We use first-principles density functional theory to investigate how the polar distortion is affected by doping in multiferroic hexagonal yttrium manganite, h-YMnO$_3$. While the introduction of charge carriers tends to suppress the polar distortion in conventional ferroelectrics, the behavior in improper geometric ferroelectrics, of which h-YMnO$_3$ is the prototype, has not been studied to date. Using both background charge doping and atomic substitution, we find an approximately linear dependence of the polar distortion on doping concentration, with hole doping suppressing and electron doping enhancing it. We show that this behavior is a direct consequence of the improper geometric nature of the ferroelectricity. In addition to its doping effect, atomic substitution can further suppress or enhance the polar distortion through changes in the local chemistry and geometry.


title: What Are Large Language Models Mapping to in the Brain? A Case Against Over-Reliance on Brain Scores

abstract: Given the remarkable capabilities of large language models (LLMs), there has been a growing interest in evaluating their similarity to the human brain. One approach towards quantifying this similarity is by measuring how well a model predicts neural signals, also called "brain score". Internal representations from LLMs achieve state-of-the-art brain scores, leading to speculation that they share computational principles with human language processing. This inference is only valid if the subset of neural activity predicted by LLMs reflects core elements of language processing. Here, we question this assumption by analyzing three neural datasets used in an impactful study on LLM-to-brain mappings, with a particular focus on an fMRI dataset where participants read short passages. We first find that when using shuffled train-test splits, as done in previous studies with these datasets, a trivial feature that encodes temporal autocorrelation not only outperforms LLMs but also accounts for the majority of neural variance that LLMs explain. We therefore use contiguous splits moving forward. Second, we explain the surprisingly high brain scores of untrained LLMs by showing they do not account for additional neural variance beyond two simple features: sentence length and sentence position. This undermines evidence used to claim that the transformer architecture biases computations to be more brain-like. Third, we find that brain scores of trained LLMs on this dataset can largely be explained by sentence length, position, and pronoun-dereferenced static word embeddings; a small, additional amount is explained by sense-specific embeddings and contextual representations of sentence structure. We conclude that over-reliance on brain scores can lead to over-interpretations of similarity between LLMs and brains, and emphasize the importance of deconstructing what LLMs are mapping to in neural signals.


title: Physics-informed deep learning and compressive collocation for high-dimensional diffusion-reaction equations: practical existence theory and numerics

abstract: On the forefront of scientific computing, Deep Learning (DL), i.e., machine learning with Deep Neural Networks (DNNs), has emerged a powerful new tool for solving Partial Differential Equations (PDEs). It has been observed that DNNs are particularly well suited to weakening the effect of the curse of dimensionality, a term coined by Richard E. Bellman in the late `50s to describe challenges such as the exponential dependence of the sample complexity, i.e., the number of samples required to solve an approximation problem, on the dimension of the ambient space. However, although DNNs have been used to solve PDEs since the `90s, the literature underpinning their mathematical efficiency in terms of numerical analysis (i.e., stability, accuracy, and sample complexity), is only recently beginning to emerge. In this paper, we leverage recent advancements in function approximation using sparsity-based techniques and random sampling to develop and analyze an efficient high-dimensional PDE solver based on DL. We show, both theoretically and numerically, that it can compete with a novel stable and accurate compressive spectral collocation method. In particular, we demonstrate a new practical existence theorem, which establishes the existence of a class of trainable DNNs with suitable bounds on the network architecture and a sufficient condition on the sample complexity, with logarithmic or, at worst, linear scaling in dimension, such that the resulting networks stably and accurately approximate a diffusion-reaction PDE with high probability.


title: Pinpointing Lattice-Matched Conditions for Wurtzite ScxAl1-xN/GaN Heterostructures with X-Ray Reciprocal Space Analysis

abstract: Using comprehensive x-ray reciprocal space mapping, we establish the precise lattice-matching composition for wurtzite $Sc_xAl_{1-x}N$ layers on (0001) GaN to be x = 0.14+/-0.01. 100-nm thick $Sc_xAl_{1-x}N$ films (x = 0.09 - 0.19) were grown in small composition increments on c-plane GaN templates by plasma-assisted molecular beam epitaxy. The alloy composition was estimated from the fit of the (0002) x-ray peak positions assuming the c-lattice parameter of ScAlN films coherently-strained on GaN increases linearly with Sc-content determined independently by Rutherford Backscattering Spectrometry. Reciprocal space maps obtained from high-resolution x-ray diffraction measurements of the (10-15) reflection reveal that $Sc_xAl_{1-x}N$ films with x = 0.14+/-0.01 are coherently strained with the GaN substrate while the other compositions show evidence of relaxation. The in-plane lattice-matching with GaN is further confirmed for a 300-nm thick $Sc_{0.14}Al_{0.86}N$ layer. The full-width-at-half-maximum of the (0002) reflection rocking curve for this $Sc_{0.14}Al_{0.86}N$ film is 106 arcseconds and corresponds to the lowest value reported in the literature for wurtzite ScAlN films.


title: Adaptive discretization algorithms for locally optimal experimental design

abstract: We develop adaptive discretization algorithms for locally optimal experimental design of nonlinear prediction models. With these algorithms, we refine and improve a pertinent state-of-the-art algorithm in various respects. We establish novel termination, convergence, and convergence rate results for the proposed algorithms. In particular, we prove a sublinear convergence rate result under very general assumptions on the design criterion and, most notably, a linear convergence result under the additional assumption that the design criterion is strongly convex and the design space is finite. Additionally, we prove the finite termination at approximately optimal designs, including upper bounds on the number of iterations until termination. And finally, we illustrate the practical use of the proposed algorithms by means of two application examples from chemical engineering: one with a stationary model and one with a dynamic model.


title: CO in the Draco Nebula: The Atomic-Molecular Transition

abstract: This paper presents maps of the J=2-1 transition of CO toward the Draco Nebula Intermediate Velocity Cloud (IVC). The maps cover 8500 square arcmin with a velocity resolution of 0.33 km~s$^{-1}$ and angular resolution of 38", or 0.11 pc at the cloud distance of 600 pc. The mapped area includes all the emission detected by the {\it Herschel} satellite with 250 $\mu$m intensity >5 MJy/sr. Previously published observations of the far-IR emission and the 21 cm line of HI are used to derive the column density distribution of H$_2$ and the abundance ratio CO/H$_2$, as well as the distribution of the molecular fraction of hydrogen, which approaches 90\% over much of the brighter parts of the nebula. The CO emission is highly clumpy and closely resembles the structures seen in far-IR images. The kinematics of the CO show supersonic motions between clumps but near-thermal to trans-sonic motions within clumps, consistent with model predictions that the scale length for dissipation of supersonic turbulence should be $\sim0.1$ pc, mediated by kinematic viscosity and/or ambipolar diffusion. Different parts of the nebula show evidence for a spread of molecular formation timescales of a few 10$^5$ years, comparable to the dynamical timescale of the infalling gas. The IVC will likely merge with the Galactic interstellar medium in $\sim 10^7$ years, and the densest clumps may form an unbound cluster of low-mass stars.


title: Symplectic Quantization and General Constraint Structure of a Prototypical Second-Class System

abstract: We discuss a general prototypical constrained Hamiltonian system with a broad application in quantum field theory and similar contexts where dynamics is defined through a functional action obeying a stationarity principle. The prototypical model amounts to a Dirac-Bergmann singular system, whose constraints restrict the actual dynamics to occur within a differential submanifold, as is the case in the major part of field theoretical models with gauge symmetry. We apply the Dirac-Bergmann algorithm in its full generality unraveling a total of $4m$ second-class constraints and obtain the corresponding Dirac brackets algebra in phase space. We follow with the Faddeev-Jackiw-Barcelos-Wotzasek approach in which the geometric character of the mentioned submanifold is emphasized by means of an internal metric function encoding its symplectic properties. We consider two straightforward examples, applying our general results to constrained motion along a toroidal geometry and to a Lorentz violating toy model in field theory. Since toroidal geometry has been recently used in cosmological models, we suggest how our results could lead to different proposals for the shape of the universe in cosmology.


title: Learning from Mistakes: a Weakly-supervised Method for Mitigating the Distribution Shift in Autonomous Vehicle Planning

abstract: The planning problem constitutes a fundamental aspect of the autonomous driving framework. Recent strides in representation learning have empowered vehicles to comprehend their surrounding environments, thereby facilitating the integration of learning-based planning strategies. Among these approaches, Imitation Learning stands out due to its notable training efficiency. However, traditional Imitation Learning methodologies encounter challenges associated with the co-variate shift phenomenon. We propose Learn from Mistakes (LfM) as a remedy to address this issue. The essence of LfM lies in deploying a pre-trained planner across diverse scenarios. Instances where the planner deviates from its immediate objectives, such as maintaining a safe distance from obstacles or adhering to traffic rules, are flagged as mistakes. The environments corresponding to these mistakes are categorized as out-of-distribution states and compiled into a new dataset termed closed-loop mistakes dataset. Notably, the absence of expert annotations for the closed-loop data precludes the applicability of standard imitation learning approaches. To facilitate learning from the closed-loop mistakes, we introduce Validity Learning, a weakly supervised method, which aims to discern valid trajectories within the current environmental context. Experimental evaluations conducted on the InD and Nuplan datasets reveal substantial enhancements in closed-loop metrics such as Progress and Collision Rate, underscoring the effectiveness of the proposed methodology.


title: Gradient Technique Theory: Tracing magnetic field and obtaining magnetic field strength

abstract: The gradient technique is a promising tool with theoretical foundations based on the fundamental properties of MHD turbulence and turbulent reconnection. Its various incarnations use spectroscopic, synchrotron, and intensity data to trace the magnetic field and measure the media magnetization in terms of Alfven Mach number. We provide an analytical theory of gradient measurements and quantify the effects of averaging gradients along the line of sight and over the plane of the sky. We derive analytical expressions that relate the properties of gradient distribution with the Alfven Mach number $M_A$. We show that these measurements can be combined with measures of sonic Mach number or line broadening to obtain the magnetic field strength. The corresponding technique has advantages to Davis-Chandrasekhar-Fermi way of obtaining the magnetic field strength.


title: Intermediate subalgebras for reduced crossed products of discrete groups

abstract: Let $\alpha : \Gamma \curvearrowright A$ be an action of a discrete group $\Gamma$ on a unital C*-algebra $A$ by *-automorphisms and let $A \rtimes_{\alpha,\lambda} \Gamma$ denote the corresponding reduced crossed product C*-algebra. Assuming that $\Gamma$ satisfies the approximation property, we establish a sufficient and (almost always) necessary condition on the action $\alpha$ for the existence of a Galois correspondence between intermediate C*-algebras for the inclusion $A \subseteq A \rtimes_{\alpha,\lambda} \Gamma$ and partial subactions of $\alpha$. This condition, which we refer to as pointwise residual proper outerness, is a natural noncommutative generalization of freeness.


title: Encoding lattice structures in Quantum Computational Basis States

abstract: Lattice models or structures are geometrical objects with mathematical forms, that are used to represent physical systems. They have been used widely in diverse fields, namely, in condensed matter physics, to study degrees of freedom of molecules in chemistry and in studying polymer dynamics and protein structures to name a few. In this article we discuss an encoding methodology of lattice structures in computational basis states of qubits (as used in quantum computing algorithms). We demonstrate a specific use case of lattice models in protein structure prediction. We do not propose any quantum algorithm to solve the protein structure prediction problem, instead, we propose a generic encoding methodology of lattice structures.


title: How to discretize continuous state-action spaces in Q-learning: A symbolic control approach

abstract: Q-learning is widely recognized as an effective approach for synthesizing controllers to achieve specific goals. However, handling challenges posed by continuous state-action spaces remains an ongoing research focus. This paper presents a systematic analysis that highlights a major drawback in space discretization methods. To address this challenge, the paper proposes a symbolic model that represents behavioral relations, such as alternating simulation from abstraction to the controlled system. This relation allows for seamless application of the synthesized controller based on abstraction to the original system. Introducing a novel Q-learning technique for symbolic models, the algorithm yields two Q-tables encoding optimal policies. Theoretical analysis demonstrates that these Q-tables serve as both upper and lower bounds on the Q-values of the original system with continuous spaces. Additionally, the paper explores the correlation between the parameters of the space abstraction and the loss in Q-values. The resulting algorithm facilitates achieving optimality within an arbitrary accuracy, providing control over the trade-off between accuracy and computational complexity. The obtained results provide valuable insights for selecting appropriate learning parameters and refining the controller. The engineering relevance of the proposed Q-learning based symbolic model is illustrated through two case studies.


title: An Information Bottleneck Perspective for Effective Noise Filtering on Retrieval-Augmented Generation

abstract: Retrieval-augmented generation integrates the capabilities of large language models with relevant information retrieved from an extensive corpus, yet encounters challenges when confronted with real-world noisy data. One recent solution is to train a filter module to find relevant content but only achieve suboptimal noise compression. In this paper, we propose to introduce the information bottleneck theory into retrieval-augmented generation. Our approach involves the filtration of noise by simultaneously maximizing the mutual information between compression and ground output, while minimizing the mutual information between compression and retrieved passage. In addition, we derive the formula of information bottleneck to facilitate its application in novel comprehensive evaluations, the selection of supervised fine-tuning data, and the construction of reinforcement learning rewards. Experimental results demonstrate that our approach achieves significant improvements across various question answering datasets, not only in terms of the correctness of answer generation but also in the conciseness with $2.5\%$ compression rate.


title: Effective Field Theory of Conformal Boundaries

abstract: We introduce an effective field theory (EFT) for conformal impurity by considering a pair of transversely displaced impurities and integrating out modes with mass inversely proportional to the separation distance. This EFT captures the universal signature of the impurity seen by a heavy local operator. We focus on the case of conformal boundaries and derive universal formulas from this EFT for the boundary structure constants at high energy. We point out that the more familiar thermal EFT for conformal field theory is a special case of this EFT with distinguished conformal boundaries. We also derive, for general conformal impurities, non-positivity and convexity-like constraints on the Casimir energy which determines the leading EFT coefficient.


title: ELSA: Evaluating Localization of Social Activities in Urban Streets

abstract: Why do some streets attract more social activities than others? Is it due to street design, or do land use patterns in neighborhoods create opportunities for businesses where people gather? These questions have intrigued urban sociologists, designers, and planners for decades. Yet, most research in this area has remained limited in scale, lacking a comprehensive perspective on the various factors influencing social interactions in urban settings. Exploring these issues requires fine-level data on the frequency and variety of social interactions on urban street. Recent advances in computer vision and the emergence of the open-vocabulary detection models offer a unique opportunity to address this long-standing issue on a scale that was previously impossible using traditional observational methods. In this paper, we propose a new benchmark dataset for Evaluating Localization of Social Activities (ELSA) in urban street images. ELSA draws on theoretical frameworks in urban sociology and design. While majority of action recognition datasets are collected in controlled settings, we use in-the-wild street-level imagery, where the size of social groups and the types of activities can vary significantly. ELSA includes 937 manually annotated images with more than 4,300 multi-labeled bounding boxes for individual and group activities, categorized into three primary groups: Condition, State, and Action. Each category contains various sub-categories, e.g., alone or group under Condition category, standing or walking, which fall under the State category, and talking or dining with regards to the Action category. ELSA is publicly available for the research community.


title: Learning equivariant tensor functions with applications to sparse vector recovery

abstract: This work characterizes equivariant polynomial functions from tuples of tensor inputs to tensor outputs. Loosely motivated by physics, we focus on equivariant functions with respect to the diagonal action of the orthogonal group on tensors. We show how to extend this characterization to other linear algebraic groups, including the Lorentz and symplectic groups. Our goal behind these characterizations is to define equivariant machine learning models. In particular, we focus on the sparse vector estimation problem. This problem has been broadly studied in the theoretical computer science literature, and explicit spectral methods, derived by techniques from sum-of-squares, can be shown to recover sparse vectors under certain assumptions. Our numerical results show that the proposed equivariant machine learning models can learn spectral methods that outperform the best theoretically known spectral methods in some regimes. The experiments also suggest that learned spectral methods can solve the problem in settings that have not yet been theoretically analyzed. This is an example of a promising direction in which theory can inform machine learning models and machine learning models could inform theory.


title: Feedback Stabilization and Finite Element Error Analysis of Viscous Burgers Equation around Non-Constant Steady State

abstract: In this article, we explore the feedback stabilization of a viscous Burgers equation around a non-constant steady state using localized interior controls and then develop error estimates for the stabilized system using finite element method. The system is not only feedback stabilizable but exhibits an exponential decay $-\omega<0$ for any $\omega>0$. The derivation of a stabilizing control in feedback form is achieved by solving a suitable algebraic Riccati equation posed for the linearized system. In the second part of the article, we utilize a conforming finite element method to discretize the continuous system, resulting in a finite-dimensional discrete system. This approximated system is also proven to be feedback stabilizable (uniformly) with exponential decay $-\omega+\epsilon$ for any $\epsilon>0$. The feedback control for this discrete system is obtained by solving a discrete algebraic Riccati equation. To validate the effectiveness of our approach, we provide error estimates for both the stabilized solutions and the stabilizing feedback controls. Numerical implementations are carried out to support and validate our theoretical results.


title: Amplitudes, Supersymmetric Black Hole Scattering at $\mathcal{O}(G^5)$, and Loop Integration

abstract: We compute the potential-graviton contribution to the scattering amplitude, the radial action, and the scattering angle of two extremal black holes in N = 8 supergravity at the fifth post-Minkowskian order to next-to-leading order in a large mass expansion (first self-force order). Properties of classical unitarity cuts allow us to focus on the integration-by-parts reduction of planar integrals, while nonplanar integrals at this order are obtained from the planar ones by straightforward manipulations. We present all master integrals and solve their associated differential equations necessary to evaluate the classical scattering amplitudes of massive scalar particles at this order in all gravitational theories, in particular in N = 8 supergravity, and in general relativity. Despite the appearance of higher-weight generalized polylogarithms and elliptic functions in the solution to the differential equation for master integrals, the final supergravity answer is remarkably simple and contains only (harmonic) polylogarithmic functions up to weight 2. The systematic analysis of elliptic integrals discussed here, as well as the particular organization of boundary integrals in N = 8 observables are independent of supersymmetry and may have wider applications, including to aspects of collider physics.


title: Towards Flexible Interactive Reflection Removal with Human Guidance

abstract: Single image reflection removal is inherently ambiguous, as both the reflection and transmission components requiring separation may follow natural image statistics. Existing methods attempt to address the issue by using various types of low-level and physics-based cues as sources of reflection signals. However, these cues are not universally applicable, since they are only observable in specific capture scenarios. This leads to a significant performance drop when test images do not align with their assumptions. In this paper, we aim to explore a novel flexible interactive reflection removal approach that leverages various forms of sparse human guidance, such as points and bounding boxes, as auxiliary high-level prior to achieve robust reflection removal. However, incorporating the raw user guidance naively into the existing reflection removal network does not result in performance gains. To this end, we innovatively transform raw user input into a unified form -- reflection masks using an Interactive Segmentation Foundation Model. Such a design absorbs the quintessence of the foundational segmentation model and flexible human guidance, thereby mitigating the challenges of reflection separations. Furthermore, to fully utilize user guidance and reduce user annotation costs, we design a mask-guided reflection removal network, comprising our proposed self-adaptive prompt block. This block adaptively incorporates user guidance as anchors and refines transmission features via cross-attention mechanisms. Extensive results on real-world images validate that our method demonstrates state-of-the-art performance on various datasets with the help of flexible and sparse user guidance. Our code and dataset will be publicly available here https://github.com/ShawnChenn/FlexibleReflectionRemoval.


title: Observations and detectability of young Suns' flaring and CME activity in optical spectra

abstract: The Sun's history is still a subject of interest to modern astrophysics. Observationally constrained CME rates of young solar analogues are still lacking, as those require dedicated monitoring. We present medium resolution optical spectroscopic monitoring of a small sample of bright and prominent solar analogues over a period of three years using the 0.5m telescope at observatory Lustb\"uhel Graz (OLG) of the University of Graz, Austria. The aim is the detection of flares and CMEs from those spectra. In more than 1700 hours of spectroscopic monitoring we found signatures of four flares and one filament eruption on EK Dra which has been reported in previous literature, but we complementarily extended the data to cover the latter phase. The other stars did not reveal detectable signatures of activity. For these non-detections we derive upper limits of occurrence rates of very massive CMEs, which are detectable with our observational setup, ranging from 0.1 to 2.2 per day , but these may be even smaller than the given rates considering observational biases. Furthermore, we investigate the detectability of flares/CMEs in OLG spectra by utilizing solar 2D H{\alpha} spectra from MEES solar observatory. We find that solar-sized events are not detectable within our observations. By scaling up the size of the solar event, we show that with a fractional active region area of 18% in residual spectra and 24% in equivalent width time series derived from the same residuals that solar events are detectable if they had hypothetically occurred on HN Peg.


title: Bayesian compositional regression with flexible microbiome feature aggregation and selection

abstract: Ongoing advances in microbiome profiling have allowed unprecedented insights into the molecular activities of microbial communities. This has fueled a strong scientific interest in understanding the critical role the microbiome plays in governing human health, by identifying microbial features associated with clinical outcomes of interest. Several aspects of microbiome data limit the applicability of existing variable selection approaches. In particular, microbiome data are high-dimensional, extremely sparse, and compositional. Importantly, many of the observed features, although categorized as different taxa, may play related functional roles. To address these challenges, we propose a novel compositional regression approach that leverages the data-adaptive clustering and variable selection properties of the spiked Dirichlet process to identify taxa that exhibit similar functional roles. Our proposed method, Bayesian Regression with Agglomerated Compositional Effects using a dirichLET process (BRACElet), enables the identification of a sparse set of features with shared impacts on the outcome, facilitating dimension reduction and model interpretation. We demonstrate that BRACElet outperforms existing approaches for microbiome variable selection through simulation studies and an application elucidating the impact of oral microbiome composition on insulin resistance.


title: Coined Quantum Walk on a Quantum Network

abstract: We explore a discrete-time, coined quantum walk on a quantum network where the coherent superposition of walker-moves originates from the unitary interaction of the walker-coin with the qubit degrees of freedom in the quantum network. The walk dynamics leads to a growth of entanglement between the walker and the network on one hand, and on the other, between the network-qubits among themselves. The initial entanglement among the network qubits plays a crucial role in determining the asymptotic values of these entanglement measures and the quantum walk statistics. Specifically, the entanglement entropy of the walker-network state and the negativity of the quantum network-qubit state saturate to values increasing with the initial network-entanglement. The asymptotic time-averaged walker-position probability distribution shows increasing localization around the initial walker-position with higher initial network entanglement. A potential application of these results as a characterisation tool for quantum network properties is suggested.


title: Prototypical Transformer as Unified Motion Learners

abstract: In this work, we introduce the Prototypical Transformer (ProtoFormer), a general and unified framework that approaches various motion tasks from a prototype perspective. ProtoFormer seamlessly integrates prototype learning with Transformer by thoughtfully considering motion dynamics, introducing two innovative designs. First, Cross-Attention Prototyping discovers prototypes based on signature motion patterns, providing transparency in understanding motion scenes. Second, Latent Synchronization guides feature representation learning via prototypes, effectively mitigating the problem of motion uncertainty. Empirical results demonstrate that our approach achieves competitive performance on popular motion tasks such as optical flow and scene depth. Furthermore, it exhibits generality across various downstream tasks, including object tracking and video stabilization.


title: Inflection Point of Minimally Coupled Tachyonic Scalar Field

abstract: In this paper, we investigate the behaviour of a minimally coupled tachyonic scalar field at inflection points in an accelerating universe. We consider the different expansion factors and obtain potentials of tachyonic scalar field. Inflection points of homogeneous tachyonic scalar field is calculated for these potentials. We employ the tools of dynamical system analysis for the considered potentials and obtain the stable points.


title: Long and Short Guidance in Score identity Distillation for One-Step Text-to-Image Generation

abstract: Diffusion-based text-to-image generation models trained on extensive text-image pairs have shown the capacity to generate photorealistic images consistent with textual descriptions. However, a significant limitation of these models is their slow sample generation, which requires iterative refinement through the same network. In this paper, we enhance Score identity Distillation (SiD) by developing long and short classifier-free guidance (LSG) to efficiently distill pretrained Stable Diffusion models without using real training data. SiD aims to optimize a model-based explicit score matching loss, utilizing a score-identity-based approximation alongside the proposed LSG for practical computation. By training exclusively with fake images synthesized with its one-step generator, SiD equipped with LSG rapidly improves FID and CLIP scores, achieving state-of-the-art FID performance while maintaining a competitive CLIP score. Specifically, its data-free distillation of Stable Diffusion 1.5 achieves a record low FID of 8.15 on the COCO-2014 validation set, with a CLIP score of 0.304 at an LSG scale of 1.5, and a FID of 9.56 with a CLIP score of 0.313 at an LSG scale of 2. Our SiD-LSG code and distilled one-step text-to-image generators are available at https://github.com/mingyuanzhou/SiD-LSG


title: A New View on Planning in Online Reinforcement Learning

abstract: This paper investigates a new approach to model-based reinforcement learning using background planning: mixing (approximate) dynamic programming updates and model-free updates, similar to the Dyna architecture. Background planning with learned models is often worse than model-free alternatives, such as Double DQN, even though the former uses significantly more memory and computation. The fundamental problem is that learned models can be inaccurate and often generate invalid states, especially when iterated many steps. In this paper, we avoid this limitation by constraining background planning to a set of (abstract) subgoals and learning only local, subgoal-conditioned models. This goal-space planning (GSP) approach is more computationally efficient, naturally incorporates temporal abstraction for faster long-horizon planning and avoids learning the transition dynamics entirely. We show that our GSP algorithm can propagate value from an abstract space in a manner that helps a variety of base learners learn significantly faster in different domains.


title: LoFiT: Localized Fine-tuning on LLM Representations

abstract: Recent work in interpretability shows that large language models (LLMs) can be adapted for new tasks in a learning-free way: it is possible to intervene on LLM representations to elicit desired behaviors for alignment. For instance, adding certain bias vectors to the outputs of certain attention heads is reported to boost the truthfulness of models. In this work, we show that localized fine-tuning serves as an effective alternative to such representation intervention methods. We introduce a framework called Localized Fine-Tuning on LLM Representations (LoFiT), which identifies a subset of attention heads that are most important for learning a specific task, then trains offset vectors to add to the model's hidden representations at those selected heads. LoFiT localizes to a sparse set of heads (3%) and learns the offset vectors from limited training data, comparable to the settings used for representation intervention. For truthfulness and reasoning tasks, we find that LoFiT's intervention vectors are more effective for LLM adaptation than vectors from representation intervention methods such as Inference-time Intervention. We also find that the localization step is important: selecting a task-specific set of attention heads can lead to higher performance than intervening on heads selected for a different task. Finally, for the tasks we study, LoFiT achieves comparable performance to other parameter-efficient fine-tuning methods such as LoRA, despite modifying 20x-200x fewer parameters than these methods.


title: Extremum Seeking Control for Scalar Maps with Distributed Diffusion PDEs

abstract: This paper deals with the gradient extremum seeking control for static scalar maps with actuators governed by distributed diffusion partial differential equations (PDEs). To achieve the real-time optimization objective, we design a compensation controller for the distributed diffusion PDE via backstepping transformation in infinite dimensions. A further contribution of this paper is the appropriate motion planning design of the so-called probing (or perturbation) signal, which is more involved than in the non-distributed counterpart. Hence, with these two design ingredients, we provide an averaging-based methodology that can be implemented using the gradient and Hessian estimates. Local exponential stability for the closed-loop equilibrium of the average error dynamics is guaranteed through a Lyapunov-based analysis. By employing the averaging theory for infinite-dimensional systems, we prove that the trajectory converges to a small neighborhood surrounding the optimal point. The effectiveness of the proposed extremum seeking controller for distributed diffusion PDEs in cascade of nonlinear maps to be optimized is illustrated by means of numerical simulations.


title: The volume of an isocanted cube is a determinant

abstract: In any dimension d>=2, we give exact volume formulas of two mutually polar dual convex d--polytopes. The primal body is called isocanted cube of dimension d, depending on two real parameters 0<a<l. The limit case a=0 yields a d--cube of edge--length l. We prove that the volume of such a body is the determinant of the matrix of order d having diagonal entries equal to l and a elsewhere. We also compute the volume of the polar dual body, getting a rational expression in l and a, homogeneous of degree -d with rational coefficients. Isocanted cubes are origin--symmetric zonotopes. Zonoids (defined as the limits of families of zonotopes) satisfy the Mahler conjecture; in particular, zonotopes do. Nonetheless, we confirm (by elementary methods) that the Mahler conjecture holds for isocanted cubes.


title: Helix: Distributed Serving of Large Language Models via Max-Flow on Heterogeneous GPUs

abstract: This paper introduces Helix, a distributed system for high-throughput, low-latency large language model (LLM) serving on heterogeneous GPU clusters. A key idea behind Helix is to formulate inference computation of LLMs over heterogeneous GPUs and network connections as a max-flow problem for a directed, weighted graph, whose nodes represent GPU instances and edges capture both GPU and network heterogeneity through their capacities. Helix then uses a mixed integer linear programming (MILP) algorithm to discover highly optimized strategies to serve LLMs. This approach allows Helix to jointly optimize model placement and request scheduling, two highly entangled tasks in heterogeneous LLM serving. Our evaluation on several heterogeneous cluster settings ranging from 24 to 42 GPU nodes shows that Helix improves serving throughput by up to 2.7$\times$ and reduces prompting and decoding latency by up to 2.8$\times$ and 1.3$\times$, respectively, compared to best existing approaches.


title: Modularity in $d>2$ free conformal field theory

abstract: We derive new closed form expressions for the partition functions of free conformally-coupled scalars on $S^{2D-1}\times S^1$ which resum the exact high-temperature expansion. The derivation relies on an identification of the partition functions, analytically continued in chemical potentials and temperature, with multiple elliptic Gamma functions. These functions satisfy interesting modular properties, which we use to arrive at our expressions. We describe a geometric interpretation of the modular properties of multiple elliptic Gamma functions in the context of superconformal field theory. Based on this, we suggest a geometric interpretation of the modular property in the context of the free scalar CFT in even dimensions and comment on extensions to odd dimensions and free fermions.


title: Regularity for the fractional $p$-Laplace equation

abstract: Higher Sobolev and H\"older regularity is studied for local weak solutions of the fractional $p$-Laplace equation of order $s$ in the case $p\ge 2$. Depending on the regime considered, i.e. $$0<s\le\tfrac{p-2}{p}\quad \text{or} \quad\tfrac{p-2}{p}<s<1,$$ precise local estimates are proven. The relevant estimates are stable if the fractional order $s$ reaches $1$; the known Sobolev regularity estimates for the local $p$-Laplace are recovered. The case $p=2$ reproduces the almost $W^{1+s,2}_{\rm loc}$-regularity for the fractional Laplace equation of any order $s\in(0,1)$.


title: Isotopologue-selective laser cooling of molecules

abstract: Direct laser cooling of molecules has made significant progress in recent years. However, the selective cooling and manipulation of molecules based on their isotopic composition, which is ubiquitous in atomic laser cooling, has not yet been achieved. Here, we demonstrate such isotopologue-selective laser cooling of molecules, using barium monofluoride (BaF) as an example. The manipulation of the rare and previously uncooled 136BaF is achieved within a molecular beam containing several isotopologues of significantly higher natural abundance. Our results enable intense molecular beams and high fidelity detection of select low-abundance isotopologues or isotopic mixtures. Such beams are a first step towards isotopologue-selective molecular trapping and will be useful for applications in trace gas analysis, cold chemistry and precision tests of fundamental symmetries.


title: Single Trajectory Conformal Prediction

abstract: We study the performance of risk-controlling prediction sets (RCPS), an empirical risk minimization-based formulation of conformal prediction, with a single trajectory of temporally correlated data from an unknown stochastic dynamical system. First, we use the blocking technique to show that RCPS attains performance guarantees similar to those enjoyed in the iid setting whenever data is generated by asymptotically stationary and contractive dynamics. Next, we use the decoupling technique to characterize the graceful degradation in RCPS guarantees when the data generating process deviates from stationarity and contractivity. We conclude by discussing how these tools could be used toward a unified analysis of online and offline conformal prediction algorithms, which are currently treated with very different tools.


title: Quantum many-body spin ratchets

abstract: Introducing a class of SU(2) invariant quantum unitary circuits generating chiral transport, we examine the role of broken space-reflection and time-reversal symmetries on spin transport properties. Upon adjusting parameters of local unitary gates, the dynamics can be either chaotic or integrable. The latter corresponds to a generalization of the space-time discretized (Trotterized) higher-spin quantum Heisenberg chain. We demonstrate that breaking of space-reflection symmetry results in a drift in the dynamical spin susceptibility. Remarkably, we find a universal drift velocity given by a simple formula which, at zero average magnetization, depends only on the values of SU(2) Casimir invariants associated with local spins. In the integrable case, the drift velocity formula is confirmed analytically based on the exact solution of thermodynamic Bethe ansatz equations. Finally, by inspecting the large fluctuations of the time-integrated current between two halves of the system in stationary maximum-entropy states, we demonstrate violation of the Gallavotti-Cohen symmetry, implying that such states cannot be regarded as equilibrium ones. We show that the scaled cumulant generating function of the time-integrated current instead obeys a generalized fluctuation relation.


title: Unlocking Guidance for Discrete State-Space Diffusion and Flow Models

abstract: Generative models on discrete state-spaces have a wide range of potential applications, particularly in the domain of natural sciences. In continuous state-spaces, controllable and flexible generation of samples with desired properties has been realized using guidance on diffusion and flow models. However, these guidance approaches are not readily amenable to discrete state-space models. Consequently, we introduce a general and principled method for applying guidance on such models. Our method depends on leveraging continuous-time Markov processes on discrete state-spaces, which unlocks computational tractability for sampling from a desired guided distribution. We demonstrate the utility of our approach, Discrete Guidance, on a range of applications including guided generation of images, small-molecules, DNA sequences and protein sequences.


title: A classifying localic category for locally compact locales with application to the Axiom of Infinity (poster)

abstract: For an internal category $\mathbb{C}$ in a cartesian category $\mathcal{C}$ we define, naturally in objects $X$ of $\mathcal{C}$, $Prin_{\mathbb{C}}(X)$. This is a category whose objects are principal $c \mathbb{C}$-bundles over $X$ and whose morphisms are principal $c(\mathbb{C}^{\uparrow})$-bundles. Here $c(\_)$ denotes taking the core groupoid of a category (same objects but only isomorphisms as morphisms) and $\mathbb{C}^{\uparrow}$ is the arrow category of $\mathbb{C}$ (objects morphisms, morphisms commuting squares). We show that $X \mapsto Prin_{\mathbb{C}}(X)$ is a stack of categories and call stacks of this sort lax-geometric. We then provide two sufficient conditions for a stack to be lax-geometric and use them to prove that the pseudo-functor $X \mapsto \mathbf{LK}_{Sh(X)}$ on the category of locales $\mathbf{Loc}$ is a lax-geometric stack. Here $\mathbf{LK}_{Sh(X)}$ is the category of locally compact locales in the topos of sheaves over $X$, $Sh(X)$. Therefore there exists a localic category $\mathbb{C}_{\mathbf{LK}}$ such that $\mathbf{LK}_{Sh(X)} \simeq Prin_{\mathbb{C}_{\mathbf{LK}}}(X)$ naturally for every locale $X$. We then show how this can be used to give a new localic characterisation of the Axiom of Infinity.


title: MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark

abstract: In the age of large-scale language models, benchmarks like the Massive Multitask Language Understanding (MMLU) have been pivotal in pushing the boundaries of what AI can achieve in language comprehension and reasoning across diverse domains. However, as models continue to improve, their performance on these benchmarks has begun to plateau, making it increasingly difficult to discern differences in model capabilities. This paper introduces MMLU-Pro, an enhanced dataset designed to extend the mostly knowledge-driven MMLU benchmark by integrating more challenging, reasoning-focused questions and expanding the choice set from four to ten options. Additionally, MMLU-Pro eliminates the trivial and noisy questions in MMLU. Our experimental results show that MMLU-Pro not only raises the challenge, causing a significant drop in accuracy by 16% to 33% compared to MMLU but also demonstrates greater stability under varying prompts. With 24 different prompt styles tested, the sensitivity of model scores to prompt variations decreased from 4-5% in MMLU to just 2% in MMLU-Pro. Additionally, we found that models utilizing Chain of Thought (CoT) reasoning achieved better performance on MMLU-Pro compared to direct answering, which is in stark contrast to the findings on the original MMLU, indicating that MMLU-Pro includes more complex reasoning questions. Our assessments confirm that MMLU-Pro is a more discriminative benchmark to better track progress in the field.


title: Stochastic Bilevel Optimization with Lower-Level Contextual Markov Decision Processes

abstract: In various applications, the optimal policy in a strategic decision-making problem depends both on the environmental configuration and exogenous events. For these settings, we introduce Bilevel Optimization with Contextual Markov Decision Processes (BO-CMDP), a stochastic bilevel decision-making model, where the lower level consists of solving a contextual Markov Decision Process (CMDP). BO-CMDP can be viewed as a Stackelberg Game where the leader and a random context beyond the leader's control together decide the setup of (many) MDPs that (potentially multiple) followers best respond to. This framework extends beyond traditional bilevel optimization and finds relevance in diverse fields such as model design for MDPs, tax design, reward shaping and dynamic mechanism design. We propose a stochastic Hyper Policy Gradient Descent (HPGD) algorithm to solve BO-CMDP, and demonstrate its convergence. Notably, HPGD only utilizes observations of the followers' trajectories. Therefore, it allows followers to use any training procedure and the leader to be agnostic of the specific algorithm used, which aligns with various real-world scenarios. We further consider the setting when the leader can influence the training of followers and propose an accelerated algorithm. We empirically demonstrate the performance of our algorithm.


title: Magnetar central engine powering the energetic GRB 210610B ?

abstract: The bright GRB 210610B was discovered simultaneously by Fermi and Swift missions at redshift 1.13. We utilized broadband Fermi-GBM observations to perform a detailed prompt emission spectral analysis and to understand the radiation physics of the burst. Our analysis displayed that the low energy spectral index ($\alpha_{\rm pt}$) exceeds boundaries expected from the typical synchrotron emission spectrum (-1.5,-0.67), suggesting additional emission signature. We added an additional thermal model with the typical Band or CPL function and found that CPL + BB function is better fitting to the data, suggesting a hybrid jet composition for the burst. Further, we found that the beaming corrected energy (E$_{\rm \gamma, \theta_{j}}$ = 1.06 $\times$ 10$^{51}$ erg) of the burst is less than the total energy budget of the magnetar. Additionally, the X-ray afterglow light curve of this burst exhibits achromatic plateaus, adding another layer of complexity to the explosion's behavior. Interestingly, we noted that the X-ray energy release during the plateau phase (E$_{\rm X,iso}$ = 1.94 $\times$ 10$^{51}$ erg) is also less than the total energy budget of the magnetar. Our results indicate the possibility that a magnetar could be the central engine for this burst.


title: An Equivalence Between Static and Dynamic Regret Minimization

abstract: We study the problem of dynamic regret minimization in online convex optimization, in which the objective is to minimize the difference between the cumulative loss of an algorithm and that of an arbitrary sequence of comparators. While the literature on this topic is very rich, a unifying framework for the analysis and design of these algorithms is still missing. In this paper, \emph{we show that dynamic regret minimization is equivalent to static regret minimization in an extended decision space}. Using this simple observation, we show that there is a frontier of lower bounds trading off penalties due to the variance of the losses and penalties due to variability of the comparator sequence, and provide a framework for achieving any of the guarantees along this frontier. As a result, we prove for the first time that adapting to the squared path-length of an arbitrary sequence of comparators to achieve regret $R_{T}(u_{1},\dots,u_{T})\le O(\sqrt{T\sum_{t} \|u_{t}-u_{t+1}\|^{2}})$ is impossible. However, we prove that it is possible to adapt to a new notion of variability based on the locally-smoothed squared path-length of the comparator sequence, and provide an algorithm guaranteeing dynamic regret of the form $R_{T}(u_{1},\dots,u_{T})\le \tilde O(\sqrt{T\sum_{i}\|\bar u_{i}-\bar u_{i+1}\|^{2}})$. Up to polylogarithmic terms, the new notion of variability is never worse than the classic one involving the path-length.


title: Towards Measuring the Impact of Technical Debt on Lead Time: An Industrial Case Study

abstract: Background: Software companies must balance fast value delivery with quality, a trade-off that can introduce technical debt and potentially waste developers' time. As software systems evolve, technical debt tends to increase. However, estimating its impact on lead time still requires more empirical and experimental evidence. Objective: We conduct an empirical study investigating whether technical debt impacts lead time in resolving Jira issues. Furthermore, our aim is to measure the extent to which variance in lead time is explainable by the technical debt. Method: We conducted an industrial case study to examine the relationship in six components, each of which was analyzed individually. Technical debt was measured using SonarQube and normalized with the component's size, while lead time to resolve Jira issues was collected directly from Jira. Results: We found a set of mixed results. Technical debt had a moderate positive impact on lead time in two components, while we did not see a meaningful impact on two others. A moderate negative impact was found in the remaining two components. Conclusion: The findings show that technical debt alone can not explain all the variance in lead time, which ranges from 5% up to 41% across components. So, there should be some other variables (e.g., size of the changes made, complexity, number of teams involved, component ownership) impacting lead time, or it might have a residual effect that might manifest later on. Further investigation into those confounding variables is essential.


title: Tetrahedron Splatting for 3D Generation

abstract: 3D representation is essential to the significant advance of 3D generation with 2D diffusion priors. As a flexible representation, NeRF has been first adopted for 3D representation. With density-based volumetric rendering, it however suffers both intensive computational overhead and inaccurate mesh extraction. Using a signed distance field and Marching Tetrahedra, DMTet allows for precise mesh extraction and real-time rendering but is limited in handling large topological changes in meshes, leading to optimization challenges. Alternatively, 3D Gaussian Splatting (3DGS) is favored in both training and rendering efficiency while falling short in mesh extraction. In this work, we introduce a novel 3D representation, Tetrahedron Splatting (TeT-Splatting), that supports easy convergence during optimization, precise mesh extraction, and real-time rendering simultaneously. This is achieved by integrating surface-based volumetric rendering within a structured tetrahedral grid while preserving the desired ability of precise mesh extraction, and a tile-based differentiable tetrahedron rasterizer. Furthermore, we incorporate eikonal and normal consistency regularization terms for the signed distance field to improve generation quality and stability. Critically, our representation can be trained without mesh extraction, making the optimization process easier to converge. Our TeT-Splatting can be readily integrated in existing 3D generation pipelines, along with polygonal mesh for texture optimization. Extensive experiments show that our TeT-Splatting strikes a superior tradeoff among convergence speed, render efficiency, and mesh quality as compared to previous alternatives under varying 3D generation settings.


title: Secret sharing on the Poisson-Furstenberg boundary I

abstract: Recently, Vadim Kaimanovich presented a particular example of a measure on a product of two standard lamplighter groups such that the Poisson boundary of the induced random walk is non-trivial, but the boundary on the marginals is trivial. This was surprising since such behavior is not possible for measures of finite entropy. As we show in this paper, this secret-sharing phenomenon is possible precisely for pairs of amenable groups with non-trivial ICC-factors.


title: Neural network learns low-dimensional polynomials with SGD near the information-theoretic limit

abstract: We study the problem of gradient descent learning of a single-index target function $f_*(\boldsymbol{x}) = \textstyle\sigma_*\left(\langle\boldsymbol{x},\boldsymbol{\theta}\rangle\right)$ under isotropic Gaussian data in $\mathbb{R}^d$, where the link function $\sigma_*:\mathbb{R}\to\mathbb{R}$ is an unknown degree $q$ polynomial with information exponent $p$ (defined as the lowest degree in the Hermite expansion). Prior works showed that gradient-based training of neural networks can learn this target with $n\gtrsim d^{\Theta(p)}$ samples, and such statistical complexity is predicted to be necessary by the correlational statistical query lower bound. Surprisingly, we prove that a two-layer neural network optimized by an SGD-based algorithm learns $f_*$ of arbitrary polynomial link function with a sample and runtime complexity of $n \asymp T \asymp C(q) \cdot d\mathrm{polylog} d$, where constant $C(q)$ only depends on the degree of $\sigma_*$, regardless of information exponent; this dimension dependence matches the information theoretic limit up to polylogarithmic factors. Core to our analysis is the reuse of minibatch in the gradient computation, which gives rise to higher-order information beyond correlational queries.


title: Variational time reversal for free energy estimation in nonequilibrium steady states

abstract: Studying the structure of systems in nonequilibrium steady states necessitates tools that quantify population shifts and associated deformations of equilibrium free energy landscapes under persistent currents. Within the framework of stochastic thermodynamics, we establish a variant of the Kawasaki--Crooks equality that relates nonequilibrium free energy corrections in driven systems to heat dissipation statistics along time-reversed relaxation trajectories computable with molecular simulation. Using stochastic control theory, we arrive at a variational approach to evaluate the Kawasaki--Crooks equality and use it to estimate distribution functions of order parameters in overdamped Langevin models of active matter, attaining substantial improvement in accuracy over simple perturbative methods.


title: Decomposing and Interpreting Image Representations via Text in ViTs Beyond CLIP

abstract: Recent works have explored how individual components of the CLIP-ViT model contribute to the final representation by leveraging the shared image-text representation space of CLIP. These components, such as attention heads and MLPs, have been shown to capture distinct image features like shape, color or texture. However, understanding the role of these components in arbitrary vision transformers (ViTs) is challenging. To this end, we introduce a general framework which can identify the roles of various components in ViTs beyond CLIP. Specifically, we (a) automate the decomposition of the final representation into contributions from different model components, and (b) linearly map these contributions to CLIP space to interpret them via text. Additionally, we introduce a novel scoring function to rank components by their importance with respect to specific features. Applying our framework to various ViT variants (e.g. DeiT, DINO, DINOv2, Swin, MaxViT), we gain insights into the roles of different components concerning particular image features.These insights facilitate applications such as image retrieval using text descriptions or reference images, visualizing token importance heatmaps, and mitigating spurious correlations.


title: SpatialRGPT: Grounded Spatial Reasoning in Vision Language Model

abstract: Vision Language Models (VLMs) have demonstrated remarkable performance in 2D vision and language tasks. However, their ability to reason about spatial arrangements remains limited. In this work, we introduce Spatial Region GPT (SpatialRGPT) to enhance VLMs' spatial perception and reasoning capabilities. SpatialRGPT advances VLMs' spatial understanding through two key innovations: (1) a data curation pipeline that enables effective learning of regional representation from 3D scene graphs, and (2) a flexible plugin module for integrating depth information into the visual encoder of existing VLMs. During inference, when provided with user-specified region proposals, SpatialRGPT can accurately perceive their relative directions and distances. Additionally, we propose SpatialRGBT-Bench, a benchmark with ground-truth 3D annotations encompassing indoor, outdoor, and simulated environments, for evaluating 3D spatial cognition in VLMs. Our results demonstrate that SpatialRGPT significantly enhances performance in spatial reasoning tasks, both with and without local region prompts. The model also exhibits strong generalization capabilities, effectively reasoning about complex spatial relations and functioning as a region-aware dense reward annotator for robotic tasks. Code, dataset, and benchmark will be released at https://www.anjiecheng.me/SpatialRGPT


title: Stochastic Control with Signatures

abstract: This paper proposes to parameterize open loop controls in stochastic optimal control problems via suitable classes of functionals depending on the driver's path signature, a concept adopted from rough path integration theory. We rigorously prove that these controls are dense in the class of progressively measurable controls and use rough path methods to establish suitable conditions for stability of the controlled dynamics and target functional. These results pave the way for Monte Carlo methods to stochastic optimal control for generic target functionals and dynamics. We discuss the rather versatile numerical algorithms for computing approximately optimal controls and verify their accurateness in benchmark problems from Mathematical Finance.


title: ManiCM: Real-time 3D Diffusion Policy via Consistency Model for Robotic Manipulation

abstract: Diffusion models have been verified to be effective in generating complex distributions from natural images to motion trajectories. Recent diffusion-based methods show impressive performance in 3D robotic manipulation tasks, whereas they suffer from severe runtime inefficiency due to multiple denoising steps, especially with high-dimensional observations. To this end, we propose a real-time robotic manipulation model named ManiCM that imposes the consistency constraint to the diffusion process, so that the model can generate robot actions in only one-step inference. Specifically, we formulate a consistent diffusion process in the robot action space conditioned on the point cloud input, where the original action is required to be directly denoised from any point along the ODE trajectory. To model this process, we design a consistency distillation technique to predict the action sample directly instead of predicting the noise within the vision community for fast convergence in the low-dimensional action manifold. We evaluate ManiCM on 31 robotic manipulation tasks from Adroit and Metaworld, and the results demonstrate that our approach accelerates the state-of-the-art method by 10 times in average inference speed while maintaining competitive average success rate.


title: PlanAgent: A Multi-modal Large Language Agent for Closed-loop Vehicle Motion Planning

abstract: Vehicle motion planning is an essential component of autonomous driving technology. Current rule-based vehicle motion planning methods perform satisfactorily in common scenarios but struggle to generalize to long-tailed situations. Meanwhile, learning-based methods have yet to achieve superior performance over rule-based approaches in large-scale closed-loop scenarios. To address these issues, we propose PlanAgent, the first mid-to-mid planning system based on a Multi-modal Large Language Model (MLLM). MLLM is used as a cognitive agent to introduce human-like knowledge, interpretability, and common-sense reasoning into the closed-loop planning. Specifically, PlanAgent leverages the power of MLLM through three core modules. First, an Environment Transformation module constructs a Bird's Eye View (BEV) map and a lane-graph-based textual description from the environment as inputs. Second, a Reasoning Engine module introduces a hierarchical chain-of-thought from scene understanding to lateral and longitudinal motion instructions, culminating in planner code generation. Last, a Reflection module is integrated to simulate and evaluate the generated planner for reducing MLLM's uncertainty. PlanAgent is endowed with the common-sense reasoning and generalization capability of MLLM, which empowers it to effectively tackle both common and complex long-tailed scenarios. Our proposed PlanAgent is evaluated on the large-scale and challenging nuPlan benchmarks. A comprehensive set of experiments convincingly demonstrates that PlanAgent outperforms the existing state-of-the-art in the closed-loop motion planning task. Codes will be soon released.


title: nn2poly: An R Package for Converting Neural Networks into Interpretable Polynomials

abstract: The nn2poly package provides the implementation in R of the NN2Poly method to explain and interpret feed-forward neural networks by means of polynomial representations that predict in an equivalent manner as the original network.Through the obtained polynomial coefficients, the effect and importance of each variable and their interactions on the output can be represented. This capabiltiy of capturing interactions is a key aspect usually missing from most Explainable Artificial Intelligence (XAI) methods, specially if they rely on expensive computations that can be amplified when used on large neural networks. The package provides integration with the main deep learning framework packages in R (tensorflow and torch), allowing an user-friendly application of the NN2Poly algorithm. Furthermore, nn2poly provides implementation of the required weight constraints to be used during the network training in those same frameworks. Other neural networks packages can also be used by including their weights in list format. Polynomials obtained with nn2poly can also be used to predict with new data or be visualized through its own plot method. Simulations are provided exemplifying the usage of the package alongside with a comparison with other approaches available in R to interpret neural networks.


title: Tilting the Odds at the Lottery: the Interplay of Overparameterisation and Curricula in Neural Networks

abstract: A wide range of empirical and theoretical works have shown that overparameterisation can amplify the performance of neural networks. According to the lottery ticket hypothesis, overparameterised networks have an increased chance of containing a sub-network that is well-initialised to solve the task at hand. A more parsimonious approach, inspired by animal learning, consists in guiding the learner towards solving the task by curating the order of the examples, i.e. providing a curriculum. However, this learning strategy seems to be hardly beneficial in deep learning applications. In this work, we undertake an analytical study that connects curriculum learning and overparameterisation. In particular, we investigate their interplay in the online learning setting for a 2-layer network in the XOR-like Gaussian Mixture problem. Our results show that a high degree of overparameterisation -- while simplifying the problem -- can limit the benefit from curricula, providing a theoretical account of the ineffectiveness of curricula in deep learning.


title: Generalized phase estimation in noisy quantum gates

abstract: We examine metrological scenarios where the parameter of interest is encoded onto a quantum state through the action of a noisy quantum gate and investigate the ultimate bound to precision by analyzing the behaviour of the Quantum Fisher Information (QFI). We focus on qubit gates and consider the possibility of employing successive applications of the gate. We go beyond the trivial case of unitary gates and characterize the robustness of the metrological procedure introducing noise in the performed quantum operation, looking at how this affects the QFI at different steps (gate applications). We model the dephasing and tilting noise affecting qubit rotations as classical fluctuations governed by a Von Mises-Fisher distribution. Compared to the noiseless case, in which the QFI grows quadratically with the number of steps, we observe a non monotonic behavior, and the appearance of a maximum in the QFI, which defines the ideal number of steps that should be performed in order to precisely characterize the action of the gate.


title: DeNVeR: Deformable Neural Vessel Representations for Unsupervised Video Vessel Segmentation

abstract: This paper presents Deformable Neural Vessel Representations (DeNVeR), an unsupervised approach for vessel segmentation in X-ray videos without annotated ground truth. DeNVeR uses optical flow and layer separation, enhancing segmentation accuracy and adaptability through test-time training. A key component of our research is the introduction of the XACV dataset, the first X-ray angiography coronary video dataset with high-quality, manually labeled segmentation ground truth. Our evaluation demonstrates that DeNVeR outperforms current state-of-the-art methods in vessel segmentation. This paper marks an advance in medical imaging, providing a robust, data-efficient tool for disease diagnosis and treatment planning and setting a new standard for future research in video vessel segmentation. See our project page for video results at https://kirito878.github.io/DeNVeR/.


title: Text-guided Controllable Mesh Refinement for Interactive 3D Modeling

abstract: We propose a novel technique for adding geometric details to an input coarse 3D mesh guided by a text prompt. Our method is composed of three stages. First, we generate a single-view RGB image conditioned on the input coarse geometry and the input text prompt. This single-view image generation step allows the user to pre-visualize the result and offers stronger conditioning for subsequent multi-view generation. Second, we use our novel multi-view normal generation architecture to jointly generate six different views of the normal images. The joint view generation reduces inconsistencies and leads to sharper details. Third, we optimize our mesh with respect to all views and generate a fine, detailed geometry as output. The resulting method produces an output within seconds and offers explicit user control over the coarse structure, pose, and desired details of the resulting 3D mesh. Project page: https://text-mesh-refinement.github.io.


title: Reconstructing and Simulating Dynamic 3D Objects with Mesh-adsorbed Gaussian Splatting

abstract: 3D reconstruction and simulation, while interrelated, have distinct objectives: reconstruction demands a flexible 3D representation adaptable to diverse scenes, whereas simulation requires a structured representation to model motion principles effectively. This paper introduces the Mesh-adsorbed Gaussian Splatting (MaGS) method to resolve such a dilemma. MaGS constrains 3D Gaussians to hover on the mesh surface, creating a mutual-adsorbed mesh-Gaussian 3D representation that combines the rendering flexibility of 3D Gaussians with the spatial coherence of meshes. Leveraging this representation, we introduce a learnable Relative Deformation Field (RDF) to model the relative displacement between the mesh and 3D Gaussians, extending traditional mesh-driven deformation paradigms that only rely on ARAP prior, thus capturing the motion of each 3D Gaussian more precisely. By joint optimizing meshes, 3D Gaussians, and RDF, MaGS achieves both high rendering accuracy and realistic deformation. Extensive experiments on the D-NeRF and NeRF-DS datasets demonstrate that MaGS can generate competitive results in both reconstruction and simulation.


title: DiffUHaul: A Training-Free Method for Object Dragging in Images

abstract: Text-to-image diffusion models have proven effective for solving many image editing tasks. However, the seemingly straightforward task of seamlessly relocating objects within a scene remains surprisingly challenging. Existing methods addressing this problem often struggle to function reliably in real-world scenarios due to lacking spatial reasoning. In this work, we propose a training-free method, dubbed DiffUHaul, that harnesses the spatial understanding of a localized text-to-image model, for the object dragging task. Blindly manipulating layout inputs of the localized model tends to cause low editing performance due to the intrinsic entanglement of object representation in the model. To this end, we first apply attention masking in each denoising step to make the generation more disentangled across different objects and adopt the self-attention sharing mechanism to preserve the high-level object appearance. Furthermore, we propose a new diffusion anchoring technique: in the early denoising steps, we interpolate the attention features between source and target images to smoothly fuse new layouts with the original appearance; in the later denoising steps, we pass the localized features from the source images to the interpolated images to retain fine-grained object details. To adapt DiffUHaul to real-image editing, we apply a DDPM self-attention bucketing that can better reconstruct real images with the localized model. Finally, we introduce an automated evaluation pipeline for this task and showcase the efficacy of our method. Our results are reinforced through a user preference study.


title: MultiPly: Reconstruction of Multiple People from Monocular Video in the Wild

abstract: We present MultiPly, a novel framework to reconstruct multiple people in 3D from monocular in-the-wild videos. Reconstructing multiple individuals moving and interacting naturally from monocular in-the-wild videos poses a challenging task. Addressing it necessitates precise pixel-level disentanglement of individuals without any prior knowledge about the subjects. Moreover, it requires recovering intricate and complete 3D human shapes from short video sequences, intensifying the level of difficulty. To tackle these challenges, we first define a layered neural representation for the entire scene, composited by individual human and background models. We learn the layered neural representation from videos via our layer-wise differentiable volume rendering. This learning process is further enhanced by our hybrid instance segmentation approach which combines the self-supervised 3D segmentation and the promptable 2D segmentation module, yielding reliable instance segmentation supervision even under close human interaction. A confidence-guided optimization formulation is introduced to optimize the human poses and shape/appearance alternately. We incorporate effective objectives to refine human poses via photometric information and impose physically plausible constraints on human dynamics, leading to temporally consistent 3D reconstructions with high fidelity. The evaluation of our method shows the superiority over prior art on publicly available datasets and in-the-wild videos.


title: The hydrodynamics of inverse phase transitions

abstract: First order phase transitions are violent phenomena that occur when the state of the universe evolves abruptly from one vacuum to another. A \emph{direct} phase transition connects a local vacuum to a deeper vacuum of the zero--temperature potential, and the energy difference between the two minima manifests itself in the acceleration of the bubble wall. In this sense, the transition is triggered by the release of vacuum energy. On the other hand, an \emph{inverse} phase transition connects a deeper minimum of the zero--temperature potential to a higher one, and the bubble actually expands against the vacuum energy. The transition is then triggered purely by thermal corrections. We study for the first time the hydrodynamics and the energy budget of inverse phase transitions. We find several modes of expansion for inverse bubbles, which are related to the known ones for direct transitions by a mirror symmetry. We finally investigate the friction exerted on the bubble wall and comment on the possibility of runaway walls in inverse phase transitions.


title: End-to-End Rate-Distortion Optimized 3D Gaussian Representation

abstract: 3D Gaussian Splatting (3DGS) has become an emerging technique with remarkable potential in 3D representation and image rendering. However, the substantial storage overhead of 3DGS significantly impedes its practical applications. In this work, we formulate the compact 3D Gaussian learning as an end-to-end Rate-Distortion Optimization (RDO) problem and propose RDO-Gaussian that can achieve flexible and continuous rate control. RDO-Gaussian addresses two main issues that exist in current schemes: 1) Different from prior endeavors that minimize the rate under the fixed distortion, we introduce dynamic pruning and entropy-constrained vector quantization (ECVQ) that optimize the rate and distortion at the same time. 2) Previous works treat the colors of each Gaussian equally, while we model the colors of different regions and materials with learnable numbers of parameters. We verify our method on both real and synthetic scenes, showcasing that RDO-Gaussian greatly reduces the size of 3D Gaussian over 40x, and surpasses existing methods in rate-distortion performance.


title: D2E-An Autonomous Decision-making Dataset involving Driver States and Human Evaluation

abstract: With the advancement of deep learning technology, data-driven methods are increasingly used in the decision-making of autonomous driving, and the quality of datasets greatly influenced the model performance. Although current datasets have made significant progress in the collection of vehicle and environment data, emphasis on human-end data including the driver states and human evaluation is not sufficient. In addition, existing datasets consist mostly of simple scenarios such as car following, resulting in low interaction levels. In this paper, we introduce the Driver to Evaluation dataset (D2E), an autonomous decision-making dataset that contains data on driver states, vehicle states, environmental situations, and evaluation scores from human reviewers, covering a comprehensive process of vehicle decision-making. Apart from regular agents and surrounding environment information, we not only collect driver factor data including first-person view videos, physiological signals, and eye attention data, but also provide subjective rating scores from 40 human volunteers. The dataset is mixed of driving simulator scenes and real-road ones. High-interaction situations are designed and filtered to ensure behavior diversity. Through data organization, analysis, and preprocessing, D2E contains over 1100 segments of interactive driving case data covering from human driver factor to evaluation results, supporting the development of data-driven decision-making related algorithms.


title: Markov Chain Monte Carlo with Gaussian Process Emulation for a 1D Hemodynamics Model of CTEPH

abstract: Microvascular disease is a contributor to persistent pulmonary hypertension in those with chronic thromboembolic pulmonary hypertension (CTEPH). The heterogenous nature of the micro and macrovascular defects motivates the use of personalized computational models, which can predict flow dynamics within multiple generations of the arterial tree and into the microvasculature. Our study uses computational hemodynamics models and Gaussian processes for rapid, subject-specific calibration using retrospective data from a large animal model of CTEPH. Our subject-specific predictions shed light on microvascular dysfunction and arterial wall shear stress changes in CTEPH.

categories: q-bio.QM cs.CE cs.LG physics.data-an stat.AP


title: NeuroAssist: Enhancing Cognitive-Computer Synergy with Adaptive AI and Advanced Neural Decoding for Efficient EEG Signal Classification

abstract: Traditional methods of controlling prosthetics frequently encounter difficulties regarding flexibility and responsiveness, which can substantially impact people with varying cognitive and physical abilities. Advancements in computational neuroscience and machine learning (ML) have recently led to the development of highly advanced brain-computer interface (BCI) systems that may be customized to meet individual requirements. To address these issues, we propose NeuroAssist, a sophisticated method for analyzing EEG data that merges state-of-the-art BCI technology with adaptable artificial intelligence (AI) algorithms. NeuroAssist's hybrid neural network design efficiently overcomes the constraints of conventional EEG data processing. Our methodology combines a Natural Language Processing (NLP) BERT model to extract complex features from numerical EEG data and utilizes LSTM networks to handle temporal dynamics. In addition, we integrate spiking neural networks (SNNs) and deep Q-networks (DQN) to improve decision-making and flexibility. Our preprocessing method classifies motor imagery (MI) one-versus-the-rest using a common spatial pattern (CSP) while preserving EEG temporal characteristics. The hybrid architecture of NeuroAssist serves as the DQN's Q-network, enabling continuous feedback-based improvement and adaptability. This enables it to acquire optimal actions through trial and error. This experimental analysis has been conducted on the GigaScience and BCI-competition-IV-2a datasets, which have shown exceptional effectiveness in categorizing MI-EEG signals, obtaining an impressive classification accuracy of 99.17%. NeuroAssist offers a crucial approach to current assistive technology by potentially enhancing the speed and versatility of BCI systems.


title: Backpropogation-Free Multi-modal On-Device Model Adaptation via Cloud-Device Collaboration

abstract: In our increasingly interconnected world, where intelligent devices continually amass copious personalized multi-modal data, a pressing need arises to deliver high-quality, personalized device-aware services. However, this endeavor presents a multifaceted challenge to prevailing artificial intelligence (AI) systems primarily rooted in the cloud. As these systems grapple with shifting data distributions between the cloud and devices, the traditional approach of fine-tuning-based adaptation (FTA) exists the following issues: the costly and time-consuming data annotation required by FTA and the looming risk of model overfitting. To surmount these challenges, we introduce a Universal On-Device Multi-modal Model Adaptation Framework, revolutionizing on-device model adaptation by striking a balance between efficiency and effectiveness. The framework features the Fast Domain Adaptor (FDA) hosted in the cloud, providing tailored parameters for the Lightweight Multi-modal Model on devices. To enhance adaptability across multi-modal tasks, the AnchorFrame Distribution Reasoner (ADR) minimizes communication costs. Our contributions, encapsulated in the Cloud-Device Collaboration Multi-modal Parameter Generation (CDC-MMPG) framework, represent a pioneering solution for on-Device Multi-modal Model Adaptation (DMMA). Extensive experiments validate the efficiency and effectiveness of our method, particularly in video question answering and retrieval tasks, driving forward the integration of intelligent devices into our daily lives.


title: Effectiveness of denoising diffusion probabilistic models for fast and high-fidelity whole-event simulation in high-energy heavy-ion experiments

abstract: Artificial intelligence (AI) generative models, such as generative adversarial networks (GANs), variational auto-encoders, and normalizing flows, have been widely used and studied as efficient alternatives for traditional scientific simulations. However, they have several drawbacks, including training instability and inability to cover the entire data distribution, especially for regions where data are rare. This is particularly challenging for whole-event, full-detector simulations in high-energy heavy-ion experiments, such as sPHENIX at the Relativistic Heavy Ion Collider and Large Hadron Collider experiments, where thousands of particles are produced per event and interact with the detector. This work investigates the effectiveness of Denoising Diffusion Probabilistic Models (DDPMs) as an AI-based generative surrogate model for the sPHENIX experiment that includes the heavy-ion event generation and response of the entire calorimeter stack. DDPM performance in sPHENIX simulation data is compared with a popular rival, GANs. Results show that both DDPMs and GANs can reproduce the data distribution where the examples are abundant (low-to-medium calorimeter energies). Nonetheless, DDPMs significantly outperform GANs, especially in high-energy regions where data are rare. Additionally, DDPMs exhibit superior stability compared to GANs. The results are consistent between both central and peripheral centrality heavy-ion collision events. Moreover, DDPMs offer a substantial speedup of approximately a factor of 100 compared to the traditional Geant4 simulation method.


title: Privacy-preserving recommender system using the data collaboration analysis for distributed datasets

abstract: In order to provide high-quality recommendations for users, it is desirable to share and integrate multiple datasets held by different parties. However, when sharing such distributed datasets, we need to protect personal and confidential information contained in the datasets. To this end, we establish a framework for privacy-preserving recommender systems using the data collaboration analysis of distributed datasets. Numerical experiments with two public rating datasets demonstrate that our privacy-preserving method for rating prediction can improve the prediction accuracy for distributed datasets. This study opens up new possibilities for privacy-preserving techniques in recommender systems.


title: An Empirical Study of Excitation and Aggregation Design Adaptions in CLIP4Clip for Video-Text Retrieval

abstract: CLIP4Clip model transferred from the CLIP has been the de-factor standard to solve the video clip retrieval task from frame-level input, triggering the surge of CLIP4Clip-based models in the video-text retrieval domain. In this work, we rethink the inherent limitation of widely-used mean pooling operation in the frame features aggregation and investigate the adaptions of excitation and aggregation design for discriminative video representation generation. We present a novel excitationand-aggregation design, including (1) The excitation module is available for capturing non-mutuallyexclusive relationships among frame features and achieving frame-wise features recalibration, and (2) The aggregation module is applied to learn exclusiveness used for frame representations aggregation. Similarly, we employ the cascade of sequential module and aggregation design to generate discriminative video representation in the sequential type. Besides, we adopt the excitation design in the tight type to obtain representative frame features for multi-modal interaction. The proposed modules are evaluated on three benchmark datasets of MSR-VTT, ActivityNet and DiDeMo, achieving MSR-VTT (43.9 R@1), ActivityNet (44.1 R@1) and DiDeMo (31.0 R@1). They outperform the CLIP4Clip results by +1.2% (+0.5%), +4.5% (+1.9%) and +9.5% (+2.7%) relative (absolute) improvements, demonstrating the superiority of our proposed excitation and aggregation designs. We hope our work will serve as an alternative for frame representations aggregation and facilitate future research.


title: An Enhanced Encoder-Decoder Network Architecture for Reducing Information Loss in Image Semantic Segmentation

abstract: The traditional SegNet architecture commonly encounters significant information loss during the sampling process, which detrimentally affects its accuracy in image semantic segmentation tasks. To counter this challenge, we introduce an innovative encoder-decoder network structure enhanced with residual connections. Our approach employs a multi-residual connection strategy designed to preserve the intricate details across various image scales more effectively, thus minimizing the information loss inherent to down-sampling procedures. Additionally, to enhance the convergence rate of network training and mitigate sample imbalance issues, we have devised a modified cross-entropy loss function incorporating a balancing factor. This modification optimizes the distribution between positive and negative samples, thus improving the efficiency of model training. Experimental evaluations of our model demonstrate a substantial reduction in information loss and improved accuracy in semantic segmentation. Notably, our proposed network architecture demonstrates a substantial improvement in the finely annotated mean Intersection over Union (mIoU) on the dataset compared to the conventional SegNet. The proposed network structure not only reduces operational costs by decreasing manual inspection needs but also scales up the deployment of AI-driven image analysis across different sectors.


title: SymTax: Symbiotic Relationship and Taxonomy Fusion for Effective Citation Recommendation

abstract: Citing pertinent literature is pivotal to writing and reviewing a scientific document. Existing techniques mainly focus on the local context or the global context for recommending citations but fail to consider the actual human citation behaviour. We propose SymTax, a three-stage recommendation architecture that considers both the local and the global context, and additionally the taxonomical representations of query-candidate tuples and the Symbiosis prevailing amongst them. SymTax learns to embed the infused taxonomies in the hyperbolic space and uses hyperbolic separation as a latent feature to compute query-candidate similarity. We build a novel and large dataset ArSyTa containing 8.27 million citation contexts and describe the creation process in detail. We conduct extensive experiments and ablation studies to demonstrate the effectiveness and design choice of each module in our framework. Also, combinatorial analysis from our experiments shed light on the choice of language models (LMs) and fusion embedding, and the inclusion of section heading as a signal. Our proposed module that captures the symbiotic relationship solely leads to performance gains of 26.66% and 39.25% in Recall@5 w.r.t. SOTA on ACL-200 and RefSeer datasets, respectively. The complete framework yields a gain of 22.56% in Recall@5 wrt SOTA on our proposed dataset. The code and dataset are available at https://github.com/goyalkaraniit/SymTax


title: Recent advances in text embedding: A Comprehensive Review of Top-Performing Methods on the MTEB Benchmark

abstract: Text embedding methods have become increasingly popular in both industrial and academic fields due to their critical role in a variety of natural language processing tasks. The significance of universal text embeddings has been further highlighted with the rise of Large Language Models (LLMs) applications such as Retrieval-Augmented Systems (RAGs). While previous models have attempted to be general-purpose, they often struggle to generalize across tasks and domains. However, recent advancements in training data quantity, quality and diversity; synthetic data generation from LLMs as well as using LLMs as backbones encourage great improvements in pursuing universal text embeddings. In this paper, we provide an overview of the recent advances in universal text embedding models with a focus on the top performing text embeddings on Massive Text Embedding Benchmark (MTEB). Through detailed comparison and analysis, we highlight the key contributions and limitations in this area, and propose potentially inspiring future research directions.


title: Detecting Deceptive Dark Patterns in E-commerce Platforms

abstract: Dark patterns are deceptive user interfaces employed by e-commerce websites to manipulate user's behavior in a way that benefits the website, often unethically. This study investigates the detection of such dark patterns. Existing solutions include UIGuard, which uses computer vision and natural language processing, and approaches that categorize dark patterns based on detectability or utilize machine learning models trained on datasets. We propose combining web scraping techniques with fine-tuned BERT language models and generative capabilities to identify dark patterns, including outliers. The approach scrapes textual content, feeds it into the BERT model for detection, and leverages BERT's bidirectional analysis and generation abilities. The study builds upon research on automatically detecting and explaining dark patterns, aiming to raise awareness and protect consumers.


title: Judgement Citation Retrieval using Contextual Similarity

abstract: Traditionally in the domain of legal research, the retrieval of pertinent citations from intricate case descriptions has demanded manual effort and keyword-based search applications that mandate expertise in understanding legal jargon. Legal case descriptions hold pivotal information for legal professionals and researchers, necessitating more efficient and automated approaches. We propose a methodology that combines natural language processing (NLP) and machine learning techniques to enhance the organization and utilization of legal case descriptions. This approach revolves around the creation of textual embeddings with the help of state-of-art embedding models. Our methodology addresses two primary objectives: unsupervised clustering and supervised citation retrieval, both designed to automate the citation extraction process. Although the proposed methodology can be used for any dataset, we employed the Supreme Court of The United States (SCOTUS) dataset, yielding remarkable results. Our methodology achieved an impressive accuracy rate of 90.9%. By automating labor-intensive processes, we pave the way for a more efficient, time-saving, and accessible landscape in legal research, benefiting legal professionals, academics, and researchers.


title: Graph structural complexity

abstract: Introduced the quantitative measure of the structural complexity of the graph (complex network, etc.) based on a procedure similar to the renormalization process, considering the difference between actual and averaged graph structures on different scales. The proposed concept of the graph structural complexity corresponds to qualitative comprehension of the complexity. The proposed measure can be obtained for the weighted graphs also. The structural complexities for various graph types were found - the deterministic infinite and finite size graphs, artificial graphs of different natures including percolation structures, and the time series of cardiac rhythms mapped to complex networks using the parametric visibility graph algorithm. The latter reaches a maximum near the formation of a giant component in the graph or at the percolation threshold for 2D and 3D square lattices when a giant cluster having a fractal structure has emerged. Therefore, the graph structural complexity allows us to detect and study the processes similar to a second-order phase transition in complex networks. A new node centrality index, characterizing the structural complexity of a certain node within the graph structure is introduced also, it can serve as a good auxiliary or generalization to the local clustering coefficient. Such an index provides another new ranking manner for the graph nodes. Being an easily computable measure, the graph structural complexity might help to reveal different features of complex systems and processes of the real world.