title: Building a temperature forecasting model for the city with the regression neural network (RNN)

abstract: In recent years, a study by environmental organizations in the world and Vietnam shows that weather change is quite complex. global warming has become a serious problem in the modern world, which is a concern for scientists. last century, it was difficult to forecast the weather due to missing weather monitoring stations and technological limitations. this made it hard to collect data for building predictive models to make accurate simulations. in Vietnam, research on weather forecast models is a recent development, having only begun around 2000. along with advancements in computer science, mathematical models are being built and applied with machine learning techniques to create more accurate and reliable predictive models. this article will summarize the research and solutions for applying recurrent neural networks to forecast urban temperatures.


title: Understanding Forgetting in Continual Learning with Linear Regression

abstract: Continual learning, focused on sequentially learning multiple tasks, has gained significant attention recently. Despite the tremendous progress made in the past, the theoretical understanding, especially factors contributing to catastrophic forgetting, remains relatively unexplored. In this paper, we provide a general theoretical analysis of forgetting in the linear regression model via Stochastic Gradient Descent (SGD) applicable to both underparameterized and overparameterized regimes. Our theoretical framework reveals some interesting insights into the intricate relationship between task sequence and algorithmic parameters, an aspect not fully captured in previous studies due to their restrictive assumptions. Specifically, we demonstrate that, given a sufficiently large data size, the arrangement of tasks in a sequence, where tasks with larger eigenvalues in their population data covariance matrices are trained later, tends to result in increased forgetting. Additionally, our findings highlight that an appropriate choice of step size will help mitigate forgetting in both underparameterized and overparameterized settings. To validate our theoretical analysis, we conducted simulation experiments on both linear regression models and Deep Neural Networks (DNNs). Results from these simulations substantiate our theoretical findings.


title: Diamond phase in space and possibility of its spectroscopic detection

abstract: Eventual presence of diamond carbon allotrope in space is discussed in numerous theoretical and experimental studies. The review summarises principal mechanisms of nanodiamond formation and experimental results of spectroscopic and structural investigations of nano- and microdiamonds extracted from meteorites. Size dependence of diamond spectroscopic properties is discussed. Infrared spectroscopy allows detection of C-H bonds on surfaces of hot nanodiamond grains. Spectroscopic observation of nitrogen-related point defects in nanodiamonds is very challenging; moreover, such defects were never observed in nanodiamonds from meteorites. At the same time, photoluminescence and, eventually, absorption, of some impurity-related defects, in particular, of silicon-vacancy (SiV) center, observed in real meteoritic nanodiamonds, opens a possibility of diamond detection in astronomical observations.

categories: astro-ph.EP astro-ph.GA astro-ph.SR cond-mat.mes-hall


title: Cyclic Quantum Teleportation of Two-Qubit Entangled States by using Six-Qubit Cluster State and Six-Qubit Entangled State

abstract: Cyclic quantum teleportation schemes requires at least the existence of three collaborators acting all as senders and receivers of quantum information, each one of them has an information to be transmitted to the next neighbour in a circular manner. Here, new cyclic quantum teleportation scheme is proposed for perfectly transmitting cyclically three arbitrary unknown two-qubit states ($\alpha$, $\beta$ and $\gamma$) among the three collaborators. In this scheme, Alice can send to Bob the quantum information contained in her two-qubit state $\alpha$ and receive from Charlie the quantum information contained in the two-qubit state in his possession $\gamma$ and similarly, Bob can transmit to Charlie the quantum information contained in his two-qubit state $\beta$ through a quantum channel of twelve-qubit state consisting of a six-qubit cluster state and a six-qubit entangled state by sequentially and cyclically performing Bell state measurements. Subsequently, each one of the three participants can afterwards retrieve his own desired two-qubit state using classical channel and by performing appropriate unitary Pauli operators and we have shown that our proposed scheme performs efficiently.


title: Schottky-Invariant $p$-Adic Diffusion Operators

abstract: A parametrised diffusion operator on the regular domain $\Omega$ of a $p$-adic Schottky group is constructed. It is defined as an integral operator on the complex-valued functions on $\Omega$ which are invariant under the Schottky group $\Gamma$, where integration is against the measure defined by an invariant regular differential 1-form $\omega$. It is proven that the space of Schottky invariant $L^2$-functions on $\Omega$ outside the zeros of $\omega$ has an orthonormal basis consiting of $\Gamma$-invariant extensions of Kozyrev wavelets which are eigenfunctions of the operator. The eigenvalues are calculated, and it is shown that the heat equation for this operator provides a unique solution for its Cauchy problem with Schottky-invariant continuous initial conditions supportes outside the zero set of $\omega$, and gives rise to a strong Markov process on the corresponding orbit space for the Schottky group whose paths are c\`adl\`ag.


title: RAGSys: Item-Cold-Start Recommender as RAG System

abstract: Large Language Models (LLM) hold immense promise for real-world applications, but their generic knowledge often falls short of domain-specific needs. Fine-tuning, a common approach, can suffer from catastrophic forgetting and hinder generalizability. In-Context Learning (ICL) offers an alternative, which can leverage Retrieval-Augmented Generation (RAG) to provide LLMs with relevant demonstrations for few-shot learning tasks. This paper explores the desired qualities of a demonstration retrieval system for ICL. We argue that ICL retrieval in this context resembles item-cold-start recommender systems, prioritizing discovery and maximizing information gain over strict relevance. We propose a novel evaluation method that measures the LLM's subsequent performance on NLP tasks, eliminating the need for subjective diversity scores. Our findings demonstrate the critical role of diversity and quality bias in retrieved demonstrations for effective ICL, and highlight the potential of recommender system techniques in this domain.


title: Two-dimensional hydrodynamic viscous electron flow in annular Corbino rings

abstract: The concept of fluidic viscosity is ubiquitous in our everyday life and for it to arise the fluidic medium must necessarily form a continuum where macroscopic properties can emerge. While a powerful concept for tangible liquids, hydrodynamic manifestation of collective flow in electronic systems such as two-dimensional electron gases (2DEGs) has only been shown recently to occur in graphene and GaAs/AlGaAs. Here, we present nonlocal electronic transport measurements in concentric annular rings formed in high-mobility GaAs/AlGaAs 2DEGs and the resulting data strongly suggest that viscous hydrodynamic flow can occur far away from the source-drain current region. Our conclusion of viscous electronic transport is further corroborated by simulations of the Navier-Stokes equations that are found to be in agreement with our measurements below 1K temperature. Most importantly, our work emphasizes the key role played by viscosity via electron-electron (e-e) interaction when hydrodynamic transport is restricted radially, and for which a priori should not have played a major role.


title: An experimental study of inflow stability in a falling soap film

abstract: Inflow control is essential for most fluid mechanics experiments. Although vertically falling soap film flows have been extensively used in the last four decades to study two-dimensional flows, its inflow stability has not yet been discussed in detail. In this article, aiming to improve the inflow stability of the system, we discuss how flow driving systems dominate the inflow states and the statistics of soap film flow properties. We report experimental measurements of inflow rates using different flow driving methods, followed by soap film velocity measurements by Laser Doppler Velocimetry (LDV). The widely-used method of a constant-pressure-head reservoir exhibits a continuous drop of inflow rate. In addition, even when the flow is not disturbed, the soap film displays high magnitudes of velocity fluctuations. The mean square of velocity fluctuation was measured at 4.6% of the mean. We also test other methods without the reservoir, where the flow is directly controlled by a pump; two staggered syringe pumps are able to maintain inflow stability over days and reduce the velocity fluctuation to 0.5% of the mean. From these measurements, we conclude that the drop of inflow rate might be caused by micro/milli-scale air bubbles, which cannot be completely removed in the system. A method to control the inflow actively is necessary in a soap film setup, when a stable and long standing film flow is needed.


title: Optimizing Layout of Recursive Datatypes with Marmoset

abstract: While programmers know that the low-level memory representation of data structures can have significant effects on performance, compiler support to optimize the layout of those structures is an under-explored field. Prior work has optimized the layout of individual, non-recursive structures without considering how collections of those objects in linked or recursive data structures are laid out. This work introduces Marmoset, a compiler that optimizes the layouts of algebraic datatypes, with a special focus on producing highly optimized, packed data layouts where recursive structures can be traversed with minimal pointer chasing. Marmoset performs an analysis of how a recursive ADT is used across functions to choose a global layout that promotes simple, strided access for that ADT in memory. It does so by building and solving a constraint system to minimize an abstract cost model, yielding a predicted efficient layout for the ADT. Marmoset then builds on top of Gibbon, a prior compiler for packed, mostly-serial representations, to synthesize optimized ADTs. We show experimentally that Marmoset is able to choose optimal layouts across a series of microbenchmarks and case studies, outperforming both Gibbons baseline approach, as well as MLton, a Standard ML compiler that uses traditional pointer-heavy representations.


title: Individualized Dynamic Mediation Analysis Using Latent Factor Models

abstract: Mediation analysis plays a crucial role in causal inference as it can investigate the pathways through which treatment influences outcome. Most existing mediation analysis assumes that mediation effects are static and homogeneous within populations. However, mediation effects usually change over time and exhibit significant heterogeneity in many real-world applications. Additionally, the presence of unobserved confounding variables imposes a significant challenge to inferring both causal effect and mediation effect. To address these issues, we propose an individualized dynamic mediation analysis method. Our approach can identify the significant mediators of the population level while capturing the time-varying and heterogeneous mediation effects via latent factor modeling on coefficients of structural equation models. Another advantage of our method is that we can infer individualized mediation effects in the presence of unmeasured time-varying confounders. We provide estimation consistency for our proposed causal estimand and selection consistency for significant mediators. Extensive simulation studies and an application to a DNA methylation study demonstrate the effectiveness and advantages of our method.


title: The deceleration parameter in perturbed Bianchi universes with a "tilt"

abstract: Relative motion effects have long been known to ``contaminate'' the observations. In fact, when looking back to the history of astronomy, one finds a number of examples where relative motions have led to a gross misinterpretation of reality. Using relativistic cosmological perturbation theory it was shown that observers living inside bulk-flow domains that expand slightly slower than their surroundings, can have the illusion of cosmic acceleration, while the host universe is actually decelerating. This claim was originally based on studies of a perturbed tilted Einstein-de Sitter model, primarily for mathematical simplicity. Nevertheless, nothing really changed when the background universe was replaced by a Friedmann cosmology with nonzero pressure and spatial curvature. This raised the possibility that the peculiar-motion effect on the deceleration parameter, as measured locally by the bulk-flow observers, may be generic and independent of the specifics of the host universe. Here, we investigate this possibility, by extending the earlier studies to perturbed Bianchi cosmologies. We find that the picture remains unchanged, unless the Bianchi background has unrealistically high anisotropy. The peculiar-motion effect on the deceleration parameter, as measured by the relatively moving observers, is essentially the same with that reported earlier in a perturbed Einstein-de Sitter universe and in the rest of its Friedmann counterparts.


title: Representations of extensions of simple groups

abstract: Feit and Tits (1978) proved that a nontrivial projective representation of minimal dimension of a finite extension of a finite nonabelian simple group $G$ factors through a projective representation of $G$, except for some groups of Lie type in characteristic 2; the exact exceptions for $G$ were determined by Kleidman and Liebeck (1989). We generalise this result in two ways. First we consider all low-dimensional projective representations, not just those of minimal dimension. Second we consider all characteristically simple groups, not just simple groups.


title: Towards Achieving Cooperation Compliance of Human Drivers in Mixed Traffic

abstract: We consider a mixed-traffic environment in transportation systems, where Connected and Automated Vehicles (CAVs) coexist with potentially non-cooperative Human-Driven Vehicles (HDVs). We develop a cooperation compliance control framework to incentivize HDVs to align their behavior with socially optimal objectives using a ``refundable toll'' scheme so as to achieve a desired compliance probability for all non-compliant HDVs through a feedback control mechanism combining global with local (individual) components. We apply this scheme to the lane-changing problem, where a ``Social Planner'' provides references to the HDVs, measures their state errors, and induces cooperation compliance for safe lane-changing through a refundable toll approach. Simulation results are included to show the effectiveness of our cooperation compliance controller in terms of improved compliance and lane-changing maneuver safety and efficiency when non-cooperative HDVs are present.


title: Element-Free Probability Distributions and Random Partitions

abstract: An "element-free" probability distribution is what remains of a probability distribution after we forget the elements to which the probabilities were assigned. These objects naturally arise in Bayesian statistics, in situations where elements are used as labels and their specific identity is not important. This paper develops the structural theory of element-free distributions, using multisets and category theory. We give operations for moving between element-free and ordinary distributions, and we show that these operations commute with multinomial sampling. We then exploit this theory to prove two representation theorems. These theorems show that element-free distributions provide a natural representation for key random structures in Bayesian nonparametric clustering: exchangeable random partitions, and random distributions parametrized by a base measure.


title: GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplane

abstract: 3D open-vocabulary scene understanding, crucial for advancing augmented reality and robotic applications, involves interpreting and locating specific regions within a 3D space as directed by natural language instructions. To this end, we introduce GOI, a framework that integrates semantic features from 2D vision-language foundation models into 3D Gaussian Splatting (3DGS) and identifies 3D Gaussians of Interest using an Optimizable Semantic-space Hyperplane. Our approach includes an efficient compression method that utilizes scene priors to condense noisy high-dimensional semantic features into compact low-dimensional vectors, which are subsequently embedded in 3DGS. During the open-vocabulary querying process, we adopt a distinct approach compared to existing methods, which depend on a manually set fixed empirical threshold to select regions based on their semantic feature distance to the query text embedding. This traditional approach often lacks universal accuracy, leading to challenges in precisely identifying specific target areas. Instead, our method treats the feature selection process as a hyperplane division within the feature space, retaining only those features that are highly relevant to the query. We leverage off-the-shelf 2D Referring Expression Segmentation (RES) models to fine-tune the semantic-space hyperplane, enabling a more precise distinction between target regions and others. This fine-tuning substantially improves the accuracy of open-vocabulary queries, ensuring the precise localization of pertinent 3D Gaussians. Extensive experiments demonstrate GOI's superiority over previous state-of-the-art methods. Our project page is available at https://goi-hyperplane.github.io/ .


title: Seismic Image Denoising With A Physics-Constrained Deep Image Prior

abstract: Seismic images often contain both coherent and random artifacts which complicate their interpretation. To mitigate these artifacts, we introduce a novel unsupervised deep-learning method based on Deep Image Prior (DIP) which uses convolutional neural networks. Our approach optimizes the network weights to refine the migration velocity model, rather than the seismic image, effectively isolating meaningful image features from noise and artifacts. We apply this method to synthetic and real seismic data, demonstrating significant improvements over standard DIP techniques with minimal computational overhead.


title: Rigidity on horocycles and hypercycles

abstract: We show that a bijection $f:\mathbb{H}^2\rightarrow\mathbb{H}^2$ of the hyperbolic plane that sends horocycles to horocycles (respectively hypercycles to hypercycles) is an isometry. This extends a previous result of J. Jeffers on geodesics to all curves with constant curvature in $\mathbb{H}^2$. We go beyond by showing that every abstract automorphism of the geodesic graph (respectively horocycles and hypercycles graphs) is induced by an earthquake map (respectively an isometry) of $\mathbb{H}^2$. This shadowed the difference between the geometry of geodesics and that of horocycles/hypercycles.


title: A Mobility Equity Metric for Multi-Modal Intelligent Transportation Systems

abstract: In this paper, we introduce a metric to evaluate the equity in mobility and a routing framework to enhance the metric within multi-modal intelligent transportation systems. The mobility equity metric (MEM) simultaneously accounts for service accessibility and transportation costs to quantify the equity and fairness in a transportation network. Finally, we develop a system planner integrated with MEM that aims to distribute travel demand for the transportation network, resulting in a socially optimal mobility system. Our framework results in a transportation network that is efficient in terms of travel time, improves accessibility, and ensures equity in transportation.


title: Spatial Spinal Fixation: A Transformative Approach Using a Unique Robot-Assisted Steerable Drilling System and Flexible Pedicle Screw

abstract: Spinal fixation procedures are currently limited by the rigidity of the existing instruments and pedicle screws leading to fixation failures and rigid pedicle screw pull out. Leveraging our recently developed Concentric Tube Steerable Drilling Robot (CT-SDR) in integration with a robotic manipulator, to address the aforementioned issue, here we introduce the transformative concept of Spatial Spinal Fixation (SSF) using a unique Flexible Pedicle Screw (FPS). The proposed SSF procedure enables planar and out-of-plane placement of the FPS throughout the full volume of the vertebral body. In other words, not only does our fixation system provide the option of drilling in-plane and out-of-plane trajectories, it also enables implanting the FPS inside linear (represented by an I-shape) and/or non-linear (represented by J-shape) trajectories. To thoroughly evaluate the functionality of our proposed robotic system and the SSF procedure, we have performed various experiments by drilling different I-J and J-J drilling trajectory pairs into our custom-designed L3 vertebral phantoms and analyzed the accuracy of the procedure using various metrics.


title: GDSW preconditioners for composite Discontinuous Galerkin discretizations of multicompartment reaction-diffusion problems

abstract: The aim of the present work is to design, analyze theoretically, and test numerically, a generalized Dryja-Smith-Widlund (GDSW) preconditioner for composite Discontinuous Galerkin discretizations of multicompartment parabolic reaction-diffusion equations, where the solution can exhibit natural discontinuities across the domain. We prove that the resulting preconditioned operator for the solution of the discrete system arising at each time step converges with a scalable and quasi-optimal upper bound for the condition number. The GDSW preconditioner is then applied to the EMI (Extracellular - Membrane - Intracellular) reaction-diffusion system, recently proposed to model microscopically the spatiotemporal evolution of cardiac bioelectrical potentials. Numerical tests validate the scalability and quasi-optimality of the EMI-GDSW preconditioner, and investigate its robustness with respect to the time step size as well as jumps in the diffusion coefficients.


title: Augmenting Textual Generation via Topology Aware Retrieval

abstract: Despite the impressive advancements of Large Language Models (LLMs) in generating text, they are often limited by the knowledge contained in the input and prone to producing inaccurate or hallucinated content. To tackle these issues, Retrieval-augmented Generation (RAG) is employed as an effective strategy to enhance the available knowledge base and anchor the responses in reality by pulling additional texts from external databases. In real-world applications, texts are often linked through entities within a graph, such as citations in academic papers or comments in social networks. This paper exploits these topological relationships to guide the retrieval process in RAG. Specifically, we explore two kinds of topological connections: proximity-based, focusing on closely connected nodes, and role-based, which looks at nodes sharing similar subgraph structures. Our empirical research confirms their relevance to text relationships, leading us to develop a Topology-aware Retrieval-augmented Generation framework. This framework includes a retrieval module that selects texts based on their topological relationships and an aggregation module that integrates these texts into prompts to stimulate LLMs for text generation. We have curated established text-attributed networks and conducted comprehensive experiments to validate the effectiveness of this framework, demonstrating its potential to enhance RAG with topological awareness.


title: Towards Biomechanical Evaluation of a Transformative Additively Manufactured Flexible Pedicle Screw for Robotic Spinal Fixation

abstract: Vital for spinal fracture treatment, pedicle screw fixation is the gold standard for spinal fixation procedures. Nevertheless, due to the screw pullout and loosening issues, this surgery often fails to be effective for patients suffering from osteoporosis (i.e., having low bone mineral density). These failures can be attributed to the rigidity of existing drilling instruments and pedicle screws forcing clinicians to place these implants into the osteoporotic regions of the vertebral body. To address this critical issue, we have developed a steerable drilling robotic system and evaluated its performance in drilling various J- and U-shape trajectories. Complementary to this robotic system, in this paper, we propose design, additive manufacturing, and biomechanical evaluation of a transformative flexible pedicle screw (FPS) that can be placed in pre-drilled straight and curved trajectories. To evaluate the performance of the proposed flexible implant, we designed and fabricated two different types of FPSs using the direct metal laser sintering (DMLS) process. Utilizing our unique experimental setup and ASTM standards, we then performed various pullout experiments on these FPSs to evaluate and analyze their biomechanical performance implanted in straight trajectories.


title: LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters

abstract: The recent trend in scaling language models has led to a growing demand for parameter-efficient tuning (PEFT) methods such as LoRA (Low-Rank Adaptation). LoRA consistently matches or surpasses the full fine-tuning baseline with fewer parameters. However, handling numerous task-specific or user-specific LoRA modules on top of a base model still presents significant storage challenges. To address this, we introduce LoRA-XS (Low-Rank Adaptation with eXtremely Small number of parameters), a novel approach leveraging Singular Value Decomposition (SVD) for parameter-efficient fine-tuning. LoRA-XS introduces a small r x r weight matrix between frozen LoRA matrices, which are constructed by SVD of the original weight matrix. Training only r x r weight matrices ensures independence from model dimensions, enabling more parameter-efficient fine-tuning, especially for larger models. LoRA-XS achieves a remarkable reduction of trainable parameters by over 100x in 7B models compared to LoRA. Our benchmarking across various scales, including GLUE, GSM8k, and MATH benchmarks, shows that our approach outperforms LoRA and recent state-of-the-art approaches like VeRA in terms of parameter efficiency while maintaining competitive performance.


title: Review of searches for vector-like quarks, vector-like leptons, and heavy neutral leptons in proton-proton collisions at $\sqrt{s}$ = 13 TeV at the CMS experiment

abstract: The LHC has provided an unprecedented amount of proton-proton collision data, bringing forth exciting opportunities to address fundamental open questions in particle physics. These questions can potentially be answered by performing searches for very rare processes predicted by models that attempt to extend the standard model of particle physics. The data collected by the CMS experiment in 2015-2018 at a center-of-mass energy of 13 TeV help to test the standard model at the highest precision ever and potentially discover new physics. An interesting opportunity is presented by the possibility of new fermions with masses ranging from the MeV to the TeV scale. Such new particles appear in many possible extensions of the standard model and are well motivated theoretically. They may explain the appearance of three generations of leptons and quarks, the mass hierarchy across the generations, and the nonzero neutrino masses. In this report, the status of searches targeting vector-like quarks, vector-like leptons, and heavy neutral leptons at the CMS experiment is discussed. A complete overview of final states is provided together with their complementarity and partial combination. The discovery potential for several of these searches at the High-Luminosity LHC is also discussed.


title: A Patient-Specific Framework for Autonomous Spinal Fixation via a Steerable Drilling Robot

abstract: In this paper, with the goal of enhancing the minimally invasive spinal fixation procedure in osteoporotic patients, we propose a first-of-its-kind image-guided robotic framework for performing an autonomous and patient-specific procedure using a unique concentric tube steerable drilling robot (CT-SDR). Particularly, leveraging a CT-SDR, we introduce the concept of J-shape drilling based on a pre-operative trajectory planned in CT scan of a patient followed by appropriate calibration, registration, and navigation steps to safely execute this trajectory in real-time using our unique robotic setup. To thoroughly evaluate the performance of our framework, we performed several experiments on two different vertebral phantoms designed based on CT scan of real patients.


title: Advancing Cultural Inclusivity: Optimizing Embedding Spaces for Balanced Music Recommendations

abstract: Popularity bias in music recommendation systems -- where artists and tracks with the highest listen counts are recommended more often -- can also propagate biases along demographic and cultural axes. In this work, we identify these biases in recommendations for artists from underrepresented cultural groups in prototype-based matrix factorization methods. Unlike traditional matrix factorization methods, prototype-based approaches are interpretable. This allows us to directly link the observed bias in recommendations for minority artists (the effect) to specific properties of the embedding space (the cause). We mitigate popularity bias in music recommendation through capturing both users' and songs' cultural nuances in the embedding space. To address these challenges while maintaining recommendation quality, we propose two novel enhancements to the embedding space: i) we propose an approach to filter-out the irrelevant prototypes used to represent each user and item to improve generalizability, and ii) we introduce regularization techniques to reinforce a more uniform distribution of prototypes within the embedding space. Our results demonstrate significant improvements in reducing popularity bias and enhancing demographic and cultural fairness in music recommendations while achieving competitive -- if not better -- overall performance.


title: Rotational synchronisation of B-type binaries in 30 Doradus

abstract: The spin evolution of stars in close binary systems can be strongly affected by tides. We investigate the rotational synchronisation of the stellar components for 69 SB1 systems and 14 SB2 B-type systems in the 30 Doradus region of the Large Magellanic Cloud using observations from the VFTS and BBC surveys. Their orbital periods range from a few to a few hundred days, while estimated primary masses for these systems are in the range 5-20 Msun with mass ratio ranges of approximately q=0.03-0.5 and q=0.6-1.0 for the SB1 and SB2 systems, respectively. Projected rotational velocities of the stellar components have been compared with their synchronous velocities derived from the orbital periods. We find that effectively all systems with orbital period of more than 10 days must be asynchronous, whilst all the systems with periods of less than 3 days are likely synchronised. In terms of the stellar fractional radius (r), our results imply that all systems with r<0.1 are asynchronous, with those having r>0.2 probably being synchronised. For the apparently synchronised systems our results are more consistent with synchronisation at the mean orbital angular velocity rather than with that at periastron.


title: GarmentCodeData: A Dataset of 3D Made-to-Measure Garments With Sewing Patterns

abstract: Recent research interest in the learning-based processing of garments, from virtual fitting to generation and reconstruction, stumbles on a scarcity of high-quality public data in the domain. We contribute to resolving this need by presenting the first large-scale synthetic dataset of 3D made-to-measure garments with sewing patterns, as well as its generation pipeline. GarmentCodeData contains 115,000 data points that cover a variety of designs in many common garment categories: tops, shirts, dresses, jumpsuits, skirts, pants, etc., fitted to a variety of body shapes sampled from a custom statistical body model based on CAESAR, as well as a standard reference body shape, applying three different textile materials. To enable the creation of datasets of such complexity, we introduce a set of algorithms for automatically taking tailor's measures on sampled body shapes, sampling strategies for sewing pattern design, and propose an automatic, open-source 3D garment draping pipeline based on a fast XPBD simulator, while contributing several solutions for collision resolution and drape correctness to enable scalability. Dataset: http://hdl.handle.net/20.500.11850/673889


title: Explainable machine learning multi-label classification of Spanish legal judgements

abstract: Artificial Intelligence techniques such as Machine Learning (ML) have not been exploited to their maximum potential in the legal domain. This has been partially due to the insufficient explanations they provided about their decisions. Automatic expert systems with explanatory capabilities can be specially useful when legal practitioners search jurisprudence to gather contextual knowledge for their cases. Therefore, we propose a hybrid system that applies ML for multi-label classification of judgements (sentences) and visual and natural language descriptions for explanation purposes, boosted by Natural Language Processing techniques and deep legal reasoning to identify the entities, such as the parties, involved. We are not aware of any prior work on automatic multi-label classification of legal judgements also providing natural language explanations to the end-users with comparable overall quality. Our solution achieves over 85 % micro precision on a labelled data set annotated by legal experts. This endorses its interest to relieve human experts from monotonous labour-intensive legal classification tasks.


title: Gravitationally produced Dark Matter and primordial black holes

abstract: We examine how the existence of a population of primordial black holes (PBHs) influences cosmological gravitational particle production (CGPP) for spin-0 and spin-1 particles. In addition to the known effects of particle production and entropy dilution resulting from PBH evaporation, we find that the generation of dark matter (DM) through CGPP is profoundly influenced by a possible era of PBH matter domination. This early matter dominated era results in an enhancement of the particle spectrum from CGPP. Specifically, it amplifies the peak comoving momentum $k_\star$ for spin-1 DM, while enhancing the plateau of the spectrum for minimally coupled spin-0 particles for low comoving momenta. At the same time, the large entropy dilution may partially or completely compensate for the increase of the spectrum and strongly mitigates the DM abundance produced by CGPP. Our results show that, in the computation of the final abundance, CGPP and PBH evaporation cannot be disentangled, but the parameters of both sectors must be considered together to obtain the final result. Furthermore, we explore the potential formation of PBHs from density fluctuations arising from CGPP and the associated challenges in such a scenario.


title: A note on the error analysis of data-driven closure models for large eddy simulations of turbulence

abstract: In this work, we provide a mathematical formulation for error propagation in flow trajectory prediction using data-driven turbulence closure modeling. Under the assumption that the predicted state of a large eddy simulation prediction must be close to that of a subsampled direct numerical simulation, we retrieve an upper bound for the prediction error when utilizing a data-driven closure model. We also demonstrate that this error is significantly affected by the time step size and the Jacobian which play a role in amplifying the initial one-step error made by using the closure. Our analysis also shows that the error propagates exponentially with rollout time and the upper bound of the system Jacobian which is itself influenced by the Jacobian of the closure formulation. These findings could enable the development of new regularization techniques for ML models based on the identified error-bound terms, improving their robustness and reducing error propagation.


title: A Framework for Multi-modal Learning: Jointly Modeling Inter- & Intra-Modality Dependencies

abstract: Supervised multi-modal learning involves mapping multiple modalities to a target label. Previous studies in this field have concentrated on capturing in isolation either the inter-modality dependencies (the relationships between different modalities and the label) or the intra-modality dependencies (the relationships within a single modality and the label). We argue that these conventional approaches that rely solely on either inter- or intra-modality dependencies may not be optimal in general. We view the multi-modal learning problem from the lens of generative models where we consider the target as a source of multiple modalities and the interaction between them. Towards that end, we propose inter- & intra-modality modeling (I2M2) framework, which captures and integrates both the inter- and intra-modality dependencies, leading to more accurate predictions. We evaluate our approach using real-world healthcare and vision-and-language datasets with state-of-the-art models, demonstrating superior performance over traditional methods focusing only on one type of modality dependency.


title: Separation theorems for bounded convex sets of bounded operators

abstract: We establish new metric characterizations for the norm (respectively, ultraweak) closure of the convex hull of a bounded set in an arbitrary $C^*$-algebra (respectively, von Neumann algebra), and provide applications of these results to the majorization theory.


title: Listenable Maps for Zero-Shot Audio Classifiers

abstract: Interpreting the decisions of deep learning models, including audio classifiers, is crucial for ensuring the transparency and trustworthiness of this technology. In this paper, we introduce LMAC-ZS (Listenable Maps for Audio Classifiers in the Zero-Shot context), which, to the best of our knowledge, is the first decoder-based post-hoc interpretation method for explaining the decisions of zero-shot audio classifiers. The proposed method utilizes a novel loss function that maximizes the faithfulness to the original similarity between a given text-and-audio pair. We provide an extensive evaluation using the Contrastive Language-Audio Pretraining (CLAP) model to showcase that our interpreter remains faithful to the decisions in a zero-shot classification context. Moreover, we qualitatively show that our method produces meaningful explanations that correlate well with different text prompts.


title: Design of a Rectangular Linear Microstrip Patch Antenna Array for 5G Communication

abstract: This paper presents the design and characterization of a rectangular microstrip patch antenna array optimized for operation within the Ku-band frequency range. The antenna array is impedance-matched to 50 Ohms and utilizes a microstrip line feeding mechanism for excitation. The design maintains compact dimensions, with the overall antenna occupying an area of 29.5x7 mm. The antenna structure is modelled on an R03003 substrate material, featuring a dielectric constant of 3, a low-loss tangent of 0.0009, and a thickness of 1.574 mm. The substrate is backed by a conducting ground plane, and the array consists of six radiating patch elements positioned on top. Evaluation of the designed antenna array reveals a resonant frequency of 18GHz, with a -10 dB impedance bandwidth extending over 700MHz. The antenna demonstrates a high gain of 7.51dBi, making it well-suited for applications in 5G and future communication systems. Its compact form factor, cost-effectiveness, and broad impedance and radiation coverage further underscore its potential in these domains.


title: Abelianization of Lie algebroids and Lie groupoids

abstract: We investigate the abelianization of a Lie algebroid and provide a necessary and sufficient condition for its existence. We also study the abelianization of groupoids and provide sufficient conditions for its existence in the smooth category and a necessary and sufficient condition for its existence in the diffeological category.


title: Symmetric Reinforcement Learning Loss for Robust Learning on Diverse Tasks and Model Scales

abstract: Reinforcement learning (RL) training is inherently unstable due to factors such as moving targets and high gradient variance. Reinforcement Learning from Human Feedback (RLHF) and Reinforcement Learning from AI Feedback (RLAIF) can introduce additional difficulty. Differing preferences can complicate the alignment process, and prediction errors in a trained reward model can become more severe as the LLM generates unseen outputs. To enhance training robustness, RL has adopted techniques from supervised learning, such as ensembles and layer normalization. In this work, we improve the stability of RL training by adapting the reverse cross entropy (RCE) from supervised learning for noisy data to define a symmetric RL loss. We demonstrate performance improvements across various tasks and scales. We conduct experiments in discrete action tasks (Atari games) and continuous action space tasks (MuJoCo benchmark and Box2D) using Symmetric A2C (SA2C) and Symmetric PPO (SPPO), with and without added noise with especially notable performance in SPPO across different hyperparameters. Furthermore, we validate the benefits of the symmetric RL loss when using SPPO for large language models through improved performance in RLHF tasks, such as IMDB positive sentiment sentiment and TL;DR summarization tasks.


title: Mechanistic insights into Z-ring formation and stability: A Langevin dynamics approach to FtsZ self-assembly

abstract: The tubulin-like protein FtsZ is crucial for cytokinesis in bacteria and many archaea, forming a ring-shaped structure called the Z-ring at the site of cell division. Despite extensive research, the formation of Z-rings is not entirely understood. We propose a theoretical model based on FtsZ's known filament structures, treating them as semiflexible polymers with specific mechanical properties and lateral inter-segment attraction that can stabilize ring formations. Our Langevin dynamics simulations reveal various morphological phases, including open helices, chains, rings, and globules, capturing experimental observations in the fission yeast model using FtsZ from different bacterial species or mutants of Escherichia coli. Using the theoretical model, we explore how treadmilling activity affects Z-ring stability and identify a spooling mechanism of ring formation. The active ring produces contractile, shear, and rotational stresses, which intensify before the Z-ring transitions to an open helix at high activity.


title: The significance of fuzzy boundaries of the barrier regions in single-molecule measurements of failed barrier crossing attempts

abstract: A recent experimental study reports on measuring the temporal duration and the spatial extent of failed attempts to cross an activation barrier (i.e., "loops") for a folding transition in a single molecule and for a Brownian particle trapped within a bistable potential. Within the model of diffusive dynamics, however, both of these quantities are, on the average, exactly zero because of the recrossings of the barrier region boundary. That is, an observer endowed with infinite spatial and temporal resolution would find that finite loops do not exist (or, more precisely, form a set of measure zero). Here we develop a description of the experiment that takes finite experimental resolution into account and show how the experimental uncertainty of localizing the point, in time and space, where the barrier is crossed leads to observable distributions of loop times and sizes. Although these distributions generally depend on the experimental resolution, this dependence, in certain cases, may amount to a simple resolution-dependent factor and thus the experiments do probe inherent properties of barrier crossing dynamics.


title: Hardy Number of Koenigs Domains: Sharp Estimate

abstract: Let $\Omega$ be a regular Koenigs domain in the complex plane $\mathbb{C}$. We prove that the Hardy number of $\Omega$ is greater or equal to $1/2$. That is, every holomorphic function in the unit disc $f \colon \mathbb{D} \to \Omega$ belongs to the Hardy space $H^{p}(\mathbb{D})$ for all $p<1/2$.


title: Accounting for Clock-Induced Charge Production in the EMCCD Gain Register

abstract: An electron-multiplying charge-coupled device (EMCCD) is often used for taking images with space telescopes and other devices. Photons hit the pixels and photo-electrons are created, and these are multiplied via impact ionization as they travel through the gain register from one gain stage to the next. A high gain means a high multiplication factor, and this is achieved through a high voltage difference across a gain stage. If the gain is high enough, the chance of clock-induced charge production in the gain register increases. The probability distribution function governing the gain process in the literature only accounts for charge multiplication if one or more electrons enters the gain register. I derive from first principles the modified probability distribution that accounts for clock-induced charge production in the gain register. I also examine some EMCCD data and show through maximum likelihood estimation that the data conform better to the modified distribution versus the usual one in the literature. The use of the modified distribution would in principle improve the accuracy of signal extraction from a frame.


title: From the Dawn of Neutrino Astronomy to A New View of the Extreme Universe

abstract: Over the past decade, neutrino astronomy has emerged as a new window into the extreme and hidden universe. Current generation experiments have detected high-energy neutrinos of astrophysical origin and identified the first sources, opening the field to discovery. Looking ahead, the authors of this Perspective identify seven major open questions in neutrino astrophysics and particle physics that could lead to transformative discoveries over the next 20 years. These multi-disciplinary questions range from understanding the vicinity of a black hole to unveiling the nature of neutrino mass, among other topics. Additionally, we critically review the current experimental capabilities and their limitations and, from there, discuss the interplay between different proposed neutrino telescope technologies and analysis techniques. The authors firmly believe that achieving the immense discovery potential over the next two decades demands a model of global partnership and complementary specialized detectors. This collaborative neutrino telescope network will pave the way for a thriving multi-messenger era, transforming our understanding of neutrino physics, astrophysics, and the extreme universe. \end{abstract}


title: Incorporating precipitation-related effects on plastic anisotropy of age-hardenable aluminium alloys into crystal plasticity constitutive models

abstract: Crystal plasticity finite element simulations are frequently employed to predict the plastic anisotropy of polycrystalline metals based on their crystallographic texture. However, precipitation in age-hardenable aluminium alloys is known to affect the texture-induced plastic anisotropy. A new modelling approach that incorporates this effect into crystal plasticity constitutive models is presented to address this issue. The approach is based on the hypothesis that precipitation occurs in a global preferred direction, resulting in direction-dependent hardening behaviour for the slip systems. The direction dependency is implemented into a conventional crystal plasticity constitutive model by modification of the hardening law using only one additional parameter. To demonstrate the applicability of the new modelling approach, it is applied to an AA6014-T4 age-hardenable aluminium alloy and compared against the current state-of-the-art crystal plasticity modelling approach, taking only the crystallographic texture into account. The results demonstrate that the predicted accuracy of the plastic anisotropy for the AA6014-T4 aluminium alloy studied is significantly improved by the proposed new modelling approach for incorporating precipitation-related effects.


title: Matrix Low-Rank Trust Region Policy Optimization

abstract: Most methods in reinforcement learning use a Policy Gradient (PG) approach to learn a parametric stochastic policy that maps states to actions. The standard approach is to implement such a mapping via a neural network (NN) whose parameters are optimized using stochastic gradient descent. However, PG methods are prone to large policy updates that can render learning inefficient. Trust region algorithms, like Trust Region Policy Optimization (TRPO), constrain the policy update step, ensuring monotonic improvements. This paper introduces low-rank matrix-based models as an efficient alternative for estimating the parameters of TRPO algorithms. By gathering the stochastic policy's parameters into a matrix and applying matrix-completion techniques, we promote and enforce low rank. Our numerical studies demonstrate that low-rank matrix-based policy models effectively reduce both computational and sample complexities compared to NN models, while maintaining comparable aggregated rewards.


title: Matrix Low-Rank Approximation For Policy Gradient Methods

abstract: Estimating a policy that maps states to actions is a central problem in reinforcement learning. Traditionally, policies are inferred from the so called value functions (VFs), but exact VF computation suffers from the curse of dimensionality. Policy gradient (PG) methods bypass this by learning directly a parametric stochastic policy. Typically, the parameters of the policy are estimated using neural networks (NNs) tuned via stochastic gradient descent. However, finding adequate NN architectures can be challenging, and convergence issues are common as well. In this paper, we put forth low-rank matrix-based models to estimate efficiently the parameters of PG algorithms. We collect the parameters of the stochastic policy into a matrix, and then, we leverage matrix-completion techniques to promote (enforce) low rank. We demonstrate via numerical studies how low-rank matrix-based policy models reduce the computational and sample complexities relative to NN models, while achieving a similar aggregated reward.


title: Salutary Labeling with Zero Human Annotation

abstract: Active learning strategically selects informative unlabeled data points and queries their ground truth labels for model training. The prevailing assumption underlying this machine learning paradigm is that acquiring these ground truth labels will optimally enhance model performance. However, this assumption may not always hold true or maximize learning capacity, particularly considering the costly labor annotations required for ground truth labels. In contrast to traditional ground truth labeling, this paper proposes salutary labeling, which automatically assigns the most beneficial labels to the most informative samples without human annotation. Specifically, we utilize the influence function, a tool for estimating sample influence, to select newly added samples and assign their salutary labels by choosing the category that maximizes their positive influence. This process eliminates the need for human annotation. Extensive experiments conducted on nine benchmark datasets demonstrate the superior performance of our salutary labeling approach over traditional active learning strategies. Additionally, we provide several in-depth explorations and practical applications of large language model (LLM) fine-tuning.


title: Tensor Low-rank Approximation of Finite-horizon Value Functions

abstract: The goal of reinforcement learning is estimating a policy that maps states to actions and maximizes the cumulative reward of a Markov Decision Process (MDP). This is oftentimes achieved by estimating first the optimal (reward) value function (VF) associated with each state-action pair. When the MDP has an infinite horizon, the optimal VFs and policies are stationary under mild conditions. However, in finite-horizon MDPs, the VFs (hence, the policies) vary with time. This poses a challenge since the number of VFs to estimate grows not only with the size of the state-action space but also with the time horizon. This paper proposes a non-parametric low-rank stochastic algorithm to approximate the VFs of finite-horizon MDPs. First, we represent the (unknown) VFs as a multi-dimensional array, or tensor, where time is one of the dimensions. Then, we use rewards sampled from the MDP to estimate the optimal VFs. More precisely, we use the (truncated) PARAFAC decomposition to design an online low-rank algorithm that recovers the entries of the tensor of VFs. The size of the low-rank PARAFAC model grows additively with respect to each of its dimensions, rendering our approach efficient, as demonstrated via numerical experiments.


title: Lindenmayer graph languages, first-order theories and expanders

abstract: Combinatorial generation of expander families and Lindenmayer-style development models are both parallel in nature. Both can be handled within proposed parallel graph grammar formalism. Their first-order properties can then be checked by encompassing the generated graph language into an appropriate automatic structure.


title: HERMES: Gamma Ray Burst and Gravitational Wave counterpart hunter

abstract: Gamma Ray Bursts (GRBs) bridge relativistic astrophysics and multi-messenger astronomy. Space-based gamma/X-ray wide field detectors have proven essential to detect and localize the highly variable GRB prompt emission, which is also a counterpart of gravitational wave events. We study the capabilities to detect long and short GRBs by the High Energy Rapid Modular Ensemble of Satellites (HERMES) Pathfinder (HP) and SpIRIT, namely a swarm of six 3U CubeSats to be launched in early 2025, and a 6U CubeSat launched on December 1st 2023. We also study the capabilities of two advanced configurations of swarms of >8 satellites with improved detector performances (HERMES Constellations). The HERMES detectors, sensitive down to ~2-3 keV, will be able to detect faint/soft GRBs which comprise X-ray flashes and high redshift bursts. By combining state-of-the-art long and short GRB population models with a description of the single module performance, we estimate that HP will detect ~195^{+22}_{-21} long GRBs (3.4^{+0.3}_{-0.8} at redshift z>6) and ~19^{+5}_{-3} short GRBs per year. The larger HERMES Constellations under study can detect between ~1300 and ~3000 long GRBs per year and between ~160 and ~400 short GRBs per year, depending on the chosen configuration, with a rate of long GRBs above z>6 between 30 and 75 per year. Finally, we explore the capabilities of HERMES to detect short GRBs as electromagnetic counterparts of binary neutron star (BNS) mergers detected as gravitational signals by current and future ground-based interferometers. Under the assumption that the GRB jets are structured, we estimate that HP can provide up to 1 (14) yr^{-1} joint detections during the fifth LIGO-Virgo-KAGRA observing run (Einstein Telescope single triangle 10 km arm configuration). These numbers become 4 (100) yr^{-1}, respectively, for the HERMES Constellation configuration.


title: BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments

abstract: Agents based on large language models have shown great potential in accelerating scientific discovery by leveraging their rich background knowledge and reasoning capabilities. Here, we develop BioDiscoveryAgent, an agent that designs new experiments, reasons about their outcomes, and efficiently navigates the hypothesis space to reach desired solutions. We demonstrate our agent on the problem of designing genetic perturbation experiments, where the aim is to find a small subset out of many possible genes that, when perturbed, result in a specific phenotype (e.g., cell growth). Utilizing its biological knowledge, BioDiscoveryAgent can uniquely design new experiments without the need to train a machine learning model or explicitly design an acquisition function. Moreover, BioDiscoveryAgent achieves an average of 18% improvement in detecting desired phenotypes across five datasets, compared to existing Bayesian optimization baselines specifically trained for this task. Our evaluation includes one dataset that is unpublished, ensuring it is not part of the language model's training data. Additionally, BioDiscoveryAgent predicts gene combinations to perturb twice as accurately as a random baseline, a task so far not explored in the context of closed-loop experiment design. The agent also has access to tools for searching the biomedical literature, executing code to analyze biological datasets, and prompting another agent to critically evaluate its predictions. Overall, BioDiscoveryAgent is interpretable at every stage, representing an accessible new paradigm in the computational design of biological experiments with the potential to augment scientists' capabilities.


title: A Duality between Hilbert Functions of Lex Ideals and Quotients

abstract: We study the Macaulay coefficients induced by the ideal and quotient segments of a degree-$\delta$ monomial in $n$ variables. We give explicit formulas for these coefficients and establish a duality between the two theories. Our main result is that the ideal and quotient coefficients form a set partition of $\{0,1,\ldots,n+\delta-2\}$.


title: HEART-felt Narratives: Tracing Empathy and Narrative Style in Personal Stories with LLMs

abstract: Empathy serves as a cornerstone in enabling prosocial behaviors, and can be evoked through sharing of personal experiences in stories. While empathy is influenced by narrative content, intuitively, people respond to the way a story is told as well, through narrative style. Yet the relationship between empathy and narrative style is not fully understood. In this work, we empirically examine and quantify this relationship between style and empathy using LLMs and large-scale crowdsourcing studies. We introduce a novel, theory-based taxonomy, HEART (Human Empathy and Narrative Taxonomy) that delineates elements of narrative style that can lead to empathy with the narrator of a story. We establish the performance of LLMs in extracting narrative elements from HEART, showing that prompting with our taxonomy leads to reasonable, human-level annotations beyond what prior lexicon-based methods can do. To show empirical use of our taxonomy, we collect a dataset of empathy judgments of stories via a large-scale crowdsourcing study with N=2,624 participants. We show that narrative elements extracted via LLMs, in particular, vividness of emotions and plot volume, can elucidate the pathways by which narrative style cultivates empathy towards personal stories. Our work suggests that such models can be used for narrative analyses that lead to human-centered social and behavioral insights.


title: On the Growth of the Extremal and Cluster Level Sets in Branching Brownian Motion

abstract: We study the limiting extremal and cluster point processes of branching Brownian motion. The former records the heights of all extreme values of the process, while the latter records the relative heights of extreme values in a genealogical neighborhood of order unity around a local maximum thereof. For the extremal point process, we show that the mass of upper level sets $[-v, \infty)$ grows as $C_\star Z v e^{\sqrt{2} v}(1+o(1))$ as $v \to \infty$, almost surely, where $Z$ is the limit of the associated derivative martingale and $C_\star \in (0, \infty)$ is a universal constant. For the cluster point process, we show that the logarithm of the mass of $[-v, \infty)$ grow as $\sqrt{2}v$ minus random fluctuations of order $v^{2/3}$, which are governed by an explicit law in the limit. The first result improves upon the works of Cortines et al. (arXiv:1703.06529) and Mytnik et al. (arXiv:2009.02042) in which asymptotics are shown in probability, while the second makes rigorous the derivation in the physics literature by Mueller et al. (arXiv:1910.06382) and Le et al. (arXiv:2207.07672) and resolves a conjecture thereof.


title: Enhancing Resiliency of Integrated Space-Air-Ground-Sea Networks with Renewable Energies: A Use Case After the 2023 T\"urkiye Earthquake

abstract: Natural disasters can have catastrophic consequences, a poignant example is the series of $7.7$ and $7.6$ magnitude earthquakes that devastated T\"urkiye on February 6, 2023. To limit the damage, it is essential to maintain the communications infrastructure to ensure individuals impacted by the disaster can receive critical information. The disastrous earthquakes in T\"urkiye have revealed the importance of considering communications and energy solutions together to build resilient and sustainable infrastructure. Thus, this paper proposes an integrated space-air-ground-sea network architecture that utilizes various communications and energy-enabling technologies. This study aims to contribute to the development of robust and sustainable disaster-response frameworks. In light of the T\"urkiye earthquakes, two methods for network management are proposed: the first aims to ensure sustainability in the pre-disaster phase and the second aims to maintain communications during the in-disaster phase. In these frameworks, communications technologies such as High Altitude Platform Station(s)(HAPS), which are among the key enablers to unlock the potential of 6G networks, and energy technologies such as Renewable Energy Sources (RES), Battery Energy Storage Systems (BESSs), and Electric Vehicles (EVs) have been used as the prominent technologies. By simulating a case study, we demonstrate the performance of a proposed framework for providing network resiliency. The paper concludes with potential challenges and future directions to achieve a disaster-resilient network architecture solution.


title: Single-Fiber Optical Frequency Domain Reflectometry Shape Sensing of Continuum Manipulators with Planar Bending

abstract: To address the challenges associated with shape sensing of continuum manipulators (CMs) using Fiber Bragg Grating (FBG) optical fibers, we feature a unique shape sensing assembly utilizing solely a single Optical Frequency Domain Reflectometry (OFDR) fiber attached to a flat nitinol wire (NiTi). Integrating this easy-to-manufacture unique sensor with a long and soft CM with 170 mm length, we performed different experiments to evaluate its shape reconstruction ability. Results demonstrate phenomenal shape reconstruction accuracy for both C-shape (< 2 mm tip error, < 1.2 mm shape error) and J-shape (< 3.4 mm tip error, < 2.3 mm shape error) experiments.


title: The Economic Implications of Large Language Model Selection on Earnings and Return on Investment: A Decision Theoretic Model

abstract: Selecting language models in business contexts requires a careful analysis of the final financial benefits of the investment. However, the emphasis of academia and industry analysis of LLM is solely on performance. This work introduces a framework to evaluate LLMs, focusing on the earnings and return on investment aspects that should be taken into account in business decision making. We use a decision-theoretic approach to compare the financial impact of different LLMs, considering variables such as the cost per token, the probability of success in the specific task, and the gain and losses associated with LLMs use. The study reveals how the superior accuracy of more expensive models can, under certain conditions, justify a greater investment through more significant earnings but not necessarily a larger RoI. This article provides a framework for companies looking to optimize their technology choices, ensuring that investment in cutting-edge technology aligns with strategic financial objectives. In addition, we discuss how changes in operational variables influence the economics of using LLMs, offering practical insights for enterprise settings, finding that the predicted gain and loss and the different probabilities of success and failure are the variables that most impact the sensitivity of the models.


title: The surprising efficiency of temporal difference learning for rare event prediction

abstract: We quantify the efficiency of temporal difference (TD) learning over the direct, or Monte Carlo (MC), estimator for policy evaluation in reinforcement learning, with an emphasis on estimation of quantities related to rare events. Policy evaluation is complicated in the rare event setting by the long timescale of the event and by the need for \emph{relative accuracy} in estimates of very small values. Specifically, we focus on least-squares TD (LSTD) prediction for finite state Markov chains, and show that LSTD can achieve relative accuracy far more efficiently than MC. We prove a central limit theorem for the LSTD estimator and upper bound the \emph{relative asymptotic variance} by simple quantities characterizing the connectivity of states relative to the transition probabilities between them. Using this bound, we show that, even when both the timescale of the rare event and the relative accuracy of the MC estimator are exponentially large in the number of states, LSTD maintains a fixed level of relative accuracy with a total number of observed transitions of the Markov chain that is only \emph{polynomially} large in the number of states.


title: Some new Bollob\'as-type inequalities

abstract: A family of disjoint pairs of finite sets $\mathcal{P}=\{(A_i,B_i)\mid i\in[m]\}$ is called a Bollob\'as system if $A_i\cap B_j\neq\emptyset$ for every $i\neq j$, and a skew Bollob\'as system if $A_i\cap B_j\neq\emptyset$ for every $i<j$. Bollob\'as proved that for a Bollob\'as system, the inequality \begin{equation*} \sum_{i=1}^m\binom{|A_i|+|B_i|}{|A_i|}^{-1}\leq 1 \end{equation*} holds. Heged\"{u}s and Frankl generalized this theorem to skew Bollob\'as systems with the inequality \begin{equation*} \sum_{i=1}^m\binom{|A_i|+|B_i|}{|A_i|}^{-1}\leq 1+n, \end{equation*} provided $A_i,B_i\subseteq [n]$. In this paper, we improve this inequality to \begin{equation*} \sum_{i=1}^m \left((1+|A_i|+|B_i|) \binom{|A_i|+|B_i|}{|A_i|}\right)^{-1} \leq 1 \end{equation*} with probabilistic method. We also generalize this result to partitions of sets on both symmetric and skew cases.


title: Probabilistically Plausible Counterfactual Explanations with Normalizing Flows

abstract: We present PPCEF, a novel method for generating probabilistically plausible counterfactual explanations (CFs). PPCEF advances beyond existing methods by combining a probabilistic formulation that leverages the data distribution with the optimization of plausibility within a unified framework. Compared to reference approaches, our method enforces plausibility by directly optimizing the explicit density function without assuming a particular family of parametrized distributions. This ensures CFs are not only valid (i.e., achieve class change) but also align with the underlying data's probability density. For that purpose, our approach leverages normalizing flows as powerful density estimators to capture the complex high-dimensional data distribution. Furthermore, we introduce a novel loss that balances the trade-off between achieving class change and maintaining closeness to the original instance while also incorporating a probabilistic plausibility term. PPCEF's unconstrained formulation allows for efficient gradient-based optimization with batch processing, leading to orders of magnitude faster computation compared to prior methods. Moreover, the unconstrained formulation of PPCEF allows for the seamless integration of future constraints tailored to specific counterfactual properties. Finally, extensive evaluations demonstrate PPCEF's superiority in generating high-quality, probabilistically plausible counterfactual explanations in high-dimensional tabular settings. This makes PPCEF a powerful tool for not only interpreting complex machine learning models but also for improving fairness, accountability, and trust in AI systems.


title: Parametrised Poincar\'e duality and equivariant fixed points methods

abstract: In this article, we introduce and develop the notion of parametrised Poincar\'{e} duality in the formalism of parametrised higher category theory by Martini-Wolf, in part generalising Cnossen's theory of twisted ambidexterity to the nonpresentable setting. We prove several basechange results, allowing us to move between different coefficient categories and ambient topoi. We then specialise the general framework to yield a good theory of equivariant Poincar\'{e} duality spaces for compact Lie groups and apply our basechange results to obtain a suite of isotropy separation methods. Finally, we employ this theory to perform various categorical Smith-theoretic manoeuvres to prove, among other things, a generalisation of a theorem of Atiyah-Bott and Conner-Floyd on group actions with single fixed points.


title: Unifying Perspectives: Plausible Counterfactual Explanations on Global, Group-wise, and Local Levels

abstract: Growing regulatory and societal pressures demand increased transparency in AI, particularly in understanding the decisions made by complex machine learning models. Counterfactual Explanations (CFs) have emerged as a promising technique within Explainable AI (xAI), offering insights into individual model predictions. However, to understand the systemic biases and disparate impacts of AI models, it is crucial to move beyond local CFs and embrace global explanations, which offer a~holistic view across diverse scenarios and populations. Unfortunately, generating Global Counterfactual Explanations (GCEs) faces challenges in computational complexity, defining the scope of "global," and ensuring the explanations are both globally representative and locally plausible. We introduce a novel unified approach for generating Local, Group-wise, and Global Counterfactual Explanations for differentiable classification models via gradient-based optimization to address these challenges. This framework aims to bridge the gap between individual and systemic insights, enabling a deeper understanding of model decisions and their potential impact on diverse populations. Our approach further innovates by incorporating a probabilistic plausibility criterion, enhancing actionability and trustworthiness. By offering a cohesive solution to the optimization and plausibility challenges in GCEs, our work significantly advances the interpretability and accountability of AI models, marking a step forward in the pursuit of transparent AI.


title: A model-independent treatment of cosmic ladder calibration and $\Omega_k$ measurement through low-$z$ observations

abstract: Looking at the well-known Hubble tension as a tension in the calibrators of the cosmic distance ladder, i.e. the absolute magnitude $M$ of standard candles such as supernovae of Type Ia (SNIa) and the standard ruler represented by the comoving sound horizon at the baryon-drag epoch, $r_d$, we propose a model-independent method to measure these distance calibrators independently from the cosmic microwave background and the first rungs of the direct distance ladder. To do so, we leverage state-of-the-art data on cosmic chronometers (CCH), SNIa and baryon acoustic oscillations (BAO) from various galaxy surveys. Taking advantage of the Gaussian Processes Bayesian technique, we reconstruct $M(z)$, $\Omega_k(z)$ and $r_d(z)$ at $z\lesssim2$ and check that no significant statistical evolution is preferred at 68\% C.L. This allows us to treat them as constants and constrain them assuming the metric description of gravity, the cosmological principle and the validity of CCH as reliable cosmic clocks, and SNIa and BAO as optimal standard candles and standard rulers, respectively, but otherwise in a model-independent way. We obtain: $\Omega_k=-0.07^{+0.12}_{-0.15}$, $M=(-19.314^{+0.086}_{-0.108})$ mag and $r_d=(142.3\pm 5.3)$ Mpc. At present, the uncertainties derived are still too large to arbitrate the tension but this is bound to change in the near future with the advent of upcoming surveys and data.


title: Mathematical Foundations of Interlocking Assemblies

abstract: The study of interlocking assemblies is an emerging field with applications in various disciplines. However, to this day, the mathematical treatment of these assemblies has been sparse. In this work, we develop a comprehensive mathematical theory for interlocking assemblies, providing a precise definition and a method for proving the interlocking property based on infinitesimal motions. We consider assemblies with crystallographic symmetries and verify interlocking properties for such assemblies. Our analysis includes the development of an infinite polytope with crystallographic symmetries to ensure that the interlocking property holds. For a certain block, called the RhomBlock, that can be assembled in numerous ways, characterised by the combinatorial theory of lozenges, we rigorously prove the interlocking property. By conclusively showing that any assembly of the RhomBlock is interlocking, we provide a robust framework for further exploration and application of interlocking assemblies.


title: Degrees of P-Grothendieck polynomials and regularity of Pfaffian varieties

abstract: We prove a formula for the degrees of Ikeda and Naruse's $P$-Grothendieck polynomials using combinatorics of shifted tableaux. We show this formula can be used in conjunction with results of Hamaker, Marberg, and Pawlowski to obtain an upper bound on the Castelnuovo-Mumford regularity of certain Pfaffian varieties known as vexillary skew-symmetric matrix Schubert varieties. Similar combinatorics additionally yields a new formula for the degree of Grassmannian Grothendieck polynomials and the regularity of Grassmannian matrix Schubert varieties, complementing a 2021 formula of Rajchgot, Ren, Robichaux, St. Dizier, and Weigandt.


title: Gap between the number of facets of the two poset polytopes

abstract: We study the difference between the number of facets of the order polytope and the chain polytope of a poset. Hibi and Li classified posets where the gap is exactly zero. We describe the bounds on this gap using the new notion of crossing numbers, and then use this result to classify the posets where the gap is exactly one.


title: The investigation of singular integro-differential equations relating to adhesive contact problems of the theory of viscoelasticity

abstract: The exact and approximate solutions of singular integro-differential equations relating to the problems of interaction of an elastic thin finite or infinite non-homogeneous patch with a plate are considered, provided that the materials of plate and patch possess the creep property. Using the method of orthogonal polynomials the problem is reduced to the infinite system of Volterra integral equations, and using the method of integral transformations this problem is reduced to the different boundary value problems of the theory of analytic functions. An asymptotic analysis is also performed.


title: Supersymmetric Charge Constraints on AdS Black Holes from Free Fields

abstract: Supersymmetric AdS black hole solutions exist only when their angular momenta and charges satisfy a certain constraint that depends on the dimension. We show that these nonlinear relations on the conserved charges agree with a computation in the dual supersymmetric CFT in its free limit, with interactions entering only through a uniform rescaling of all charges. Our computations apply to the highly non-trivial charge constraints for AdS$_4$, AdS$_5$ and AdS$_7$ black holes, and generalize an earlier one for the analogous constraint in AdS$_3$. Our results suggest a microscopic understanding of AdS black holes beyond the scope of supersymmetric indices.


title: The $e$-positivity of the chromatic symmetric function for twinned paths and cycles

abstract: The operation of twinning a graph at a vertex was introduced by Foley, Ho\`ang, and Merkel (2019), who conjectured that twinning preserves $e$-positivity of the chromatic symmetric function. A counterexample to this conjecture was given by Li, Li, Wang, and Yang (2021). In this paper, we prove that $e$-positivity is preserved by the twinning operation on cycles, by giving an $e$-positive generating function for the chromatic symmetric function, as well as an $e$-positive recurrence. We derive similar $e$-positive generating functions and recurrences for twins of paths. Our methods make use of the important triple deletion formulas of Orellana and Scott (2014), as well as new symmetric function identities.


title: An Analysis of Performance Bottlenecks in MRI Pre-Processing

abstract: Magnetic Resonance Image (MRI) pre-processing is a critical step for neuroimaging analysis. However, the computational cost of MRI pre-processing pipelines is a major bottleneck for large cohort studies and some clinical applications. While High-Performance Computing (HPC) and, more recently, Deep Learning have been adopted to accelerate the computations, these techniques require costly hardware and are not accessible to all researchers. Therefore, it is important to understand the performance bottlenecks of MRI pre-processing pipelines to improve their performance. Using Intel VTune profiler, we characterized the bottlenecks of several commonly used MRI-preprocessing pipelines from the ANTs, FSL, and FreeSurfer toolboxes. We found that few functions contributed to most of the CPU time, and that linear interpolation was the largest contributor. Data access was also a substantial bottleneck. We identified a bug in the ITK library that impacts the performance of ANTs pipeline in single-precision and a potential issue with the OpenMP scaling in FreeSurfer recon-all. Our results provide a reference for future efforts to optimize MRI pre-processing pipelines.


title: Diphoton Signals of Muon-philic Scalars at DarkQuest

abstract: We analyze the unique capability of the DarkQuest proton beam-dump experiment at Fermilab to discover new light resonances decaying into photons. As an example model, we focus on muon-philic scalar particles that decay to photons. This is one of the few minimal models that can address the $(g-2)_\mu$ anomaly at low mass. These scalars can be copiously produced by meson decays and muon bremsstrahlung. We point out that thanks to DarkQuest's compact geometry, muons can propagate through the dump and efficiently produce dark scalars near the end of the dump. This mechanism enables DarkQuest to be sensitive to both long-lived and prompt scalars. At the same time, di-photon signatures are generically not background free, and we discuss in detail the different sources of background and strategies to mitigate them. We find that the backgrounds can be sufficiently reduced for DarkQuest to test currently-viable $(g-2)_\mu$ parameter space.


title: Monotone two-scale methods for a class of integrodifferential operators and applications

abstract: We develop a monotone, two-scale discretization for a class of integrodifferential operators of order $2s$, $s \in (0,1)$. We apply it to develop numerical schemes, and convergence rates, for linear and obstacle problems governed by such operators. As applications of the monotonicity, we provide error estimates for free boundaries and a convergent numerical scheme for a concave fully nonlinear, nonlocal, problem.


title: InversionView: A General-Purpose Method for Reading Information from Neural Activations

abstract: The inner workings of neural networks can be better understood if we can fully decipher the information encoded in neural activations. In this paper, we argue that this information is embodied by the subset of inputs that give rise to similar activations. Computing such subsets is nontrivial as the input space is exponentially large. We propose InversionView, which allows us to practically inspect this subset by sampling from a trained decoder model conditioned on activations. This helps uncover the information content of activation vectors, and facilitates understanding of the algorithms implemented by transformer models. We present three case studies where we investigate models ranging from small transformers to GPT-2. In these studies, we demonstrate the characteristics of our method, show the distinctive advantages it offers, and provide causally verified circuits.


title: Data-Driven Personalized Energy Consumption Range Estimation for Plug-in Hybrid Electric Vehicles in Urban Traffic

abstract: In urban traffic environments, driver behaviors exhibit considerable diversity in vehicle operation, encompassing a range of acceleration and braking maneuvers as well as adherence to traffic regulations, such as speed limits. It is well-established that these intrinsic driving behaviors significantly influence vehicle energy consumption. Therefore, establishing a quantitative relationship between driver behavior and energy usage is essential for identifying energy-efficient driving practices and optimizing routes within urban traffic. This study introduces a data-driven approach to predict the equivalent fuel consumption of a plug-in hybrid electric vehicle (PHEV) based on an integrated model of driver behavior and vehicle energy consumption. Unlike traditional models that provide point predictions of fuel consumption, this approach uses Conformalized Quantile Regression (CQR) to offer prediction intervals that capture the variability and uncertainty in fuel consumption. These intervals reflect changes in fuel consumption, as well as variations in driver behavior, and vehicle and route conditions. To develop this model, driver-specific data were collected through a driver-in-the-loop simulator, which tested different human drivers responses. The CQR model was then trained and validated using the experimental data from the driver-in-the-loop simulator, augmented by the synthetic data generated from Monte Carlo simulations conducted using a calibrated microscopic driver behavior and vehicle energy model. The CQR model was evaluated by comparing its predictions of equivalent fuel consumption intervals with those of baseline prediction interval methods that rely solely on conformal prediction.


title: Active flow control for drag reduction through multi-agent reinforcement learning on a turbulent cylinder at $Re_D=3900$

abstract: This study presents novel active-flow-control (AFC) strategies aimed at achieving drag reduction for a three-dimensional cylinder immersed in a flow at a Reynolds number based on freestream velocity and cylinder diameter of (Re_D=3900). The cylinder in this subcritical flow regime has been extensively studied in the literature and is considered a classic case of turbulent flow arising from a bluff body. The strategies presented are explored through the use of deep reinforcement learning. The cylinder is equipped with 10 independent zero-net-mass-flux jet pairs, distributed on the top and bottom surfaces, which define the AFC setup. The method is based on the coupling between a computational-fluid-dynamics solver and a multi-agent reinforcement-learning (MARL) framework using the proximal-policy-optimization algorithm. Thanks to the acceleration in training facilitated by exploiting the local invariants with MARL, a drag reduction of (8\%) was achieved, with a mass cost efficiency two orders of magnitude lower than those of the existing classical controls in the literature. This development represents a significant advancement in active flow control, particularly in turbulent regimes critical to industrial applications.


title: Alignment is Key for Applying Diffusion Models to Retrosynthesis

abstract: Retrosynthesis, the task of identifying precursors for a given molecule, can be naturally framed as a conditional graph generation task. Diffusion models are a particularly promising modelling approach, enabling post-hoc conditioning and trading off quality for speed during generation. We show mathematically that permutation equivariant denoisers severely limit the expressiveness of graph diffusion models and thus their adaptation to retrosynthesis. To address this limitation, we relax the equivariance requirement such that it only applies to aligned permutations of the conditioning and the generated graphs obtained through atom mapping. Our new denoiser achieves the highest top-$1$ accuracy ($54.7$\%) across template-free and template-based methods on USPTO-50k. We also demonstrate the ability for flexible post-training conditioning and good sample quality with small diffusion step counts, highlighting the potential for interactive applications and additional controls for multi-step planning.


title: Robust Perception and Navigation of Autonomous Surface Vehicles in Challenging Environments

abstract: Research on coastal regions traditionally involves methods like manual sampling, monitoring buoys, and remote sensing, but these methods face challenges in spatially and temporally diverse regions of interest. Autonomous surface vehicles (ASVs) with artificial intelligence (AI) are being explored, and recognized by the International Maritime Organization (IMO) as vital for future ecosystem understanding. However, there is not yet a mature technology for autonomous environmental monitoring due to typically complex coastal situations: (1) many static (e.g., buoy, dock) and dynamic (e.g., boats) obstacles not compliant with the rules of the road (COLREGs); (2) uncharted or uncertain information (e.g., non-updated nautical chart); and (3) high-cost ASVs not accessible to the community and citizen science while resulting in technology illiteracy. To address the above challenges, my research involves both system and algorithmic development: (1) a robotic boat system for stable and reliable in-water monitoring, (2) maritime perception to detect and track obstacles (such as buoys, and boats), and (3) navigational decision-making with multiple-obstacle avoidance and multi-objective optimization.


title: Generative Query Reformulation Using Ensemble Prompting, Document Fusion, and Relevance Feedback

abstract: Query Reformulation (QR) is a set of techniques used to transform a user's original search query to a text that better aligns with the user's intent and improves their search experience. Recently, zero-shot QR has been a promising approach due to its ability to exploit knowledge inherent in large language models. Inspired by the success of ensemble prompting strategies which have benefited other tasks, we investigate if they can improve query reformulation. In this context, we propose two ensemble-based prompting techniques, GenQREnsemble and GenQRFusion which leverage paraphrases of a zero-shot instruction to generate multiple sets of keywords to improve retrieval performance ultimately. We further introduce their post-retrieval variants to incorporate relevance feedback from a variety of sources, including an oracle simulating a human user and a "critic" LLM. We demonstrate that an ensemble of query reformulations can improve retrieval effectiveness by up to 18% on nDCG@10 in pre-retrieval settings and 9% on post-retrieval settings on multiple benchmarks, outperforming all previously reported SOTA results. We perform subsequent analyses to investigate the effects of feedback documents, incorporate domain-specific instructions, filter reformulations, and generate fluent reformulations that might be more beneficial to human searchers. Together, the techniques and the results presented in this paper establish a new state of the art in automated query reformulation for retrieval and suggest promising directions for future research.


title: Enhancing Global Sensitivity and Uncertainty Quantification in Medical Image Reconstruction with Monte Carlo Arbitrary-Masked Mamba

abstract: Deep learning has been extensively applied in medical image reconstruction, where Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) represent the predominant paradigms, each possessing distinct advantages and inherent limitations: CNNs exhibit linear complexity with local sensitivity, whereas ViTs demonstrate quadratic complexity with global sensitivity. The emerging Mamba has shown superiority in learning visual representation, which combines the advantages of linear scalability and global sensitivity. In this study, we introduce MambaMIR, an Arbitrary-Masked Mamba-based model with wavelet decomposition for joint medical image reconstruction and uncertainty estimation. A novel Arbitrary Scan Masking (ASM) mechanism "masks out" redundant information to introduce randomness for further uncertainty estimation. Compared to the commonly used Monte Carlo (MC) dropout, our proposed MC-ASM provides an uncertainty map without the need for hyperparameter tuning and mitigates the performance drop typically observed when applying dropout to low-level tasks. For further texture preservation and better perceptual quality, we employ the wavelet transformation into MambaMIR and explore its variant based on the Generative Adversarial Network, namely MambaMIR-GAN. Comprehensive experiments have been conducted for multiple representative medical image reconstruction tasks, demonstrating that the proposed MambaMIR and MambaMIR-GAN outperform other baseline and state-of-the-art methods in different reconstruction tasks, where MambaMIR achieves the best reconstruction fidelity and MambaMIR-GAN has the best perceptual quality. In addition, our MC-ASM provides uncertainty maps as an additional tool for clinicians, while mitigating the typical performance drop caused by the commonly used dropout.


title: LoReTrack: Efficient and Accurate Low-Resolution Transformer Tracking

abstract: High-performance Transformer trackers have shown excellent results, yet they often bear a heavy computational load. Observing that a smaller input can immediately and conveniently reduce computations without changing the model, an easy solution is to adopt the low-resolution input for efficient Transformer tracking. Albeit faster, this hurts tracking accuracy much due to information loss in low resolution tracking. In this paper, we aim to mitigate such information loss to boost the performance of the low-resolution Transformer tracking via dual knowledge distillation from a frozen high-resolution (but not a larger) Transformer tracker. The core lies in two simple yet effective distillation modules, comprising query-key-value knowledge distillation (QKV-KD) and discrimination knowledge distillation (Disc-KD), across resolutions. The former, from the global view, allows the low-resolution tracker to inherit the features and interactions from the high-resolution tracker, while the later, from the target-aware view, enhances the target-background distinguishing capacity via imitating discriminative regions from its high-resolution counterpart. With the dual knowledge distillation, our Low-Resolution Transformer Tracker (LoReTrack) enjoys not only high efficiency owing to reduced computation but also enhanced accuracy by distilling knowledge from the high-resolution tracker. In extensive experiments, LoReTrack with a 256x256 resolution consistently improves baseline with the same resolution, and shows competitive or even better results compared to 384x384 high-resolution Transformer tracker, while running 52% faster and saving 56% MACs. Moreover, LoReTrack is resolution-scalable. With a 128x128 resolution, it runs 25 fps on a CPU with 64.9%/46.4% SUC scores on LaSOT/LaSOText, surpassing all other CPU real-time trackers. Code will be released.


title: RefDrop: Controllable Consistency in Image or Video Generation via Reference Feature Guidance

abstract: There is a rapidly growing interest in controlling consistency across multiple generated images using diffusion models. Among various methods, recent works have found that simply manipulating attention modules by concatenating features from multiple reference images provides an efficient approach to enhancing consistency without fine-tuning. Despite its popularity and success, few studies have elucidated the underlying mechanisms that contribute to its effectiveness. In this work, we reveal that the popular approach is a linear interpolation of image self-attention and cross-attention between synthesized content and reference features, with a constant rank-1 coefficient. Motivated by this observation, we find that a rank-1 coefficient is not necessary and simplifies the controllable generation mechanism. The resulting algorithm, which we coin as RefDrop, allows users to control the influence of reference context in a direct and precise manner. Besides further enhancing consistency in single-subject image generation, our method also enables more interesting applications, such as the consistent generation of multiple subjects, suppressing specific features to encourage more diverse content, and high-quality personalized video generation by boosting temporal consistency. Even compared with state-of-the-art image-prompt-based generators, such as IP-Adapter, RefDrop is competitive in terms of controllability and quality while avoiding the need to train a separate image encoder for feature injection from reference images, making it a versatile plug-and-play solution for any image or video diffusion model.


title: Nonlinear steepest descent on a torus: A case study of the Landau-Lifshitz equation

abstract: We obtain rigorous large time asymptotics for the Landau-Lifshitz equation in the soliton free case by extending the nonlinear steepest descent method to genus 1 surfaces. The methods presented in this paper pave the way to rigorous analysis of other integrable equations on the torus and enables asymptotic analysis on different regimes of the Landau-Lifshitz equation.


title: What's the Opposite of a Face? Finding Shared Decodable Concepts and their Negations in the Brain

abstract: Prior work has offered evidence for functional localization in the brain; different anatomical regions preferentially activate for certain types of visual input. For example, the fusiform face area preferentially activates for visual stimuli that include a face. However, the spectrum of visual semantics is extensive, and only a few semantically-tuned patches of cortex have so far been identified in the human brain. Using a multimodal (natural language and image) neural network architecture (CLIP) we train a highly accurate contrastive model that maps brain responses during naturalistic image viewing to CLIP embeddings. We then use a novel adaptation of the DBSCAN clustering algorithm to cluster the parameters of these participant-specific contrastive models. This reveals what we call Shared Decodable Concepts (SDCs): clusters in CLIP space that are decodable from common sets of voxels across multiple participants. Examining the images most and least associated with each SDC cluster gives us additional insight into the semantic properties of each SDC. We note SDCs for previously reported visual features (e.g. orientation tuning in early visual cortex) as well as visual semantic concepts such as faces, places and bodies. In cases where our method finds multiple clusters for a visuo-semantic concept, the least associated images allow us to dissociate between confounding factors. For example, we discovered two clusters of food images, one driven by color, the other by shape. We also uncover previously unreported areas such as regions of extrastriate body area (EBA) tuned for legs/hands and sensitivity to numerosity in right intraparietal sulcus, and more. Thus, our contrastive-learning methodology better characterizes new and existing visuo-semantic representations in the brain by leveraging multimodal neural network representations and a novel adaptation of clustering algorithms.


title: Adaptive Device-Edge Collaboration on DNN Inference in AIoT: A Digital Twin-Assisted Approach

abstract: Device-edge collaboration on deep neural network (DNN) inference is a promising approach to efficiently utilizing network resources for supporting artificial intelligence of things (AIoT) applications. In this paper, we propose a novel digital twin (DT)-assisted approach to device-edge collaboration on DNN inference that determines whether and when to stop local inference at a device and upload the intermediate results to complete the inference on an edge server. Instead of determining the collaboration for each DNN inference task only upon its generation, multi-step decision-making is performed during the on-device inference to adapt to the dynamic computing workload status at the device and the edge server. To enhance the adaptivity, a DT is constructed to evaluate all potential offloading decisions for each DNN inference task, which provides augmented training data for a machine learning-assisted decision-making algorithm. Then, another DT is constructed to estimate the inference status at the device to avoid frequently fetching the status information from the device, thus reducing the signaling overhead. We also derive necessary conditions for optimal offloading decisions to reduce the offloading decision space. Simulation results demon-strate the outstanding performance of our DT-assisted approach in terms of balancing the tradeoff among inference accuracy, delay, and energy consumption.