title: Signatures of infinite randomness in transport properties of disordered spin chains

abstract: We study the spin transport properties of some disordered spin chains with a special focus on the distribution of the frequency-dependent spin conductivity. In the cases of interest here, the systems are governed by an effectively infinite disorder at low energies. A hallmark of this behavior is the wide discrepancy between the average and the typical values of some physical quantities, which are described by extremely broad distributions. We show that such is also the case of the spin conductivity, whose average value is metallic but whose typical one, the physically relevant quantity, is insulating. This solves the apparent contradiction between the prediction of a spin metallic phase of the spin-1/2 disordered XX chain and its known localized behavior (after a mapping to free fermions). Our results are based on analytical and numerical implementations of a strong-disorder renormalization group as well as exact diagonalization studies. We present our analyses in very general terms, valid for systems of any spin $S$ value, but the cases of $S=1/2$ and 1 are studied in greater detail.


title: Mechanical properties of cubic boron nitride and diamond at dynamical pressure and temperature

abstract: We report the mechanical properties of cubic boron nitride (c-BN) and diamond under the combined impact of dynamical pressure and temperature, calculated using ab initio molecular dynamics. Our study revealed a pronounced sensitivity of the mechanical properties of c-BN to applied pressure. Notably, c-BN undergoes a brittle-to-ductile transition at ~220 GPa, consistent across various dynamical temperatures, while diamond exhibits no such transition. Furthermore, the Vickers hardness profile for c-BN closely mirrors that of diamond across a spectrum of temperature-pressure conditions, highlighting c-BN's significant mechanical robustness. These results underscore the superior resilience and adaptability of c-BN compared to diamond, suggesting its potential as an ideal candidate for applications in extreme environments.


title: Comparable Demonstrations are Important in In-Context Learning: A Novel Perspective on Demonstration Selection

abstract: In-Context Learning (ICL) is an important paradigm for adapting Large Language Models (LLMs) to downstream tasks through a few demonstrations. Despite the great success of ICL, the limitation of the demonstration number may lead to demonstration bias, i.e. the input-label mapping induced by LLMs misunderstands the task's essence. Inspired by human experience, we attempt to mitigate such bias through the perspective of the inter-demonstration relationship. Specifically, we construct Comparable Demonstrations (CDs) by minimally editing the texts to flip the corresponding labels, in order to highlight the task's essence and eliminate potential spurious correlations through the inter-demonstration comparison. Through a series of experiments on CDs, we find that (1) demonstration bias does exist in LLMs, and CDs can significantly reduce such bias; (2) CDs exhibit good performance in ICL, especially in out-of-distribution scenarios. In summary, this study explores the ICL mechanisms from a novel perspective, providing a deeper insight into the demonstration selection strategy for ICL.


title: Three-dimensional bound states of cylindrical quantum heterostructures with position-dependent mass carriers

abstract: We present a comprehensive spectral analysis of cylindrical quantum heterostructures by considering effective electronic carriers with position-dependent mass for five different kinetic-operator orderings. We obtain the bound energy eigenstates of particles in a three-dimensional cylindrical nanowire under a confining hyperbolic potential with both open and closed boundary conditions in the radial and the axial directions. In the present model we consider carriers with continuous mass distributions within the dot with abrupt mass discontinuities at the barriers, moving in a quantum dot that connects different substances. Continuity of mass and potential at the interfaces with the external layers result as a particular case. Our approach is mostly analytical and allows a precise comparison among von Roos ordering classes.

categories: cond-mat.mes-hall cond-mat.mtrl-sci physics.atm-clus physics.atom-ph quant-ph


title: Double-Flow GAN model for the reconstruction of perceived faces from brain activities

abstract: Face plays an important role in human's visual perception, and reconstructing perceived faces from brain activities is challenging because of its difficulty in extracting high-level features and maintaining consistency of multiple face attributes, such as expression, identity, gender, etc. In this study, we proposed a novel reconstruction framework, which we called Double-Flow GAN, that can enhance the capability of discriminator and handle imbalances in images from certain domains that are too easy for generators. We also designed a pretraining process that uses features extracted from images as conditions for making it possible to pretrain the conditional reconstruction model from fMRI in a larger pure image dataset. Moreover, we developed a simple pretrained model to perform fMRI alignment to alleviate the problem of cross-subject reconstruction due to the variations of brain structure among different subjects. We conducted experiments by using our proposed method and state-of-the-art reconstruction models. Our results demonstrated that our method showed significant reconstruction performance, outperformed the previous reconstruction models, and exhibited a good generation ability.


title: Convex Parameter Estimation of Perturbed Multivariate Generalized Gaussian Distributions

abstract: The multivariate generalized Gaussian distribution (MGGD), also known as the multivariate exponential power (MEP) distribution, is widely used in signal and image processing. However, estimating MGGD parameters, which is required in practical applications, still faces specific theoretical challenges. In particular, establishing convergence properties for the standard fixed-point approach when both the distribution mean and the scatter (or the precision) matrix are unknown is still an open problem. In robust estimation, imposing classical constraints on the precision matrix, such as sparsity, has been limited by the non-convexity of the resulting cost function. This paper tackles these issues from an optimization viewpoint by proposing a convex formulation with well-established convergence properties. We embed our analysis in a noisy scenario where robustness is induced by modelling multiplicative perturbations. The resulting framework is flexible as it combines a variety of regularizations for the precision matrix, the mean and model perturbations. This paper presents proof of the desired theoretical properties, specifies the conditions preserving these properties for different regularization choices and designs a general proximal primal-dual optimization strategy. The experiments show a more accurate precision and covariance matrix estimation with similar performance for the mean vector parameter compared to Tyler's M-estimator. In a high-dimensional setting, the proposed method outperforms the classical GLASSO, one of its robust extensions, and the regularized Tyler's estimator.


title: Microscale stress-geometry interactions in an additively manufactured NiTi cardiovascular stent: A synchrotron dual imaging tomography and diffraction study

abstract: This study explores cardiovascular stents fabricated using laser powder bed fusion (LPBF); an emerging method to offer patient-specific customisable parts. Here, the shape memory alloy NiTi, in a near equiatomic composition, was investigated to deconvolve the material response from macroscopic component effects. Specifically, stress-geometry interactions were revealed, in-situ, for a minaturised cardiovascular stent subjected to an externally applied cylindrical stress whilst acquiring synchrotron X-ray imaging and diffraction data. The approach enabled the collection of spatially resolved micromechanical deformation data; the formation of stress-induced martensite and R-phase was evident, occurring in locations near junctions between stent ligaments where stress concentrations exist. In the as-fabricated condition, hardness maps were obtained through nanoindentation, demonstrating that the localised deformation and deformation patterning is further controlled by porosity and microstructural heterogeneity. Electron backscatter diffraction (EBSD) supported these observations, showing a finer grain structure near stent junctions with higher associated lattice curvature. These features, combined with stress concentrations when loaded will initiate localised phase transformations. If the stent was subjected to repeated loading, representing in-vivo conditions, these regions would be susceptible to cyclic damage through transformation memory loss, leading to premature component failure. This study highlights the challenges that must be addressed for the post-processing treatment of LABF-processed stents for healthcare-related applications.


title: Off-diagonal long-range order for the free Bose gas via the Feynman--Kac formula

abstract: We consider the path-integral representation of the ideal Bose gas under various boundary conditions. We show that Bose--Einstein condensation occurs at the famous critical density threshold, by proving that its $1$-particle-reduced density matrix exhibits off-diagonal long-range order above that threshold, but not below. Our proofs are based on the well-known Feynman--Kac formula and a representation in terms of a crucial Poisson point process. Furthermore, in the condensation regime, we derive a law of large numbers with strong concentration for the number of particles in short loops. In contrast to the situation for free boundary conditions, where the entire condensate sits in just one loop, for all other boundary conditions we obtain the limiting Poisson--Dirichlet distribution for the collection of the lengths of all long loops. Our proofs are new and purely probabilistic (apart from a standard eigenvalue expansion), using elementary tools like Markov's inequality, Poisson point processes, combinatorial formulas for cardinalities of particular partition sets, and asymptotics for random walks with Pareto-distributed steps.


title: Classification of retail products: From probabilistic ranking to neural networks

abstract: Food retailing is now on an accelerated path to a success penetration into the digital market by new ways of value creation at all stages of the consumer decision process. One of the most important imperatives in this path is the availability of quality data to feed all the process in digital transformation. But the quality of data is not so obvious if we consider the variety of products and suppliers in the grocery market. Within this context of digital transformation of grocery industry, \textit{Midiadia} is Spanish data provider company that works on converting data from the retailers' products into knowledge with attributes and insights from the product labels, that is, maintaining quality data in a dynamic market with a high dispersion of products. Currently, they manually categorize products (groceries) according to the information extracted directly (text processing) from the product labelling and packaging. This paper introduces a solution to automatically categorize the constantly changing product catalogue into a 3-level food taxonomy. Our proposal studies three different approaches: a score-based ranking method, traditional machine learning algorithms, and deep neural networks. Thus, we provide four different classifiers that support a more efficient and less error-prone maintenance of groceries catalogues, the main asset of the company. Finally, we have compared the performance of these three alternatives, concluding that traditional machine learning algorithms perform better, but closely followed by the score-based approach.


title: Turning Earth into Venus: A Stochastic Model of Possible Evolutions of Terrestrial Topography

abstract: Venus may have had both an Earth-like climate as well as extensive water oceans and active (or incipient) plate tectonics for an extended interval of its history. The topographical power spectrum of Venus provides important clues to the planet's past evolution. By drawing detailed contrast with the strong low-order odd-$l$ dominated global topography of Earth, we demonstrate that the relatively flat Venusian topography can be interpreted to have arisen from the transition from active terrestrial-like plate tectonics to the current stagnant lid configuration at a time $\tau = 544^{+886}_{-193}$ million years before present. This scenario is plausible if loss of oceans and the attendant transition to a CO$_2$-dominated atmosphere were accompanied by rapid continental-scale erosion, followed by gradual lava resurfacing at an outflow rate $\sim$ 1 km$^{3}$ yr$^{-1}$. We study Venus' proposed topographical relaxation with a global diffusion-like model that adopts terrestrial erosion rates scaled to account for the increased rainfall and temperatures that would accompany a planet-wide transition from an Earth-like climate to the runaway greenhouse climate that could ultimately yield present-day Venus, with an estimate of $5.1^{+1.8}_{-1.1}$ Myr if the global erosion operated as efficiently as that of a typical bedrock river basin on Earth.


title: Search for long-lived heavy neutral leptons with lepton flavour conserving or violating decays to a jet and a charged lepton

abstract: A search for long-lived heavy neutral leptons (HNLs) is presented, which considers the hadronic final state and coupling scenarios involving all three lepton generations in the 2-20 GeV HNL mass range for the first time. Events comprising two leptons (electrons or muons) and jets are analyzed in a data sample of proton-proton collisions, recorded with the CMS experiment at the CERN LHC at a centre-of-mass energy of 13 TeV, corresponding to an integrated luminosity of 138 fb$^{-1}$. A novel jet tagger, based on a deep neural network, has been developed to identify jets from an HNL decay using various features of the jet and its constituent particles. The network output can be used as a powerful discriminating tool to probe a broad range of HNL lifetimes and masses. Contributions from background processes are determined from data. No excess of events in data over the expected background is observed. Upper limits on the HNL production cross section are derived as functions of the HNL mass and the three coupling strengths $V_{\ell\mathrm{N}}$ to each lepton generation $\ell$ and presented as exclusion limits in the coupling-mass plane, as lower limits on the HNL lifetime, and on the HNL mass. In this search, the most stringent limit on the coupling strength is obtained for pure muon coupling scenarios; values of $\lvert V_{\mu\mathrm{N}}\rvert^{2}$ $\gt $ 5 (4) $\times$ 10$^{-7}$ are excluded for Dirac (Majorana) HNLs with a mass of 10 GeV at a confidence level of 95% that correspond to proper decay lengths of 17 (10) mm.


title: MinD-3D: Reconstruct High-quality 3D objects in Human Brain

abstract: In this paper, we introduce Recon3DMind, an innovative task aimed at reconstructing 3D visuals from Functional Magnetic Resonance Imaging (fMRI) signals, marking a significant advancement in the fields of cognitive neuroscience and computer vision. To support this pioneering task, we present the fMRI-Shape dataset, which includes data from 14 participants and features 360-degree videos of 3D objects to enable comprehensive fMRI signal capture across various settings, thereby laying a foundation for future research. Furthermore, we propose MinD-3D, a novel and effective three-stage framework specifically designed to decode the brain's 3D visual information from fMRI signals, demonstrating the feasibility of this challenging task. The framework begins by extracting and aggregating features from fMRI frames through a neuro-fusion encoder, subsequently employs a feature bridge diffusion model to generate visual features, and ultimately recovers the 3D object via a generative transformer decoder. We assess the performance of MinD-3D using a suite of semantic and structural metrics and analyze the correlation between the features extracted by our model and the visual regions of interest (ROIs) in fMRI signals. Our findings indicate that MinD-3D not only reconstructs 3D objects with high semantic relevance and spatial similarity but also significantly enhances our understanding of the human brain's capabilities in processing 3D visual information. Project page at: https://jianxgao.github.io/MinD-3D.


title: Dark energy from topology change induced by microscopic Gauss-Bonnet wormholes

abstract: It is known that the appearance of microscopic objects with distinct topologies and different Euler characteristics, such as instatons and wormholes, at the spacetime-foam level in Euclidean quantum gravity approaches, leads to spacetime topology changes. Such changes, in principle, may affect the field equations that arise through the semiclassical variation procedure of gravitational actions. Although in the case of Einstein-Hilbert action the presence of microscopic wormholes does not lead to any non-trivial result, when the Gauss-Bonnet term is added in the gravitational action, the above effective topological variation procedure induces an effective cosmological constant that depends on the Gauss-Bonnet coupling and the wormhole density. Since the later in a dynamical spacetime is in general time-dependent, one obtains an effective dark energy sector of topological origin.


title: Current-controlled chirality dynamics in a mesoscopic magnetic domain wall

abstract: Chirality as internal degree of freedom of a mesoscopic domain wall inside a quasi-one-dimensional fixture can be controlled by spin-polarized current for ferro- as well as anti-ferro-magnetic domain walls. We show that the current density required for the chirality manipulation can be significantly reduced in the low-temperature regime where the chirality dynamics exhibits quantum effects. In this quantum regime, weak currents can excite Bloch oscillations of the domain wall angular rotation velocity, with the oscillation frequency proportional to the current, modulated by a much higher magnon-range frequency. In addition to that, the Wannier-Stark localization effects enable controlled switching between different chiral states, suppressing inertial effects characteristic for the classical regime. We also show that for recently discovered novel class of magnetic materials -- altermagnets -- chirality switching can be driven by the usual charge current (not spin-polarized).


title: LMDrive: Closed-Loop End-to-End Driving with Large Language Models

abstract: Despite significant recent progress in the field of autonomous driving, modern methods still struggle and can incur serious accidents when encountering long-tail unforeseen events and challenging urban scenarios. On the one hand, large language models (LLM) have shown impressive reasoning capabilities that approach "Artificial General Intelligence". On the other hand, previous autonomous driving methods tend to rely on limited-format inputs (e.g. sensor data and navigation waypoints), restricting the vehicle's ability to understand language information and interact with humans. To this end, this paper introduces LMDrive, a novel language-guided, end-to-end, closed-loop autonomous driving framework. LMDrive uniquely processes and integrates multi-modal sensor data with natural language instructions, enabling interaction with humans and navigation software in realistic instructional settings. To facilitate further research in language-based closed-loop autonomous driving, we also publicly release the corresponding dataset which includes approximately 64K instruction-following data clips, and the LangAuto benchmark that tests the system's ability to handle complex instructions and challenging driving scenarios. Extensive closed-loop experiments are conducted to demonstrate LMDrive's effectiveness. To the best of our knowledge, we're the very first work to leverage LLMs for closed-loop end-to-end autonomous driving. Codes, models, and datasets can be found at https://github.com/opendilab/LMDrive


title: NearbyPatchCL: Leveraging Nearby Patches for Self-Supervised Patch-Level Multi-Class Classification in Whole-Slide Images

abstract: Whole-slide image (WSI) analysis plays a crucial role in cancer diagnosis and treatment. In addressing the demands of this critical task, self-supervised learning (SSL) methods have emerged as a valuable resource, leveraging their efficiency in circumventing the need for a large number of annotations, which can be both costly and time-consuming to deploy supervised methods. Nevertheless, patch-wise representation may exhibit instability in performance, primarily due to class imbalances stemming from patch selection within WSIs. In this paper, we introduce Nearby Patch Contrastive Learning (NearbyPatchCL), a novel self-supervised learning method that leverages nearby patches as positive samples and a decoupled contrastive loss for robust representation learning. Our method demonstrates a tangible enhancement in performance for downstream tasks involving patch-level multi-class classification. Additionally, we curate a new dataset derived from WSIs sourced from the Canine Cutaneous Cancer Histology, thus establishing a benchmark for the rigorous evaluation of patch-level multi-class classification methodologies. Intensive experiments show that our method significantly outperforms the supervised baseline and state-of-the-art SSL methods with top-1 classification accuracy of 87.56%. Our method also achieves comparable results while utilizing a mere 1% of labeled data, a stark contrast to the 100% labeled data requirement of other approaches. Source code: https://github.com/nvtien457/NearbyPatchCL


title: A Chromatic Treatment of Linear Polarization in the Solar Corona at the 2023 Total Solar Eclipse

abstract: The broadband solar K-corona is linearly polarized due to Thomson scattering. Various strategies have been used to represent coronal polarization. Here, we present a new way to visualize the polarized corona, using observations from the 2023 April 20 total solar eclipse in Australia in support of the Citizen CATE 2024 project. We convert observations in the common four-polarizer orthogonal basis (0{\deg}, 45{\deg}, 90{\deg}, & 135{\deg}) to -60{\deg}, 0{\deg}, and +60{\deg} (MZP) polarization, which is homologous to R, G, B color channels. The unique image generated provides some sense of how humans might visualize polarization if we could perceive it in the same way we perceive color.

categories: physics.pop-ph astro-ph.IM astro-ph.SR physics.space-ph


title: On Robot Acceptance and Trust: A Review and Unanswered Questions

abstract: This position paper briefly considers the current benefits and shortcomings surrounding robot trust and acceptance, focusing on robots with interactive capabilities. The paper concludes with currently unanswered questions and may serve as a jumping-off point for discussion.


title: SocialStigmaQA: A Benchmark to Uncover Stigma Amplification in Generative Language Models

abstract: Current datasets for unwanted social bias auditing are limited to studying protected demographic features such as race and gender. In this work, we introduce a comprehensive benchmark that is meant to capture the amplification of social bias, via stigmas, in generative language models. Taking inspiration from social science research, we start with a documented list of 93 US-centric stigmas and curate a question-answering (QA) dataset which involves simple social situations. Our benchmark, SocialStigmaQA, contains roughly 10K prompts, with a variety of prompt styles, carefully constructed to systematically test for both social bias and model robustness. We present results for SocialStigmaQA with two open source generative language models and we find that the proportion of socially biased output ranges from 45% to 59% across a variety of decoding strategies and prompting styles. We demonstrate that the deliberate design of the templates in our benchmark (e.g., adding biasing text to the prompt or using different verbs that change the answer that indicates bias) impacts the model tendencies to generate socially biased output. Additionally, through manual evaluation, we discover problematic patterns in the generated chain-of-thought output that range from subtle bias to lack of reasoning. Warning: This paper contains examples of text which are toxic, biased, and potentially harmful.


title: Polarization-induced Weyl phonons in nonsymmorphic crystals

abstract: In this work, it is shown that in certain nonsymmorphic space groups, electric polarization due to an external electric field or ferroelectric order produces Weyl phonons.


title: Morse Index Stability of Biharmonic Maps in Critical Dimension

abstract: Furthering the development of Da Lio-Gianocca-Rivi\`ere's Morse stability theory (arXiv:2212.03124) that was first applied to harmonic maps between manifolds and later extended to the case of Willmore immersions (arXiv:2306.04608-04609), we generalise the method to the case of (intrinsic or extrinsic) biharmonic maps. In the course of the proof, we develop a novel method to prove strong energy quantization (in the space of squared-integrable functions that corresponds to the pre-dual of the Marcinkiewicz space of weakly squared-integrable functions) in a wide class of problems in geometric analysis, which allows us to recover some previous results in a unified fashion.


title: Exploring Plain ViT Reconstruction for Multi-class Unsupervised Anomaly Detection

abstract: This work studies the recently proposed challenging and practical Multi-class Unsupervised Anomaly Detection (MUAD) task, which only requires normal images for training while simultaneously testing both normal/anomaly images for multiple classes. Existing reconstruction-based methods typically adopt pyramid networks as encoders/decoders to obtain multi-resolution features, accompanied by elaborate sub-modules with heavier handcraft engineering designs for more precise localization. In contrast, a plain Vision Transformer (ViT) with simple architecture has been shown effective in multiple domains, which is simpler, more effective, and elegant. Following this spirit, this paper explores plain ViT architecture for MUAD. Specifically, we abstract a Meta-AD concept by inducing current reconstruction-based methods. Then, we instantiate a novel and elegant plain ViT-based symmetric ViTAD structure, effectively designed step by step from three macro and four micro perspectives. In addition, this paper reveals several interesting findings for further exploration. Finally, we propose a comprehensive and fair evaluation benchmark on eight metrics for the MUAD task. Based on a naive training recipe, ViTAD achieves state-of-the-art (SoTA) results and efficiency on the MVTec AD and VisA datasets without bells and whistles, obtaining 85.4 mAD that surpasses SoTA UniAD by +3.0, and only requiring 1.1 hours and 2.3G GPU memory to complete model training by a single V100 GPU. Source code, models, and more results are available at https://zhangzjn.github.io/projects/ViTAD.


title: Magnetic quantum oscillations of in-plane Hall conductivity and magnetoresistance tensor in quasi-two-dimensional metals

abstract: We develop the theory of magnetoresistance oscillations in layered quasi-two-dimensional (quasi-2D) metals. Using the Kubo-Streda formula, we calculate the Hall intralayer conductivity in a magnetic field perpendicular to conducting layers. The analytical expressions for the amplitudes and phases of magnetic quantum oscillations (MQO) and of the difference or the so-called slow oscillations (SO) are derived as a function of several parameters: magnetic field strength, interlayer transfer integral, temperature, and the electron mean-free time. We calculate the quantum oscillations of the magnetoresistance tensor, because the magnetoresistance rather than conductivity is usually measured. We also discuss the averaging of magnetoresistance oscillations over MQO period due to finite temperature and long-range sample inhomogeneities. The results obtained are useful to analyze experimental data on magnetoresistance oscillations in various quasi-2D metals.


title: Practical Benchmarking of Randomized Measurement Methods for Quantum Chemistry Hamiltonians

abstract: Many hybrid quantum-classical algorithms for the application of ground state energy estimation in quantum chemistry involve estimating the expectation value of a molecular Hamiltonian with respect to a quantum state through measurements on a quantum device. To guide the selection of measurement methods designed for this observable estimation problem, we propose a benchmark called CSHOREBench (Common States and Hamiltonians for ObseRvable Estimation Benchmark) that assesses the performance of these methods against a set of common molecular Hamiltonians and common states encountered during the runtime of hybrid quantum-classical algorithms. In CSHOREBench, we account for resource utilization of a quantum computer through measurements of a prepared state, and a classical computer through computational runtime spent in proposing measurements and classical post-processing of acquired measurement outcomes. We apply CSHOREBench considering a variety of measurement methods on Hamiltonians of size up to 16 qubits. Our discussion is aided by using the framework of decision diagrams which provides an efficient data structure for various randomized methods and illustrate how to derandomize distributions on decision diagrams. In numerical simulations, we find that the methods of decision diagrams and derandomization are the most preferable. In experiments on IBM quantum devices against small molecules, we observe that decision diagrams reduces the number of measurements made by classical shadows by more than 80%, that made by locally biased classical shadows by around 57%, and consistently require fewer quantum measurements along with lower classical computational runtime than derandomization. Furthermore, CSHOREBench is empirically efficient to run when considering states of random quantum ansatz with fixed depth.


title: Black hole shadows of massive particles and photons in plasma

abstract: Explicitly covariant analytical expressions are derived that describe the boundaries of shadows cast by massive particles scattered by a gravitating object. This covers scenarios with particles having effectively variable mass, such as photons in plasma, geodesics in higher dimensions, and particles interacting with a scalar field. The derived formula takes advantage of recent advances in understanding the relationship between slice-reducible Killing tensors and massive particle surfaces that generalize photon surfaces. The formula allows us to obtain simple approximations of scaling as the particle energy changes. We illustrate this structure using Kerr-NUT and EMD black holes for both massive particles and photons in plasma. The versatility of this framework extends beyond astrophysics and has potential applications in analog models of gravity and condensed matter physics.


title: No Violation of Bell-CHSH Inequalities at Large Distances

abstract: The usual derivation of the violation of Bell-type inequalities can be applied actually only for small distances between detectors. It does not take into account the dependence of the quantum mechanical wave function on space-time variables. We study the behavior of entangled photons obtained in spontaneous parametric down-conversion (SPDC) experiments and show that at large distances there is in fact no violation of the Bell-CHSH inequalities. We show that the initial entangled states become disentangled at large space-like distances. This does not contradict the violation of Bell inequalities observed at small distances between detectors. We propose an experiment to study the dependence of the quantum correlation function and Bell value on increasing distance between detectors. We predict that these quantities decrease inversely proportional to the increase of the distance between the detectors.


title: Multi-Branch Network for Imagery Emotion Prediction

abstract: For a long time, images have proved perfect at both storing and conveying rich semantics, especially human emotions. A lot of research has been conducted to provide machines with the ability to recognize emotions in photos of people. Previous methods mostly focus on facial expressions but fail to consider the scene context, meanwhile scene context plays an important role in predicting emotions, leading to more accurate results. In addition, Valence-Arousal-Dominance (VAD) values offer a more precise quantitative understanding of continuous emotions, yet there has been less emphasis on predicting them compared to discrete emotional categories. In this paper, we present a novel Multi-Branch Network (MBN), which utilizes various source information, including faces, bodies, and scene contexts to predict both discrete and continuous emotions in an image. Experimental results on EMOTIC dataset, which contains large-scale images of people in unconstrained situations labeled with 26 discrete categories of emotions and VAD values, show that our proposed method significantly outperforms state-of-the-art methods with 28.4% in mAP and 0.93 in MAE. The results highlight the importance of utilizing multiple contextual information in emotion prediction and illustrate the potential of our proposed method in a wide range of applications, such as effective computing, human-computer interaction, and social robotics. Source code: https://github.com/BaoNinh2808/Multi-Branch-Network-for-Imagery-Emotion-Prediction


title: $S$-wave contribution to rare $D^0 \to \pi^+ \pi^- \ell^+ \ell^-$ decays in the Standard Model and sensitivity to New Physics

abstract: Physics of the up-type flavour offers unique possibilities of testing the Standard Model (SM) compared to the down-type flavour sector. Here, we discuss SM and New Physics (NP) contributions to the rare charm-meson decay $ D^0 \to \pi^+ \pi^- \ell^+ \ell^- $. In particular, we discuss the effect of including the lightest scalar isoscalar resonance in the SM picture, namely, the $f_0 (500)$, which manifests in a big portion of the allowed phase space. Other than showing in the total branching ratio at an observable level of about $ 20\% $, the $f_0 (500)$ resonance manifests as interference terms with the vector resonances, such as at high invariant mass of the leptonic pair in distinct angular observables. Recent data from LHCb optimize the sensitivity to $P$-wave contributions, that we analyse in view of the inclusion of vector resonances. We propose the measurement of alternative observables which are sensitive to the $S$-wave and are straightforward to implement experimentally. This leads to a new set of null observables, that vanish in the SM due to its gauge and flavour structures. Finally, we study observables that depend on the SM interference with generic NP contributions from semi-leptonic four-fermion operators in the presence of the $S$-wave.


title: Posterior Concentration for Gaussian Process Priors under Rescaled Mat\'ern and Confluent Hypergeometric Covariance Functions

abstract: In nonparameteric Bayesian approaches, Gaussian stochastic processes can serve as priors on real-valued function spaces. Existing literature on the posterior convergence rates under Gaussian process priors shows that it is possible to achieve optimal or near-optimal posterior contraction rates if the smoothness of the Gaussian process matches that of the target function. Among those priors, Gaussian processes with a parametric Mat\'ern covariance function is particularly notable in that its degree of smoothness can be determined by a dedicated smoothness parameter. Ma and Bhadra(2023) recently introduced a new family of covariance functions called the Confluent Hypergeometric (CH) class that simultaneously possess two parameters: one controls the tail index of the polynomially decaying covariance function, and the other parameter controls the degree of mean-squared smoothness analogous to the Mat\'ern class. In this paper, we show that with proper choice of rescaling parameters in the Mat\'ern and CH covariance functions, it is possible to obtain the minimax optimal posterior contraction rate for $\eta$-regular functions. Unlike the previous results for unrescaled cases, the smoothness parameter of the covariance function need not equal $\eta$ for achieving the optimal minimax rate, for either rescaled Mat\'ern or rescaled CH covariances, illustrating a key benefit for rescaling. The theoretical properties of the rescaled Mat\'ern and CH classes are further verified via extensive simulations and an illustration on a geospatial data set is presented.


title: Scintillation of Ar/CF$_4$ mixtures: glass-THGEM characterization with 1% CF$_4$ at 1-1.5 bar

abstract: Argon gas doped with 1% wavelength-shifter (CF$_4$) has been employed in an optical time projection chamber (OTPC) to image cosmic radiation. We present results obtained during the system commissioning, performed with two stacked glass-THGEMs and an EMCCD camera at 1 bar. Preliminary estimates indicate that the combined optical gain was of the order of 10$^6$ (ph/e), producing sharp and high-contrast raw images without resorting to any filtering or post-processing. A first assessment of the impact of pressurization showed no change in the attainable gains when operating at 1.5 bar


title: COLMAP-Free 3D Gaussian Splatting

abstract: While neural rendering has led to impressive advances in scene reconstruction and novel view synthesis, it relies heavily on accurately pre-computed camera poses. To relax this constraint, multiple efforts have been made to train Neural Radiance Fields (NeRFs) without pre-processed camera poses. However, the implicit representations of NeRFs provide extra challenges to optimize the 3D structure and camera poses at the same time. On the other hand, the recently proposed 3D Gaussian Splatting provides new opportunities given its explicit point cloud representations. This paper leverages both the explicit geometric representation and the continuity of the input video stream to perform novel view synthesis without any SfM preprocessing. We process the input frames in a sequential manner and progressively grow the 3D Gaussians set by taking one input frame at a time, without the need to pre-compute the camera poses. Our method significantly improves over previous approaches in view synthesis and camera pose estimation under large motion changes. Our project page is https://oasisyang.github.io/colmap-free-3dgs


title: Fluctuation relations for a few observable currents at their own beat

abstract: Coarse-grained models are widely used to explain the effective behavior of partially observable physical systems with hidden degrees of freedom. Reduction procedures in state space typically disrupt Markovianity and a fluctuation relation cannot be formulated. A recently developed framework of transition-based coarse-graining gave rise to a fluctuation relation for a single current, while all others are hidden. Here, we extend the treatment to an arbitrary number of observable currents. Crucial for the derivation are the concepts of mixed currents and their conjugated effective affinities, that can be inferred from the time series of observable transitions. We also discuss the connection to generating functions, transient behavior, and how our result recovers the fluctuation relation for a complete set of currents.


title: Aliasing from Galactic Plane Setting in Widefield Radio Interferometry

abstract: Measurements with widefield radio interferometers often include the near-infinite gradient between the sky and the horizon. This causes aliasing inherent to the measurement itself, and is purely a consequence of the Fourier basis. For this reason, the horizon is often attenuated by the instrumental beam down to levels deemed inconsequential. However, this effect is enhanced via our own Galactic plane as it sets over the course of a night. We show all-sky simulations of the Galactic plane setting in a radio interferometer in detail for the first time. We then apply these simulations to the Murchison Widefield Array to show that a beam attenuation of 0.1% is not sufficient in some precision science cases. We determine that the noise statistics of the residual data image are drastically more Gaussian with aliasing removal, and explore consequences in simulation for cataloging of extragalactic sources and 21 cm Epoch of Reionization detection via the power spectrum.


title: NAC-TCN: Temporal Convolutional Networks with Causal Dilated Neighborhood Attention for Emotion Understanding

abstract: In the task of emotion recognition from videos, a key improvement has been to focus on emotions over time rather than a single frame. There are many architectures to address this task such as GRUs, LSTMs, Self-Attention, Transformers, and Temporal Convolutional Networks (TCNs). However, these methods suffer from high memory usage, large amounts of operations, or poor gradients. We propose a method known as Neighborhood Attention with Convolutions TCN (NAC-TCN) which incorporates the benefits of attention and Temporal Convolutional Networks while ensuring that causal relationships are understood which results in a reduction in computation and memory cost. We accomplish this by introducing a causal version of Dilated Neighborhood Attention while incorporating it with convolutions. Our model achieves comparable, better, or state-of-the-art performance over TCNs, TCAN, LSTMs, and GRUs while requiring fewer parameters on standard emotion recognition datasets. We publish our code online for easy reproducibility and use in other projects.


title: An isotropic full-sky sample of optically selected blazars

abstract: $\it{Context.}$ Various high-energy phenomena in the Universe are associated with blazars, powerful active galaxies with jets pointing to the observer. Novel results relating blazars to high-energy neutrinos, cosmic rays, and even possible manifestations of new particle physics, are often based on statistical analyses of blazar samples, and uniform sky coverage is important for many of these studies. $\it{Aims.}$ Here, we construct a uniform full-sky catalog of blazars selected by their optical emission. $\it{Methods.}$ We define criteria of isotropy, making a special effort to cover the Galactic plane region, and compile an isotropic sample of blazars with GAIA optical magnitudes $G<18^{\rm m}$, corrected for the Galactic absorption. The sources are taken from full-sky samples selected by parsec-scale radio emission or by high-energy gamma-ray flux, both being known to efficiently select blazar-like objects. $\it{Results.}$ We present a catalog of 651 optically bright blazars, uniformly distributed in the sky, together with their radio, optical, X-ray and gamma-ray fluxes, and an isotropic sample of 336 confirmed BL Lac type objects. $\it{Conclusions.}$ This catalog may be used in future statistical studies of energetic neutrinos, cosmic rays and gamma rays.


title: PEEKABOO: Interactive Video Generation via Masked-Diffusion

abstract: Modern video generation models like Sora have achieved remarkable success in producing high-quality videos. However, a significant limitation is their inability to offer interactive control to users, a feature that promises to open up unprecedented applications and creativity. In this work, we introduce the first solution to equip diffusion-based video generation models with spatio-temporal control. We present Peekaboo, a novel masked attention module, which seamlessly integrates with current video generation models offering control without the need for additional training or inference overhead. To facilitate future research, we also introduce a comprehensive benchmark for interactive video generation. This benchmark offers a standardized framework for the community to assess the efficacy of emerging interactive video generation models. Our extensive qualitative and quantitative assessments reveal that Peekaboo achieves up to a 3.8x improvement in mIoU over baseline models, all while maintaining the same latency. Code and benchmark are available on the webpage.


title: Introducing Model Benchmark Analysis for dark matter models with isomorphic lagrangians

abstract: In this work, we propose a novel approach to particle physics phenomenology, which we dubbed as model benchmark analysis. We consider models that provide vertices with similar topology but different Lorentz and gauge structure, which we call isomorphic models. Under this setup, the coupling constants for each theory have the same meaning, in the sense that describe the topologically equivalent diagrams. Consequently, each model acts like a map of parameter space into the observable space. This definition allows to group isomorphic models into families with a common parameter space and perform calculations for each model. As a proof of concept, we obtained some guidelines for the search of leptophilic dark fermions at CLIC, making predictions oriented to discriminate between beyond the standard model scenarios in light of possible signals of new physics that could appear at lepton colliders. We present different observables that can be useful to help discriminating between models.


title: A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systems

abstract: Recent advances in computational modelling of atomic systems, spanning molecules, proteins, and materials, represent them as geometric graphs with atoms embedded as nodes in 3D Euclidean space. In these graphs, the geometric attributes transform according to the inherent physical symmetries of 3D atomic systems, including rotations and translations in Euclidean space, as well as node permutations. In recent years, Geometric Graph Neural Networks have emerged as the preferred machine learning architecture powering applications ranging from protein structure prediction to molecular simulations and material generation. Their specificity lies in the inductive biases they leverage - such as physical symmetries and chemical properties - to learn informative representations of these geometric graphs. In this opinionated paper, we provide a comprehensive and self-contained overview of the field of Geometric GNNs for 3D atomic systems. We cover fundamental background material and introduce a pedagogical taxonomy of Geometric GNN architectures: (1) invariant networks, (2) equivariant networks in Cartesian basis, (3) equivariant networks in spherical basis, and (4) unconstrained networks. Additionally, we outline key datasets and application areas and suggest future research directions. The objective of this work is to present a structured perspective on the field, making it accessible to newcomers and aiding practitioners in gaining an intuition for its mathematical abstractions.


title: On-demand population of Andreev levels by their ionization in the presence of Coulomb blockade

abstract: A mechanism to deterministically prepare a nanowire Josephson junction in an odd parity state is proposed. The mechanism involves population of two Andreev levels by a resonant microwave drive breaking a Cooper pair, and a subsequent ionization of one of the levels by the same drive. Robust preparation of the odd state is allowed by a residual Coulomb repulsion in the junction. A similar resonant process can also be used to prepare the junction in the even state. Our theory explains a recent experiment [J. J. Wesdorp, et al., Phys. Rev. Lett. 131, 117001 (2023)].


title: NeuroHeed+: Improving Neuro-steered Speaker Extraction with Joint Auditory Attention Detection

abstract: Neuro-steered speaker extraction aims to extract the listener's brain-attended speech signal from a multi-talker speech signal, in which the attention is derived from the cortical activity. This activity is usually recorded using electroencephalography (EEG) devices. Though promising, current methods often have a high speaker confusion error, where the interfering speaker is extracted instead of the attended speaker, degrading the listening experience. In this work, we aim to reduce the speaker confusion error in the neuro-steered speaker extraction model through a jointly fine-tuned auxiliary auditory attention detection model. The latter reinforces the consistency between the extracted target speech signal and the EEG representation, and also improves the EEG representation. Experimental results show that the proposed network significantly outperforms the baseline in terms of speaker confusion and overall signal quality in two-talker scenarios.


title: Integrated and Lightweight Design of Electro-hydraulic Ankle Prosthesis

abstract: For lower limb amputees, an active ankle joint prosthesis can provide basic mobility functions. This study focuses on an ankle joint prosthesis system based on the principle of electric-hydraulic actuation. By analyzing the characteristics of human gait cycles and the mechanics of ankle joint movement, a lightweight and integrated ankle joint prosthesis is designed, considering the requirements for normal ankle joint kinematics and dynamics. The components of the prosthesis are optimized through simulation and iterative improvements, while ensuring tight integration within minimal space. The design and simulation verification of the integrated lightweight prosthesis components are achieved. This research addresses the contradiction between the high output capability and the constraints on volume and weight in prosthetic devices.


title: Quantum Anomalous Hall and Spin Hall Effects in Magnetic Graphene

abstract: A promising approach to attain long-distance coherent spin propagation is accessing quantum Hall topological spin-polarized edge states in graphene. Achieving this without large external magnetic fields necessitates engineering graphene band structure, obtainable through proximity to 2D magnetic materials. In this work, we detect spin-polarized helical edge transport in graphene at zero external magnetic field, allowed by the out-of-plane magnetic proximity of CrPS$_4$ that spin-splits the zeroth Landau level. This zero-field detection of the quantum anomalous spin Hall state is enabled by large induced spin-orbit and exchange couplings in the graphene that also lead to the detection of an enhanced Berry curvature, shifting the Landau levels, and result in an unconventional sequence of quantum Hall plateaus. Remarkably, we observe that the quantum anomalous Hall transport in the magnetized graphene persists up to room temperature. The detection of spin-polarized helical edge states at zero magnetic field and the robustness of the quantum anomalous Hall transport up to room temperature open the route for practical applications of magnetic graphene in quantum information processing and spintronic circuitries.


title: Learning finitely correlated states: stability of the spectral reconstruction

abstract: We show that marginals of blocks of $t$ systems of any finitely correlated translation invariant state on a chain can be learned, in trace distance, with $O(t^2)$ copies -- with an explicit dependence on local dimension, memory dimension and spectral properties of a certain map constructed from the state -- and computational complexity polynomial in $t$. The algorithm requires only the estimation of a marginal of a controlled size, in the worst case bounded by the minimum bond dimension, from which it reconstructs a translation invariant matrix product operator. In the analysis, a central role is played by the theory of operator systems. A refined error bound can be proven for $C^*$-finitely correlated states, which have an operational interpretation in terms of sequential quantum channels applied to the memory system. We can also obtain an analogous error bound for a class of matrix product density operators reconstructible by local marginals. In this case, a linear number of marginals must be estimated, obtaining a sample complexity of $\tilde{O}(t^3)$. The learning algorithm also works for states that are only close to a finitely correlated state, with the potential of providing competitive algorithms for other interesting families of states.


title: Search Optimization with Query Likelihood Boosting and Two-Level Approximate Search for Edge Devices

abstract: We present a novel search optimization solution for approximate nearest neighbor (ANN) search on resource-constrained edge devices. Traditional ANN approaches fall short in meeting the specific demands of real-world scenarios, e.g., skewed query likelihood distribution and search on large-scale indices with a low latency and small footprint. To address these limitations, we introduce two key components: a Query Likelihood Boosted Tree (QLBT) to optimize average search latency for frequently used small datasets, and a two-level approximate search algorithm to enable efficient retrieval with large datasets on edge devices. We perform thorough evaluation on simulated and real data and demonstrate QLBT can significantly reduce latency by 15% on real data and our two-level search algorithm successfully achieve deployable accuracy and latency on a 10 million dataset for edge devices. In addition, we provide a comprehensive protocol for configuring and optimizing on-device search algorithm through extensive empirical studies.


title: Natural volume forms on pseudo-Finslerian manifolds with $m$-th root metrics

abstract: We define natural volume forms on $n$-dimensional oriented pseudo-Finslerian manifolds with non-degenerate $m$-th root metrics. Our definitions of the natural volume forms depend on the parity of the positive integer $m>1$. The advantage of the stated definitions is their algebraic structure. The natural volume forms are expressed in terms of Cayley hyperdeterminants. In particular, the computation of the natural volume form does not require the difficult integration over the domain within the indicatrix in the tangent space $T_x M^n$ of the pseudo-Finslerian manifold at a point $x$.


title: A half-space Bernstein theorem for anisotropic minimal graphs

abstract: We prove that an anisotropic minimal graph over a half-space with flat boundary must itself be flat. This generalizes a result of Edelen-Wang to the anisotropic case. The proof uses only the maximum principle and ideas from fully nonlinear PDE theory in lieu of a monotonicity formula.


title: Estimating Counterfactual Matrix Means with Short Panel Data

abstract: We develop a new, spectral approach for identifying and estimating average counterfactual outcomes under a low-rank factor model with short panel data and general outcome missingness patterns. Applications include event studies and studies of outcomes of "matches" between agents of two types, e.g. workers and firms, typically conducted under less-flexible Two-Way-Fixed-Effects (TWFE) models of outcomes. Given an infinite population of units and a finite number of outcomes, we show our approach identifies all counterfactual outcome means, including those not estimable by existing methods, if a particular graph constructed based on overlaps in observed outcomes between subpopulations is connected. Our analogous, computationally efficient estimation procedure yields consistent, asymptotically normal estimates of counterfactual outcome means under fixed-$T$ (number of outcomes), large-$N$ (sample size) asymptotics. In a semi-synthetic simulation study based on matched employer-employee data, our estimator has lower bias and only slightly higher variance than a TWFE-model-based estimator when estimating average log-wages.


title: Modularity and Graph Expansion

abstract: We relate two important notions in graph theory: expanders which are highly connected graphs, and modularity a parameter of a graph that is primarily used in community detection. More precisely, we show that a graph having modularity bounded below 1 is equivalent to it having a large subgraph which is an expander. We further show that a connected component $H$ will be split in an optimal partition of the host graph $G$ if and only if the relative size of $H$ in $G$ is greater than an expansion constant of $H$. This is a further exploration of the resolution limit known for modularity, and indeed recovers the bound that a connected component $H$ in the host graph~$G$ will not be split if~$e(H)<\sqrt{2e(G)}$.


title: Short rewriting, and geometric explanations related to the active bijection, for: Extension-lifting bijections for oriented matroids, by S. Backman, F. Santos, C.H. Yuen, arXiv:1904.03562v2 (October 29, 2023)

abstract: For an oriented matroid M, and given a generic single element extension and a generic single element lifting of M, the main result of [1] provides a bijection between bases of M and certain reorientations of M induced by the extension-lifting. This note is intended to somehow clarify and precise the geometric setting for this paper in terms of oriented matroid arrangements and oriented matroid programming, to describe and prove the main bijective result in a short simple way, and to show how it consists of combining two direct bijections and a central bijection, which is the same as a special case - practically uniform - of the bounded case of the active bijection [5, 6]. (The relation with the active bijection is addressed in [1] in an indirect and more complicated way.)


title: Self-Healing Distributed Swarm Formation Control Using Image Moments

abstract: Human-swarm interaction is facilitated by a low-dimensional encoding of the swarm formation, independent of the (possibly large) number of robots. We propose using image moments to encode two-dimensional formations of robots. Each robot knows its pose and the desired formation moments, and simultaneously estimates the current moments of the entire swarm while controlling its motion to better achieve the desired group moments. The estimator is a distributed optimization, requiring no centralized processing, and self-healing, meaning that the process is robust to initialization errors, packet drops, and robots being added to or removed from the swarm. Our experimental results with a swarm of 50 robots, suffering nearly 50% packet loss, show that distributed estimation and control of image moments effectively achieves desired swarm formations.


title: A cosmological "Big Storm Scenario" following the QCD phase transition

abstract: It was proposed that acoustic perturbations generated by the QCD phase transition could create an inverse turbulent cascade \cite{Kalaydzhyan:2014wca}. An assumption was that propagation toward smaller momenta could reach the wavelength of a few km, the Universe's size at the time. Such acoustic waves were proposed to be the source of gravity waves. The kilometer wavelength corresponds to year-long gravity wave today, which were recently discovered using pulsar correlations. This paper argues further that an acoustic turbulence must be an ensemble of shocks. This brings two consequences: First, shocks generate gravity waves much more efficiently than sound waves due to the intermittency of matter distribution. We reconsider gravity wave radiation, using universal emission theory for soft radiation, and argue that soft-momenta plateau should reach wavelengths of the order of shock mean free paths. Second, collisions of shock waves create local density excess, which may create primordial black holes. A good tool to settle this issue can be an evaluation of the {\em trapped surfaces} like it was done in studies of heavy ion collisions using AdS/CFT correspondence


title: Anomalous cosmic-ray correlations revisited with a complete full-sky sample of BL Lac type objects

abstract: Cosmic rays with energies above $10^{19}$ eV, observed in 1999-2004 by the High Resolution Fly's Eye (HiRes) experiment in the stereoscopic mode, were found to correlate with directions to distant BL Lac type objects (BL Lacs), suggesting non-standard neutral particles travelling for cosmological distances without attenuation. This effect could not be tested by newer experiments because of their inferior angular resolution. The distribution in the sky of BL Lacs associated with cosmic rays was found to deviate from isotropy, which might give a clue to the interpretation of the observed anomaly. However, previous studies made use of a sample of BL Lacs which was anisotropic by itself, thus complicating these interpretations. Here, we use a recently compiled isotropic sample of BL Lacs and the same HiRes data to confirm the presence of correlations and to strengthen the case for the local large-scale structure pattern in the distribution of the correlated events in the sky. Further tests of the anomaly await new precise cosmic-ray data.


title: RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimation

abstract: Real-time multi-person pose estimation presents significant challenges in balancing speed and precision. While two-stage top-down methods slow down as the number of people in the image increases, existing one-stage methods often fail to simultaneously deliver high accuracy and real-time performance. This paper introduces RTMO, a one-stage pose estimation framework that seamlessly integrates coordinate classification by representing keypoints using dual 1-D heatmaps within the YOLO architecture, achieving accuracy comparable to top-down methods while maintaining high speed. We propose a dynamic coordinate classifier and a tailored loss function for heatmap learning, specifically designed to address the incompatibilities between coordinate classification and dense prediction models. RTMO outperforms state-of-the-art one-stage pose estimators, achieving 1.1% higher AP on COCO while operating about 9 times faster with the same backbone. Our largest model, RTMO-l, attains 74.8% AP on COCO val2017 and 141 FPS on a single V100 GPU, demonstrating its efficiency and accuracy. The code and models are available at https://github.com/open-mmlab/mmpose/tree/main/projects/rtmo.


title: BaRDa: A Belief and Reasoning Dataset that Separates Factual Accuracy and Reasoning Ability

abstract: While there are numerous benchmarks comparing the performance of modern language models (LMs), end-task evaluations often conflate notions of *factual accuracy* ("truth") and *reasoning ability* ("rationality", or "honesty" in the sense of correctly reporting implications of beliefs). Our goal is a dataset that clearly distinguishes these two notions. Our approach is to leverage and extend a collection of human-annotated *entailment trees*, engineered to express both good and bad chains of reasoning, and using a mixture of true and false facts, in particular including counterfactual examples, to avoid belief bias (also known as the "content effect"). The resulting dataset, called BaRDa, contains 3000 entailments (1787 valid, 1213 invalid), using 6681 true and 2319 false statements. Testing on four GPT-series models, GPT3(curie)/GPT3(davinici)/3.5/4, we find factual accuracy (truth) scores of 74.1/80.6/82.6/87.1 and reasoning accuracy scores of 63.1/78.0/71.8/79.2. This shows the clear progression of models towards improved factual accuracy and entailment reasoning, and the dataset provides a new benchmark that more cleanly separates and quantifies these two notions.


title: Continuum extrapolated high order baryon fluctuations

abstract: Fluctuations play a key role in the study of QCD phases. Lattice QCD is a valuable tool to calculate them, but going to high orders is challenging. Up to the fourth order, continuum results are available since 2015. We present the first continuum results for sixth order baryon fluctuations for temperatures between $T=130 - 200$ MeV, and eighth order at $T=145$ MeV in a fixed volume. We show that for $T \leq 145$ MeV, relevant for criticality search, finite volume effects are under control. Our results are in sharp contrast with well known results in the literature obtained at finite lattice spacing.


title: Topological Obstructions and How to Avoid Them

abstract: Incorporating geometric inductive biases into models can aid interpretability and generalization, but encoding to a specific geometric structure can be challenging due to the imposed topological constraints. In this paper, we theoretically and empirically characterize obstructions to training encoders with geometric latent spaces. We show that local optima can arise due to singularities (e.g. self-intersection) or due to an incorrect degree or winding number. We then discuss how normalizing flows can potentially circumvent these obstructions by defining multimodal variational distributions. Inspired by this observation, we propose a new flow-based model that maps data points to multimodal distributions over geometric spaces and empirically evaluate our model on 2 domains. We observe improved stability during training and a higher chance of converging to a homeomorphic encoder.


title: Weakly Supervised 3D Object Detection via Multi-Level Visual Guidance

abstract: Weakly supervised 3D object detection aims to learn a 3D detector with lower annotation cost, e.g., 2D labels. Unlike prior work which still relies on few accurate 3D annotations, we propose a framework to study how to leverage constraints between 2D and 3D domains without requiring any 3D labels. Specifically, we employ visual data from three perspectives to establish connections between 2D and 3D domains. First, we design a feature-level constraint to align LiDAR and image features based on object-aware regions. Second, the output-level constraint is developed to enforce the overlap between 2D and projected 3D box estimations. Finally, the training-level constraint is utilized by producing accurate and consistent 3D pseudo-labels that align with the visual data. We conduct extensive experiments on the KITTI dataset to validate the effectiveness of the proposed three constraints. Without using any 3D labels, our method achieves favorable performance against state-of-the-art approaches and is competitive with the method that uses 500-frame 3D annotations. Code and models will be made publicly available at https://github.com/kuanchihhuang/VG-W3D.


title: WHAM: Reconstructing World-grounded Humans with Accurate 3D Motion

abstract: The estimation of 3D human motion from video has progressed rapidly but current methods still have several key limitations. First, most methods estimate the human in camera coordinates. Second, prior work on estimating humans in global coordinates often assumes a flat ground plane and produces foot sliding. Third, the most accurate methods rely on computationally expensive optimization pipelines, limiting their use to offline applications. Finally, existing video-based methods are surprisingly less accurate than single-frame methods. We address these limitations with WHAM (World-grounded Humans with Accurate Motion), which accurately and efficiently reconstructs 3D human motion in a global coordinate system from video. WHAM learns to lift 2D keypoint sequences to 3D using motion capture data and fuses this with video features, integrating motion context and visual information. WHAM exploits camera angular velocity estimated from a SLAM method together with human motion to estimate the body's global trajectory. We combine this with a contact-aware trajectory refinement method that lets WHAM capture human motion in diverse conditions, such as climbing stairs. WHAM outperforms all existing 3D human motion recovery methods across multiple in-the-wild benchmarks. Code will be available for research purposes at http://wham.is.tue.mpg.de/


title: Interfacing Foundation Models' Embeddings

abstract: We present FIND, a generalized interface for aligning foundation models' embeddings. As shown in teaser figure, a lightweight transformer interface without tuning any foundation model weights is enough for a unified image (segmentation) and dataset-level (retrieval) understanding. The proposed interface has the following favorable attributes: (1) Generalizable. It applies to various tasks spanning retrieval, segmentation, \textit{etc.}, under the same architecture and weights. (2) Prototypable. Different tasks are able to be implemented through prototyping attention masks and embedding types. (3) Extendable. The proposed interface is adaptive to new tasks, and new models. (4) Interleavable. With the benefit of multi-task multi-modal training, the proposed interface creates an interleaved shared embedding space. In light of the interleaved embedding space, we introduce the FIND-Bench, which introduces new training and evaluation annotations to the COCO dataset for interleave segmentation and retrieval. Our approach achieves state-of-the-art performance on FIND-Bench and competitive performance on standard retrieval and segmentation settings. The training, evaluation, and demo code as well as the dataset have been released at https://github.com/UX-Decoder/FIND.


title: VILA: On Pre-training for Visual Language Models

abstract: Visual language models (VLMs) rapidly progressed with the recent success of large language models. There have been growing efforts on visual instruction tuning to extend the LLM with visual inputs, but lacks an in-depth study of the visual language pre-training process, where the model learns to perform joint modeling on both modalities. In this work, we examine the design options for VLM pre-training by augmenting LLM towards VLM through step-by-step controllable comparisons. We introduce three main findings: (1) freezing LLMs during pre-training can achieve decent zero-shot performance, but lack in-context learning capability, which requires unfreezing the LLM; (2) interleaved pre-training data is beneficial whereas image-text pairs alone are not optimal; (3) re-blending text-only instruction data to image-text data during instruction fine-tuning not only remedies the degradation of text-only tasks, but also boosts VLM task accuracy. With an enhanced pre-training recipe we build VILA, a Visual Language model family that consistently outperforms the state-of-the-art models, e.g., LLaVA-1.5, across main benchmarks without bells and whistles. Multi-modal pre-training also helps unveil appealing properties of VILA, including multi-image reasoning, enhanced in-context learning, and better world knowledge.


title: Cosmological Field Emulation and Parameter Inference with Diffusion Models

abstract: Cosmological simulations play a crucial role in elucidating the effect of physical parameters on the statistics of fields and on constraining parameters given information on density fields. We leverage diffusion generative models to address two tasks of importance to cosmology -- as an emulator for cold dark matter density fields conditional on input cosmological parameters $\Omega_m$ and $\sigma_8$, and as a parameter inference model that can return constraints on the cosmological parameters of an input field. We show that the model is able to generate fields with power spectra that are consistent with those of the simulated target distribution, and capture the subtle effect of each parameter on modulations in the power spectrum. We additionally explore their utility as parameter inference models and find that we can obtain tight constraints on cosmological parameters.


title: Improved Frequency Estimation Algorithms with and without Predictions

abstract: Estimating frequencies of elements appearing in a data stream is a key task in large-scale data analysis. Popular sketching approaches to this problem (e.g., CountMin and CountSketch) come with worst-case guarantees that probabilistically bound the error of the estimated frequencies for any possible input. The work of Hsu et al. (2019) introduced the idea of using machine learning to tailor sketching algorithms to the specific data distribution they are being run on. In particular, their learning-augmented frequency estimation algorithm uses a learned heavy-hitter oracle which predicts which elements will appear many times in the stream. We give a novel algorithm, which in some parameter regimes, already theoretically outperforms the learning based algorithm of Hsu et al. without the use of any predictions. Augmenting our algorithm with heavy-hitter predictions further reduces the error and improves upon the state of the art. Empirically, our algorithms achieve superior performance in all experiments compared to prior approaches.


title: FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Condition

abstract: Recent approaches such as ControlNet offer users fine-grained spatial control over text-to-image (T2I) diffusion models. However, auxiliary modules have to be trained for each type of spatial condition, model architecture, and checkpoint, putting them at odds with the diverse intents and preferences a human designer would like to convey to the AI models during the content creation process. In this work, we present FreeControl, a training-free approach for controllable T2I generation that supports multiple conditions, architectures, and checkpoints simultaneously. FreeControl designs structure guidance to facilitate the structure alignment with a guidance image, and appearance guidance to enable the appearance sharing between images generated using the same seed. Extensive qualitative and quantitative experiments demonstrate the superior performance of FreeControl across a variety of pre-trained T2I models. In particular, FreeControl facilitates convenient training-free control over many different architectures and checkpoints, allows the challenging input conditions on which most of the existing training-free methods fail, and achieves competitive synthesis quality with training-based approaches.


title: FreeInit: Bridging Initialization Gap in Video Diffusion Models

abstract: Though diffusion-based video generation has witnessed rapid progress, the inference results of existing models still exhibit unsatisfactory temporal consistency and unnatural dynamics. In this paper, we delve deep into the noise initialization of video diffusion models, and discover an implicit training-inference gap that attributes to the unsatisfactory inference quality. Our key findings are: 1) the spatial-temporal frequency distribution of the initial latent at inference is intrinsically different from that for training, and 2) the denoising process is significantly influenced by the low-frequency components of the initial noise. Motivated by these observations, we propose a concise yet effective inference sampling strategy, FreeInit, which significantly improves temporal consistency of videos generated by diffusion models. Through iteratively refining the spatial-temporal low-frequency components of the initial latent during inference, FreeInit is able to compensate the initialization gap between training and inference, thus effectively improving the subject appearance and temporal consistency of generation results. Extensive experiments demonstrate that FreeInit consistently enhances the generation results of various text-to-video generation models without additional training.


title: Anatomically Constrained Implicit Face Models

abstract: Coordinate based implicit neural representations have gained rapid popularity in recent years as they have been successfully used in image, geometry and scene modeling tasks. In this work, we present a novel use case for such implicit representations in the context of learning anatomically constrained face models. Actor specific anatomically constrained face models are the state of the art in both facial performance capture and performance retargeting. Despite their practical success, these anatomical models are slow to evaluate and often require extensive data capture to be built. We propose the anatomical implicit face model; an ensemble of implicit neural networks that jointly learn to model the facial anatomy and the skin surface with high-fidelity, and can readily be used as a drop in replacement to conventional blendshape models. Given an arbitrary set of skin surface meshes of an actor and only a neutral shape with estimated skull and jaw bones, our method can recover a dense anatomical substructure which constrains every point on the facial surface. We demonstrate the usefulness of our approach in several tasks ranging from shape fitting, shape editing, and performance retargeting.


title: HeadArtist: Text-conditioned 3D Head Generation with Self Score Distillation

abstract: This work presents HeadArtist for 3D head generation from text descriptions. With a landmark-guided ControlNet serving as the generative prior, we come up with an efficient pipeline that optimizes a parameterized 3D head model under the supervision of the prior distillation itself. We call such a process self score distillation (SSD). In detail, given a sampled camera pose, we first render an image and its corresponding landmarks from the head model, and add some particular level of noise onto the image. The noisy image, landmarks, and text condition are then fed into the frozen ControlNet twice for noise prediction. Two different classifier-free guidance (CFG) weights are applied during these two predictions, and the prediction difference offers a direction on how the rendered image can better match the text of interest. Experimental results suggest that our approach delivers high-quality 3D head sculptures with adequate geometry and photorealistic appearance, significantly outperforming state-ofthe-art methods. We also show that the same pipeline well supports editing the generated heads, including both geometry deformation and appearance change.


title: diff History for Neural Language Agents

abstract: Neural Language Models (LMs) offer an exciting solution for general-purpose embodied control. However, a key technical issue arises when using an LM-based controller: environment observations must be converted to text, which coupled with history, results in long and verbose textual prompts. As a result, prior work in LM agents is limited to restricted domains with small observation size as well as minimal needs for interaction history or instruction tuning. In this paper, we introduce diff history, a simple and highly effective solution to these issues. By applying the Unix diff command on consecutive text observations in the interaction histories used to prompt LM policies, we can both abstract away redundant information and focus the content of textual inputs on the salient changes in the environment. On NetHack, an unsolved video game that requires long-horizon reasoning for decision-making, LMs tuned with diff history match state-of-the-art performance for neural agents while needing 1800x fewer training examples compared to prior work. Even on the simpler BabyAI-Text environment with concise text observations, we find that although diff history increases the length of prompts, the representation it provides offers a 25% improvement in the efficiency of low-sample instruction tuning. Further, we show that diff history scales favorably across different tuning dataset sizes. We open-source our code and data to https://diffhistory.github.io.


title: SMERF: Streamable Memory Efficient Radiance Fields for Real-Time Large-Scene Exploration

abstract: Recent techniques for real-time view synthesis have rapidly advanced in fidelity and speed, and modern methods are capable of rendering near-photorealistic scenes at interactive frame rates. At the same time, a tension has arisen between explicit scene representations amenable to rasterization and neural fields built on ray marching, with state-of-the-art instances of the latter surpassing the former in quality while being prohibitively expensive for real-time applications. In this work, we introduce SMERF, a view synthesis approach that achieves state-of-the-art accuracy among real-time methods on large scenes with footprints up to 300 m$^2$ at a volumetric resolution of 3.5 mm$^3$. Our method is built upon two primary contributions: a hierarchical model partitioning scheme, which increases model capacity while constraining compute and memory consumption, and a distillation training strategy that simultaneously yields high fidelity and internal consistency. Our approach enables full six degrees of freedom (6DOF) navigation within a web browser and renders in real-time on commodity smartphones and laptops. Extensive experiments show that our method exceeds the current state-of-the-art in real-time novel view synthesis by 0.78 dB on standard benchmarks and 1.78 dB on large scenes, renders frames three orders of magnitude faster than state-of-the-art radiance field models, and achieves real-time performance across a wide variety of commodity devices, including smartphones. We encourage readers to explore these models interactively at our project website: https://smerf-3d.github.io.


title: Line configurations and K3 surfaces

abstract: We study the realization spaces of $10_3$ line configurations. Answering a question posed by Sturmfels in 1991, we use elliptic surface techniques to show that realizations over $\mathbb{Q}$ are dense in those over $\mathbb{R}$ for all $10_3$ configurations. We find that for exactly four of the ten configurations, the realization space admits a compactification by a K3 surface. We show that these have Picard number 20 and compute their discriminants. Finally, we use geometric invariant theory to give an elegant interpretation of these K3 surfaces as moduli spaces.


title: An elementary and direct computation of cohomology with and without a group action

abstract: Recently, we introduced a configuration space with interaction structure and a uniform local cohomology on it with co-authors in arXiv:2009.04699. The notion is used to understand a common structure of infinite product spaces appeared in the proof of Varadhan's non-gradient method. For this, the cohomology of the configuration space with a group action is the main target to study, but the cohomology is easily obtained from that of the configuration space without a group action by applying a well-known property on the group cohomology. In fact, the analysis of the cohomology of the configuration space without a group action is the essential part of arXiv:2009.04699. In this article, we give an elementary and direct proof to obtain the cohomology of a space with a group action from that without a group action under a certain condition including the setting of the configuration space with interaction structure. In particular, no knowledge of group cohomology is required.


title: The Sleeping Beauty Problem -- A Real-World Solution

abstract: The Sleeping Beauty Problem remains a paradoxical problem that penetrates multiple disciplines that include probability theory, self-locating belief, decision theory, cognitive science, the philosophy of mathematics and science. It asks the credence of Sleeping Beauty on a coin toss being Heads in the experiment that incites two main stances, that of the Halfers and Thirders. Here a real-world empirical approach numerically highlights breakdown between these groups and considers the role of how a real-world application of such an experiment with sleep induction by anesthesia and pharmacological amnesia induction would affect the coin credence probability of Sleeping Beauty.


title: A Toy Model of Quantum Measurement with Experimentally Falsifiable Predictions

abstract: I describe a toy model of quantum measurement in which wave function collapse is described as a stochastic entropically-driven event guided by interactions between a measured two-state particle and an Ising-like measurement device. The model reproduces existing experimental results and suggests new calorimetric experiments that can be used to test hidden variables theories. When applied to entangled particles, the model predicts energy cannot be transferred faster than the speed of light, but that certain schemas would allow for nonlocal information transfer.


title: Decoding Working-Memory Load During n-Back Task Performance from High Channel NIRS Data

abstract: Near-infrared spectroscopy (NIRS) can measure neural activity through blood oxygenation changes in the brain in a wearable form factor, enabling unique applications for research in and outside the lab. NIRS has proven capable of measuring cognitive states such as mental workload, often using machine learning (ML) based brain-computer interfaces (BCIs). To date, NIRS research has largely relied on probes with under ten to several hundred channels, although recently a new class of wearable NIRS devices with thousands of channels has emerged. This poses unique challenges for ML classification, as NIRS is typically limited by few training trials which results in severely under-determined estimation problems. So far, it is not well understood how such high-resolution data is best leveraged in practical BCIs and whether state-of-the-art (SotA) or better performance can be achieved. To address these questions, we propose an ML strategy to classify working-memory load that relies on spatio-temporal regularization and transfer learning from other subjects in a combination that has not been used in previous NIRS BCIs. The approach can be interpreted as an end-to-end generalized linear model and allows for a high degree of interpretability using channel-level or cortical imaging approaches. We show that using the proposed methodology, it is possible to achieve SotA decoding performance with high-resolution NIRS data. We also replicated several SotA approaches on our dataset of 43 participants wearing a 3198 dual-channel NIRS device while performing the n-Back task and show that these existing methods struggle in the high-channel regime and are largely outperformed by the proposed method. Our approach helps establish high-channel NIRS devices as a viable platform for SotA BCI and opens new applications using this class of headset while also enabling high-resolution model imaging and interpretation.


title: Active Inference and Intentional Behaviour

abstract: Recent advances in theoretical biology suggest that basal cognition and sentient behaviour are emergent properties of in vitro cell cultures and neuronal networks, respectively. Such neuronal networks spontaneously learn structured behaviours in the absence of reward or reinforcement. In this paper, we characterise this kind of self-organisation through the lens of the free energy principle, i.e., as self-evidencing. We do this by first discussing the definitions of reactive and sentient behaviour in the setting of active inference, which describes the behaviour of agents that model the consequences of their actions. We then introduce a formal account of intentional behaviour, that describes agents as driven by a preferred endpoint or goal in latent state-spaces. We then investigate these forms of (reactive, sentient, and intentional) behaviour using simulations. First, we simulate the aforementioned in vitro experiments, in which neuronal cultures spontaneously learn to play Pong, by implementing nested, free energy minimising processes. The simulations are then used to deconstruct the ensuing predictive behaviour, leading to the distinction between merely reactive, sentient, and intentional behaviour, with the latter formalised in terms of inductive planning. This distinction is further studied using simple machine learning benchmarks (navigation in a grid world and the Tower of Hanoi problem), that show how quickly and efficiently adaptive behaviour emerges under an inductive form of active inference.


title: Can the "basis vectors'', describing the internal space of point fermion and boson fields with the Clifford odd (for fermions) and Clifford even (for bosons) objects, be meaningfully extended to strings?

abstract: The {\it string theory} seems to be a mathematically consistent way for explaining so far observed fermion and boson second quantized fields, with gravity included, by offering the renormalizability of the theory by extending the point fermions and bosons into strings and by offering the supersymmetry among fermions and bosons. In a long series of works one of the authors in collaboration with another author and other collaborators, has found the phenomenological success with the model named the {\it spin-charge-family} theory with the properties: The creation and annihilation operators for fermions and bosons fields are described as tensor products of the Clifford odd (for fermions) and the Clifford even (for bosons) ``basis vectors'' and basis in ordinary space, explaining the second quantization postulates. The theory offers the explanation for the observed properties of fermion and bosons and for several cosmological observations. Since the number of creation and annihilation operators for fermions and bosons is in this theory the same, manifesting correspondingly a kind of supersymmetry, the authors start to study in this contribution the properties of the creation and annihilation operators if extending the point fermions and bosons into strings, expecting that this theory offers the low energy limit for the {\it string theory}.


title: Make-A-Storyboard: A General Framework for Storyboard with Disentangled and Merged Control

abstract: Story Visualization aims to generate images aligned with story prompts, reflecting the coherence of storybooks through visual consistency among characters and scenes.Whereas current approaches exclusively concentrate on characters and neglect the visual consistency among contextually correlated scenes, resulting in independent character images without inter-image coherence.To tackle this issue, we propose a new presentation form for Story Visualization called Storyboard, inspired by film-making, as illustrated in Fig.1.Specifically, a Storyboard unfolds a story into visual representations scene by scene. Within each scene in Storyboard, characters engage in activities at the same location, necessitating both visually consistent scenes and characters.For Storyboard, we design a general framework coined as Make-A-Storyboard that applies disentangled control over the consistency of contextual correlated characters and scenes and then merge them to form harmonized images.Extensive experiments demonstrate 1) Effectiveness.the effectiveness of the method in story alignment, character consistency, and scene correlation; 2) Generalization. Our method could be seamlessly integrated into mainstream Image Customization methods, empowering them with the capability of story visualization.


title: Understanding (Un)Intended Memorization in Text-to-Image Generative Models

abstract: Multimodal machine learning, especially text-to-image models like Stable Diffusion and DALL-E 3, has gained significance for transforming text into detailed images. Despite their growing use and remarkable generative capabilities, there is a pressing need for a detailed examination of these models' behavior, particularly with respect to memorization. Historically, memorization in machine learning has been context-dependent, with diverse definitions emerging from classification tasks to complex models like Large Language Models (LLMs) and Diffusion models. Yet, a definitive concept of memorization that aligns with the intricacies of text-to-image synthesis remains elusive. This understanding is vital as memorization poses privacy risks yet is essential for meeting user expectations, especially when generating representations of underrepresented entities. In this paper, we introduce a specialized definition of memorization tailored to text-to-image models, categorizing it into three distinct types according to user expectations. We closely examine the subtle distinctions between intended and unintended memorization, emphasizing the importance of balancing user privacy with the generative quality of the model outputs. Using the Stable Diffusion model, we offer examples to validate our memorization definitions and clarify their application.


title: Language Model Alignment with Elastic Reset

abstract: Finetuning language models with reinforcement learning (RL), e.g. from human feedback (HF), is a prominent method for alignment. But optimizing against a reward model can improve on reward while degrading performance in other areas, a phenomenon known as reward hacking, alignment tax, or language drift. First, we argue that commonly-used test metrics are insufficient and instead measure how different algorithms tradeoff between reward and drift. The standard method modified the reward with a Kullback-Lieber (KL) penalty between the online and initial model. We propose Elastic Reset, a new algorithm that achieves higher reward with less drift without explicitly modifying the training objective. We periodically reset the online model to an exponentially moving average (EMA) of itself, then reset the EMA model to the initial model. Through the use of an EMA, our model recovers quickly after resets and achieves higher reward with less drift in the same number of steps. We demonstrate that fine-tuning language models with Elastic Reset leads to state-of-the-art performance on a small scale pivot-translation benchmark, outperforms all baselines in a medium-scale RLHF-like IMDB mock sentiment task and leads to a more performant and more aligned technical QA chatbot with LLaMA-7B. Code available at github.com/mnoukhov/elastic-reset.


title: Large Language Models for Intent-Driven Session Recommendations

abstract: Intent-aware session recommendation (ISR) is pivotal in discerning user intents within sessions for precise predictions. Traditional approaches, however, face limitations due to their presumption of a uniform number of intents across all sessions. This assumption overlooks the dynamic nature of user sessions, where the number and type of intentions can significantly vary. In addition, these methods typically operate in latent spaces, thus hinder the model's transparency.Addressing these challenges, we introduce a novel ISR approach, utilizing the advanced reasoning capabilities of large language models (LLMs). First, this approach begins by generating an initial prompt that guides LLMs to predict the next item in a session, based on the varied intents manifested in user sessions. Then, to refine this process, we introduce an innovative prompt optimization mechanism that iteratively self-reflects and adjusts prompts. Furthermore, our prompt selection module, built upon the LLMs' broad adaptability, swiftly selects the most optimized prompts across diverse domains. This new paradigm empowers LLMs to discern diverse user intents at a semantic level, leading to more accurate and interpretable session recommendations. Our extensive experiments on three real-world datasets demonstrate the effectiveness of our method, marking a significant advancement in ISR systems.


title: Hijacking Context in Large Multi-modal Models

abstract: Recently, Large Multi-modal Models (LMMs) have demonstrated their ability to understand the visual contents of images given the instructions regarding the images. Built upon the Large Language Models (LLMs), LMMs also inherit their abilities and characteristics such as in-context learning where a coherent sequence of images and texts are given as the input prompt. However, we identify a new limitation of off-the-shelf LMMs where a small fraction of incoherent images or text descriptions mislead LMMs to only generate biased output about the hijacked context, not the originally intended context. To address this, we propose a pre-filtering method that removes irrelevant contexts via GPT-4V, based on its robustness towards distribution shift within the contexts. We further investigate whether replacing the hijacked visual and textual contexts with the correlated ones via GPT-4V and text-to-image models can help yield coherent responses.


title: The small $p$-adic Simpson correspondence in terms of moduli spaces

abstract: For any rigid space over a perfectoid extension of $\mathbb Q_p$ that admits a liftable smooth formal model, we construct an isomorphism between the moduli stacks of Hitchin-small Higgs bundles and Hitchin-small v-vector bundles. This constitutes a moduli-theoretic improvement of the small $p$-adic Simpson correspondence of Faltings, Abbes-Gros, Tsuji and Wang. Our construction is based on the Hodge-Tate stack of Bhatt-Lurie. We also prove an analogous correspondence in the arithmetic setting of rigid spaces of good reduction over $p$-adic fields.


title: All About the Galilean Group SGal(3)

abstract: We consider the Galilean group of transformations that preserve spatial distances and absolute time intervals between events in spacetime. The special Galilean group SGal(3) is a 10-dimensional Lie group; we examine the structure of the group and its Lie algebra and discuss the representation of uncertainty on the group manifold. Along the way, we mention several other groups, including the special orthogonal group, the special Euclidean group, and the group of extended poses, all of which are proper subgroups of the Galilean group. We describe the role of time in Galilean relativity and touch on the relationship between temporal and spatial uncertainty.


title: Federated Learning for Short Text Clustering

abstract: Short text clustering has been popularly studied for its significance in mining valuable insights from many short texts. In this paper, we focus on the federated short text clustering (FSTC) problem, i.e., clustering short texts that are distributed in different clients, which is a realistic problem under privacy requirements. Compared with the centralized short text clustering problem that short texts are stored on a central server, the FSTC problem has not been explored yet. To fill this gap, we propose a Federated Robust Short Text Clustering (FSTC) framework. FSTC includes two main modules, i.e., robust short text clustering module and federated cluster center aggregation module. The robust short text clustering module aims to train an effective short text clustering model with local data in each client. We innovatively combine optimal transport to generate pseudo-labels with Gaussian-uniform mixture model to ensure the reliability of the pseudo-supervised data. The federated cluster center aggregation module aims to exchange knowledge across clients without sharing local raw data in an efficient way. The server aggregates the local cluster centers from different clients and then sends the global centers back to all clients in each communication round. Our empirical studies on three short text clustering datasets demonstrate that FSTC significantly outperforms the federated short text clustering baselines.