title: Floer-theoretic filtration on Painlev\'e Hitchin systems

abstract: We classify equivariant $\mathbb{C}^*$-actions on moduli spaces of Higgs bundles corresponding to the Painlev\'e equations. We deduce the Floer-theoretic filtrations on the cohomology of these spaces, introduced by Ritter and the second author in arXiv:2304.13026. Filtration is then compared with the $``P=W"$ and the filtration obtained by multiplicities of the irreducible components of the nilpotent cone, for all the 2-dimensional Higgs moduli.


title: Domain Wall Magnetic Tunnel Junction Reliable Integrate and Fire Neuron

abstract: In spiking neural networks, neuron dynamics are described by the biologically realistic integrate-and-fire model that captures membrane potential accumulation and above-threshold firing behaviors. Among the hardware implementations of integrate-and-fire neuron devices, one important feature, reset, has been largely ignored. Here, we present the design and fabrication of a magnetic domain wall and magnetic tunnel junction based artificial integrate-and-fire neuron device that achieves reliable reset at the end of the integrate-fire cycle. We demonstrate the domain propagation in the domain wall racetrack (integration), reading using a magnetic tunnel junction (fire), and reset as the domain is ejected from the racetrack, showing the artificial neuron can be operated continuously over 100 integrate-fire-reset cycles. Both pulse amplitude and pulse number encoding is demonstrated. The device data is applied on an image classification task using a spiking neural network and shown to have comparable performance to an ideal leaky, integrate-and-fire neural network. These results achieve the first demonstration of reliable integrate-fire-reset in domain wall-magnetic tunnel junction-based neuron devices and shows the promise of spintronics for neuromorphic computing.


title: PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression

abstract: There has been significant interest in "extreme" compression of large language models (LLMs), i.e., to 1-2 bits per parameter, which allows such models to be executed efficiently on resource-constrained devices. Existing work focused on improved one-shot quantization techniques and weight representations; yet, purely post-training approaches are reaching diminishing returns in terms of the accuracy-vs-bit-width trade-off. State-of-the-art quantization methods such as QuIP# and AQLM include fine-tuning (part of) the compressed parameters over a limited amount of calibration data; however, such fine-tuning techniques over compressed weights often make exclusive use of straight-through estimators (STE), whose performance is not well-understood in this setting. In this work, we question the use of STE for extreme LLM compression, showing that it can be sub-optimal, and perform a systematic study of quantization-aware fine-tuning strategies for LLMs. We propose PV-Tuning - a representation-agnostic framework that generalizes and improves upon existing fine-tuning strategies, and provides convergence guarantees in restricted cases. On the practical side, when used for 1-2 bit vector quantization, PV-Tuning outperforms prior techniques for highly-performant models such as Llama and Mistral. Using PV-Tuning, we achieve the first Pareto-optimal quantization for Llama 2 family models at 2 bits per parameter.


title: Privileged Sensing Scaffolds Reinforcement Learning

abstract: We need to look at our shoelaces as we first learn to tie them but having mastered this skill, can do it from touch alone. We call this phenomenon "sensory scaffolding": observation streams that are not needed by a master might yet aid a novice learner. We consider such sensory scaffolding setups for training artificial agents. For example, a robot arm may need to be deployed with just a low-cost, robust, general-purpose camera; yet its performance may improve by having privileged training-time-only access to informative albeit expensive and unwieldy motion capture rigs or fragile tactile sensors. For these settings, we propose "Scaffolder", a reinforcement learning approach which effectively exploits privileged sensing in critics, world models, reward estimators, and other such auxiliary components that are only used at training time, to improve the target policy. For evaluating sensory scaffolding agents, we design a new "S3" suite of ten diverse simulated robotic tasks that explore a wide range of practical sensor setups. Agents must use privileged camera sensing to train blind hurdlers, privileged active visual perception to help robot arms overcome visual occlusions, privileged touch sensors to train robot hands, and more. Scaffolder easily outperforms relevant prior baselines and frequently performs comparably even to policies that have test-time access to the privileged sensors. Website: https://penn-pal-lab.github.io/scaffolder/


title: TerDiT: Ternary Diffusion Models with Transformers

abstract: Recent developments in large-scale pre-trained text-to-image diffusion models have significantly improved the generation of high-fidelity images, particularly with the emergence of diffusion models based on transformer architecture (DiTs). Among these diffusion models, diffusion transformers have demonstrated superior image generation capabilities, boosting lower FID scores and higher scalability. However, deploying large-scale DiT models can be expensive due to their extensive parameter numbers. Although existing research has explored efficient deployment techniques for diffusion models such as model quantization, there is still little work concerning DiT-based models. To tackle this research gap, in this paper, we propose TerDiT, a quantization-aware training (QAT) and efficient deployment scheme for ternary diffusion models with transformers. We focus on the ternarization of DiT networks and scale model sizes from 600M to 4.2B. Our work contributes to the exploration of efficient deployment strategies for large-scale DiT models, demonstrating the feasibility of training extremely low-bit diffusion transformer models from scratch while maintaining competitive image generation capacities compared to full-precision models. Code will be available at https://github.com/Lucky-Lance/TerDiT.


title: Synergistic Global-space Camera and Human Reconstruction from Videos

abstract: Remarkable strides have been made in reconstructing static scenes or human bodies from monocular videos. Yet, the two problems have largely been approached independently, without much synergy. Most visual SLAM methods can only reconstruct camera trajectories and scene structures up to scale, while most HMR methods reconstruct human meshes in metric scale but fall short in reasoning with cameras and scenes. This work introduces Synergistic Camera and Human Reconstruction (SynCHMR) to marry the best of both worlds. Specifically, we design Human-aware Metric SLAM to reconstruct metric-scale camera poses and scene point clouds using camera-frame HMR as a strong prior, addressing depth, scale, and dynamic ambiguities. Conditioning on the dense scene recovered, we further learn a Scene-aware SMPL Denoiser to enhance world-frame HMR by incorporating spatio-temporal coherency and dynamic scene constraints. Together, they lead to consistent reconstructions of camera trajectories, human meshes, and dense scene point clouds in a common world frame. Project page: https://paulchhuang.github.io/synchmr


title: The Channel Capacity of a Relativistic String

abstract: I explore the limitations on the capacity of a relativistic channel to transmit power and information that arise because of the finiteness of the transverse speed of light. As a model system, I consider a rope constructed from a fundamental string, for which relativistic invariance is built in. By wiggling one end of the string, both power and information may be transmitted to the other end. I argue that even though an unbounded amount of power and information may be traveling down the string, there is a bound on how much may be transmitted. Further, I conjecture that the two kinds of channel capacity -- power and information -- interfere with each other, so that the only way to transmit the maximum amount of power is to send no information, and vice versa.


title: Semantica: An Adaptable Image-Conditioned Diffusion Model

abstract: We investigate the task of adapting image generative models to different datasets without finetuneing. To this end, we introduce Semantica, an image-conditioned diffusion model capable of generating images based on the semantics of a conditioning image. Semantica is trained exclusively on web-scale image pairs, that is it receives a random image from a webpage as conditional input and models another random image from the same webpage. Our experiments highlight the expressivity of pretrained image encoders and necessity of semantic-based data filtering in achieving high-quality image generation. Once trained, it can adaptively generate new images from a dataset by simply using images from that dataset as input. We study the transfer properties of Semantica on ImageNet, LSUN Churches, LSUN Bedroom and SUN397.


title: Mamba-R: Vision Mamba ALSO Needs Registers

abstract: Similar to Vision Transformers, this paper identifies artifacts also present within the feature maps of Vision Mamba. These artifacts, corresponding to high-norm tokens emerging in low-information background areas of images, appear much more severe in Vision Mamba -- they exist prevalently even with the tiny-sized model and activate extensively across background regions. To mitigate this issue, we follow the prior solution of introducing register tokens into Vision Mamba. To better cope with Mamba blocks' uni-directional inference paradigm, two key modifications are introduced: 1) evenly inserting registers throughout the input token sequence, and 2) recycling registers for final decision predictions. We term this new architecture Mamba-R. Qualitative observations suggest, compared to vanilla Vision Mamba, Mamba-R's feature maps appear cleaner and more focused on semantically meaningful regions. Quantitatively, Mamba-R attains stronger performance and scales better. For example, on the ImageNet benchmark, our base-size Mamba-R attains 82.9% accuracy, significantly outperforming Vim-B's 81.8%; furthermore, we provide the first successful scaling to the large model size (i.e., with 341M parameters), attaining a competitive accuracy of 83.2% (84.5% if finetuned with 384x384 inputs). Additional validation on the downstream semantic segmentation task also supports Mamba-R's efficacy.


title: Quadrupolar resonance spectroscopy of individual nuclei using a room-temperature quantum sensor

abstract: Nuclear quadrupolar resonance (NQR) spectroscopy reveals chemical bonding patterns in materials and molecules through the unique coupling between nuclear spins and local fields. However, traditional NQR techniques require macroscopic ensembles of nuclei to yield a detectable signal, which precludes the study of individual molecules and obscures molecule-to-molecule variations due to local perturbations or deformations. Optically active electronic spin qubits, such as the nitrogen-vacancy (NV) center in diamond, facilitate the detection and control of individual nuclei through their local magnetic couplings. Here, we use NV centers to perform NQR spectroscopy on their associated nitrogen-14 ($^{14}$N) nuclei at room temperature. In mapping the nuclear quadrupolar Hamiltonian, we resolve minute variations between individual nuclei. The measurements further reveal correlations between the parameters in the NV center's electronic spin Hamiltonian and the $^{14}$N quadropolar Hamiltonian, as well as a previously unreported Hamiltonian term that results from symmetry breaking. We further design pulse sequences to initialize, readout, and control the quantum evolution of the $^{14}$N nuclear state using the nuclear quadrupolar Hamiltonian.


title: Not All Language Model Features Are Linear

abstract: Recent work has proposed the linear representation hypothesis: that language models perform computation by manipulating one-dimensional representations of concepts ("features") in activation space. In contrast, we explore whether some language model representations may be inherently multi-dimensional. We begin by developing a rigorous definition of irreducible multi-dimensional features based on whether they can be decomposed into either independent or non-co-occurring lower-dimensional features. Motivated by these definitions, we design a scalable method that uses sparse autoencoders to automatically find multi-dimensional features in GPT-2 and Mistral 7B. These auto-discovered features include strikingly interpretable examples, e.g. circular features representing days of the week and months of the year. We identify tasks where these exact circles are used to solve computational problems involving modular arithmetic in days of the week and months of the year. Finally, we provide evidence that these circular features are indeed the fundamental unit of computation in these tasks with intervention experiments on Mistral 7B and Llama 3 8B, and we find further circular representations by breaking down the hidden states for these tasks into interpretable components.


title: Adapting to Unknown Low-Dimensional Structures in Score-Based Diffusion Models

abstract: This paper investigates score-based diffusion models when the underlying target distribution is concentrated on or near low-dimensional manifolds within the higher-dimensional space in which they formally reside, a common characteristic of natural image distributions. Despite previous efforts to understand the data generation process of diffusion models, existing theoretical support remains highly suboptimal in the presence of low-dimensional structure, which we strengthen in this paper. For the popular Denoising Diffusion Probabilistic Model (DDPM), we find that the dependency of the error incurred within each denoising step on the ambient dimension $d$ is in general unavoidable. We further identify a unique design of coefficients that yields a converges rate at the order of $O(k^{2}/\sqrt{T})$ (up to log factors), where $k$ is the intrinsic dimension of the target distribution and $T$ is the number of steps. This represents the first theoretical demonstration that the DDPM sampler can adapt to unknown low-dimensional structures in the target distribution, highlighting the critical importance of coefficient design. All of this is achieved by a novel set of analysis tools that characterize the algorithmic dynamics in a more deterministic manner.


title: Bitune: Bidirectional Instruction-Tuning

abstract: We introduce Bitune, a method that improves instruction-tuning of pretrained decoder-only large language models, leading to consistent gains on downstream tasks. Bitune applies both causal and bidirectional attention to the prompt, to obtain a better representation of the query or instruction. We realize this by introducing two sets of parameters, for which we apply parameter-efficient finetuning techniques. These causal and bidirectional features are then combined into a weighted average with trainable coefficients, which is subsequently used to generate new tokens. We demonstrate significant improvements in zero-shot performance on commonsense reasoning, arithmetic, and language understanding tasks, while extensive ablation studies validate the role of each component and demonstrate the method's agnosticism to different PEFT techniques.


title: A Nurse is Blue and Elephant is Rugby: Cross Domain Alignment in Large Language Models Reveal Human-like Patterns

abstract: Cross-domain alignment refers to the task of mapping a concept from one domain to another. For example, ``If a \textit{doctor} were a \textit{color}, what color would it be?''. This seemingly peculiar task is designed to investigate how people represent concrete and abstract concepts through their mappings between categories and their reasoning processes over those mappings. In this paper, we adapt this task from cognitive science to evaluate the conceptualization and reasoning abilities of large language models (LLMs) through a behavioral study. We examine several LLMs by prompting them with a cross-domain mapping task and analyzing their responses at both the population and individual levels. Additionally, we assess the models' ability to reason about their predictions by analyzing and categorizing their explanations for these mappings. The results reveal several similarities between humans' and models' mappings and explanations, suggesting that models represent concepts similarly to humans. This similarity is evident not only in the model representation but also in their behavior. Furthermore, the models mostly provide valid explanations and deploy reasoning paths that are similar to those of humans.


title: Video Diffusion Models are Training-free Motion Interpreter and Controller

abstract: Video generation primarily aims to model authentic and customized motion across frames, making understanding and controlling the motion a crucial topic. Most diffusion-based studies on video motion focus on motion customization with training-based paradigms, which, however, demands substantial training resources and necessitates retraining for diverse models. Crucially, these approaches do not explore how video diffusion models encode cross-frame motion information in their features, lacking interpretability and transparency in their effectiveness. To answer this question, this paper introduces a novel perspective to understand, localize, and manipulate motion-aware features in video diffusion models. Through analysis using Principal Component Analysis (PCA), our work discloses that robust motion-aware feature already exists in video diffusion models. We present a new MOtion FeaTure (MOFT) by eliminating content correlation information and filtering motion channels. MOFT provides a distinct set of benefits, including the ability to encode comprehensive motion information with clear interpretability, extraction without the need for training, and generalizability across diverse architectures. Leveraging MOFT, we propose a novel training-free video motion control framework. Our method demonstrates competitive performance in generating natural and faithful motion, providing architecture-agnostic insights and applicability in a variety of downstream tasks.


title: Borromean states in a one-dimensional three-body system

abstract: We show the existence of Borromean bound states in a one-dimensional quantum three-body system composed of two identical bosons and a distinguishable particle. It is assumed that there is no interaction between the two bosons, while the mass-imbalanced two-body subsystems can be tuned to be either bound or unbound. Within the framework of the Faddeev equations, the three-body spectrum and the corresponding wave functions are computed numerically. In addition, we identify the parameter-space region for the two-body interaction, where the Borromean states occur, evaluate their geometric properties, and investigate their dependence on the mass ratio.


title: Tele-Aloha: A Low-budget and High-authenticity Telepresence System Using Sparse RGB Cameras

abstract: In this paper, we present a low-budget and high-authenticity bidirectional telepresence system, Tele-Aloha, targeting peer-to-peer communication scenarios. Compared to previous systems, Tele-Aloha utilizes only four sparse RGB cameras, one consumer-grade GPU, and one autostereoscopic screen to achieve high-resolution (2048x2048), real-time (30 fps), low-latency (less than 150ms) and robust distant communication. As the core of Tele-Aloha, we propose an efficient novel view synthesis algorithm for upper-body. Firstly, we design a cascaded disparity estimator for obtaining a robust geometry cue. Additionally a neural rasterizer via Gaussian Splatting is introduced to project latent features onto target view and to decode them into a reduced resolution. Further, given the high-quality captured data, we leverage weighted blending mechanism to refine the decoded image into the final resolution of 2K. Exploiting world-leading autostereoscopic display and low-latency iris tracking, users are able to experience a strong three-dimensional sense even without any wearable head-mounted display device. Altogether, our telepresence system demonstrates the sense of co-presence in real-life experiments, inspiring the next generation of communication.


title: Improved Distribution Matching Distillation for Fast Image Synthesis

abstract: Recent approaches have shown promises distilling diffusion models into efficient one-step generators. Among them, Distribution Matching Distillation (DMD) produces one-step generators that match their teacher in distribution, without enforcing a one-to-one correspondence with the sampling trajectories of their teachers. However, to ensure stable training, DMD requires an additional regression loss computed using a large set of noise-image pairs generated by the teacher with many steps of a deterministic sampler. This is costly for large-scale text-to-image synthesis and limits the student's quality, tying it too closely to the teacher's original sampling paths. We introduce DMD2, a set of techniques that lift this limitation and improve DMD training. First, we eliminate the regression loss and the need for expensive dataset construction. We show that the resulting instability is due to the fake critic not estimating the distribution of generated samples accurately and propose a two time-scale update rule as a remedy. Second, we integrate a GAN loss into the distillation procedure, discriminating between generated samples and real images. This lets us train the student model on real data, mitigating the imperfect real score estimation from the teacher model, and enhancing quality. Lastly, we modify the training procedure to enable multi-step sampling. We identify and address the training-inference input mismatch problem in this setting, by simulating inference-time generator samples during training time. Taken together, our improvements set new benchmarks in one-step image generation, with FID scores of 1.28 on ImageNet-64x64 and 8.35 on zero-shot COCO 2014, surpassing the original teacher despite a 500X reduction in inference cost. Further, we show our approach can generate megapixel images by distilling SDXL, demonstrating exceptional visual quality among few-step methods.


title: Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesis

abstract: Accurate reconstruction of complex dynamic scenes from just a single viewpoint continues to be a challenging task in computer vision. Current dynamic novel view synthesis methods typically require videos from many different camera viewpoints, necessitating careful recording setups, and significantly restricting their utility in the wild as well as in terms of embodied AI applications. In this paper, we propose $\textbf{GCD}$, a controllable monocular dynamic view synthesis pipeline that leverages large-scale diffusion priors to, given a video of any scene, generate a synchronous video from any other chosen perspective, conditioned on a set of relative camera pose parameters. Our model does not require depth as input, and does not explicitly model 3D scene geometry, instead performing end-to-end video-to-video translation in order to achieve its goal efficiently. Despite being trained on synthetic multi-view video data only, zero-shot real-world generalization experiments show promising results in multiple domains, including robotics, object permanence, and driving environments. We believe our framework can potentially unlock powerful applications in rich dynamic scene understanding, perception for robotics, and interactive 3D video viewing experiences for virtual reality.


title: PuzzleAvatar: Assembling 3D Avatars from Personal Albums

abstract: Generating personalized 3D avatars is crucial for AR/VR. However, recent text-to-3D methods that generate avatars for celebrities or fictional characters, struggle with everyday people. Methods for faithful reconstruction typically require full-body images in controlled settings. What if a user could just upload their personal "OOTD" (Outfit Of The Day) photo collection and get a faithful avatar in return? The challenge is that such casual photo collections contain diverse poses, challenging viewpoints, cropped views, and occlusion (albeit with a consistent outfit, accessories and hairstyle). We address this novel "Album2Human" task by developing PuzzleAvatar, a novel model that generates a faithful 3D avatar (in a canonical pose) from a personal OOTD album, while bypassing the challenging estimation of body and camera pose. To this end, we fine-tune a foundational vision-language model (VLM) on such photos, encoding the appearance, identity, garments, hairstyles, and accessories of a person into (separate) learned tokens and instilling these cues into the VLM. In effect, we exploit the learned tokens as "puzzle pieces" from which we assemble a faithful, personalized 3D avatar. Importantly, we can customize avatars by simply inter-changing tokens. As a benchmark for this new task, we collect a new dataset, called PuzzleIOI, with 41 subjects in a total of nearly 1K OOTD configurations, in challenging partial photos with paired ground-truth 3D bodies. Evaluation shows that PuzzleAvatar not only has high reconstruction accuracy, outperforming TeCH and MVDreamBooth, but also a unique scalability to album photos, and strong robustness. Our model and data will be public.


title: An Empirical Study of Training State-of-the-Art LiDAR Segmentation Models

abstract: In the rapidly evolving field of autonomous driving, precise segmentation of LiDAR data is crucial for understanding complex 3D environments. Traditional approaches often rely on disparate, standalone codebases, hindering unified advancements and fair benchmarking across models. To address these challenges, we introduce MMDetection3D-lidarseg, a comprehensive toolbox designed for the efficient training and evaluation of state-of-the-art LiDAR segmentation models. We support a wide range of segmentation models and integrate advanced data augmentation techniques to enhance robustness and generalization. Additionally, the toolbox provides support for multiple leading sparse convolution backends, optimizing computational efficiency and performance. By fostering a unified framework, MMDetection3D-lidarseg streamlines development and benchmarking, setting new standards for research and application. Our extensive benchmark experiments on widely-used datasets demonstrate the effectiveness of the toolbox. The codebase and trained models have been publicly available, promoting further research and innovation in the field of LiDAR segmentation for autonomous driving.


title: NeRF-Casting: Improved View-Dependent Appearance with Consistent Reflections

abstract: Neural Radiance Fields (NeRFs) typically struggle to reconstruct and render highly specular objects, whose appearance varies quickly with changes in viewpoint. Recent works have improved NeRF's ability to render detailed specular appearance of distant environment illumination, but are unable to synthesize consistent reflections of closer content. Moreover, these techniques rely on large computationally-expensive neural networks to model outgoing radiance, which severely limits optimization and rendering speed. We address these issues with an approach based on ray tracing: instead of querying an expensive neural network for the outgoing view-dependent radiance at points along each camera ray, our model casts reflection rays from these points and traces them through the NeRF representation to render feature vectors which are decoded into color using a small inexpensive network. We demonstrate that our model outperforms prior methods for view synthesis of scenes containing shiny objects, and that it is the only existing NeRF method that can synthesize photorealistic specular appearance and reflections in real-world scenes, while requiring comparable optimization time to current state-of-the-art view synthesis models.


title: Replica Wormholes and Entanglement Islands in the Karch-Randall Braneworld

abstract: The Karch-Randall braneworld provides a natural set-up to study the Hawking radiation from a black hole using holographic tools. Such a black hole lives on a brane and is highly quantum yet has a holographic dual as a higher dimensional classical theory that lives in the ambient space. Moreover, such a black hole is coupled to a nongravitational bath which is absorbing its Hawking radiation. This allows us to compute the entropy of the Hawking radiation by studying the bath using the quantum extremal surface prescription. The quantum extremal surface geometrizes into a Ryu-Takayanagi surface in the ambient space. The topological phase transition of the Ryu-Takayanagi surface in time from connecting different portions of the bath to the one connecting the bath and the brane gives the Page curve of the Hawking radiation that is consistent with unitarity. Nevertheless, there doesn't exit a derivation of the quantum extremal surface prescription and its geometrization in the Karch-Randall braneworld. In this paper, we fill this gap. We mainly focus on the case that the ambient space is (2+1)-dimensional for which explicit computations can be done in each description of the set-up. We show that the topological phase transition of the Ryu-Takayanagi surface corresponds to the formation of the replica wormhole on the Karch-Randall brane as the dominate contribution to the replica path integral. For higher dimensional situations, we show that the geometry of the brane satisfies Einstein's equation coupled with conformal matter. We comment on possible implications to the general rule of gravitational path integral from this equation.


title: Federated Online Adaptation for Deep Stereo

abstract: We introduce a novel approach for adapting deep stereo networks in a collaborative manner. By building over principles of federated learning, we develop a distributed framework allowing for demanding the optimization process to a number of clients deployed in different environments. This makes it possible, for a deep stereo network running on resourced-constrained devices, to capitalize on the adaptation process carried out by other instances of the same architecture, and thus improve its accuracy in challenging environments even when it cannot carry out adaptation on its own. Experimental results show how federated adaptation performs equivalently to on-device adaptation, and even better when dealing with challenging environments.


title: Investigating Robustness of Open-Vocabulary Foundation Object Detectors under Distribution Shifts

abstract: The challenge of Out-Of-Distribution (OOD) robustness remains a critical hurdle towards deploying deep vision models. Open-vocabulary object detection extends the capabilities of traditional object detection frameworks to recognize and classify objects beyond predefined categories. Investigating OOD robustness in open-vocabulary object detection is essential to increase the trustworthiness of these models. This study presents a comprehensive robustness evaluation of zero-shot capabilities of three recent open-vocabulary foundation object detection models, namely OWL-ViT, YOLO World, and Grounding DINO. Experiments carried out on the COCO-O and COCO-C benchmarks encompassing distribution shifts highlight the challenges of the models' robustness. Source code shall be made available to the research community on GitHub.


title: BloodCell-Net: A lightweight convolutional neural network for the classification of all microscopic blood cell images of the human body

abstract: Blood cell classification and counting are vital for the diagnosis of various blood-related diseases, such as anemia, leukemia, and thrombocytopenia. The manual process of blood cell classification and counting is time-consuming, prone to errors, and labor-intensive. Therefore, we have proposed a DL based automated system for blood cell classification and counting from microscopic blood smear images. We classify total of nine types of blood cells, including Erythrocyte, Erythroblast, Neutrophil, Basophil, Eosinophil, Lymphocyte, Monocyte, Immature Granulocytes, and Platelet. Several preprocessing steps like image resizing, rescaling, contrast enhancement and augmentation are utilized. To segment the blood cells from the entire microscopic images, we employed the U-Net model. This segmentation technique aids in extracting the region of interest (ROI) by removing complex and noisy background elements. Both pixel-level metrics such as accuracy, precision, and sensitivity, and object-level evaluation metrics like Intersection over Union (IOU) and Dice coefficient are considered to comprehensively evaluate the performance of the U-Net model. The segmentation model achieved impressive performance metrics, including 98.23% accuracy, 98.40% precision, 98.25% sensitivity, 95.97% Intersection over Union (IOU), and 97.92% Dice coefficient. Subsequently, a watershed algorithm is applied to the segmented images to separate overlapped blood cells and extract individual cells. We have proposed a BloodCell-Net approach incorporated with custom light weight convolutional neural network (LWCNN) for classifying individual blood cells into nine types. Comprehensive evaluation of the classifier's performance is conducted using metrics including accuracy, precision, recall, and F1 score. The classifier achieved an average accuracy of 97.10%, precision of 97.19%, recall of 97.01%, and F1 score of 97.10%.


title: Precise and Robust Sidewalk Detection: Leveraging Ensemble Learning to Surpass LLM Limitations in Urban Environments

abstract: This study aims to compare the effectiveness of a robust ensemble model with the state-of-the-art ONE-PEACE Large Language Model (LLM) for accurate detection of sidewalks. Accurate sidewalk detection is crucial in improving road safety and urban planning. The study evaluated the model's performance on Cityscapes, Ade20k, and the Boston Dataset. The results showed that the ensemble model performed better than the individual models, achieving mean Intersection Over Union (mIOU) scores of 93.1\%, 90.3\%, and 90.6\% on these datasets under ideal conditions. Additionally, the ensemble model maintained a consistent level of performance even in challenging conditions such as Salt-and-Pepper and Speckle noise, with only a gradual decrease in efficiency observed. On the other hand, the ONE-PEACE LLM performed slightly better than the ensemble model in ideal scenarios but experienced a significant decline in performance under noisy conditions. These findings demonstrate the robustness and reliability of the ensemble model, making it a valuable asset for improving urban infrastructure related to road safety and curb space management. This study contributes positively to the broader context of urban health and mobility.


title: Visual Deformation Detection Using Soft Material Simulation for Pre-training of Condition Assessment Models

abstract: This paper addresses the challenge of geometric quality assurance in manufacturing, particularly when human assessment is required. It proposes using Blender, an open-source simulation tool, to create synthetic datasets for machine learning (ML) models. The process involves translating expert information into shape key parameters to simulate deformations, generating images for both deformed and non-deformed objects. The study explores the impact of discrepancies between real and simulated environments on ML model performance and investigates the effect of different simulation backgrounds on model sensitivity. Additionally, the study aims to enhance the model's robustness to camera positioning by generating datasets with a variety of randomized viewpoints. The entire process, from data synthesis to model training and testing, is implemented using a Python API interfacing with Blender. An experiment with a soda can object validates the accuracy of the proposed pipeline.


title: Improving and Evaluating Machine Learning Methods for Forensic Shoeprint Matching

abstract: We propose a machine learning pipeline for forensic shoeprint pattern matching that improves on the accuracy and generalisability of existing methods. We extract 2D coordinates from shoeprint scans using edge detection and align the two shoeprints with iterative closest point (ICP). We then extract similarity metrics to quantify how well the two prints match and use these metrics to train a random forest that generates a probabilistic measurement of how likely two prints are to have originated from the same outsole. We assess the generalisability of machine learning methods trained on lab shoeprint scans to more realistic crime scene shoeprint data by evaluating the accuracy of our methods on several shoeprint scenarios: partial prints, prints with varying levels of blurriness, prints with different amounts of wear, and prints from different shoe models. We find that models trained on one type of shoeprint yield extremely high levels of accuracy when tested on shoeprint pairs of the same scenario but fail to generalise to other scenarios. We also discover that models trained on a variety of scenarios predict almost as accurately as models trained on specific scenarios.


title: Automatic Coral Detection with YOLO: A Deep Learning Approach for Efficient and Accurate Coral Reef Monitoring

abstract: Coral reefs are vital ecosystems that are under increasing threat due to local human impacts and climate change. Efficient and accurate monitoring of coral reefs is crucial for their conservation and management. In this paper, we present an automatic coral detection system utilizing the You Only Look Once (YOLO) deep learning model, which is specifically tailored for underwater imagery analysis. To train and evaluate our system, we employ a dataset consisting of 400 original underwater images. We increased the number of annotated images to 580 through image manipulation using data augmentation techniques, which can improve the model's performance by providing more diverse examples for training. The dataset is carefully collected from underwater videos that capture various coral reef environments, species, and lighting conditions. Our system leverages the YOLOv5 algorithm's real-time object detection capabilities, enabling efficient and accurate coral detection. We used YOLOv5 to extract discriminating features from the annotated dataset, enabling the system to generalize, including previously unseen underwater images. The successful implementation of the automatic coral detection system with YOLOv5 on our original image dataset highlights the potential of advanced computer vision techniques for coral reef research and conservation. Further research will focus on refining the algorithm to handle challenging underwater image conditions, and expanding the dataset to incorporate a wider range of coral species and spatio-temporal variations.


title: Dissecting Query-Key Interaction in Vision Transformers

abstract: Self-attention in vision transformers is often thought to perform perceptual grouping where tokens attend to other tokens with similar embeddings, which could correspond to semantically similar features of an object. However, attending to dissimilar tokens can be beneficial by providing contextual information. We propose to use the Singular Value Decomposition to dissect the query-key interaction (i.e. ${\textbf{W}_q}^\top\textbf{W}_k$). We find that early layers attend more to similar tokens, while late layers show increased attention to dissimilar tokens, providing evidence corresponding to perceptual grouping and contextualization, respectively. Many of these interactions between features represented by singular vectors are interpretable and semantic, such as attention between relevant objects, between parts of an object, or between the foreground and background. This offers a novel perspective on interpreting the attention mechanism, which contributes to understanding how transformer models utilize context and salient features when processing images.


title: DiffuseMix: Label-Preserving Data Augmentation with Diffusion Models

abstract: Recently, a number of image-mixing-based augmentation techniques have been introduced to improve the generalization of deep neural networks. In these techniques, two or more randomly selected natural images are mixed together to generate an augmented image. Such methods may not only omit important portions of the input images but also introduce label ambiguities by mixing images across labels resulting in misleading supervisory signals. To address these limitations, we propose DiffuseMix, a novel data augmentation technique that leverages a diffusion model to reshape training images, supervised by our bespoke conditional prompts. First, concatenation of a partial natural image and its generated counterpart is obtained which helps in avoiding the generation of unrealistic images or label ambiguities. Then, to enhance resilience against adversarial attacks and improves safety measures, a randomly selected structural pattern from a set of fractal images is blended into the concatenated image to form the final augmented image for training. Our empirical results on seven different datasets reveal that DiffuseMix achieves superior performance compared to existing state-of the-art methods on tasks including general classification,fine-grained classification, fine-tuning, data scarcity, and adversarial robustness. Augmented datasets and codes are available here: https://diffusemix.github.io/


title: LookUp3D: Data-Driven 3D Scanning

abstract: We introduce a novel calibration and reconstruction procedure for structured light scanning that foregoes explicit point triangulation in favor of a data-driven lookup procedure. The key idea is to sweep a calibration checkerboard over the entire scanning volume with a linear stage and acquire a dense stack of images to build a per-pixel lookup table from colors to depths. Imperfections in the setup, lens distortion, and sensor defects are baked into the calibration data, leading to a more reliable and accurate reconstruction. Existing structured light scanners can be reused without modifications while enjoying the superior precision and resilience that our calibration and reconstruction algorithms offer. Our algorithm shines when paired with a custom-designed analog projector, which enables 1-megapixel high-speed 3D scanning at up to 500 fps. We describe our algorithm and hardware prototype for high-speed 3D scanning and compare them with commercial and open-source structured light scanning methods.


title: Spectral Image Data Fusion for Multisource Data Augmentation

abstract: Multispectral and hyperspectral images are increasingly popular in different research fields, such as remote sensing, astronomical imaging, or precision agriculture. However, the amount of free data available to perform machine learning tasks is relatively small. Moreover, artificial intelligence models developed in the area of spectral imaging require input images with a fixed spectral signature, expecting the data to have the same number of spectral bands or the same spectral resolution. This requirement significantly reduces the number of usable sources that can be used for a given model. The scope of this study is to introduce a methodology for spectral image data fusion, in order to allow machine learning models to be trained and/or used on data from a larger number of sources, thus providing better generalization. For this purpose, we propose different interpolation techniques, in order to make multisource spectral data compatible with each other. The interpolation outcomes are evaluated through various approaches. This includes direct assessments using surface plots and metrics such as a Custom Mean Squared Error (CMSE) and the Normalized Difference Vegetation Index (NDVI). Additionally, indirect evaluation is done by estimating their impact on machine learning model training, particularly for semantic segmentation.


title: The story around the first 4n signal

abstract: The GANIL campaign around the first 4n signal was very peculiar. The beginning and end were both dictated by unexpected events that, unfortunately, do not fit within the streamlined format of standard scientific publications. However, they illustrate many aspects of how basic research should work, or at least does work. Therefore, I take this opportunity to share them with those not involved in the campaign, hoping that they will offer a better perspective of that research in particular and of basic research in general. As a disclaimer, this is only a personal recollection of those events.


title: Reservoir Computing with Generalized Readout based on Generalized Synchronization

abstract: Reservoir computing is a machine learning framework that exploits nonlinear dynamics, exhibiting significant computational capabilities. One of the defining characteristics of reservoir computing is its low cost and straightforward training algorithm, i.e. only the readout, given by a linear combination of reservoir variables, is trained. Inspired by recent mathematical studies based on dynamical system theory, in particular generalized synchronization, we propose a novel reservoir computing framework with generalized readout, including a nonlinear combination of reservoir variables. The first crucial advantage of using the generalized readout is its mathematical basis for improving information processing capabilities. Secondly, it is still within a linear learning framework, which preserves the original strength of reservoir computing. In summary, the generalized readout is naturally derived from mathematical theory and allows the extraction of useful basis functions from reservoir dynamics without sacrificing simplicity. In a numerical study, we find that introducing the generalized readout leads to a significant improvement in accuracy and an unexpected enhancement in robustness for the short- and long-term prediction of Lorenz chaos, with a particular focus on how to harness low-dimensional reservoir dynamics. A novel way and its advantages for physical implementations of reservoir computing with generalized readout are briefly discussed.


title: Brain MRI detection by Sematic Segmentation models- Transfer Learning approach

abstract: The paper discusses the use of MRI for segmentation techniques, specifically focusing on brain tumor detection. It discusses the use of convolutional neural networks (CNN) for automatic segmentation but also discusses challenges such as non-isotropic resolution, Rician noise, and bias field effects. The paper proposes models like VGG16, ResNet50, and ResU-net to predict MRI images based on original and predicted masks. ResNet50 is found to be a promising model with high accuracy and F1 score.


title: Modeling the dynamics of the Hepatitis B virus via a variable-order discrete system

abstract: We investigate the dynamics of the hepatitis B virus by integrating variable-order calculus and discrete analysis. Specifically, we utilize the Caputo variable-order difference operator in this study. To establish the existence and uniqueness results of the model, we employ a fixed-point technique. Furthermore, we prove that the model exhibits bounded and positive solutions. Additionally, we explore the local stability of the proposed model by determining the basic reproduction number. Finally, we present several numerical simulations to illustrate the richness of our results.


title: A two-phase-ACO algorithm for solving nonlinear optimization problems subjected to fuzzy relational equations

abstract: In this paper, we investigate nonlinear optimization problems whose constraints are defined as fuzzy relational equations (FRE) with max-min composition. Since the feasible solution set of the FRE is often a non-convex set and the resolution of the FREs is an NP-hard problem, conventional nonlinear approaches may involve high computational complexity. Based on the theoretical aspects of the problem, an algorithm (called FRE-ACO algorithm) is presented which benefits from the structural properties of the FREs, the ability of discrete ant colony optimization algorithm (denoted by ACO) to tackle combinatorial problems, and that of continuous ant colony optimization algorithm (denoted by ACOR) to solve continuous optimization problems. In the current method, the fundamental ideas underlying ACO and ACOR are combined and form an efficient approach to solve the nonlinear optimization problems constrained with such non-convex regions. Moreover, FRE-ACO algorithm preserves the feasibility of new generated solutions without having to initially find the minimal solutions of the feasible region or check the feasibility after generating the new solutions. FRE-ACO algorithm has been compared with some related works proposed for solving nonlinear optimization problems with respect to maxmin FREs. The obtained results demonstrate that the proposed algorithm has a higher convergence rate and requires a less number of function evaluations compared to other considered algorithms.


title: Multi-Point Gradient Estimation in Turbulence

abstract: When studying turbulence, it is often desirable to be able to estimate the local spatial gradient of a vector quantity using in situ measurements from a small number of irregularly spaced points. While previous studies have focused on the accuracy of these methods as the number of measurement points varies, we focus on the accuracy of gradient estimations as a function of shape of the measurement point configuration. We find that for well-shaped configurations that are of correct relative size, we can very accurately estimate the local spatial gradient using only four points.

categories: physics.flu-dyn physics.comp-ph physics.data-an physics.plasm-ph physics.space-ph


title: SNF-ROM: Projection-based nonlinear reduced order modeling with smooth neural fields

abstract: Reduced order modeling lowers the computational cost of solving PDEs by learning a low-order spatial representation from data and dynamically evolving these representations using manifold projections of the governing equations. While commonly used, linear subspace reduced-order models (ROMs) are often suboptimal for problems with a slow decay of Kolmogorov $n$-width, such as advection-dominated fluid flows at high Reynolds numbers. There has been a growing interest in nonlinear ROMs that use state-of-the-art representation learning techniques to accurately capture such phenomena with fewer degrees of freedom. We propose smooth neural field ROM (SNF-ROM), a nonlinear reduced modeling framework that combines grid-free reduced representations with Galerkin projection. The SNF-ROM architecture constrains the learned ROM trajectories to a smoothly varying path, which proves beneficial in the dynamics evaluation when the reduced manifold is traversed in accordance with the governing PDEs. Furthermore, we devise robust regularization schemes to ensure the learned neural fields are smooth and differentiable. This allows us to compute physics-based dynamics of the reduced system nonintrusively with automatic differentiation and evolve the reduced system with classical time-integrators. SNF-ROM leads to fast offline training as well as enhanced accuracy and stability during the online dynamics evaluation. We demonstrate the efficacy of SNF-ROM on a range of advection-dominated linear and nonlinear PDE problems where we consistently outperform state-of-the-art ROMs.


title: Auditing the Fairness of COVID-19 Forecast Hub Case Prediction Models

abstract: The COVID-19 Forecast Hub, a repository of COVID-19 forecasts from over 50 independent research groups, is used by the Centers for Disease Control and Prevention (CDC) for their official COVID-19 communications. As such, the Forecast Hub is a critical centralized resource to promote transparent decision making. Nevertheless, by focusing exclusively on prediction accuracy, the Forecast Hub fails to evaluate whether the proposed models have similar performance across social determinants that have been known to play a role in the COVID-19 pandemic including race, ethnicity and urbanization level. In this paper, we carry out a comprehensive fairness analysis of the Forecast Hub model predictions and we show statistically significant diverse predictive performance across social determinants, with minority racial and ethnic groups as well as less urbanized areas often associated with higher prediction errors. We hope this work will encourage COVID-19 modelers and the CDC to report fairness metrics together with accuracy, and to reflect on the potential harms of the models on specific social groups and contexts.


title: Parallel Approximations for High-Dimensional Multivariate Normal Probability Computation in Confidence Region Detection Applications

abstract: Addressing the statistical challenge of computing the multivariate normal (MVN) probability in high dimensions holds significant potential for enhancing various applications. One common way to compute high-dimensional MVN probabilities is the Separation-of-Variables (SOV) algorithm. This algorithm is known for its high computational complexity of O(n^3) and space complexity of O(n^2), mainly due to a Cholesky factorization operation for an n X n covariance matrix, where $n$ represents the dimensionality of the MVN problem. This work proposes a high-performance computing framework that allows scaling the SOV algorithm and, subsequently, the confidence region detection algorithm. The framework leverages parallel linear algebra algorithms with a task-based programming model to achieve performance scalability in computing process probabilities, especially on large-scale systems. In addition, we enhance our implementation by incorporating Tile Low-Rank (TLR) approximation techniques to reduce algorithmic complexity without compromising the necessary accuracy. To evaluate the performance and accuracy of our framework, we conduct assessments using simulated data and a wind speed dataset. Our proposed implementation effectively handles high-dimensional multivariate normal (MVN) probability computations on shared and distributed-memory systems using finite precision arithmetics and TLR approximation computation. Performance results show a significant speedup of up to 20X in solving the MVN problem using TLR approximation compared to the reference dense solution without sacrificing the application's accuracy. The qualitative results on synthetic and real datasets demonstrate how we maintain high accuracy in detecting confidence regions even when relying on TLR approximation to perform the underlying linear algebra operations.


title: YUI: Day-ahead Electricity Price Forecasting Using Invariance Simplified Supply and Demand Curve

abstract: In day-ahead electricity market, it is crucial for all market participants to have access to reliable and accurate price forecasts for their decision-making processes. Forecasting methods currently utilized in industrial applications frequently neglect the underlying mechanisms of price formation, while economic research from the perspective of supply and demand have stringent data collection requirements, making it difficult to apply in actual markets. Observing the characteristics of the day-ahead electricity market, we introduce two invariance assumptions to simplify the modeling of supply and demand curves. Upon incorporating the time invariance assumption, we can forecast the supply curve using the market equilibrium points from multiple time slots in the recent period. By introducing the price insensitivity assumption, we can approximate the demand curve using a straight line. The point where these two curves intersect provides us with the forecast price. The proposed model, forecasting suppl\textbf{Y} and demand cUrve simplified by Invariance, termed as YUI, is more efficient than state-of-the-art methods. Our experiment results in Shanxi day-ahead electricity market show that compared with existing methods, YUI can reduce forecast error by 13.8\% in MAE and 28.7\% in sMAPE. Code is publicly available at https://github.com/wangln19/YUI.


title: Thermodynamic Properties of Modified Black Hole Metrics in $f(R)$ Gravity

abstract: To construct new Schwarzschild and Kerr-Newman metric solutions, we start from the Lagrangian in entropy and statistical mechanics, introducing $f(R)$ gravity theory and dark energy definitions. Through a series of calculations, we derive the corrected metric solutions under different forms of $f(R)$ gravity.


title: TOI-1685 b is a Hot Rocky Super-Earth: Updates to the Stellar and Planet Parameters of a Popular JWST Cycle 2 Target

abstract: We present an updated characterization of the TOI-1685 planetary system, which consists of a P$_{\rm{b}}$ = 0.69\,day USP super-Earth planet orbiting a nearby ($d$ = 37.6\,pc) M2.5V star (TIC 28900646, 2MASS J04342248+4302148). This planet was previously featured in two contemporaneous discovery papers, but the best-fit planet mass, radius, and bulk density values were discrepant allowing it to be interpreted either as a hot, bare rock or a 50\% H$_{2}$O / 50\% MgSiO$_{3}$ water world. TOI-1685 b will be observed in three independent JWST cycle two programs, two of which assume the planet is a water world while the third assumes that it is a hot rocky planet. Here we include a refined stellar classification with a focus on addressing the host star's metallicity, an updated planet radius measurement that includes two sectors of TESS data and multi-color photometry from a variety of ground-based facilities, and a more accurate dynamical mass measurement from a combined CARMENES, IRD, and MAROON-X radial velocity data set. We find that the star is very metal-rich ([Fe/H] $\simeq$ +0.3) and that the planet is systematically smaller, lower mass, and higher density than initially reported, with new best-fit parameters of \Rpl = 1.468 $^{+0.050}_{-0.051}$ \Rearth\ and \Mpl = 3.03$^{+0.33}_{-0.32}$ \Mearth. These results fall in between the previously derived values and suggest that TOI-1685 b is a hot, rocky, planet with an Earth-like density (\Rhopl = 5.3 $\pm$ 0.8 g cm$^{-3}$, or 0.96 \rhoearth), high equilibrium temperature (T$_{\rm{eq}}$ = 1062 $\pm$ 27 K) and negligible volatiles, rather than a water world.


title: Study on spike-and-wave detection in epileptic signals using t-location-scale distribution and the K-nearest neighbors classifier

abstract: Pattern classification in electroencephalography (EEG) signals is an important problem in biomedical engineering since it enables the detection of brain activity, particularly the early detection of epileptic seizures. In this paper, we propose a k-nearest neighbors classification for epileptic EEG signals based on a t-location-scale statistical representation to detect spike-and-waves. The proposed approach is demonstrated on a real dataset containing both spike-and-wave events and normal brain function signals, where our performance is evaluated in terms of classification accuracy, sensitivity, and specificity.


title: Inverse Radon transforms: analytical and Tikhonov-like regularizations of inversion

abstract: We study the influence of analytical regularization used in the generalized function (distribution) space to the Tikhonov regularization procedure utilized in the different versions of Moore-Penrose's inversion. By introducing a new analytical term to the Tikhonov regularization of Moore-Penrose's inversion procedure, we derive new optimization conditions that extend the Tikhonov regularization framework and influence the fitting parameter. This enhancement yields a more robust and accurate reconstruction of physical quantities, demonstrating its potential impact on various studies. We illustrate the significance of new term through schematic examples of physical applications, highlighting its relevance to diverse fields. Our findings provide a valuable tool for improving inversion methods and their applications in physics and beyond.


title: A (simple) proof of the rna conjecture on powers of cycles

abstract: We verify a recent conjecture of Sehrawat, Kumar and Ahlawat on the minimum bisection width (a notion that was rediscovered in 2020 by Acharya and Kureethara under the name of rna number) of powers of cycles.


title: DETAIL: Task DEmonsTration Attribution for Interpretable In-context Learning

abstract: In-context learning (ICL) allows transformer-based language models that are pre-trained on general text to quickly learn a specific task with a few "task demonstrations" without updating their parameters, significantly boosting their flexibility and generality. ICL possesses many distinct characteristics from conventional machine learning, thereby requiring new approaches to interpret this learning paradigm. Taking the viewpoint of recent works showing that transformers learn in context by formulating an internal optimizer, we propose an influence function-based attribution technique, DETAIL, that addresses the specific characteristics of ICL. We empirically verify the effectiveness of our approach for demonstration attribution while being computationally efficient. Leveraging the results, we then show how DETAIL can help improve model performance in real-world scenarios through demonstration reordering and curation. Finally, we experimentally prove the wide applicability of DETAIL by showing our attribution scores obtained on white-box models are transferable to black-box models in improving model performance.


title: Fair Evaluation of Federated Learning Algorithms for Automated Breast Density Classification: The Results of the 2022 ACR-NCI-NVIDIA Federated Learning Challenge

abstract: The correct interpretation of breast density is important in the assessment of breast cancer risk. AI has been shown capable of accurately predicting breast density, however, due to the differences in imaging characteristics across mammography systems, models built using data from one system do not generalize well to other systems. Though federated learning (FL) has emerged as a way to improve the generalizability of AI without the need to share data, the best way to preserve features from all training data during FL is an active area of research. To explore FL methodology, the breast density classification FL challenge was hosted in partnership with the American College of Radiology, Harvard Medical School's Mass General Brigham, University of Colorado, NVIDIA, and the National Institutes of Health National Cancer Institute. Challenge participants were able to submit docker containers capable of implementing FL on three simulated medical facilities, each containing a unique large mammography dataset. The breast density FL challenge ran from June 15 to September 5, 2022, attracting seven finalists from around the world. The winning FL submission reached a linear kappa score of 0.653 on the challenge test data and 0.413 on an external testing dataset, scoring comparably to a model trained on the same data in a central location.


title: On some Analytic Inequalities for Gauss Hypergeometric Functions via Gruss Discrete Inequality

abstract: Recently, many researchers devoted their attention to study the extensions of the gamma and beta functions. In the present work, we focus on investigating some approximations for a class of Gauss hypergeometric functions by exploiting Gr\"{u}ss discrete inequality.


title: Global urban activity changes from COVID-19 physical distancing restrictions

abstract: During the COVID-19 pandemic changes in human activity became widespread through official policies and organically in response to the virus's transmission, which in turn, impacted the environment and the economy. The pandemic has been described as a natural experiment that tested how social and economic disruptions impacted different components of the global Earth System. To move this beyond hypotheses, locally-resolved, globally-available measures of how, where, and when human activity changed are critically needed. Here we use satellite-derived nighttime lights to quantify and map daily changes in human activity that are atypical for each urban area globally for two years after the onset of the pandemic using machine learning anomaly detectors. Metrics characterizing changes in lights from pre-COVID baseline in human settlements and quality assurance measures are reported. This dataset, TRacking Anomalous COVID-19 induced changEs in NTL (TRACE-NTL), is the first to resolve COVID-19 disruptions for all metropolitan regions globally, daily. It is suitable to support a variety of post-pandemic studies that assess how changes in human activity impact environmental systems.


title: Neural Fluidic System Design and Control with Differentiable Simulation

abstract: We present a novel framework to explore neural control and design of complex fluidic systems with dynamic solid boundaries. Our system features a fast differentiable Navier-Stokes solver with solid-fluid interface handling, a low-dimensional differentiable parametric geometry representation, a control-shape co-design algorithm, and gym-like simulation environments to facilitate various fluidic control design applications. Additionally, we present a benchmark of design, control, and learning tasks on high-fidelity, high-resolution dynamic fluid environments that pose challenges for existing differentiable fluid simulators. These tasks include designing the control of artificial hearts, identifying robotic end-effector shapes, and controlling a fluid gate. By seamlessly incorporating our differentiable fluid simulator into a learning framework, we demonstrate successful design, control, and learning results that surpass gradient-free solutions in these benchmark tasks.


title: Large deviation principles and evolutionary multiple structure alignment of non-coding RNA

abstract: Non-coding RNA are functional molecules that are not translated into proteins. Their function comes as important regulators of biological function. Because they are not translated, they need not be as stable as other types of RNA. The TKF91 Structure Tree from Holmes 2004 is a probability model that effectively describes correlated substitution, insertion, and deletion of base pairs, and found to have some worth in understanding dynamic folding patterns. In this paper, we provide a new probabilistic analysis of the TKF91 Structure Tree. Large deviation principles on stem lengths, helix lengths, and tree size are proved. Additionally, we give a new alignment procedure that constructs accurate sequence and structural alignments for sequences with low identity for a dense enough phylogeny.


title: Structural Entities Extraction and Patient Indications Incorporation for Chest X-ray Report Generation

abstract: The automated generation of imaging reports proves invaluable in alleviating the workload of radiologists. A clinically applicable reports generation algorithm should demonstrate its effectiveness in producing reports that accurately describe radiology findings and attend to patient-specific indications. In this paper, we introduce a novel method, \textbf{S}tructural \textbf{E}ntities extraction and patient indications \textbf{I}ncorporation (SEI) for chest X-ray report generation. Specifically, we employ a structural entities extraction (SEE) approach to eliminate presentation-style vocabulary in reports and improve the quality of factual entity sequences. This reduces the noise in the following cross-modal alignment module by aligning X-ray images with factual entity sequences in reports, thereby enhancing the precision of cross-modal alignment and further aiding the model in gradient-free retrieval of similar historical cases. Subsequently, we propose a cross-modal fusion network to integrate information from X-ray images, similar historical cases, and patient-specific indications. This process allows the text decoder to attend to discriminative features of X-ray images, assimilate historical diagnostic information from similar cases, and understand the examination intention of patients. This, in turn, assists in triggering the text decoder to produce high-quality reports. Experiments conducted on MIMIC-CXR validate the superiority of SEI over state-of-the-art approaches on both natural language generation and clinical efficacy metrics.


title: AutoCoder: Enhancing Code Large Language Model with \textsc{AIEV-Instruct}

abstract: We introduce AutoCoder, the first Large Language Model to surpass GPT-4 Turbo (April 2024) and GPT-4o in pass@1 on the Human Eval benchmark test ($\mathbf{90.9\%}$ vs. $\mathbf{90.2\%}$). In addition, AutoCoder offers a more versatile code interpreter compared to GPT-4 Turbo and GPT-4o. It's code interpreter can install external packages instead of limiting to built-in packages. AutoCoder's training data is a multi-turn dialogue dataset created by a system combining agent interaction and external code execution verification, a method we term \textbf{\textsc{AIEV-Instruct}} (Instruction Tuning with Agent-Interaction and Execution-Verified). Compared to previous large-scale code dataset generation methods, \textsc{AIEV-Instruct} reduces dependence on proprietary large models and provides execution-validated code dataset. The code and the demo video is available in \url{https://github.com/bin123apple/AutoCoder}.


title: Degeneracy of holomorphic mappings into or avoiding Fermat type hypersurfaces

abstract: We prove that if $f\colon\mathbb{C}^p\rightarrow\mathbb{P}^n(\mathbb{C})$ is a holomorphic mapping of maximal rank whose image lies in the Fermat hypersurface of degree $d>(n+1)\max\{n-p,1\}$, then its image is contained in a linear subspace of dimension at most $\bigg[\dfrac{n-1}{2}\bigg]$. Analog in the logarithmic case is also given. Our result strengthens a classical result of Green and provides a Nevanlinna theoretic proof for a recent result due to Etesse.


title: Data Mixing Made Efficient: A Bivariate Scaling Law for Language Model Pretraining

abstract: Large language models exhibit exceptional generalization capabilities, primarily attributed to the utilization of diversely sourced data. However, conventional practices in integrating this diverse data heavily rely on heuristic schemes, lacking theoretical guidance. This research tackles these limitations by investigating strategies based on low-cost proxies for data mixtures, with the aim of streamlining data curation to enhance training efficiency. Specifically, we propose a unified scaling law, termed BiMix, which accurately models the bivariate scaling behaviors of both data quantity and mixing proportions. We conduct systematic experiments and provide empirical evidence for the predictive power and fundamental principles of BiMix. Notably, our findings reveal that entropy-driven training-free data mixtures can achieve comparable or even better performance than more resource-intensive methods. We hope that our quantitative insights can shed light on further judicious research and development in cost-effective language modeling.


title: Interpretable Price Bounds Estimation with Shape Constraints in Price Optimization

abstract: This paper addresses the interpretable estimation of price bounds within the context of price optimization. In recent years, price optimization methods have become indispensable for maximizing revenues and profits. However, effectively applying these methods to real-world pricing operations remains a significant challenge. It is crucial for operators, who are responsible for setting prices, to utilize reasonable price bounds that are not only interpretable but also acceptable. Despite this necessity, most studies assume that price bounds are given constant values, and few have explored the reasonable determination of these bounds. In response, we propose a comprehensive framework for determining price bounds, which includes both the estimation and adjustment of these bounds. Specifically, we first estimate the price bounds using three distinct approaches based on historical pricing data. We then adjust the estimated price bounds by solving an optimization problem that incorporates shape constraints. This method allows for the implementation of price optimization under practical and reasonable price bounds, suitable for real-world applications. We report the effectiveness of our proposed method through numerical experiments conducted with historical pricing data from actual services.


title: A Short Introduction to Basic Principles of Quantum Navigation Based-on Rb Cold Atom Interferometry

abstract: Due to advances in cold atom interferometry, laser spectroscopy it is possible to achieve more precise accelerometers and gyroscopes which never occurs in mechanical- and optical-based sensors. Because of the inherent and independent characteristics of atomic levels which are too sensitive respect to the external changes, a self-calibrated navigation system with no satellite can be achieved. Here, in this paper we very shortly review the basic principles of inertia cold atom navigation sensor.


title: Saturated absorption spectroscopy and frequency locking of DBR laser on the D2 transition of rubidium atoms

abstract: In this paper, we experimentally report the saturated absorption spectroscopy (SAS) and frequency locking (FL) of a narrow-band DBR laser with 0.5MHz linewidth on the LD2-transition of Rb atoms.


title: Refractive index for the mechanical refraction of a relativistic particle

abstract: We have analytically determined the refractive index for the mechanical refraction of a relativistic particle for its all possible speeds. We have critically analysed the importance of Descartes' metaphysical theory and extended it in this regard. We have considered the conservation of the tangential component of the relativistic momentum and the relativistic energy of the particle in the process of the mechanical refraction within the optical-mechanical analogy. Our result for the mechanical refractive index exactly matches with the forms of both the Fermat's result on Snell's law of optical refraction at the ultra-relativistic limit and the Descartes' metaphysical result on the pseudo-Snell law of optical refraction at the non-relativistic limit.


title: High Rank Path Development: an approach of learning the filtration of stochastic processes

abstract: Since the weak convergence for stochastic processes does not account for the growth of information over time which is represented by the underlying filtration, a slightly erroneous stochastic model in weak topology may cause huge loss in multi-periods decision making problems. To address such discontinuities Aldous introduced the extended weak convergence, which can fully characterise all essential properties, including the filtration, of stochastic processes; however was considered to be hard to find efficient numerical implementations. In this paper, we introduce a novel metric called High Rank PCF Distance (HRPCFD) for extended weak convergence based on the high rank path development method from rough path theory, which also defines the characteristic function for measure-valued processes. We then show that such HRPCFD admits many favourable analytic properties which allows us to design an efficient algorithm for training HRPCFD from data and construct the HRPCF-GAN by using HRPCFD as the discriminator for conditional time series generation. Our numerical experiments on both hypothesis testing and generative modelling validate the out-performance of our approach compared with several state-of-the-art methods, highlighting its potential in broad applications of synthetic time series generation and in addressing classic financial and economic challenges, such as optimal stopping or utility maximisation problems.


title: Counting representations of quivers with multiplicities

abstract: In this thesis, we study counts of quiver representations over finite rings of truncated power series. We prove a plethystic formula relating counts of quiver representations over these rings and counts of jets on fibres of quiver moment maps. This solves a conjecture of Wyss and allows us to compute both counts on additional examples, using local zeta functions. The relation between counts of representations and counts of jets generalises the relation between Kac polynomials and counts of points on preprojective stacks. Pursuing this analogy, we establish further properties of our counts. We show that, for totally negative quivers, counts of jets converge to p-adic integrals on fibres of quiver moment maps. One expects a relation between these p-adic integrals and BPS invariants of preprojective algebras i.e. Kac polynomials. For small rank vectors, we also prove that the polynomials counting indecomposable quiver representations over finite rings have non-negative coefficients. Moreover, we show that jet schemes of fibres of quiver moment maps are cohomologically pure in that setting, so that their Poincar\'e polynomials are given by the former counts. This is reminiscent of the structure of cohomological Hall algebras, which are built from the cohomology of preprojective stacks. Finally, we compute the cohomology of jet spaces of preprojective stacks explicitly for the A2 quiver. Building on the structure of the preprojective cohomological Hall algebra of A2, we propose a candidate analogue of the BPS Lie algebra and conjecture the existence of a Hall product on the cohomology of these jet spaces.


title: Cluster expansion formulas and perfect matchings for type B and C

abstract: Let $\mathbf{P}_{2n+2}$ be the regular polygon with $2n+2$ vertices, and let $\theta$ be the rotation of 180$^\circ$. Fomin and Zelevinsky proved that $\theta$-invariant triangulations of $\mathbf{P}_{2n+2}$ are in bijection with the clusters of cluster algebras of type $B_n$ or $C_n$. Furthermore, cluster variables correspond to the orbits of the action of $\theta$ on the diagonals of $\mathbf{P}_{2n+2}$. In this paper, we associate a labeled modified snake graph $\mathcal{G}_{ab}$ to each $\theta$-orbit $[a,b]$, and we get the cluster variables of type $B_n$ and $C_n$ which correspond to $[a,b]$ as perfect matching Laurent polynomials of $\mathcal{G}_{ab}$. This extends the work of Musiker for cluster algebras of type B and C to every seed.


title: Static and dynamic properties of atomic nuclei with high-resolution potentials

abstract: We compute ground-state and dynamical properties of $^4$He and $^{16}$O nuclei using as input high-resolution, phenomenological nucleon-nucleon and three-nucleon forces that are local in coordinate space. The nuclear Schr\"odinger equation for both nuclei is accurately solved employing the auxiliary-field diffusion Monte Carlo approach. For the $^4$He nucleus, detailed benchmarks are carried out with the hyperspherical harmonics method. In addition to presenting results for the binding energies and radii, we also analyze the momentum distributions of these nuclei and their Euclidean response function corresponding to the isoscalar density transition. The latter quantity is particularly relevant for lepton-nucleus scattering experiments, as it paves the way to quantum Monte Carlo calculations of electroweak response functions of $^{16}$O.


title: SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models

abstract: Large language models (LLMs) achieve remarkable performance in natural language understanding but require substantial computation and memory resources. Post-training quantization (PTQ) is a powerful compression technique extensively investigated in LLMs. However, existing PTQ methods are still not ideal in terms of accuracy and efficiency, especially with below 4 bit-widths. Standard PTQ methods using group-wise quantization suffer difficulties in quantizing LLMs accurately to such low-bit, but advanced methods remaining high-precision weights element-wisely are hard to realize their theoretical hardware efficiency. This paper presents a Salience-Driven Mixed-Precision Quantization scheme for LLMs, namely SliM-LLM. The scheme exploits the salience distribution of weights to determine optimal bit-width and quantizers for accurate LLM quantization, while aligning bit-width partition to groups for compact memory usage and fast integer inference. Specifically, the proposed SliM-LLM mainly relies on two novel techniques: (1) Salience-Determined Bit Allocation utilizes the clustering characteristics of salience distribution to allocate the bit-widths of each group, increasing the accuracy of quantized LLMs and maintaining the inference efficiency; (2) Salience-Weighted Quantizer Calibration optimizes the parameters of the quantizer by considering the element-wise salience within the group, balancing the maintenance of salient information and minimization of errors. Comprehensive experiments show that SliM-LLM significantly improves the accuracy of LLMs at ultra-low bits, e.g., 2-bit LLaMA-7B achieves a 5.5-times memory-saving than original model on NVIDIA A800 GPUs, and 48% decrease of perplexity compared to the state-of-the-art gradient-free PTQ method. Moreover, SliM-LLM+, which is integrated from the extension of SliM-LLM with gradient-based quantizers, further reduces perplexity by 35.1%.


title: AnalogCoder: Analog Circuit Design via Training-Free Code Generation

abstract: Analog circuit design is a significant task in modern chip technology, focusing on the selection of component types, connectivity, and parameters to ensure proper circuit functionality. Despite advances made by Large Language Models (LLMs) in digital circuit design, the complexity and scarcity of data in analog circuitry pose significant challenges. To mitigate these issues, we introduce AnalogCoder, the first training-free LLM agent for designing analog circuits through Python code generation. Firstly, AnalogCoder incorporates a feedback-enhanced flow with tailored domain-specific prompts, enabling the automated and self-correcting design of analog circuits with a high success rate. Secondly, it proposes a circuit tool library to archive successful designs as reusable modular sub-circuits, simplifying composite circuit creation. Thirdly, extensive experiments on a benchmark designed to cover a wide range of analog circuit tasks show that AnalogCoder outperforms other LLM-based methods. It has successfully designed 20 circuits, 5 more than standard GPT-4o. We believe AnalogCoder can significantly improve the labor-intensive chip design process, enabling non-experts to design analog circuits efficiently.


title: Solitons with Self-induced Topological Nonreciprocity

abstract: The nonlinear Schrodinger equation supports solitons -- self-interacting, localized states that behave as nearly independent objects. We exhibit solitons with self-induced nonreciprocal dynamics in a discrete nonlinear Schrodinger equation. This nonreciprocal behavior, dependent on soliton power, arises from the interplay between linear and nonlinear terms in the equations of motion. Initially stable at high power, solitons exhibit nonreciprocal instabilities as power decreases, leading to unidirectional acceleration and amplification. This behavior is topologically protected by winding numbers on the solitons' mean-field Hamiltonian and their stability matrix, linking nonlinear dynamics and point gap topology in non-Hermitian Hamiltonians.


title: On Robust Controlled Invariants for Continuous-time Monotone Systems

abstract: This paper delves into the problem of computing robust controlled invariants for monotone continuous-time systems, with a specific focus on lower-closed specifications. We consider the classes of state monotone (SM) and control-state monotone (CSM) systems, we provide the structural properties of robust controlled invariants for these classes of systems and show how these classes significantly impact the computation of invariants. Additionally, we introduce a notion of feasible points, demonstrating that their existence is sufficient to characterize robust controlled invariants for the considered class of systems. The study further investigates the necessity of reducing the feasibility condition for CSM and Lipschitz systems, unveiling conditions that guide this reduction. Leveraging these insights, we construct an algorithm for the computation of robust controlled invariants. To demonstrate the practicality of our approach, we applied the developed algorithm to the coupled tank problem.


title: Background Contamination of the Project Hephaistos Dyson Spheres Candidates

abstract: Project Hephaistos recently identified seven M-dwarfs as possible Dyson Spheres (DS) candidates. We have cross-matched three of these candidates (A, B \& G) with radio sources detected in various all-sky surveys. The radio sources are offset from the Gaia stellar positions by $\sim 4.9$, $\sim 0.4$ and $\sim 5.0$ arcseconds for candidates A, B, and G respectively. We propose that DOGs (Dust obscured galaxies) lying close to the line-of-sight of these M-dwarf stars significantly contribute to the measured WISE mid-IR flux densities in the WISE W3 and W4 wavebands. These three stars have therefore been misidentified as DS candidates. We also note that with an areal sky density of $9 \times 10^{-6}$ per square arcsecond, Hot DOGs can probably account for the contamination of all 7 DS candidates drawn from an original sample of 5 million stars.


title: The nuclear-spin dark state in silicon

abstract: We report the formation of a nuclear-spin dark state in a gate-defined silicon double quantum dot. The dark state has been predicted to emerge during dynamic nuclear polarization when the electrons in the quantum dot drive the nuclei in the semiconductor into a decoupled state. We show that, as expected, the electron-nuclear coupling rapidly diminishes in the dark state, and that this state depends on the synchronized precession of the nuclear spins. Moreover, the dark state significantly increases the lifetimes of electronic spin states. This nuclear-spin dark state could be used as a quantum memory or as a resource for quantum sensing, and further studies of the dark state may point the way toward increased polarization of nuclear spin ensembles.


title: How Does Bayes Error Limit Probabilistic Robust Accuracy

abstract: Adversarial examples pose a security threat to many critical systems built on neural networks. Given that deterministic robustness often comes with significantly reduced accuracy, probabilistic robustness (i.e., the probability of having the same label with a vicinity is $\ge 1-\kappa$) has been proposed as a promising way of achieving robustness whilst maintaining accuracy. However, existing training methods for probabilistic robustness still experience non-trivial accuracy loss. It is unclear whether there is an upper bound on the accuracy when optimising towards probabilistic robustness, and whether there is a certain relationship between $\kappa$ and this bound. This work studies these problems from a Bayes error perspective. We find that while Bayes uncertainty does affect probabilistic robustness, its impact is smaller than that on deterministic robustness. This reduced Bayes uncertainty allows a higher upper bound on probabilistic robust accuracy than that on deterministic robust accuracy. Further, we prove that with optimal probabilistic robustness, each probabilistically robust input is also deterministically robust in a smaller vicinity. We also show that voting within the vicinity always improves probabilistic robust accuracy and the upper bound of probabilistic robust accuracy monotonically increases as $\kappa$ grows. Our empirical findings also align with our results.


title: Upper tail large deviations of the directed landscape

abstract: Starting from one-point tail bounds, we establish an upper tail large deviation principle for the directed landscape at the metric level. Metrics of finite rate are in one-to-one correspondence with measures supported on a set of countably many paths, and the rate function is given by a certain Kruzhkov entropy of these measures. As an application of our main result, we prove a large deviation principle for the directed geodesic.


title: PILOT: Equivariant diffusion for pocket conditioned de novo ligand generation with multi-objective guidance via importance sampling

abstract: The generation of ligands that both are tailored to a given protein pocket and exhibit a range of desired chemical properties is a major challenge in structure-based drug design. Here, we propose an in-silico approach for the $\textit{de novo}$ generation of 3D ligand structures using the equivariant diffusion model PILOT, combining pocket conditioning with a large-scale pre-training and property guidance. Its multi-objective trajectory-based importance sampling strategy is designed to direct the model towards molecules that not only exhibit desired characteristics such as increased binding affinity for a given protein pocket but also maintains high synthetic accessibility. This ensures the practicality of sampled molecules, thus maximizing their potential for the drug discovery pipeline. PILOT significantly outperforms existing methods across various metrics on the common benchmark dataset CrossDocked2020. Moreover, we employ PILOT to generate novel ligands for unseen protein pockets from the Kinodata-3D dataset, which encompasses a substantial portion of the human kinome. The generated structures exhibit predicted $IC_{50}$ values indicative of potent biological activity, which highlights the potential of PILOT as a powerful tool for structure-based drug design.


title: The magic angle of Sr$_2$RuO$_4$: optimizing correlation-driven superconductivity

abstract: A fundamental understanding of unconventional superconductivity is crucial for engineering materials with specific order parameters or elevated superconducting transition temperatures. However, for many of these materials, such as Sr$_2$RuO$_4$, the pairing mechanism and the symmetry of the superconducting order parameter remain unclear; furthermore, reliable and efficient methods of predicting their response to tuning - e.g. via structural distortions through strain and octahedral rotations - are lacking. Here we investigate the response of superconductivity in Sr$_2$RuO$_4$ to distortions via two numerical techniques, the random phase approximation (RPA) and functional renormalization group (FRG), starting from realistic models of the electronic structure. Comparison of the results from the two techniques suggests that RPA misses the important interplay of competing fluctuation channels, while FRG reproduces key experimental findings. In accordance with earlier studies by RPA and FRG, we confirm the experimentally observed tuneability of $T_c$ with uniaxial strain. With octahedral rotation, we find an even larger increase of $T_c$ before superconductivity is completely suppressed in FRG, a finding that confirms experiments but is not reproduced in RPA. Throughout the parameter space investigated here, we find a dominant $d_{x^2-y^2}$ pairing symmetry from FRG. To provide benchmark results for determining the pairing symmetry experimentally by quasiparticle interference using a Scanning Tunneling Microscope, we introduce the pairing interactions into continuum local density of states calculations, enabling experimental verification of the symmetry of the order parameter via phase-referenced Bogoliubov Quasiparticle Interference imaging.


title: Slow measurement-only dynamics of entanglement in Pauli subsystem codes

abstract: We study the non-unitary dynamics of a class of quantum circuits based on stochastically measuring check operators of subsystem quantum error-correcting codes, such as the Bacon-Shor code and its various generalizations. Our focus is on how properties of the underlying code are imprinted onto the measurement-only dynamics. We find that in a large class of codes with nonlocal stabilizer generators, at late times there is generically a nonlocal contribution to the subsystem entanglement entropy which scales with the subsystem size. The nonlocal stabilizer generators can also induce slow dynamics, since depending on the rate of competing measurements the associated degrees of freedom can take exponentially long (in system size) to purify (disentangle from the environment when starting from a mixed state) and to scramble (become entangled with the rest of the system when starting from a product state). Concretely, we consider circuits for which the nonlocal stabilizer generators of the underlying subsystem code take the form of subsystem symmetries. We present a systematic study of the phase diagrams and relevant time scales in two and three spatial dimensions for both Calderbank-Shor-Steane (CSS) and non-CSS codes, focusing in particular on the link between slow measurement-only dynamics and the geometry of the subsystem symmetry. A key finding of our work is that slowly purifying or scrambling degrees of freedom appear to emerge only in codes whose subsystem symmetries are nonlocally {\it generated}, a strict subset of those whose symmetries are simply nonlocal. We comment on the link between our results on subsystem codes and the phenomenon of Hilbert-space fragmentation in light of their shared algebraic structure.

categories: quant-ph cond-mat.dis-nn cond-mat.stat-mech cond-mat.str-el


title: Unbounded entropy production and violent fragmentation in long-range interacting super-Tonks-Girardeau systems

abstract: We study the non-equilibrium dynamics of a one-dimensional Bose gas with long-range interactions that decay as $(\frac{1}{r^{\alpha}})$ $(0.5 < \alpha <4.0$). We investigate the system when the interactions are suddenly switched from the Tonks-Girardeau (TG) to the super-Tonks-Girardeau (sTG) limit. We find that relaxation is achieved through a complex intermediate dynamics demonstrated by violent fragmentation and chaotic delocalization. We establish that the sTG gas exhibits classical gaseous characteristics and an asymptotic state associated with unbounded entropy production. The phase diagram shows an exponential boundary between the nonthermal (quantum) gas and the thermal (classical) gas. We show the universality of the dynamics by also presenting results for spinless fermions. Weaker quench protocols give a certain degree of control over the relaxation process and induce some intermediate quasi-prethermal states. Our study showcases the complex relaxation behavior of tunable long-range interacting systems that could be engineered in state-of-the-art experiments, e.g. in trapped ions or Rydberg atoms.

categories: cond-mat.quant-gas cond-mat.other cond-mat.stat-mech cond-mat.str-el quant-ph


title: Lieb-Schultz-Mattis theorems and generalizations in long-range interacting systems

abstract: In a unified fashion, we establish Lieb-Schultz-Mattis (LSM) theorems and their generalizations in systems with long-range interactions. We show that, for a quantum spin chain, if the interactions decay fast enough as their ranges increase and the Hamiltonian has an anomalous symmetry, the Hamiltonian cannot have a unique gapped symmetric ground state. If the Hamiltonian contains only 2-spin interactions, these theorems hold when the interactions decay faster than $1/r^2$, with $r$ the distance between the two interacting spins. Moreover, any pure state with an anomalous symmetry, which may not be a ground state of any natural Hamiltonian, must be long-range entangled. The symmetries we consider include on-site internal symmetries combined with lattice translation symmetries, and they can also extend to purely internal but non-on-site symmetries. Moreover, these internal symmetries can be discrete or continuous. We explore the applications of the theorems through various examples.

categories: cond-mat.str-el cond-mat.quant-gas math-ph math.MP math.OA quant-ph


title: AstroPT: Scaling Large Observation Models for Astronomy

abstract: This work presents AstroPT, an autoregressive pretrained transformer developed with astronomical use-cases in mind. The AstroPT models presented here have been pretrained on 8.6 million $512 \times 512$ pixel $grz$-band galaxy postage stamp observations from the DESI Legacy Survey DR8. We train a selection of foundation models of increasing size from 1 million to 2.1 billion parameters, and find that AstroPT follows a similar saturating log-log scaling law to textual models. We also find that the models' performances on downstream tasks as measured by linear probing improves with model size up to the model parameter saturation point. We believe that collaborative community development paves the best route towards realising an open source `Large Observation Model' -- a model trained on data taken from the observational sciences at the scale seen in natural language processing. To this end, we release the source code, weights, and dataset for AstroPT under the MIT license, and invite potential collaborators to join us in collectively building and researching these models.


title: A mass for the dual axion

abstract: In this article we study a modification of axion physics in which the dual axion acquires a mass. This mass explicitly breaks the shift symmetry of the dual axion. The potential breaking of this shift symmetry poses a dual axion quality problem. When the dual axion acquires a mass, the axion gets eaten and becomes the longitudinal degree of freedom of a massive vector field. In this phase, axion strings are screened and far-separated instanton configurations are exponentially suppressed. This confinement of instantons corresponds to the worldline action of a particle-like soliton traveling between the instantons analogous to Abrikosov/Nielsen-Oleson vortex solitons that stretch between confined magnetic monopoles in a superconductor. We calculate the cost of this additional worldline suppression and provide several models in which both the confined instantons and confining worldline are dynamical.