title: KerasCV and KerasNLP: Vision and Language Power-Ups

abstract: We present the Keras domain packages KerasCV and KerasNLP, extensions of the Keras API for Computer Vision and Natural Language Processing workflows, capable of running on either JAX, TensorFlow, or PyTorch. These domain packages are designed to enable fast experimentation, with a focus on ease-of-use and performance. We adopt a modular, layered design: at the library's lowest level of abstraction, we provide building blocks for creating models and data preprocessing pipelines, and at the library's highest level of abstraction, we provide pretrained ``task" models for popular architectures such as Stable Diffusion, YOLOv8, GPT2, BERT, Mistral, CLIP, Gemma, T5, etc. Task models have built-in preprocessing, pretrained weights, and can be fine-tuned on raw inputs. To enable efficient training, we support XLA compilation for all models, and run all preprocessing via a compiled graph of TensorFlow operations using the tf.data API. The libraries are fully open-source (Apache 2.0 license) and available on GitHub.


title: Image-to-Joint Inverse Kinematic of a Supportive Continuum Arm Using Deep Learning

abstract: In this work, a deep learning-based technique is used to study the image-to-joint inverse kinematics of a tendon-driven supportive continuum arm. An eye-off-hand configuration is considered by mounting a camera at a fixed pose with respect to the inertial frame attached at the arm base. This camera captures an image for each distinct joint variable at each sampling time to construct the training dataset. This dataset is then employed to adapt a feed-forward deep convolutional neural network, namely the modified VGG-16 model, to estimate the joint variable. One thousand images are recorded to train the deep network, and transfer learning and fine-tuning techniques are applied to the modified VGG-16 to further improve the training. Finally, training is also completed with a larger dataset of images that are affected by various types of noises, changes in illumination, and partial occlusion. The main contribution of this research is the development of an image-to-joint network that can estimate the joint variable given an image of the arm, even if the image is not captured in an ideal condition. The key benefits of this research are twofold: 1) image-to-joint mapping can offer a real-time alternative to computationally complex inverse kinematic mapping through analytical models; and 2) the proposed technique can provide robustness against noise, occlusion, and changes in illumination. The dataset is publicly available on Kaggle.


title: Collective Coordinate Models for 2-Vortex Shape Mode Dynamics

abstract: Models are developed for the motion of charge-2 Abelian Higgs vortices through the 2-vortex moduli space $M$, with the vortices excited by their shape mode oscillations. The models simplify to the well-known geodesic flow on $M$, modified by a potential, when the mode oscillations are fast relative to the moduli space motion and their amplitudes are small. When the lowest-frequency mode is excited with a large amplitude, the geodesic flow is not a correct description. Instead, a chaotic, or even fractal, multi-bounce structure in vortex-vortex collisions is predicted.


title: Entropy annealing for policy mirror descent in continuous time and space

abstract: Entropy regularization has been extensively used in policy optimization algorithms to regularize the optimization landscape and accelerate convergence; however, it comes at the cost of introducing an additional regularization bias. This work quantifies the impact of entropy regularization on the convergence of policy gradient methods for stochastic exit time control problems. We analyze a continuous-time policy mirror descent dynamics, which updates the policy based on the gradient of an entropy-regularized value function and adjusts the strength of entropy regularization as the algorithm progresses. We prove that with a fixed entropy level, the dynamics converges exponentially to the optimal solution of the regularized problem. We further show that when the entropy level decays at suitable polynomial rates, the annealed flow converges to the solution of the unregularized problem at a rate of $\mathcal O(1/S)$ for discrete action spaces and, under suitable conditions, at a rate of $\mathcal O(1/\sqrt{S})$ for general action spaces, with $S$ being the gradient flow time. This paper explains how entropy regularization improves policy optimization, even with the true gradient, from the perspective of convergence rate.


title: An Expanding Accretion Disk and a Warm Disk Wind As Seen In the Spectral Evolution of HBC 722

abstract: We present a comprehensive analysis of the post-outburst evolution of the FU Ori object HBC 722 in optical/near-infrared (NIR) photometry and spectroscopy. Using a modified viscous accretion disk model, we fit the outburst epoch SED to determine the physical parameters of the disk, including $\dot{M}_\mathrm{acc} = 10^{-4.0} \ M_\odot$ yr$^{-1}$, $R_\mathrm{inner} = 3.65 \ R_\odot$, $i = 79^\circ$, and a maximum disk temperature of $T_\mathrm{max} = 5700$ K. We then use a decade of optical/NIR spectra to demonstrate a changing accretion rate drives the visible-range photometric variation, while the NIR shows the outer radius of the active accretion disk expands outward as the outburst progresses. We also identify the major components of the disk system: a plane-parallel disk atmosphere in Keplerian rotation and a 2-part warm disk wind that is collimated near the star and wide-angle at larger radii. The wind is traced by classic wind lines, and appears as a narrow, low-velocity, deep absorption component in several atomic lines spanning the visible spectrum and in the CO 2.29$\mu$m band. We compare the wind lines to those computed from wind models for other FU Ori systems and rapidly accreting young stellar disks and find a 4000-6000 K wind can explain the observed line profiles. Fitting the progenitor spectrum, we find $M_* = 0.2 \ M_\odot$ and $\dot{M}_\mathrm{progenitor} = 7.8 \times 10^{-8} \ M_\odot \ \mathrm{yr}^{-1}$. Finally, we discuss HBC 722 relative to V960 Mon, another FU Ori object we have previously studied in detail.


title: Towards Hierarchical Multi-Agent Workflows for Zero-Shot Prompt Optimization

abstract: Large language models (LLMs) have shown great progress in responding to user questions, allowing for a multitude of diverse applications. Yet, the quality of LLM outputs heavily depends on the prompt design, where a good prompt might enable the LLM to answer a very challenging question correctly. Therefore, recent works have developed many strategies for improving the prompt, including both manual crafting and in-domain optimization. However, their efficacy in unrestricted scenarios remains questionable, as the former depends on human design for specific questions and the latter usually generalizes poorly to unseen scenarios. To address these problems, we give LLMs the freedom to design the best prompts according to themselves. Specifically, we include a hierarchy of LLMs, first constructing a prompt with precise instructions and accurate wording in a hierarchical manner, and then using this prompt to generate the final answer to the user query. We term this pipeline Hierarchical Multi-Agent Workflow, or HMAW. In contrast with prior works, HMAW imposes no human restriction and requires no training, and is completely task-agnostic while capable of adjusting to the nuances of the underlying task. Through both quantitative and qualitative experiments across multiple benchmarks, we verify that despite its simplicity, the proposed approach can create detailed and suitable prompts, further boosting the performance of current LLMs.


title: Evaluating Large Language Model Biases in Persona-Steered Generation

abstract: The task of persona-steered text generation requires large language models (LLMs) to generate text that reflects the distribution of views that an individual fitting a persona could have. People have multifaceted personas, but prior work on bias in LLM-generated opinions has only explored multiple-choice settings or one-dimensional personas. We define an incongruous persona as a persona with multiple traits where one trait makes its other traits less likely in human survey data, e.g. political liberals who support increased military spending. We find that LLMs are 9.7% less steerable towards incongruous personas than congruous ones, sometimes generating the stereotypical stance associated with its demographic rather than the target stance. Models that we evaluate that are fine-tuned with Reinforcement Learning from Human Feedback (RLHF) are more steerable, especially towards stances associated with political liberals and women, but present significantly less diverse views of personas. We also find variance in LLM steerability that cannot be predicted from multiple-choice opinion evaluation. Our results show the importance of evaluating models in open-ended text generation, as it can surface new LLM opinion biases. Moreover, such a setup can shed light on our ability to steer models toward a richer and more diverse range of viewpoints.


title: Conversational Agents to Facilitate Deliberation on Harmful Content in WhatsApp Groups

abstract: WhatsApp groups have become a hotbed for the propagation of harmful content including misinformation, hate speech, polarizing content, and rumors, especially in Global South countries. Given the platform's end-to-end encryption, moderation responsibilities lie on group admins and members, who rarely contest such content. Another approach is fact-checking, which is unscalable, and can only contest factual content (e.g., misinformation) but not subjective content (e.g., hate speech). Drawing on recent literature, we explore deliberation -- open and inclusive discussion -- as an alternative. We investigate the role of a conversational agent in facilitating deliberation on harmful content in WhatsApp groups. We conducted semi-structured interviews with 21 Indian WhatsApp users, employing a design probe to showcase an example agent. Participants expressed the need for anonymity and recommended AI assistance to reduce the effort required in deliberation. They appreciated the agent's neutrality but pointed out the futility of deliberation in echo chamber groups. Our findings highlight design tensions for such an agent, including privacy versus group dynamics and freedom of speech in private spaces. We discuss the efficacy of deliberation using deliberative theory as a lens, compare deliberation with moderation and fact-checking, and provide design recommendations for future such systems. Ultimately, this work advances CSCW by offering insights into designing deliberative systems for combating harmful content in private group chats on social media.


title: Beyond spin-charge separation: Helical modes and topological quantum phase transitions in one-dimensional Fermi gases with spin-orbit and Rabi couplings

abstract: Motivated by the experimental observation of spin-charge separation in one-dimensional interacting Fermi gases, we investigate these systems in the presence of spin-orbit coupling and Rabi fields. We demonstrate that spin-charge-separated modes evolve into helical collective modes due to the special mixing of spin and charge induced by spin-orbit coupling and Rabi fields. We obtain the phase diagram of chemical potential versus Rabi fields for given spin-orbit coupling and interactions, and find several topological quantum phase transitions of the Lifshitz type. We show that the velocities of the collective modes are nonanalytic at the boundaries between different phases. Lastly, we analyze the charge-charge, spin-charge and spin-spin dynamical structure factors to show that the dispersions, spectral weights and helicities of the collective modes can be experimentally extracted in systems such as $^{6}{\rm Li}$, $^{40}{\rm K}$ and $^{173}{\rm Yb}$.


title: Gravitational Lensing in More Realistic Dark Matter Halo Models

abstract: In this study, we investigate gravitational lensing within the framework of more realistic dark matter halo models, transcending the limitations of spherical-collapse approximations. Through analytical computations utilizing diverse mass functions, we address critical factors typically overlooked in the standard Press-Schechter formalism, including ellipsoidal-collapse conditions, angular momentum dynamics, dynamical friction, and the cosmological constant. Our analysis incorporates two widely recognized halo density profiles, the Navarro-Frenk-White and Einasto profiles, considering both spherical and ellipsoidal-collapse scenarios. We present relevant calculations of pivotal gravitational lensing observables, such as Einstein radii, lensing optical depths, and time delays, spanning a wide range of redshifts and masses across two distinct lensing models: the point mass and singular isothermal sphere (SIS) lens models. Our findings illuminate that adopting more realistic dark matter halo models leads to heightened lensing effects compared to their spherical-collapse counterparts. Furthermore, our analyses of lensing optical depths and time delays reveal distinct characteristics between point mass and SIS lens models. These outcomes highlight the need for more realistic halo descriptions instead of simple approximations when modeling gravitational lensing, as this approach can potentially better reveal the complex structures of dark matter.


title: A test for a local formation of finite groups to be a formation of soluble groups with the Shemetkov property

abstract: L.A. Shemetkov posed a Problem 9.74 in Kourovka Notebook to find all local formations $\mathfrak{F}$ of finite groups such that every finite minimal non-$\mathfrak{F}$-group is either a Schmidt group or a group of prime order. All known solutions to this problem are obtained under the assumption that every minimal non-$\mathfrak{F}$-group is soluble. Using the above mentioned solutions we present a polynomial in $n$ time check for a local formation $\mathfrak{F}$ with bounded $\pi(\mathfrak{F})$ to be a formation of soluble groups with the Shemtkov property where $n=\max \pi(\mathfrak{F})$.


title: Static Subspace Approximation for Random Phase Approximation Correlation Energies: Implementation and Performance

abstract: Developing theoretical understanding of complex reactions and processes at interfaces requires using methods that go beyond semilocal density functional theory to accurately describe the interactions between solvent, reactants and substrates. Methods based on many-body perturbation theory, such as the random phase approximation (RPA), have previously been limited due to their computational complexity. However, this is now a surmountable barrier due to the advances in computational power available, in particular through modern GPU-based supercomputers. In this work, we describe the implementation of RPA calculations within BerkeleyGW and show its favorable computational performance on large complex systems relevant for catalysis and electrochemistry applications. Our implementation builds off of the static subspace approximation which, by employing a compressed representation of the frequency dependent polarizability, enables the evaluation of the RPA correlation energy with significant acceleration and systematically controllable accuracy. We find that the computational cost of calculating the RPA correlation energy scales only linearly with system size for systems containing up to 50 thousand bands, and is expected to scale quadratically thereafter. We also show excellent strong scaling results across several supercomputers, demonstrating the performance and portability of this implementation.


title: FaceMixup: Enhancing Facial Expression Recognition through Mixed Face Regularization

abstract: The proliferation of deep learning solutions and the scarcity of large annotated datasets pose significant challenges in real-world applications. Various strategies have been explored to overcome this challenge, with data augmentation (DA) approaches emerging as prominent solutions. DA approaches involve generating additional examples by transforming existing labeled data, thereby enriching the dataset and helping deep learning models achieve improved generalization without succumbing to overfitting. In real applications, where solutions based on deep learning are widely used, there is facial expression recognition (FER), which plays an essential role in human communication, improving a range of knowledge areas (e.g., medicine, security, and marketing). In this paper, we propose a simple and comprehensive face data augmentation approach based on mixed face component regularization that outperforms the classical DA approaches from the literature, including the MixAugment which is a specific approach for the target task in two well-known FER datasets existing in the literature.


title: Ancillary Services Provision by Cross-Voltage-Level Power Flow Control using Flexibility Regions

abstract: The large-scale integration of distributed renewable energy sources into the electricity grid requires the investigation of new methods to ensure stability. For example, Active Distribution Networks (ADNs) can be used at (sub-) transmission levels for emergency operation, provided robust and efficient control is available. This paper investigates the use of Feasible Operating Regions (FORs) and Flexibility Regions (FRs) for Cross-Voltage-Level Power Flow Control (CPFC). The enhancement of network stability due to the provision of ancillary services is illustrated, as is the need for strengthened cooperation between Transmission (TSOs) and Distribution System Operators (DSOs). Optimal power flow methods are considered, focusing on computational advances through PieceWise Linearization (PWL) and convex relaxation techniques aiming to speed up runtime while keeping high accuracy. To illustrate the algorithms' benefits and drawbacks, they are analyzed using exemplary medium voltage grids.


title: Speed Profile Definition for GLOSA Implementation on Buses Based on Statistical Analysis of Experimental Data

abstract: Intelligent Transportation Systems (ITS) are pushing an increasing interest and development when dealing with eco-driving systems. In this framework, this paper presents a method to define speed profiles specifically designed for Green Light Optimal Speed Advisory (GLOSA) systems on buses. GLOSA aims to optimize traffic flow by providing vehicles with real-time speed recommendations synchronized with traffic signal timings. Leveraging statistical analysis of experimental data collected from an urban bus, the study develops a methodology to extract meaningful insights into bus behaviour and traffic dynamics. The proposed approach considers road topology, scheduled bus stops, and signal timings to define simple although suitable speed profiles considering the peculiarities of the motion of a bus in an urban scenario. Through extensive data collection robust statistical data are defined, allowing the definition of vehicle motion profile for effectively develop and implement GLOSA systems. This research contributes to the advancement of Intelligent Transportation Systems by providing realistic data and practical insights for optimizing bus operations in urban environments.


title: Geometric categorifications of Verma modules: Grassmannian Quiver Hecke algebras

abstract: Naisse and Vaz defined an extension of KLR algebras to categorify Verma modules. We realise these algebras geometrically as convolution algebras in Borel--Moore homology. For this we introduce \emph{Grassmannian--Steinberg quiver flag varieties}. They generalize Steinberg quiver flag varieties in a non-obvious way, reflecting the diagrammatics from the Naisse--Vaz construction. Using different kind of stratifications we provide geometric explanations of the rather mysterious algebraic and diagrammatic basis theorems. A geometric categorification of Verma modules was recently found in the special case of $\mathfrak{sl}_2$ by Rouquier. Rouquier's construction uses coherent sheaves on certain quasi-map spaces to flag varieties (zastavas), whereas our construction is implicitly based on perverse sheaves. Both should be seen as parts (on dual sides) of a general geometric framework for the Naisse--Vaz approach. We first treat the (substantially easier) $\mathfrak{sl}_2$ case in detail and construct as a byproduct a geometric dg-model of the nil-Hecke algebras. The extra difficulties we encounter in general require the use of more complicated Grassmannian--Steinberg quiver flag varieties. Their definition arises from combinatorially defined \emph{diagram varieties} which we assign to each Naisse--Vaz basis diagram. Our explicit analysis here might shed some light on categories of coherent sheaves on more general zastava spaces studied by Feigin--Finkelberg--Kuznetsov--Mirkovi{\'c} and Braverman, which we expect to occur in a generalization of Rouquier's construction away from $\mathfrak{sl}_2$.


title: An algebraic proof of the graph orientation problem dichotomy for forbidden tournaments

abstract: Using the theory of smooth approximations, we give a new and algebraic proof that for any set F of finite tournaments, the problem of orienting a finite graph whilst avoiding all members of F is either in P or NP-complete. We characterize both cases by algebraic conditions.


title: Transmission of multiple pathogens across species

abstract: We analyse a model that describes the propagation of many pathogens within and between many species. A branching process approximation is used to compute the probability of disease outbreaks. Special cases of aquatic environments with two host species and one or two pathogens are considered both analytically and computationally.


title: Pinning and dipole asymptotics of locally deformed striped phases

abstract: We investigate the effect of spatial inhomogeneity on perfectly periodic, self-organized striped patterns in spatially extended systems. We demonstrate that inhomogeneities select a specific translate of the striped patterns and induce algebraically decaying, dipole-type farfield deformations. Phase shifts and leading order terms are determined by effective moments of the spatial inhomogeneity. Farfield decay is proportional to the derivatives of the Green's function of an effective Laplacian. Technically, we use mode filters and conjugacies to an effective Laplacian to establish Fredholm properties of the linearization in Kondratiev spaces. Spatial localization in a contraction argument is gained through the use of an explicit deformation ansatz and a subtle cancellation in Bloch wave space.


title: Hyperuniformity in Ashkin-Teller model

abstract: We show that equilibrium systems in $d$ dimension that obey the inequality $d\nu> 2,$ known as Harris criterion, exhibit suppressed energy fluctuation in their critical state. Ashkin-Teller model is an example in $d=2$ where the correlation length exponent $\nu$ varies continuously with the inter-spin interaction strength $\lambda$ and exceeds the value $d/2$ set by Harris criterion when $\lambda$ is negative; there, the variance of the subsystem energy across a length scale $l$ varies as $l^{d-\alpha}$ with hyperuniformity exponent $\alpha = 2(1-\nu^{-1}).$ Point configurations constructed by assigning unity to the sites which has coarse-grained energy beyond a threshold value also exhibit suppressed number fluctuation and hyperuniformiyty with same exponent $\alpha.$


title: Auto Arena of LLMs: Automating LLM Evaluations with Agent Peer-battles and Committee Discussions

abstract: As LLMs evolve on a daily basis, there is an urgent need for a trustworthy evaluation method that can provide robust evaluation results in a timely fashion. Currently, as static benchmarks are prone to contamination concerns, users tend to trust human voting platforms, such as Chatbot Arena. However, human annotations require extensive manual efforts. To provide an automatic, robust, and trustworthy evaluation framework, we innovatively propose the Auto-Arena of LLMs, which automates the entire evaluation process with LLM agents. Firstly, an examiner LLM devises queries. Then, a pair of candidate LLMs engage in a multi-round peer-battle around the query, during which the LLM's true performance gaps become visible. Finally, a committee of LLM judges collectively discuss and determine the winner, which alleviates bias and promotes fairness. In our extensive experiment on the 17 newest LLMs, Auto-Arena shows the highest correlation with human preferences, providing a promising alternative to human evaluation platforms.


title: On Morita equivalences with endopermutation source and isotypies

abstract: We introduce a new type of equivalence between blocks of finite group algebras called an almost isotypy. An almost isotypy restricts to a weak isotypy in Brou\'{e}'s original definition, and it is slightly weaker than Linckelmann's version. We show that a bimodule of two block algebras of finite groups - which has an endopermutation module as a source and which induces a Morita equivalence - gives rise to an almost isotypy if and only if the character values of a (hence any) source are rational integers. This generalises a previous result of Huang and Zhou. Consequently, if two blocks are Morita equivalent via a bimodule with endopermutation source, then they are almost isotypic.


title: IsraParlTweet: The Israeli Parliamentary and Twitter Resource

abstract: We introduce IsraParlTweet, a new linked corpus of Hebrew-language parliamentary discussions from the Knesset (Israeli Parliament) between the years 1992-2023 and Twitter posts made by Members of the Knesset between the years 2008-2023, containing a total of 294.5 million Hebrew tokens. In addition to raw text, the corpus contains comprehensive metadata on speakers and Knesset sessions as well as several linguistic annotations. As a result, IsraParlTweet can be used to conduct a wide variety of quantitative and qualitative analyses and provide valuable insights into political discourse in Israel.


title: Bridging electronic and classical density-functional theory using universal machine-learned functional approximations

abstract: The accuracy of density-functional theory (DFT) is determined by the quality of the approximate functionals, such as exchange-correlation in electronic DFT and the excess functional in the classical DFT formalism of fluids. The exact functional is highly nonlocal for both electrons and fluids, yet most approximate functionals are semi-local or nonlocal in a limited weighted-density form. Machine-learned (ML) nonlocal density-functional approximations are promising in both electronic and classical DFT, but have so far employed disparate approaches with limited generality. Here, we formulate a universal approximation framework and training protocol for nonlocal ML functionals, combining features of equivariant convolutional neural networks and the weighted-density approximation. We prototype this approach for several 1D and quasi-1D problems and demonstrate that a functional with exactly the same hyperparameters achieves excellent accuracy for the hard-rod fluid, the inhomogeneous Ising model, the exact exchange functional for electrons, the electron kinetic energy functional for orbital-free DFT, as well as for liquid water with 1D inhomogeneities. These results lay the foundation for a universal ML approach to exact 3D functionals spanning electronic and classical DFT.


title: ETHER: Efficient Finetuning of Large-Scale Models with Hyperplane Reflections

abstract: Parameter-efficient finetuning (PEFT) has become ubiquitous to adapt foundation models to downstream task requirements while retaining their generalization ability. However, the amount of additionally introduced parameters and compute for successful adaptation and hyperparameter searches can explode quickly, especially when deployed at scale to serve numerous individual requests. To ensure effective, parameter-efficient, and hyperparameter-robust adaptation, we propose the ETHER transformation family, which performs Efficient fineTuning via HypErplane Reflections. By design, ETHER transformations require a minimal number of parameters, are less likely to deteriorate model performance, and exhibit robustness to hyperparameter and learning rate choices. In particular, we introduce ETHER and its relaxation ETHER+, which match or outperform existing PEFT methods with significantly fewer parameters ($\sim$$10$-$100$ times lower than LoRA or OFT) across multiple image synthesis and natural language tasks without exhaustive hyperparameter tuning. Finally, we investigate the recent emphasis on Hyperspherical Energy retention for adaptation and raise questions on its practical utility. The code is available at https://github.com/mwbini/ether.


title: Reconstruction Attacks on Machine Unlearning: Simple Models are Vulnerable

abstract: Machine unlearning is motivated by desire for data autonomy: a person can request to have their data's influence removed from deployed models, and those models should be updated as if they were retrained without the person's data. We show that, counter-intuitively, these updates expose individuals to high-accuracy reconstruction attacks which allow the attacker to recover their data in its entirety, even when the original models are so simple that privacy risk might not otherwise have been a concern. We show how to mount a near-perfect attack on the deleted data point from linear regression models. We then generalize our attack to other loss functions and architectures, and empirically demonstrate the effectiveness of our attacks across a wide range of datasets (capturing both tabular and image data). Our work highlights that privacy risk is significant even for extremely simple model classes when individuals can request deletion of their data from the model.


title: Arbitrary State Preparation via Quantum Walks

abstract: Continuous-time quantum walks (CTQWs) on dynamic graphs, referred to as dynamic CTQWs, are a recently introduced universal model of computation that offers a new paradigm in which to envision quantum algorithms. In this work we develop a mapping from dynamic CTQWs to the gate model of computation in the form of an algorithm to convert arbitrary single edge walks and single self loop walks, which are the fundamental building blocks of dynamic CTQWs, to their circuit model counterparts. We use this mapping to introduce an arbitrary quantum state preparation framework based on dynamic CTQWs. Our approach utilizes global information about the target state, relates state preparation to finding the optimal path in a graph, and leads to optimizations in the reduction of controls that are not as obvious in other approaches. Interestingly, classical optimization problems such as the minimal hitting set, minimum spanning tree, and shortest Hamiltonian path problems arise in our framework. We test our methods against uniformly controlled rotations methods, used by Qiskit, and find ours requires fewer CX gates when the target state has a polynomial number of non-zero amplitudes.


title: ROAST: Review-level Opinion Aspect Sentiment Target Joint Detection

abstract: Aspect-Based Sentiment Analysis (ABSA) has experienced tremendous expansion and diversity due to various shared tasks spanning several languages and fields and organized via SemEval workshops and Germeval. Nonetheless, a few shortcomings still need to be addressed, such as the lack of low-resource language evaluations and the emphasis on sentence-level analysis. To thoroughly assess ABSA techniques in the context of complete reviews, this research presents a novel task, Review-Level Opinion Aspect Sentiment Target (ROAST). ROAST seeks to close the gap between sentence-level and text-level ABSA by identifying every ABSA constituent at the review level. We extend the available datasets to enable ROAST, addressing the drawbacks noted in previous research by incorporating low-resource languages, numerous languages, and a variety of topics. Through this effort, ABSA research will be able to cover more ground and get a deeper comprehension of the task and its practical application in a variety of languages and domains (https://github.com/RiTUAL-UH/ROAST-ABSA).


title: Enhanced Duality in 4D Supergravity

abstract: U-duality imposes strong constraints on the structure of divergences in supergravity. But Gaillard-Zumino Sp$(2n_v, \mathbb{R})$ duality in D=4 has more symmetries than U-duality. For example, in $N = 8$ the dimension of Sp(56) is 1596, whereas its U-duality subgroup $E_{7(7)}$ has a dimension of 133. In comparison, in D $> 4$ maximal dualities are U-dualities. We argue that the extra dualities in 4D, enhancing U-duality, determine the properties of perturbative quantum supergravity. The presence/absence of enhanced dualities suggests a possible explanation of the results of the amplitude loop computations in D-dimensional supergravities and of the special status of D = 4 in this respect.


title: Proof of the Diaconis--Freedman Conjecture on partially-exchangeable processes

abstract: We prove a conjecture of Diaconis and Freedman (Ann. Probab. 1980) characterising the extreme points of the set of partially-exchangeable processes on a countable set. More concretely, we prove that the partially exchangeable sigma-algebra of any transient partially exchangeable process $X=(X_i)_{i\geq 0}$ (and hence any transient Markov chain) coincides up to null sets with the sigma-algebra generated by the initial state $X_0$ and the transition counts $( \#\{i\geq 0: X_i=x, X_{i+1}=y\} : x,y\in S)$. Our proof is based on an analysis of Gibbs measures for Eulerian paths on rooted digraphs, relying in particular on the connection to uniform spanning trees and Wilson's algorithm via the de Bruijn--Ehrenfest--Smith--Tutte (BEST) bijection, and yields an explicit method to sample from the conditional distribution of a transient Markov chain given its transition counts.


title: Pre-train and Refine: Towards Higher Efficiency in K-Agnostic Community Detection without Quality Degradation

abstract: Community detection (CD) is a classic graph inference task that partitions nodes of a graph into densely connected groups. While many CD methods have been proposed with either impressive quality or efficiency, balancing the two aspects remains a challenge. This study explores the potential of deep graph learning to achieve a better trade-off between the quality and efficiency of K-agnostic CD, where the number of communities K is unknown. We propose PRoCD (Pre-training & Refinement fOr Community Detection), a simple yet effective method that reformulates K-agnostic CD as the binary node pair classification. PRoCD follows a pre-training & refinement paradigm inspired by recent advances in pre-training techniques. We first conduct the offline pre-training of PRoCD on small synthetic graphs covering various topology properties. Based on the inductive inference across graphs, we then generalize the pre-trained model (with frozen parameters) to large real graphs and use the derived CD results as the initialization of an existing efficient CD method (e.g., InfoMap) to further refine the quality of CD results. In addition to benefiting from the transfer ability regarding quality, the online generalization and refinement can also help achieve high inference efficiency, since there is no time-consuming model optimization. Experiments on public datasets with various scales demonstrate that PRoCD can ensure higher efficiency in K-agnostic CD without significant quality degradation.


title: Length independent generalization bounds for deep SSM architectures with stability constraints

abstract: Many state-of-the-art models trained on long-range sequences, for example S4, S5 or LRU, are made of sequential blocks combining State-Space Models (SSMs) with neural networks. In this paper we provide a PAC bound that holds for these kind of architectures with stable SSM blocks and does not depend on the length of the input sequence. Imposing stability of the SSM blocks is a standard practice in the literature, and it is known to help performance. Our results provide a theoretical justification for the use of stable SSM blocks as the proposed PAC bound decreases as the degree of stability of the SSM blocks increases.


title: CV-VAE: A Compatible Video VAE for Latent Generative Video Models

abstract: Spatio-temporal compression of videos, utilizing networks such as Variational Autoencoders (VAE), plays a crucial role in OpenAI's SORA and numerous other video generative models. For instance, many LLM-like video models learn the distribution of discrete tokens derived from 3D VAEs within the VQVAE framework, while most diffusion-based video models capture the distribution of continuous latent extracted by 2D VAEs without quantization. The temporal compression is simply realized by uniform frame sampling which results in unsmooth motion between consecutive frames. Currently, there lacks of a commonly used continuous video (3D) VAE for latent diffusion-based video models in the research community. Moreover, since current diffusion-based approaches are often implemented using pre-trained text-to-image (T2I) models, directly training a video VAE without considering the compatibility with existing T2I models will result in a latent space gap between them, which will take huge computational resources for training to bridge the gap even with the T2I models as initialization. To address this issue, we propose a method for training a video VAE of latent video models, namely CV-VAE, whose latent space is compatible with that of a given image VAE, e.g., image VAE of Stable Diffusion (SD). The compatibility is achieved by the proposed novel latent space regularization, which involves formulating a regularization loss using the image VAE. Benefiting from the latent space compatibility, video models can be trained seamlessly from pre-trained T2I or video models in a truly spatio-temporally compressed latent space, rather than simply sampling video frames at equal intervals. With our CV-VAE, existing video models can generate four times more frames with minimal finetuning. Extensive experiments are conducted to demonstrate the effectiveness of the proposed video VAE.


title: Quarkonium Polarization in Medium from Open Quantum Systems and Chromomagnetic Correlators

abstract: We study the spin-dependent in-medium dynamics of quarkonia by using the potential nonrelativistic QCD (pNRQCD) and the open quantum system framework. We consider the pNRQCD Lagrangian valid up to the order $\frac{r}{M^0}=r$ and $\frac{r^0}{M}=\frac{1}{M}$ in the double power counting. By considering the Markovian condition and applying the Wigner transformation upon the diagonal spin components of the quarkonium density matrix with the semiclassical expansion, we systematically derive the Boltzmann transport equation for quarkonia with polarization dependence in the quantum optical limit. Unlike the spin-independent collision terms governed by certain chromoelectric field correlators, new gauge invariant correlators of chromomagnetic fields determine the recombination and dissociation terms with polarization dependence at the order we are working. We also derive a Lindblad equation describing the in-medium transitions between spin-singlet and spin-triplet heavy quark-antiquark pairs in the quantum Brownian motion limit. The Lindblad equation is governed by new transport coefficients defined in terms of the chromomagnetic field correlators. Our formalism is generic and valid for both weakly-coupled and strongly-coupled quark gluon plasmas. It can be further applied to study spin alignment of vector quarkonia in heavy ion collisions.


title: Tight Characterizations for Preprocessing against Cryptographic Salting

abstract: Cryptography often considers the strongest yet plausible attacks in the real world. Preprocessing (a.k.a. non-uniform attack) plays an important role in both theory and practice: an efficient online attacker can take advantage of advice prepared by a time-consuming preprocessing stage. Salting is a heuristic strategy to counter preprocessing attacks by feeding a small amount of randomness to the cryptographic primitive. We present general and tight characterizations of preprocessing against cryptographic salting, with upper bounds matching the advantages of the most intuitive attack. Our result quantitatively strengthens the previous work by Coretti, Dodis, Guo, and Steinberger (EUROCRYPT'18). Our proof exploits a novel connection between the non-uniform security of salted games and direct product theorems for memoryless algorithms. For quantum adversaries, we give similar characterizations for property finding games, resolving an open problem of the quantum non-uniform security of salted collision resistant hash by Chung, Guo, Liu, and Qian (FOCS'20). Our proof extends the compressed oracle framework of Zhandry (CRYPTO'19) to prove quantum strong direct product theorems for property finding games in the average-case hardness.


title: SemFlow: Binding Semantic Segmentation and Image Synthesis via Rectified Flow

abstract: Semantic segmentation and semantic image synthesis are two representative tasks in visual perception and generation. While existing methods consider them as two distinct tasks, we propose a unified diffusion-based framework (SemFlow) and model them as a pair of reverse problems. Specifically, motivated by rectified flow theory, we train an ordinary differential equation (ODE) model to transport between the distributions of real images and semantic masks. As the training object is symmetric, samples belonging to the two distributions, images and semantic masks, can be effortlessly transferred reversibly. For semantic segmentation, our approach solves the contradiction between the randomness of diffusion outputs and the uniqueness of segmentation results. For image synthesis, we propose a finite perturbation approach to enhance the diversity of generated results without changing the semantic categories. Experiments show that our SemFlow achieves competitive results on semantic segmentation and semantic image synthesis tasks. We hope this simple framework will motivate people to rethink the unification of low-level and high-level vision. Project page: https://github.com/wang-chaoyang/SemFlow.


title: TetSphere Splatting: Representing High-Quality Geometry with Lagrangian Volumetric Meshes

abstract: We present TetSphere splatting, an explicit, Lagrangian representation for reconstructing 3D shapes with high-quality geometry. In contrast to conventional object reconstruction methods which predominantly use Eulerian representations, including both neural implicit (e.g., NeRF, NeuS) and explicit representations (e.g., DMTet), and often struggle with high computational demands and suboptimal mesh quality, TetSphere splatting utilizes an underused but highly effective geometric primitive -- tetrahedral meshes. This approach directly yields superior mesh quality without relying on neural networks or post-processing. It deforms multiple initial tetrahedral spheres to accurately reconstruct the 3D shape through a combination of differentiable rendering and geometric energy optimization, resulting in significant computational efficiency. Serving as a robust and versatile geometry representation, Tet-Sphere splatting seamlessly integrates into diverse applications, including single-view 3D reconstruction, image-/text-to-3D content generation. Experimental results demonstrate that TetSphere splatting outperforms existing representations, delivering faster optimization speed, enhanced mesh quality, and reliable preservation of thin structures.


title: Fock's dimer model on the Aztec diamond

abstract: We consider the dimer model on the Aztec diamond with Fock's weights, which is gauge equivalent to the model with any choice of positive weight function. We prove an explicit, compact formula for the inverse Kasteleyn matrix, thus extending numerous results in the case of periodic graphs. We also show an explicit product formula for the partition function; as a specific instance of the genus 0 case, we recover Stanley's formula. We then use our explicit formula for the inverse Kasteleyn matrix to recover, in a simple way, limit shape results; we also obtain new ones. In doing so, we extend the correspondence between the limit shape and the amoeba of the corresponding spectral curve of arXiv:2306.07482 to the case of non-generic weights.


title: Who Writes the Review, Human or AI?

abstract: With the increasing use of Artificial Intelligence in Natural Language Processing, concerns have been raised regarding the detection of AI-generated text in various domains. This study aims to investigate this issue by proposing a methodology to accurately distinguish AI-generated and human-written book reviews. Our approach utilizes transfer learning, enabling the model to identify generated text across different topics while improving its ability to detect variations in writing style and vocabulary. To evaluate the effectiveness of the proposed methodology, we developed a dataset consisting of real book reviews and AI-generated reviews using the recently proposed Vicuna open-source language model. The experimental results demonstrate that it is feasible to detect the original source of text, achieving an accuracy rate of 96.86%. Our efforts are oriented toward the exploration of the capabilities and limitations of Large Language Models in the context of text identification. Expanding our knowledge in these aspects will be valuable for effectively navigating similar models in the future and ensuring the integrity and authenticity of human-generated content.


title: Monogamy of Nonlocal Games

abstract: Our study explores multipartite nonlocality by extending $2$-player nonlocal games to multiplayer games, where the players are positioned across the vertices of a graph. We characterize when $2$-player games cannot violate Bell nonlocality on graphs with more than $2$ vertices. Using similar techniques, we show the CHSH game only exhibits nonlocality in two distributed scenarios: the original 2-player game and the 4-player game on the path graph. In contrast, several other well-studied games have no such violations on larger graphs. Lastly, we provide a $2$-player game that exhibits nonlocality on infinitely many graphs.


title: Flexible SE(2) graph neural networks with applications to PDE surrogates

abstract: This paper presents a novel approach for constructing graph neural networks equivariant to 2D rotations and translations and leveraging them as PDE surrogates on non-gridded domains. We show that aligning the representations with the principal axis allows us to sidestep many constraints while preserving SE(2) equivariance. By applying our model as a surrogate for fluid flow simulations and conducting thorough benchmarks against non-equivariant models, we demonstrate significant gains in terms of both data efficiency and accuracy.

categories: cs.LG cs.AI cs.NA math.NA physics.flu-dyn


title: A family of cyclic quartic monogenic polynomials

abstract: We produce an explicit family of totally real cyclic quartic polynomials that are monogenic in many cases, and conjecturally are monogenic and generating distinct quartic fields infinitely often.


title: DITTO-2: Distilled Diffusion Inference-Time T-Optimization for Music Generation

abstract: Controllable music generation methods are critical for human-centered AI-based music creation, but are currently limited by speed, quality, and control design trade-offs. Diffusion Inference-Time T-optimization (DITTO), in particular, offers state-of-the-art results, but is over 10x slower than real-time, limiting practical use. We propose Distilled Diffusion Inference-Time T -Optimization (or DITTO-2), a new method to speed up inference-time optimization-based control and unlock faster-than-real-time generation for a wide-variety of applications such as music inpainting, outpainting, intensity, melody, and musical structure control. Our method works by (1) distilling a pre-trained diffusion model for fast sampling via an efficient, modified consistency or consistency trajectory distillation process (2) performing inference-time optimization using our distilled model with one-step sampling as an efficient surrogate optimization task and (3) running a final multi-step sampling generation (decoding) using our estimated noise latents for best-quality, fast, controllable generation. Through thorough evaluation, we find our method not only speeds up generation over 10-20x, but simultaneously improves control adherence and generation quality all at once. Furthermore, we apply our approach to a new application of maximizing text adherence (CLAP score) and show we can convert an unconditional diffusion model without text inputs into a model that yields state-of-the-art text control. Sound examples can be found at https://ditto-music.github.io/ditto2/.


title: Fermi-Level Pinning of Yu-Shiba-Rusinov States in Weak Magnetic Field

abstract: As is well known, magnetic impurities adsorbed on superconductors, e.g. of the s-wave type, can introduce a bound gap-state (Yu-Shiba-Rusinov resonance). We here investigate within a minimal model how the impurity moment arranges with respect to a weak homogeneous external magnetic field employing a fully self-consistent mean-field treatment. Our investigation reveals a critical window of impurity-to-substrate coupling constants, $J$. The width of the critical region, $\delta J$, scales like $\delta J \sim B/\Delta$, where $B$ is the magnitude of the external field and $\Delta$ is the bulk order parameter. While tuning $J$ through the window, the energy of the Yu-Shiba-Rusinov (YSR) resonance is pinned to the Fermi energy $\varepsilon_\text{F}$ and the impurity moment rotates in a continuous fashion. We emphasize the pivotal role of self-consistency: In treatments ignoring self-consistency, the critical window adopts zero width, $\delta J=0$; consequently, there is no pinning of the YSR-resonance to $\varepsilon_\text{F}$, the impurity orientation jumps and therefore this orientation cannot be controlled continuously by fine-tuning the coupling $J$. In this sense, our study highlights the significance of self-consistency for understanding intricate magnetic interactions between superconductive materials and Shiba chains.


title: Unveiling and Mitigating Backdoor Vulnerabilities based on Unlearning Weight Changes and Backdoor Activeness

abstract: The security threat of backdoor attacks is a central concern for deep neural networks (DNNs). Recently, without poisoned data, unlearning models with clean data and then learning a pruning mask have contributed to backdoor defense. Additionally, vanilla fine-tuning with those clean data can help recover the lost clean accuracy. However, the behavior of clean unlearning is still under-explored, and vanilla fine-tuning unintentionally induces back the backdoor effect. In this work, we first investigate model unlearning from the perspective of weight changes and gradient norms, and find two interesting observations in the backdoored model: 1) the weight changes between poison and clean unlearning are positively correlated, making it possible for us to identify the backdoored-related neurons without using poisoned data; 2) the neurons of the backdoored model are more active (i.e., larger changes in gradient norm) than those in the clean model, suggesting the need to suppress the gradient norm during fine-tuning. Then, we propose an effective two-stage defense method. In the first stage, an efficient Neuron Weight Change (NWC)-based Backdoor Reinitialization is proposed based on observation 1). In the second stage, based on observation 2), we design an Activeness-Aware Fine-Tuning to replace the vanilla fine-tuning. Extensive experiments, involving eight backdoor attacks on three benchmark datasets, demonstrate the superior performance of our proposed method compared to recent state-of-the-art backdoor defense approaches.


title: All-Loop Geometry for Four-Point Correlation Function

abstract: In this letter, we consider a positive geometry conjectured to encode the loop integrand of four-point stress-energy correlators in planar $\mathcal{N}=4$ super Yang-Mills. Beginning with four lines in twistor space, we characterize a positive subspace to which an $\ell$-loop geometry is attached. The loop geometry then consists of $\ell$ lines in twistor space satisfying positivity conditions among themselves and with respect to the base. Consequently, the \textit{loop geometry} can be viewed as fibration over a \textit{tree geometry}. The fibration naturally dissects the base into chambers, in which the degree-$4 \ell$ loop form is unique and distinct for each chamber. Interestingly, up to three loops, the chambers are simply organized by the six ordering of $x^2_{12}x^2_{34}$, $x^2_{14}x^2_{23}$ and $x^2_{13}x^2_{24}$. We explicitly verify our conjecture by computing the loop-forms in terms of a basis of planar conformal integrals up to $\ell=3$, which indeed yield correct loop integrands for the four-point correlator.


title: Points of bounded height on quintic del Pezzo surfaces over number fields

abstract: We prove Manin's conjecture for split smooth quintic del Pezzo surfaces over arbitrary number fields with respect to fairly general anticanonical height functions. After passing to universal torsors, we first show that we may restrict the torsor variables to their typical sizes, and then we can solve the counting problem in the framework of o-minimal structures.


title: Multi-headed lattices and Green functions

abstract: Lattice geometries and random walks on them are of great interest for their applications in different fields such as physics, chemistry, and computer science. In this work, we focus on multi-headed lattices and study properties of the Green functions for these lattices such as the associated differential equations and the P\'olya numbers. In particular, we complete the analysis of three missing cases in dimensions no larger than five. Our results are built upon an automatic machinery of creative telescoping.


title: How (not) to Build Quantum PKE in Minicrypt

abstract: The seminal work by Impagliazzo and Rudich (STOC'89) demonstrated the impossibility of constructing classical public key encryption (PKE) from one-way functions (OWF) in a black-box manner. However, the question remains: can quantum PKE (QPKE) be constructed from quantumly secure OWF? A recent line of work has shown that it is indeed possible to build QPKE from OWF, but with one caveat -- they rely on quantum public keys, which cannot be authenticated and reused. In this work, we re-examine the possibility of perfect complete QPKE in the quantum random oracle model (QROM), where OWF exists. Our first main result: QPKE with classical public keys, secret keys and ciphertext, does not exist in the QROM, if the key generation only makes classical queries. Therefore, a necessary condition for constructing such QPKE from OWF is to have the key generation classically ``un-simulatable''. Previous discussions (Austrin et al. CRYPTO'22) on the impossibility of QPKE from OWF rely on a seemingly strong conjecture. Our work makes a significant step towards a complete and unconditional quantization of Impagliazzo and Rudich's results. Our second main result extends to QPKE with quantum public keys. The second main result: QPKE with quantum public keys, classical secret keys and ciphertext, does not exist in the QROM, if the key generation only makes classical queries and the quantum public key is either pure or ``efficiently clonable''. The result is tight due to all existing QPKEs constructions. Our result further gives evidence on why existing QPKEs lose reusability. To achieve these results, we use a novel argument based on conditional mutual information and quantum Markov chain by Fawzi and Renner (Communications in Mathematical Physics). We believe the techniques used in the work will find other usefulness in separations in quantum cryptography/complexity.


title: Critical metrology of minimally accessible anisotropic spin chains

abstract: We address quantum metrology in critical spin chains with anisotropy and Dzyaloshinskii-Moriya (DM) interaction, and show how local and quasi-local measurements may be exploited to characterize global properties of the systems. In particular, we evaluate the classical (magnetization) and quantum Fisher information of the relevant parameters for the density matrix of a single spin and that of a pair of spins ranging from nearest to sixth-nearest neighbors, to the limiting case of very distant spins. Our results allow us to elucidate the role of the different parameters and to individuate the optimal working regimes for the precise characterization of the system, also clarifying the effects of correlations on the estimation precision.


title: Gaussian factors, spectra, and $P$-entropy

abstract: There is a set of continual cardinality of pairwise disjoint Gaussian automorphisms with spectrally isomorphic even factors having Lebesgue spectrum.


title: Representation Theory for Massless Quasiparticles in Bogoliubov-de Gennes Systems

abstract: Gapless quasiparticles can exist in the Bogoliubov-de Gennes (BdG) Hamiltonians in the mean field description of superconductors (SCs), fermionic superfluids (SFs) and quantum spin liquids (QSLs). The mechanism of gapless quasiparticles in superconductors was studied in literature based on the homotopy theory or symmetry-indicators. However, important properties of the gapless quasiparticles including the degeneracy, the energy-momentum dispersion and the responses to external probe fields need to be determined. In the present work, we investigate gapless quasiparticles in general BdG systems by using projective representation theory for the full `symmetry' groups formed by combinations of lattice, spin and charge operations. We find that (I) charge conjugation (or effective charge conjugation) symmetry can yield gapless quasiparticles with linear, quadratic or higher order dispersions at high symmetry points of the Brillouin zone; (II) different quantum numbers protected level crossing can give rise to zero modes along high symmetry lines; (III) combined spatial inversion and time reversal symmetry can protect zero modes appearing at generic $k$ points. To obtain the low energy properties of gapless quasiparticles, the $k\cdot p$ theory is provided using a high efficient method--the Hamiltonian approach. Based on generalized band representation theory for BdG systems, several lattice models are constructed to illustrate the above results. Our theory provides a method to classify nodal SCs/SFs/QSLs with given symmetries, and enlightens the realization of Majorana type massless quasiparticles in condensed matter physics.


title: Scaling White-Box Transformers for Vision

abstract: CRATE, a white-box transformer architecture designed to learn compressed and sparse representations, offers an intriguing alternative to standard vision transformers (ViTs) due to its inherent mathematical interpretability. Despite extensive investigations into the scaling behaviors of language and vision transformers, the scalability of CRATE remains an open question which this paper aims to address. Specifically, we propose CRATE-$\alpha$, featuring strategic yet minimal modifications to the sparse coding block in the CRATE architecture design, and a light training recipe designed to improve the scalability of CRATE. Through extensive experiments, we demonstrate that CRATE-$\alpha$ can effectively scale with larger model sizes and datasets. For example, our CRATE-$\alpha$-B substantially outperforms the prior best CRATE-B model accuracy on ImageNet classification by 3.7%, achieving an accuracy of 83.2%. Meanwhile, when scaling further, our CRATE-$\alpha$-L obtains an ImageNet classification accuracy of 85.1%. More notably, these model performance improvements are achieved while preserving, and potentially even enhancing the interpretability of learned CRATE models, as we demonstrate through showing that the learned token representations of increasingly larger trained CRATE-$\alpha$ models yield increasingly higher-quality unsupervised object segmentation of images. The project page is https://rayjryang.github.io/CRATE-alpha/.


title: Kemeny's constant and the Lemoine point of a simplex

abstract: Kemeny's constant is an invariant of discrete-time Markov chains, equal to the expected number of steps between two states sampled from the stationary distribution. It appears in applications as a concise characterization of the mixing properties of a Markov chain and has many alternative definitions. In this short article, we derive a new geometric expression for Kemeny's constant, which involves the distance between two points in a simplex associated to the Markov chain: the circumcenter and the Lemoine point. Our proof uses an expression due to Wang, Dubbeldam and Van Mieghem of Kemeny's constant in terms of effective resistances and Fiedler's interpretation of effective resistances as edge lengths of a simplex.


title: Quantization commutes with reduction again: the quantum GIT conjecture I

abstract: For a compact monotone symplectic manifold $X$ with Hamiltonian action of a compact Lie group $G$ and smooth symplectic reduction, we relate its gauged $2$-dimensional $A$-model to the $A$-model of $X/\!/G$. This (long conjectured) result is parallel to the ($B$-model!) \emph{quantization commutes with reduction} theorem of Guillemin and Sternberg in quantum mechanics. Here, we spell out some of the precise statements, and outline the proof of equality for the spaces of states (quantum cohomology). We also indicate the way to some related results in the non-monotone case. Additional Floer theory details will be included in a follow-up paper.


title: Summer Amplification of Wind Stilling and Land Warming Compounds Energy Risks in a Changing Climate

abstract: Wind energy is key for reducing greenhouse gas emissions and meeting increasing energy demand. Long-term changes in wind resources were extensively studied but notable gaps remain. Meanwhile, the temporal changes and compounding risks received little attention. Here we analyze large-ensemble climate simulations and show that anthropogenic warming can contribute to significant wind stilling, particularly in the warm season of the northern hemisphere midlatitudes. The stilling is related to the amplified warming of the midlatitude land and mid-to-upper troposphere. At representative US sites, the stilling will unlikely threaten the cost-competitiveness of onshore wind relative to fossil energy. However, its impact can exceed a large interest increase and make wind energy less cost-competitive than other clean energy. Moreover, the summertime stilling coincides with surging cooling demand in the midlatitudes and may bring challenges to energy security. The findings about wind stilling and its implications may help inform future energy investments.


title: Truthful Budget Aggregation: Beyond Moving-Phantom Mechanisms

abstract: We study a budget-aggregation setting in which a number of voters report their ideal distribution of a budget over a set of alternatives, and a mechanism aggregates these reports into an allocation. Ideally, such mechanisms are truthful, i.e., voters should not be incentivized to misreport their preferences. For the case of two alternatives, the set of mechanisms that are truthful and additionally meet a range of basic desiderata (anonymity, neutrality, and continuity) exactly coincides with the so-called moving-phantom mechanisms, but whether this space is richer for more alternatives was repeatedly stated as an open question. We answer this question in the affirmative by presenting a new mechanism that is not a moving-phantom mechanism but satisfies the four properties. Since moving-phantom mechanisms can only provide limited fairness guarantees (measured as the worst-case distance to a fair share solution), one motivation for broadening the class of truthful mechanisms is the hope for improved fairness guarantees. We dispel this hope by showing that lower bounds holding for the class of moving-phantom mechanisms extend to all truthful, anonymous, neutral, and continuous mechanisms.


title: Group Robust Preference Optimization in Reward-free RLHF

abstract: Adapting large language models (LLMs) for specific tasks usually involves fine-tuning through reinforcement learning with human feedback (RLHF) on preference data. While these data often come from diverse labelers' groups (e.g., different demographics, ethnicities, company teams, etc.), traditional RLHF approaches adopt a "one-size-fits-all" approach, i.e., they indiscriminately assume and optimize a single preference model, thus not being robust to unique characteristics and needs of the various groups. To address this limitation, we propose a novel Group Robust Preference Optimization (GRPO) method to align LLMs to individual groups' preferences robustly. Our approach builds upon reward-free direct preference optimization methods, but unlike previous approaches, it seeks a robust policy which maximizes the worst-case group performance. To achieve this, GRPO adaptively and sequentially weights the importance of different groups, prioritizing groups with worse cumulative loss. We theoretically study the feasibility of GRPO and analyze its convergence for the log-linear policy class. By fine-tuning LLMs with GRPO using diverse group-based global opinion data, we significantly improved performance for the worst-performing groups, reduced loss imbalances across groups, and improved probability accuracies compared to non-robust baselines.


title: Can't make an Omelette without Breaking some Eggs: Plausible Action Anticipation using Large Video-Language Models

abstract: We introduce PlausiVL, a large video-language model for anticipating action sequences that are plausible in the real-world. While significant efforts have been made towards anticipating future actions, prior approaches do not take into account the aspect of plausibility in an action sequence. To address this limitation, we explore the generative capability of a large video-language model in our work and further, develop the understanding of plausibility in an action sequence by introducing two objective functions, a counterfactual-based plausible action sequence learning loss and a long-horizon action repetition loss. We utilize temporal logical constraints as well as verb-noun action pair logical constraints to create implausible/counterfactual action sequences and use them to train the model with plausible action sequence learning loss. This loss helps the model to differentiate between plausible and not plausible action sequences and also helps the model to learn implicit temporal cues crucial for the task of action anticipation. The long-horizon action repetition loss puts a higher penalty on the actions that are more prone to repetition over a longer temporal window. With this penalization, the model is able to generate diverse, plausible action sequences. We evaluate our approach on two large-scale datasets, Ego4D and EPIC-Kitchens-100, and show improvements on the task of action anticipation.


title: A consistency test of the cosmological model at the epoch of recombination using DESI BAO and Planck measurements

abstract: The value of the Hubble constant determined from CMB and BAO measurements is directly dependent on the sound horizon at the photon-baryon decoupling. There has been significant interest in the possibility of new physics at the epoch around recombination that could reduce the sound horizon and increase the inferred value of $H_0$, thus helping to relieve the Hubble tension. One way to determine if new physics is required would be to measure $H_0$ from BAO and CMB without assuming any model for computing the sound horizon. In this study, we use the recently released DESI Year 1 BAO data combined with the CMB acoustic scale $\theta_\star$ and the Planck $\Lambda$CDM prior on $\Omega_{\rm m} h^2$ to determine $H_0$ while treating the sound horizon at baryon decoupling $r_{\rm d}$ as a free parameter. We find $H_0=69.88 \pm 0.93$ km/s/Mpc, which is $\sim2\sigma$ larger than $H_0 = 67.44 \pm 0.47$ km/s/Mpc in the Planck-best-fit $\Lambda$CDM where $r_{\rm d}$ is derived using the standard recombination model. For comparison, we perform the same analysis using the pre-DESI BAO data with $\theta_\star$ and the same prior on $\Omega_{\rm m} h^2$, finding $H_0= 67.37 \pm 0.96$ km/s/Mpc. This difference derives from the notably larger value of the product $r_{\rm d}H_0$ measured by DESI. Future BAO data from DESI will help determine if the cosmological model at the epoch of recombination model requires a modification.


title: Variational Mapping of Chern Bands to Landau Levels: Application to Fractional Chern Insulators in Twisted MoTe$_2$

abstract: We present a theoretical study of mapping between Chern bands and generalized Landau levels in twisted bilayer MoTe$_2$, where fractional Chern insulators have been observed. We construct an exact Landau-level representation of moir\'e bands, where the bases are derived from Landau-level wavefunctions dressed by spinors aligned or antialigned with the layer pseudospin skyrmion field and maintain uniform quantum geometry. We further generalize the dressed zeroth Landau level to a variational wavefunction with an ideal yet nonuniform quantum geometry and variationally maximize its weight in the first moir\'e band. The variational wavefunction quantitatively reproduces the exact diagonalization spectra of fractional Chern insulators at hole-filling factors $\nu_h=2/3$ and $3/5$ across a large twist-angle range. Our work introduces a new approach to studying fractional states by bridging the gap between Chern bands and Landau levels.


title: On the Spielman-Teng Conjecture

abstract: Let $M$ be an $n\times n$ matrix with iid subgaussian entries with mean $0$ and variance $1$ and let $\sigma_n(M)$ denote the least singular value of $M$. We prove that \[\mathbb{P}\big( \sigma_{n}(M) \leq \varepsilon n^{-1/2} \big) = (1+o(1)) \varepsilon + e^{-\Omega(n)}\] for all $0 \leq \varepsilon \ll 1$. This resolves, up to a $1+o(1)$ factor, a seminal conjecture of Spielman and Teng.


title: Large Language Models Can Self-Improve At Web Agent Tasks

abstract: Training models to act as agents that can effectively navigate and perform actions in a complex environment, such as a web browser, has typically been challenging due to lack of training data. Large language models (LLMs) have recently demonstrated some capability to navigate novel environments as agents in a zero-shot or few-shot fashion, purely guided by natural language instructions as prompts. Recent research has also demonstrated LLMs have the capability to exceed their base performance through self-improvement, i.e. fine-tuning on data generated by the model itself. In this work, we explore the extent to which LLMs can self-improve their performance as agents in long-horizon tasks in a complex environment using the WebArena benchmark. In WebArena, an agent must autonomously navigate and perform actions on web pages to achieve a specified objective. We explore fine-tuning on three distinct synthetic training data mixtures and achieve a 31\% improvement in task completion rate over the base model on the WebArena benchmark through a self-improvement procedure. We additionally contribute novel evaluation metrics for assessing the performance, robustness, capabilities, and quality of trajectories of our fine-tuned agent models to a greater degree than simple, aggregate-level benchmark scores currently used to measure self-improvement.


title: A Pixel Is Worth More Than One 3D Gaussians in Single-View 3D Reconstruction

abstract: Learning 3D scene representation from a single-view image is a long-standing fundamental problem in computer vision, with the inherent ambiguity in predicting contents unseen from the input view. Built on the recently proposed 3D Gaussian Splatting (3DGS), the Splatter Image method has made promising progress on fast single-image novel view synthesis via learning a single 3D Gaussian for each pixel based on the U-Net feature map of an input image. However, it has limited expressive power to represent occluded components that are not observable in the input view. To address this problem, this paper presents a Hierarchical Splatter Image method in which a pixel is worth more than one 3D Gaussians. Specifically, each pixel is represented by a parent 3D Gaussian and a small number of child 3D Gaussians. Parent 3D Gaussians are learned as done in the vanilla Splatter Image. Child 3D Gaussians are learned via a lightweight Multi-Layer Perceptron (MLP) which takes as input the projected image features of a parent 3D Gaussian and the embedding of a target camera view. Both parent and child 3D Gaussians are learned end-to-end in a stage-wise way. The joint condition of input image features from eyes of the parent Gaussians and the target camera position facilitates learning to allocate child Gaussians to ``see the unseen'', recovering the occluded details that are often missed by parent Gaussians. In experiments, the proposed method is tested on the ShapeNet-SRN and CO3D datasets with state-of-the-art performance obtained, especially showing promising capabilities of reconstructing occluded contents in the input view.


title: Martingale central limit theorem for random multiplicative functions

abstract: Let $\alpha$ be a Steinhaus or a Rademacher random multiplicative function. For a wide class of multiplicative functions $f$ we show that the sum $\sum_{n \le x}\alpha(n) f(n)$, normalised to have mean square $1$, has a non-Gaussian limiting distribution. More precisely, we establish a generalised central limit theorem with random variance determined by the total mass of a random measure associated with $\alpha f$. Our result applies to $d_z$, the $z$-th divisor function, as long as $z$ is strictly between $0$ and $\tfrac{1}{\sqrt{2}}$. Other examples of admissible $f$-s include any multiplicative indicator function with the property that $f(p)=1$ holds for a set of primes of density strictly between $0$ and $\tfrac{1}{2}$.


title: Active Dwarf Galaxy Database I: Overlap between active galactic nuclei selected by different techniques

abstract: We assemble a sample of 733 dwarf galaxies ($M_{\ast} \le 10^{9.5} \text{M}_\odot$) with signatures of active galactic nuclei (AGN) and explore the intersection between different AGN selection techniques. Objects in our database are compiled from previous studies that identify AGN in dwarf galaxies through spectroscopy, X-ray emission, infrared colors, and optical photometric variability. We apply a uniform set of AGN diagnostic tools to the database using archival data. We find that any single selection method captures no more than half of the overall AGN population, and there is a general disagreement amongst the AGN selection methods in this stellar mass regime. The largest overlap between methods is found when both methods use optical spectroscopic data. In contrast, the populations of AGN intersect the least when comparing those methods that use photometric data at different wavelengths. These results can be used to better constrain the active fraction in dwarf galaxies, which is in turn an important constraint for black hole seed formation models. In a follow-up paper, we will explore links between the effectiveness of each selection technique and host galaxy properties.


title: Sequence-Augmented SE(3)-Flow Matching For Conditional Protein Backbone Generation

abstract: Proteins are essential for almost all biological processes and derive their diverse functions from complex 3D structures, which are in turn determined by their amino acid sequences. In this paper, we exploit the rich biological inductive bias of amino acid sequences and introduce FoldFlow-2, a novel sequence-conditioned SE(3)-equivariant flow matching model for protein structure generation. FoldFlow-2 presents substantial new architectural features over the previous FoldFlow family of models including a protein large language model to encode sequence, a new multi-modal fusion trunk that combines structure and sequence representations, and a geometric transformer based decoder. To increase diversity and novelty of generated samples -- crucial for de-novo drug design -- we train FoldFlow-2 at scale on a new dataset that is an order of magnitude larger than PDB datasets of prior works, containing both known proteins in PDB and high-quality synthetic structures achieved through filtering. We further demonstrate the ability to align FoldFlow-2 to arbitrary rewards, e.g. increasing secondary structures diversity, by introducing a Reinforced Finetuning (ReFT) objective. We empirically observe that FoldFlow-2 outperforms previous state-of-the-art protein structure-based generative models, improving over RFDiffusion in terms of unconditional generation across all metrics including designability, diversity, and novelty across all protein lengths, as well as exhibiting generalization on the task of equilibrium conformation sampling. Finally, we demonstrate that a fine-tuned FoldFlow-2 makes progress on challenging conditional design tasks such as designing scaffolds for the VHH nanobody.


title: S3D: A Simple and Cost-Effective Self-Speculative Decoding Scheme for Low-Memory GPUs

abstract: Speculative decoding (SD) has attracted a significant amount of research attention due to the substantial speedup it can achieve for LLM inference. However, despite the high speedups they offer, speculative decoding methods often achieve optimal performance on high-end devices or with a substantial GPU memory overhead. Given limited memory and the necessity of quantization, a high-performing model on a high-end GPU can slow down by up to 7 times. To this end, we propose Skippy Simultaneous Speculative Decoding (or S3D), a cost-effective self-speculative SD method based on simultaneous multi-token decoding and mid-layer skipping. When compared against recent effective open-source SD systems, our method has achieved one of the top performance-memory ratios while requiring minimal architecture changes and training data. Leveraging our memory efficiency, we created a smaller yet more effective SD model based on Phi-3. It is 1.4 to 2 times faster than the quantized EAGLE model and operates in half-precision while using less VRAM.


title: ANAH: Analytical Annotation of Hallucinations in Large Language Models

abstract: Reducing the `$\textit{hallucination}$' problem of Large Language Models (LLMs) is crucial for their wide applications. A comprehensive and fine-grained measurement of the hallucination is the first key step for the governance of this issue but is under-explored in the community. Thus, we present $\textbf{ANAH}$, a bilingual dataset that offers $\textbf{AN}$alytical $\textbf{A}$nnotation of $\textbf{H}$allucinations in LLMs within Generative Question Answering. Each answer sentence in our dataset undergoes rigorous annotation, involving the retrieval of a reference fragment, the judgment of the hallucination type, and the correction of hallucinated content. ANAH consists of ~12k sentence-level annotations for ~4.3k LLM responses covering over 700 topics, constructed by a human-in-the-loop pipeline. Thanks to the fine granularity of the hallucination annotations, we can quantitatively confirm that the hallucinations of LLMs progressively accumulate in the answer and use ANAH to train and evaluate hallucination annotators. We conduct extensive experiments on studying generative and discriminative annotators and show that, although current open-source LLMs have difficulties in fine-grained hallucination annotation, the generative annotator trained with ANAH can surpass all open-source LLMs and GPT-3.5, obtain performance competitive with GPT-4, and exhibits better generalization ability on unseen questions.


title: The COS-Holes Survey: Connecting Galaxy Black Hole Mass with the State of the CGM

abstract: We present an analysis of \textit{HST}/COS/G160M observations of CIV in the inner circumgalactic medium (CGM) of a novel sample of eight z$\sim$0, L$\approx$L$^{\star}$ galaxies, paired with UV-bright QSOs at impact parameters ($R_\mathrm{proj}$) between 25-130 kpc. The galaxies in this stellar-mass-controlled sample (log$_{10}$M$_{\star}$/M$_{\odot}$ $\sim$ 10.2-10.9 M$_{\odot}$) host super-massive black holes (SMBHs) with dynamically-measured masses spanning log$_{10}$M$_\mathrm{BH}$/M$_{\odot}$ $\sim$ 6.8-8.4; this allows us to compare our results with models of galaxy formation where the integrated feedback history from the SMBH alters the CGM over long timescales. We find that the \ion{C}{IV} column density measurements (N$_{\rm C IV}$) (average log$_{10}$N$_{\rm C IV, CH}$ = 13.94$\pm$0.09 cm$^{-2}$) are largely consistent with existing measurements from other surveys of N$_{\rm C IV}$ in the CGM (average log$_{10}$N$_{\rm C IV, Lit}$ = 13.90$\pm$0.08 cm$^{-2}$), but do not show obvious variation as a function of the SMBH mass. In contrast, specific star-formation rate (sSFR) is highly correlated with the ionized content of the CGM. We find a large spread in sSFR for galaxies with log$_{10}$M$_\mathrm{BH}$/M$_{\odot}$ $>$ 7.0, where the CGM \ion{C}{IV} content shows clear dependence on galaxy sSFR but not M$_\mathrm{BH}$. Our results do not indicate an obvious causal link between CGM CIV and the mass of the galaxy's SMBH; however through comparisons to the EAGLE, Romulus25, $\&$ IllustrisTNG simulations, we find that our sample is likely too small to constrain such causality.


title: Analytic Kramer sampling and quasi Lagrange-type interpolation in vector valued RKHS

abstract: This paper discusses an abstract Kramer sampling theorem for functions within a reproducing kernel Hilbert space (RKHS) of vector valued holomorphic functions. Additionally, we extend the concept of quasi Lagrange-type interpolation for functions within a RKHS of vector valued entire functions. The dependence of having quasi Lagrange-type interpolation on an invariance condition under the generalized backward shift operator has also been discussed. Furthermore, the paper establishes the connection between quasi Lagrange-type interpolation, operator of multiplication by the independent variable, and de Branges spaces of vector valued entire functions.


title: CausalQuest: Collecting Natural Causal Questions for AI Agents

abstract: Humans have an innate drive to seek out causality. Whether fuelled by curiosity or specific goals, we constantly question why things happen, how they are interconnected, and many other related phenomena. To develop AI agents capable of addressing this natural human quest for causality, we urgently need a comprehensive dataset of natural causal questions. Unfortunately, existing datasets either contain only artificially-crafted questions that do not reflect real AI usage scenarios or have limited coverage of questions from specific sources. To address this gap, we present CausalQuest, a dataset of 13,500 naturally occurring questions sourced from social networks, search engines, and AI assistants. We formalize the definition of causal questions and establish a taxonomy for finer-grained classification. Through a combined effort of human annotators and large language models (LLMs), we carefully label the dataset. We find that 42% of the questions humans ask are indeed causal, with the majority seeking to understand the causes behind given effects. Using this dataset, we train efficient classifiers (up to 2.85B parameters) for the binary task of identifying causal questions, achieving high performance with F1 scores of up to 0.877. We conclude with a rich set of future research directions that can build upon our data and models.


title: ParSEL: Parameterized Shape Editing with Language

abstract: The ability to edit 3D assets from natural language presents a compelling paradigm to aid in the democratization of 3D content creation. However, while natural language is often effective at communicating general intent, it is poorly suited for specifying precise manipulation. To address this gap, we introduce ParSEL, a system that enables controllable editing of high-quality 3D assets from natural language. Given a segmented 3D mesh and an editing request, ParSEL produces a parameterized editing program. Adjusting the program parameters allows users to explore shape variations with a precise control over the magnitudes of edits. To infer editing programs which align with an input edit request, we leverage the abilities of large-language models (LLMs). However, while we find that LLMs excel at identifying initial edit operations, they often fail to infer complete editing programs, and produce outputs that violate shape semantics. To overcome this issue, we introduce Analytical Edit Propagation (AEP), an algorithm which extends a seed edit with additional operations until a complete editing program has been formed. Unlike prior methods, AEP searches for analytical editing operations compatible with a range of possible user edits through the integration of computer algebra systems for geometric analysis. Experimentally we demonstrate ParSEL's effectiveness in enabling controllable editing of 3D objects through natural language requests over alternative system designs.


title: Improving the Training of Rectified Flows

abstract: Diffusion models have shown great promise for image and video generation, but sampling from state-of-the-art models requires expensive numerical integration of a generative ODE. One approach for tackling this problem is rectified flows, which iteratively learn smooth ODE paths that are less susceptible to truncation error. However, rectified flows still require a relatively large number of function evaluations (NFEs). In this work, we propose improved techniques for training rectified flows, allowing them to compete with knowledge distillation methods even in the low NFE setting. Our main insight is that under realistic settings, a single iteration of the Reflow algorithm for training rectified flows is sufficient to learn nearly straight trajectories; hence, the current practice of using multiple Reflow iterations is unnecessary. We thus propose techniques to improve one-round training of rectified flows, including a U-shaped timestep distribution and LPIPS-Huber premetric. With these techniques, we improve the FID of the previous 2-rectified flow by up to 72% in the 1 NFE setting on CIFAR-10. On ImageNet 64$\times$64, our improved rectified flow outperforms the state-of-the-art distillation methods such as consistency distillation and progressive distillation in both one-step and two-step settings and rivals the performance of improved consistency training (iCT) in FID. Code is available at https://github.com/sangyun884/rfpp.


title: Vision-based Manipulation from Single Human Video with Open-World Object Graphs

abstract: We present an object-centric approach to empower robots to learn vision-based manipulation skills from human videos. We investigate the problem of imitating robot manipulation from a single human video in the open-world setting, where a robot must learn to manipulate novel objects from one video demonstration. We introduce ORION, an algorithm that tackles the problem by extracting an object-centric manipulation plan from a single RGB-D video and deriving a policy that conditions on the extracted plan. Our method enables the robot to learn from videos captured by daily mobile devices such as an iPad and generalize the policies to deployment environments with varying visual backgrounds, camera angles, spatial layouts, and novel object instances. We systematically evaluate our method on both short-horizon and long-horizon tasks, demonstrating the efficacy of ORION in learning from a single human video in the open world. Videos can be found in the project website https://ut-austin-rpl.github.io/ORION-release.


title: Quantum generalizations of Glauber and Metropolis dynamics

abstract: Classical Markov Chain Monte Carlo methods have been essential for simulating statistical physical systems and have proven well applicable to other systems with complex degrees of freedom. Motivated by the statistical physics origins, Chen, Kastoryano, and Gily\'en [CKG23] proposed a continuous-time quantum thermodynamic analog to Glauber dynamic that is (i) exactly detailed balanced, (ii) efficiently implementable, and (iii) quasi-local for geometrically local systems. Physically, their construction gives a smooth variant of the Davies' generator derived from weak system-bath interaction. In this work, we give an efficiently implementable discrete-time quantum counterpart to Metropolis sampling that also enjoys the desirable features (i)-(iii). Also, we give an alternative highly coherent quantum generalization of detailed balanced dynamics that resembles another physically derived master equation, and propose a smooth interpolation between this and earlier constructions. We study generic properties of all constructions, including the uniqueness of the fixed-point and the locality of the resulting operators. We hope our results provide a systematic approach to the possible quantum generalizations of classical Glauber and Metropolis dynamics.


title: $\textit{S}^3$Gaussian: Self-Supervised Street Gaussians for Autonomous Driving

abstract: Photorealistic 3D reconstruction of street scenes is a critical technique for developing real-world simulators for autonomous driving. Despite the efficacy of Neural Radiance Fields (NeRF) for driving scenes, 3D Gaussian Splatting (3DGS) emerges as a promising direction due to its faster speed and more explicit representation. However, most existing street 3DGS methods require tracked 3D vehicle bounding boxes to decompose the static and dynamic elements for effective reconstruction, limiting their applications for in-the-wild scenarios. To facilitate efficient 3D scene reconstruction without costly annotations, we propose a self-supervised street Gaussian ($\textit{S}^3$Gaussian) method to decompose dynamic and static elements from 4D consistency. We represent each scene with 3D Gaussians to preserve the explicitness and further accompany them with a spatial-temporal field network to compactly model the 4D dynamics. We conduct extensive experiments on the challenging Waymo-Open dataset to evaluate the effectiveness of our method. Our $\textit{S}^3$Gaussian demonstrates the ability to decompose static and dynamic scenes and achieves the best performance without using 3D annotations. Code is available at: https://github.com/nnanhuang/S3Gaussian/.


title: Don't drop your samples! Coherence-aware training benefits Conditional diffusion

abstract: Conditional diffusion models are powerful generative models that can leverage various types of conditional information, such as class labels, segmentation masks, or text captions. However, in many real-world scenarios, conditional information may be noisy or unreliable due to human annotation errors or weak alignment. In this paper, we propose the Coherence-Aware Diffusion (CAD), a novel method that integrates coherence in conditional information into diffusion models, allowing them to learn from noisy annotations without discarding data. We assume that each data point has an associated coherence score that reflects the quality of the conditional information. We then condition the diffusion model on both the conditional information and the coherence score. In this way, the model learns to ignore or discount the conditioning when the coherence is low. We show that CAD is theoretically sound and empirically effective on various conditional generation tasks. Moreover, we show that leveraging coherence generates realistic and diverse samples that respect conditional information better than models trained on cleaned datasets where samples with low coherence have been discarded.


title: MotionFollower: Editing Video Motion via Lightweight Score-Guided Diffusion

abstract: Despite impressive advancements in diffusion-based video editing models in altering video attributes, there has been limited exploration into modifying motion information while preserving the original protagonist's appearance and background. In this paper, we propose MotionFollower, a lightweight score-guided diffusion model for video motion editing. To introduce conditional controls to the denoising process, MotionFollower leverages two of our proposed lightweight signal controllers, one for poses and the other for appearances, both of which consist of convolution blocks without involving heavy attention calculations. Further, we design a score guidance principle based on a two-branch architecture, including the reconstruction and editing branches, which significantly enhance the modeling capability of texture details and complicated backgrounds. Concretely, we enforce several consistency regularizers and losses during the score estimation. The resulting gradients thus inject appropriate guidance to the intermediate latents, forcing the model to preserve the original background details and protagonists' appearances without interfering with the motion modification. Experiments demonstrate the competitive motion editing ability of MotionFollower qualitatively and quantitatively. Compared with MotionEditor, the most advanced motion editing model, MotionFollower achieves an approximately 80% reduction in GPU memory while delivering superior motion editing performance and exclusively supporting large camera movements and actions.


title: Interacting Fields at Spatial Infinity

abstract: We study the properties of massive fields extrapolated to the blowup of spatial infinity ($\hat{i}^0$), extending the program initiated in arXiv:2207.06406. In the free theory, we find an explicit representation of boundary two-point functions and boundary to bulk two-point functions, and also present an HKLL-type reconstruction formula for local bulk operators in terms of smeared boundary operators. We study interacting Wightman correlators and find that, generically, interacting massive fields decay slower than free fields as one approaches $\hat{i}^0$. We propose that meaningful correlators at $\hat{i}^0$ can be obtained through an LSZ-like prescription that isolates the on-shell part of bulk Wightman correlators before extrapolating them to $\hat{i}^0$. We show that a natural basis for operators at $\hat{i}^0$, defined via this prescription, is given by the average of "in" and "out" operators defined at $i^-$ and $i^+$ respectively. Therefore, correlators at $\hat{i}^0$ and cross correlators between $\hat{i}^0$, $i^-$ and $i^+$ can be represented within the class of asymptotic observables studied by Caron-Huot et al. in arXiv:2308.02125. We present several sample calculations.


title: GECO: Generative Image-to-3D within a SECOnd

abstract: 3D generation has seen remarkable progress in recent years. Existing techniques, such as score distillation methods, produce notable results but require extensive per-scene optimization, impacting time efficiency. Alternatively, reconstruction-based approaches prioritize efficiency but compromise quality due to their limited handling of uncertainty. We introduce GECO, a novel method for high-quality 3D generative modeling that operates within a second. Our approach addresses the prevalent issues of uncertainty and inefficiency in current methods through a two-stage approach. In the initial stage, we train a single-step multi-view generative model with score distillation. Then, a second-stage distillation is applied to address the challenge of view inconsistency from the multi-view prediction. This two-stage process ensures a balanced approach to 3D generation, optimizing both quality and efficiency. Our comprehensive experiments demonstrate that GECO achieves high-quality image-to-3D generation with an unprecedented level of efficiency.


title: mRNA secondary structure prediction using utility-scale quantum computers

abstract: Recent advancements in quantum computing have opened new avenues for tackling long-standing complex combinatorial optimization problems that are intractable for classical computers. Predicting secondary structure of mRNA is one such notoriously difficult problem that can benefit from the ever-increasing maturity of quantum computing technology. Accurate prediction of mRNA secondary structure is critical in designing RNA-based therapeutics as it dictates various steps of an mRNA life cycle, including transcription, translation, and decay. The current generation of quantum computers have reached utility-scale, allowing us to explore relatively large problem sizes. In this paper, we examine the feasibility of solving mRNA secondary structures on a quantum computer with sequence length up to 60 nucleotides representing problems in the qubit range of 10 to 80. We use Conditional Value at Risk (CVaR)-based VQE algorithm to solve the optimization problems, originating from the mRNA structure prediction problem, on the IBM Eagle and Heron quantum processors. To our encouragement, even with ``minimal'' error mitigation and fixed-depth circuits, our hardware runs yield accurate predictions of minimum free energy (MFE) structures that match the results of the classical solver CPLEX. Our results provide sufficient evidence for the viability of solving mRNA structure prediction problems on a quantum computer and motivate continued research in this direction.


title: Did Binary Neutron Star Merger GW170817 Leave Behind A Long-lived Neutron Star?

abstract: We consider the observational implications of the binary neutron star (BNS) merger GW170817 leaving behind a rapidly rotating massive neutron star that launches a relativistic, equatorial outflow as well as a jet. We show that if the equatorial outflow (ring) is highly beamed in the equatorial plane, its luminosity can be "hidden" from view until late times, even if carrying a significant fraction of the spin-down energy of the merger remnant. This hidden ring reveals itself as a re-brightening in the light curve once it slows down enough for Earth to be within the ring's relativistic beaming solid angle. We compute semi-analytic light curves using this model and find they are in agreement with the observations thus far, and we provide predictions for the ensuing afterglow.