title: Physics-informed Score-based Diffusion Model for Limited-angle Reconstruction of Cardiac Computed Tomography

abstract: Cardiac computed tomography (CT) has emerged as a major imaging modality for the diagnosis and monitoring of cardiovascular diseases. High temporal resolution is essential to ensure diagnostic accuracy. Limited-angle data acquisition can reduce scan time and improve temporal resolution, but typically leads to severe image degradation and motivates for improved reconstruction techniques. In this paper, we propose a novel physics-informed score-based diffusion model (PSDM) for limited-angle reconstruction of cardiac CT. At the sampling time, we combine a data prior from a diffusion model and a model prior obtained via an iterative algorithm and Fourier fusion to further enhance the image quality. Specifically, our approach integrates the primal-dual hybrid gradient (PDHG) algorithm with score-based diffusion models, thereby enabling us to reconstruct high-quality cardiac CT images from limited-angle data. The numerical simulations and real data experiments confirm the effectiveness of our proposed approach.


title: Dunkl symmetric coherent pairs of measures. An application to Fourier Dunkl-Sobolev expansions

abstract: Let $\mathcal{T}_{\mu}$ be the Dunkl operator. A pair of symmetric measures $(u, v)$ supported on a symmetric subset of the real line is said to be a symmetric Dunkl-coherent pair if the corresponding sequences of monic orthogonal polynomials $\{P_n\}_{n\geq 0}$ and $\{R_n\}_{n\geq 0}$ (resp.) satisfy $$ R_{n}(x)=\frac{\mathcal{T}_{\mu}P_{n+1} (x)}{\mu_{n+1}}-\sigma_{n-1}\frac{\mathcal{T}_{\mu} P_{n-1}(x)}{\mu_{n-1}}, n\geq 2,$$ where $\{\sigma_n\}_{n\geq1}$ is a sequence of non-zero complex numbers and $\mu_{2n}=2n, \mu_{2n-1}= 2n-1+ 2\mu, n\geq 1.$ In this contribution we focus the attention on the sequence $\{S_n^{(\lambda,\mu)}\}_{n\geq 0}$ of monic orthogonal polynomials with respect to the Dunkl-Sobolev inner product $$ <p,q>_{s,\mu}=<u,pq>+\lambda<v,\mathcal{T}_{\mu}p\mathcal{T}_{\mu}q>, \lambda >0, \ \ p, \ q \ \in \mathcal{P}.$$ An algorithm is stated to compute the coefficients of the Fourier--Sobolev type expansions with respect to $<. , .>$ for suitable smooth functions $f$ such that $f \in\mathcal{W}_2^1(R, u, v, \mu)=\{ f; \ \|f\|_{u}^{2} + \lambda \| \mathcal{T}_{\mu }f\|_{v}^{2} <\infty\}$. Finally, two illustrative numerical examples are presented.


title: Vortex-capturing multiscale spaces for the Ginzburg-Landau equation

abstract: This paper considers minimizers of the Ginzburg-Landau energy functional in particular multiscale spaces which are based on finite elements. The spaces are constructed by localized orthogonal decomposition techniques and their usage for solving the Ginzburg-Landau equation was first suggested in [D\"orich, Henning, SINUM 2024]. In this work we further explore their approximation properties and give an analytical explanation for why vortex structures of energy minimizers can be captured more accurately in these spaces. We quantify the necessary mesh resolution in terms of the Ginzburg-Landau parameter $\kappa$ and a stabilization parameter $\beta \ge 0$ that is used in the construction of the multiscale spaces. Furthermore, we analyze how $\kappa$ affects the necessary locality of the multiscale basis functions and we prove that the choice $\beta=0$ yields typically the highest accuracy. Our findings are supported by numerical experiments.


title: Fully charmed tetraquarks from LHC to FCC: Natural stability from fragmentation

abstract: We investigate the inclusive production of fully charmed tetraquarks, $T_{4c}(0^{++})$ or $T_{4c}(2^{++})$ radial excitations, in high-energy proton collisions. We build our study upon the collinear fragmentation of a single parton in a variable-flavor number scheme, suited to describe the tetraquark formation mechanism from moderate to large transverse-momentum regimes. To this extent, we derive a novel set of DGLAP-evolving collinear fragmentation functions, named TQ4Q1.0 determinations. They encode initial-scale inputs corresponding to both gluon and heavy-quark fragmentation channels, defined within the context of quark-potential and spin-physics inspired models, respectively. We work within the NLL/NLO$^+$ hybrid factorization and make use of the JETHAD numeric interface along with the symJETHAD symbolic calculation plugin. With these tools, we provide predictions for high-energy observables sensitive to $T_{4c}$ plus jet emissions at center-of-mass energies ranging from 14 TeV at the LHC to the 100 TeV nominal energy of the FCC.


title: Analytical model for predicting induced-stress distributions in polycrystalline materials

abstract: A simple micromechanical model of polycrystalline materials is proposed, which enables us to swiftly produce grain-boundary-stress distributions induced by the uniform external loading (in the elastic strain regime). Such statistical knowledge of local stresses is a necessary prerequisite to assess the probability for intergranular cracking initiation. Model predictions are verified through finite element calculations for various loading configurations, material properties, and grain-boundary types specified by the properties of a bicrystal pair of grains enclosing the grain boundary.


title: Second order analysis for the optimal selection of time delays

abstract: For a nonlinear ordinary differential equation with time delay, the differentiation of the solution with respect to the delay is investigated. Special emphasis is laid on the second-order derivative. The results are applied to an associated optimization problem for the time delay. A first- and second-order sensitivity analysis is performed including an adjoint calculus that avoids the second derivative of the state with respect to the delay.


title: Kinetics of orbital ordering in cooperative Jahn-Teller models: Machine-learning enabled large-scale simulations

abstract: We present a scalable machine learning (ML) force-field model for the adiabatic dynamics of cooperative Jahn-Teller (JT) systems. Large scale dynamical simulations of the JT model also shed light on the orbital ordering dynamics in colossal magnetoresistance manganites. The JT effect in these materials describes the distortion of local oxygen octahedra driven by a coupling to the orbital degrees of freedom of $e_g$ electrons. An effective electron-mediated interaction between the local JT modes leads to a structural transition and the emergence of long-range orbital order at low temperatures. Assuming the principle of locality, a deep-learning neural-network model is developed to accurately and efficiently predict the electron-induced forces that drive the dynamical evolution of JT phonons. A group-theoretical method is utilized to develop a descriptor that incorporates the combined orbital and lattice symmetry into the ML model. Large-scale Langevin dynamics simulations, enabled by the ML force-field models, are performed to investigate the coarsening dynamics of the composite JT distortion and orbital order after a thermal quench. The late-stage coarsening of orbital domains exhibits pronounced freezing behaviors which are likely related to the unusual morphology of the domain structures. Our work highlights a promising avenue for multi-scale dynamical modeling of correlated electron systems.


title: Topological Weyl Altermagnetism in CrSb

abstract: Altermagnets constitute a novel, third fundamental class of collinear magnetic ordered materials, alongside with ferro- and antiferromagnets. They share with conventional antiferromagnets the feature of a vanishing net magnetization. At the same time they show a spin-splitting of electronic bands, just as in ferromagnets, caused by the atomic exchange interaction. On the other hand, topology has recently revolutionized our understanding of condensed matter physics, introducing new phases of matter classified by intrinsic topological order. Here we connect the worlds of altermagnetism and topology, showing that the electronic structure of the altermagnet CrSb is topological and hosts a novel Weyl semimetallic state. Using high-resolution and spin angleresolved photoemission spectroscopy, we observe a large momentum-dependent spin-splitting in CrSb, reaching up to 1 eV, that induces altermagnetic Weyl nodes with an associated magnetic quantum number. At the surface we observe their spin-polarized topological Fermi-arcs. This establishes that in altermagnets the large energy scale intrinsic to the spin-splitting - orders of magnitude larger than the relativistic spin-orbit coupling - creates its own realm of robust electronic topology.


title: Optimal Rates for Vector-Valued Spectral Regularization Learning Algorithms

abstract: We study theoretical properties of a broad class of regularized algorithms with vector-valued output. These spectral algorithms include kernel ridge regression, kernel principal component regression, various implementations of gradient descent and many more. Our contributions are twofold. First, we rigorously confirm the so-called saturation effect for ridge regression with vector-valued output by deriving a novel lower bound on learning rates; this bound is shown to be suboptimal when the smoothness of the regression function exceeds a certain level. Second, we present the upper bound for the finite sample risk general vector-valued spectral algorithms, applicable to both well-specified and misspecified scenarios (where the true regression function lies outside of the hypothesis space) which is minimax optimal in various regimes. All of our results explicitly allow the case of infinite-dimensional output variables, proving consistency of recent practical applications.


title: Smart Bilingual Focused Crawling of Parallel Documents

abstract: Crawling parallel texts $\unicode{x2014}$texts that are mutual translations$\unicode{x2014}$ from the Internet is usually done following a brute-force approach: documents are massively downloaded in an unguided process, and only a fraction of them end up leading to actual parallel content. In this work we propose a smart crawling method that guides the crawl towards finding parallel content more rapidly. Our approach builds on two different models: one that infers the language of a document from its URL, and another that infers whether a pair of URLs link to parallel documents. We evaluate both models in isolation and their integration into a crawling tool. The results demonstrate the individual effectiveness of both models and highlight that their combination enables the early discovery of parallel content during crawling, leading to a reduction in the amount of downloaded documents deemed useless, and yielding a greater quantity of parallel documents compared to conventional crawling approaches.


title: Metric Flow Matching for Smooth Interpolations on the Data Manifold

abstract: Matching objectives underpin the success of modern generative models and rely on constructing conditional paths that transform a source distribution into a target distribution. Despite being a fundamental building block, conditional paths have been designed principally under the assumption of Euclidean geometry, resulting in straight interpolations. However, this can be particularly restrictive for tasks such as trajectory inference, where straight paths might lie outside the data manifold, thus failing to capture the underlying dynamics giving rise to the observed marginals. In this paper, we propose Metric Flow Matching (MFM), a novel simulation-free framework for conditional flow matching where interpolants are approximate geodesics learned by minimizing the kinetic energy of a data-induced Riemannian metric. This way, the generative model matches vector fields on the data manifold, which corresponds to lower uncertainty and more meaningful interpolations. We prescribe general metrics to instantiate MFM, independent of the task, and test it on a suite of challenging problems including LiDAR navigation, unpaired image translation, and modeling cellular dynamics. We observe that MFM outperforms the Euclidean baselines, particularly achieving SOTA on single-cell trajectory prediction.


title: Unified Neural Backdoor Removal with Only Few Clean Samples through Unlearning and Relearning

abstract: The application of deep neural network models in various security-critical applications has raised significant security concerns, particularly the risk of backdoor attacks. Neural backdoors pose a serious security threat as they allow attackers to maliciously alter model behavior. While many defenses have been explored, existing approaches are often bounded by model-specific constraints, or necessitate complex alterations to the training process, or fall short against diverse backdoor attacks. In this work, we introduce a novel method for comprehensive and effective elimination of backdoors, called ULRL (short for UnLearn and ReLearn for backdoor removal). ULRL requires only a small set of clean samples and works effectively against all kinds of backdoors. It first applies unlearning for identifying suspicious neurons and then targeted neural weight tuning for backdoor mitigation (i.e., by promoting significant weight deviation on the suspicious neurons). Evaluated against 12 different types of backdoors, ULRL is shown to significantly outperform state-of-the-art methods in eliminating backdoors whilst preserving the model utility.


title: Lessons from the Trenches on Reproducible Evaluation of Language Models

abstract: Effective evaluation of language models remains an open challenge in NLP. Researchers and engineers face methodological issues such as the sensitivity of models to evaluation setup, difficulty of proper comparisons across methods, and the lack of reproducibility and transparency. In this paper we draw on three years of experience in evaluating large language models to provide guidance and lessons for researchers. First, we provide an overview of common challenges faced in language model evaluation. Second, we delineate best practices for addressing or lessening the impact of these challenges on research. Third, we present the Language Model Evaluation Harness (lm-eval): an open source library for independent, reproducible, and extensible evaluation of language models that seeks to address these issues. We describe the features of the library as well as case studies in which the library has been used to alleviate these methodological concerns.


title: Low-Energy Line Codes for On-Chip Networks

abstract: Energy is a primary constraint in processor design, and much of that energy is consumed in on-chip communication. Communication can be intra-core (e.g., from a register file to an ALU) or inter-core (e.g., over the on-chip network). In this paper, we use the on-chip network (OCN) as a case study for saving on-chip communication energy. We have identified a new way to reduce the OCN's link energy consumption by using line coding, a longstanding technique in information theory. Our line codes, called Low-Energy Line Codes (LELCs), reduce energy by reducing the frequency of voltage transitions of the links, and they achieve a range of energy/performance trade-offs.


title: Unconventional superconductivity in twisted bilayer WSe2

abstract: Moir\'e materials have enabled the realization of flat electron bands and quantum phases that are driven by strong correlations associated with flat bands. Superconductivity has been observed, but solely, in graphene moir\'e materials. The absence of robust superconductivity in moir\'e materials beyond graphene, such as semiconductor moir\'e materials, has remained a mystery and challenged our current understanding of superconductivity in flat bands. Here, we report the observation of robust superconductivity in 3.65-degree twisted bilayer WSe2 which hosts a honeycomb moir\'e lattice. Superconductivity emerges at half-band filling and under small sublattice potential differences, where the moir\'e band is a flat Chern band. The optimal superconducting transition temperature is about 220 mK and constitutes 2% of the effective Fermi temperature; the latter is comparable to the value in high-temperature cuprate superconductors and suggests strong pairing. The superconductor borders on two distinct metals below and above half-band filling; it undergoes a continuous transition to a correlated insulator by tuning the sublattice potential difference. The observed superconductivity on the verge of Coulomb-induced charge localization suggests roots in strong electron correlations.


title: EditWorld: Simulating World Dynamics for Instruction-Following Image Editing

abstract: Diffusion models have significantly improved the performance of image editing. Existing methods realize various approaches to achieve high-quality image editing, including but not limited to text control, dragging operation, and mask-and-inpainting. Among these, instruction-based editing stands out for its convenience and effectiveness in following human instructions across diverse scenarios. However, it still focuses on simple editing operations like adding, replacing, or deleting, and falls short of understanding aspects of world dynamics that convey the realistic dynamic nature in the physical world. Therefore, this work, EditWorld, introduces a new editing task, namely world-instructed image editing, which defines and categorizes the instructions grounded by various world scenarios. We curate a new image editing dataset with world instructions using a set of large pretrained models (e.g., GPT-3.5, Video-LLava and SDXL). To enable sufficient simulation of world dynamics for image editing, our EditWorld trains model in the curated dataset, and improves instruction-following ability with designed post-edit strategy. Extensive experiments demonstrate our method significantly outperforms existing editing methods in this new task. Our dataset and code will be available at https://github.com/YangLing0818/EditWorld


title: The TESS-Keck Survey XX: 15 New TESS Planets and a Uniform RV Analysis of all Survey Targets

abstract: The Transiting Exoplanet Survey Satellite (TESS) has discovered hundreds of new worlds, with TESS planet candidates now outnumbering the total number of confirmed planets from $\textit{Kepler}$. Owing to differences in survey design, TESS continues to provide planets that are better suited for subsequent follow-up studies, including mass measurement through radial velocity (RV) observations, compared to Kepler targets. In this work, we present the TESS-Keck Survey's (TKS) Mass Catalog: a uniform analysis of all TKS RV survey data which has resulted in mass constraints for 126 planets and candidate signals. This includes 58 mass measurements that have reached $\geq5\sigma$ precision. We confirm or validate 32 new planets from the TESS mission either by significant mass measurement (15) or statistical validation (17), and we find no evidence of likely false positives among our entire sample. This work also serves as a data release for all previously unpublished TKS survey data, including 9,204 RV measurements and associated activity indicators over our three year survey. We took the opportunity to assess the performance of our survey, and found that we achieved many of our goals including measuring the mass of 38 small ($<4R_{\oplus}$) planets, nearly achieving the TESS mission's basic science requirement. In addition, we evaluated the performance of the Automated Planet Finder (APF) as survey support and observed meaningful constraints on system parameters due to its more uniform phase coverage. Finally, we compared our measured masses to those predicted by commonly used mass-radius relations and investigated evidence of systematic bias.


title: Construction and sampling of alloy cluster expansions -- A tutorial

abstract: Crystalline alloys and related mixed systems make up a large family of materials with high tunability which have been proposed as the solution to a large number of energy related materials design problems. Due to the presence of chemical order and disorder in these systems, neither experimental efforts nor ab-initio computational methods alone are sufficient to span the inherently large configuration space. Therefore, fast and accurate models are necessary. To this end, cluster expansions have been widely and successfully used for the past decades. Cluster expansions are generalized Ising models designed to predict the energy of any atomic configuration of a system after training on a small subset of the available configurations. Constructing and sampling a cluster expansion consists of multiple steps that have to be performed with care. In this tutorial, we provide a comprehensive guide to this process, highlighting important considerations and potential pitfalls. The tutorial consists of three parts, starting with cluster expansion construction for a relatively simple system, continuing with strategies for more challenging systems such as surfaces and closing with examples of Monte Carlo sampling of cluster expansions to study order-disorder transitions and phase diagrams.


title: Masked Image Modelling for retinal OCT understanding

abstract: This work explores the effectiveness of masked image modelling for learning representations of retinal OCT images. To this end, we leverage Masked Autoencoders (MAE), a simple and scalable method for self-supervised learning, to obtain a powerful and general representation for OCT images by training on 700K OCT images from 41K patients collected under real world clinical settings. We also provide the first extensive evaluation for a model of OCT on a challenging battery of 6 downstream tasks. Our model achieves strong performance when fully finetuned but can also serve as a versatile frozen feature extractor for many tasks using lightweight adapters. Furthermore, we propose an extension of the MAE pretraining to fuse OCT with an auxiliary modality, namely, IR fundus images and learn a joint model for both. We demonstrate our approach improves performance on a multimodal downstream application. Our experiments utilize most publicly available OCT datasets, thus enabling future comparisons. Our code and model weights are publicly available https://github.com/TheoPis/MIM_OCT.


title: A Bayesian Approach to Estimate Causal Peer Influence Accounting for Latent Network Homophily

abstract: Researchers have focused on understanding how individual's behavior is influenced by the behaviors of their peers in observational studies of social networks. Identifying and estimating causal peer influence, however, is challenging due to confounding by homophily, where people tend to connect with those who share similar characteristics with them. Moreover, since all the attributes driving homophily are generally not always observed and act as unobserved confounders, identifying and estimating causal peer influence becomes infeasible using standard causal identification assumptions. In this paper, we address this challenge by leveraging latent locations inferred from the network itself to disentangle homophily from causal peer influence, and we extend this approach to multiple networks by adopting a Bayesian hierarchical modeling framework. To accommodate the nonlinear dependency of peer influence on individual behavior, we employ a Bayesian nonparametric method, specifically Bayesian Additive Regression Trees (BART), and we propose a Bayesian framework that accounts for the uncertainty in inferring latent locations. We assess the operating characteristics of the estimator via extensive simulation study. Finally, we apply our method to estimate causal peer influence in advice-seeking networks of teachers in secondary schools, in order to assess whether the teachers' belief about mathematics education is influenced by the beliefs of their peers from whom they receive advice. Our results suggest that, overlooking latent homophily can lead to either underestimation or overestimation of causal peer influence, accompanied by considerable estimation uncertainty.


title: DIDI: Diffusion-Guided Diversity for Offline Behavioral Generation

abstract: In this paper, we propose a novel approach called DIffusion-guided DIversity (DIDI) for offline behavioral generation. The goal of DIDI is to learn a diverse set of skills from a mixture of label-free offline data. We achieve this by leveraging diffusion probabilistic models as priors to guide the learning process and regularize the policy. By optimizing a joint objective that incorporates diversity and diffusion-guided regularization, we encourage the emergence of diverse behaviors while maintaining the similarity to the offline data. Experimental results in four decision-making domains (Push, Kitchen, Humanoid, and D4RL tasks) show that DIDI is effective in discovering diverse and discriminative skills. We also introduce skill stitching and skill interpolation, which highlight the generalist nature of the learned skill space. Further, by incorporating an extrinsic reward function, DIDI enables reward-guided behavior generation, facilitating the learning of diverse and optimal behaviors from sub-optimal data.


title: Recurrent Early Exits for Federated Learning with Heterogeneous Clients

abstract: Federated learning (FL) has enabled distributed learning of a model across multiple clients in a privacy-preserving manner. One of the main challenges of FL is to accommodate clients with varying hardware capacities; clients have differing compute and memory requirements. To tackle this challenge, recent state-of-the-art approaches leverage the use of early exits. Nonetheless, these approaches fall short of mitigating the challenges of joint learning multiple exit classifiers, often relying on hand-picked heuristic solutions for knowledge distillation among classifiers and/or utilizing additional layers for weaker classifiers. In this work, instead of utilizing multiple classifiers, we propose a recurrent early exit approach named ReeFL that fuses features from different sub-models into a single shared classifier. Specifically, we use a transformer-based early-exit module shared among sub-models to i) better exploit multi-layer feature representations for task-specific prediction and ii) modulate the feature representation of the backbone model for subsequent predictions. We additionally present a per-client self-distillation approach where the best sub-model is automatically selected as the teacher of the other sub-models at each client. Our experiments on standard image and speech classification benchmarks across various emerging federated fine-tuning baselines demonstrate ReeFL's effectiveness over previous works.


title: Tetrahedron Instantons on Orbifolds

abstract: Given a homomorphism $\tau$ from a suitable finite group $\mathsf{\Gamma}$ to $\mathsf{SU}(4)$ with image $\mathsf{\Gamma}^\tau$, we construct a cohomological gauge theory on a noncommutative resolution of the quotient singularity $\mathbb{C}^4/\mathsf{\Gamma}^\tau$ whose BRST fixed points are $\mathsf{\Gamma}$-invariant tetrahedron instantons on a generally non-effective orbifold. The partition function computes the expectation values of complex codimension one defect operators in rank $r$ cohomological Donaldson-Thomas theory on a flat gerbe over the quotient stack $[\mathbb{C}^4/\,\mathsf{\Gamma}^\tau]$. We describe the generalized ADHM parametrization of the tetrahedron instanton moduli space, and evaluate the orbifold partition functions through virtual torus localization. If $\mathsf{\Gamma}$ is an abelian group the partition function is expressed as a combinatorial series over arrays of $\mathsf{\Gamma}$-coloured plane partitions, while if $\mathsf{\Gamma}$ is non-abelian the partition function localizes onto a sum over torus-invariant connected components of the moduli space labelled by lower-dimensional partitions. When $\mathsf{\Gamma}=\mathbb{Z}_n$ is a finite abelian subgroup of $\mathsf{SL}(2,\mathbb{C})$, we exhibit the reduction of Donaldson-Thomas theory on the toric Calabi-Yau four-orbifold $\mathbb{C}^2/\,\mathsf{\Gamma}\times\mathbb{C}^2$ to the cohomological field theory of tetrahedron instantons, from which we express the partition function as a closed infinite product formula. We also use the crepant resolution correpondence to derive a closed formula for the partition function on any polyhedral singularity.


title: SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flow

abstract: We introduce SEA-RAFT, a more simple, efficient, and accurate RAFT for optical flow. Compared with RAFT, SEA-RAFT is trained with a new loss (mixture of Laplace). It directly regresses an initial flow for faster convergence in iterative refinements and introduces rigid-motion pre-training to improve generalization. SEA-RAFT achieves state-of-the-art accuracy on the Spring benchmark with a 3.69 endpoint-error (EPE) and a 0.36 1-pixel outlier rate (1px), representing 22.9% and 17.8% error reduction from best published results. In addition, SEA-RAFT obtains the best cross-dataset generalization on KITTI and Spring. With its high efficiency, SEA-RAFT operates at least 2.3x faster than existing methods while maintaining competitive performance. The code is publicly available at https://github.com/princeton-vl/SEA-RAFT.


title: RetAssist: Facilitating Vocabulary Learners with Generative Images in Story Retelling Practices

abstract: Reading and repeatedly retelling a short story is a common and effective approach to learning the meanings and usages of target words. However, learners often struggle with comprehending, recalling, and retelling the story contexts of these target words. Inspired by the Cognitive Theory of Multimedia Learning, we propose a computational workflow to generate relevant images paired with stories. Based on the workflow, we work with learners and teachers to iteratively design an interactive vocabulary learning system named RetAssist. It can generate sentence-level images of a story to facilitate the understanding and recall of the target words in the story retelling practices. Our within-subjects study (N=24) shows that compared to a baseline system without generative images, RetAssist significantly improves learners' fluency in expressing with target words. Participants also feel that RetAssist eases their learning workload and is more useful. We discuss insights into leveraging text-to-image generative models to support learning tasks.


title: Rainbow Stackings of Random Edge-Colorings

abstract: A rainbow stacking of $r$-edge-colorings $\chi_1, \ldots, \chi_m$ of the complete graph on $n$ vertices is a way of superimposing $\chi_1, \ldots, \chi_m$ so that no edges of the same color are superimposed on each other. We determine a sharp threshold for $r$ (as a function of $m$ and $n$) governing the existence and nonexistence of rainbow stackings of random $r$-edge-colorings $\chi_1,\ldots,\chi_m$.


title: Generative Plant Growth Simulation from Sequence-Informed Environmental Conditions

abstract: A plant growth simulation can be characterized as a reconstructed visual representation of a plant or plant system. The phenotypic characteristics and plant structures are controlled by the scene environment and other contextual attributes. Considering the temporal dependencies and compounding effects of various factors on growth trajectories, we formulate a probabilistic approach to the simulation task by solving a frame synthesis and pattern recognition problem. We introduce a sequence-informed plant growth simulation framework (SI-PGS) that employs a conditional generative model to implicitly learn a distribution of possible plant representations within a dynamic scene from a fusion of low dimensional temporal sensor and context data. Methods such as controlled latent sampling and recurrent output connections are used to improve coherence in the plant structures between frames of predictions. In this work, we demonstrate that SI-PGS is able to capture temporal dependencies and continuously generate realistic frames of plant growth.


title: An asymptotic local-global theorem on heights of some Kleinian group orbits

abstract: We use circle method prove an asymptotic local-global theorem on the heights of point orbits of thin subgroups of Bianchi groups in $\mathbb H^3$.


title: Koszul duality and the Poincar\'e-Birkhoff-Witt theorem

abstract: Using a homotopy introduced by de Wilde and Lecomte and homological perturbation theory for $A_\infty$-algebras, we give an explicit proof that the universal enveloping algebra $UL$ of a differential graded Lie algebra $L$ is Koszul, via an explicit contracting homotopy from the cobar construction $\Omega CL$ of the Chevalley-Eilenberg chain coalgebra $CL$ of $L$ to $UL$.


title: Exploring modified Kaniadakis entropy: MOND theory and the Bekenstein bound conjecture

abstract: We examine the potential of Kaniadakis entropy to describe black hole entropy, proposing a modified version accounting for black hole thermodynamics. Additionally, we discuss the Modified Newtonian Dynamics (MOND) theory, a modification of Newton's second law aimed at explaining galaxy rotation curves without resorting to dark matter. Furthermore, we consider the Bekenstein bound conjecture which imposes an upper limit on the entropy of confined quantum systems. We analyze this conjecture in the context of a modified Kaniadakis entropy and find that it holds for typical values of $\kappa$, as evidenced by our numerical investigation. Our exploration underscores the potential of a modified Kaniadakis statistics in understanding diverse physical phenomena, from gravitational systems to quantum mechanics, offering a promising direction for future research at the intersection of statistical mechanics and other important areas of physics as well.


title: Membership Inference on Text-to-Image Diffusion Models via Conditional Likelihood Discrepancy

abstract: Text-to-image diffusion models have achieved tremendous success in the field of controllable image generation, while also coming along with issues of privacy leakage and data copyrights. Membership inference arises in these contexts as a potential auditing method for detecting unauthorized data usage. While some efforts have been made on diffusion models, they are not applicable to text-to-image diffusion models due to the high computation overhead and enhanced generalization capabilities. In this paper, we first identify a conditional overfitting phenomenon in text-to-image diffusion models, indicating that these models tend to overfit the conditional distribution of images given the text rather than the marginal distribution of images. Based on this observation, we derive an analytical indicator, namely Conditional Likelihood Discrepancy (CLiD), to perform membership inference, which reduces the stochasticity in estimating the memorization of individual samples. Experimental results demonstrate that our method significantly outperforms previous methods across various data distributions and scales. Additionally, our method shows superior resistance to overfitting mitigation strategies such as early stopping and data augmentation.


title: Pseudospin density wave instability in 2D electron bilayers

abstract: We investigate the instability of layer pseudospin paramagnetic (PSP) state to the formation of pseudospin density wave (PSDW) in two-dimensional (2D) electron bilayers, analogous to the formation of Overhauser spin density wave (SDW) in a single-layer 2D electron gas (2DEG) with spin 1/2. Our comprehensive study on phase diagrams, based on the self-consistent Hartree-Fock (HF) theory, reveals that the PSDW has a lower energy than both PSP and pseudospin ferromagnetic (PSF) states near the PSP-PSF phase transition boundary. When the two layers are populated by the same number of electrons, the PSDW momentum $Q_c \sim 2k_F$ near the PSP-PSDW boundary, where $k_F= (2\pi n)^{1/2}$ is the Fermi momentum characterized by the density in one of the two layers, and $Q_c$ decreases as the system transitions to the PSF regime. Extending the HF study to the case of unequal layer densities, the PSP phase is unstable to PSDW for small density imbalances, with momentum $Q_c \sim k_{F,t} + k_{F,b}$, where $k_{F,t}$ and $k_{F,b}$ are Fermi momenta of top and bottom layers, respectively. In PSDW regime, the ground state stability, defined by the energy difference between PSDW and the second lowest-energy state, is one order of magnitude lower than that in PSF regime, and decreases with increasing layer separation $d$. Furthermore, incorporating RPA static screening with the Hubbard-type local field correction leads to disappearance of both SDW and PSDW phases, and pushes the phase boundaries of paramagnetic to ferromagnetic transitions to larger $r_s$ values. Our study on PSDW in 2D electron bilayers is equally applicable to 2D hole bilayers. The idea of pursuing PSDW is, in general, relevant across various 2D bilayer systems, not limited to the parabolic model that we investigate in this paper, and provides a new possibility of exploring novel coherent phases.


title: Fast-DDPM: Fast Denoising Diffusion Probabilistic Models for Medical Image-to-Image Generation

abstract: Denoising diffusion probabilistic models (DDPMs) have achieved unprecedented success in computer vision. However, they remain underutilized in medical imaging, a field crucial for disease diagnosis and treatment planning. This is primarily due to the high computational cost associated with (1) the use of large number of time steps (e.g., 1,000) in diffusion processes and (2) the increased dimensionality of medical images, which are often 3D or 4D. Training a diffusion model on medical images typically takes days to weeks, while sampling each image volume takes minutes to hours. To address this challenge, we introduce Fast-DDPM, a simple yet effective approach capable of improving training speed, sampling speed, and generation quality simultaneously. Unlike DDPM, which trains the image denoiser across 1,000 time steps, Fast-DDPM trains and samples using only 10 time steps. The key to our method lies in aligning the training and sampling procedures to optimize time-step utilization. Specifically, we introduced two efficient noise schedulers with 10 time steps: one with uniform time step sampling and another with non-uniform sampling. We evaluated Fast-DDPM across three medical image-to-image generation tasks: multi-image super-resolution, image denoising, and image-to-image translation. Fast-DDPM outperformed DDPM and current state-of-the-art methods based on convolutional networks and generative adversarial networks in all tasks. Additionally, Fast-DDPM reduced the training time to 0.2x and the sampling time to 0.01x compared to DDPM. Our code is publicly available at: https://github.com/mirthAI/Fast-DDPM.


title: On the Value of the Cosmological Constant in Entropic Gravity

abstract: We explicitly calculate the value of the cosmological constant, based on the recently developed theory connecting entropic gravity with quantum-events, induced by transactions, called transactional gravity. We suggest a novel interpretation of the cosmological constant and rigorously show its inverse proportionality to the squared radius of the causal universe.


title: Can LLMs Solve longer Math Word Problems Better?

abstract: Math Word Problems (MWPs) are crucial for evaluating the capability of Large Language Models (LLMs), with current research primarily focusing on questions with concise contexts. However, as real-world math problems often involve complex circumstances, LLMs' ability to solve long MWPs is vital for their applications in these scenarios, yet remains under-explored. This study pioneers the exploration of Context Length Generalizability (CoLeG), the ability of LLMs to solve long MWPs. We introduce Extended Grade-School Math (E-GSM), a collection of MWPs with lengthy narratives. Two novel metrics are proposed to assess the efficacy and resilience of LLMs in solving these problems. Our examination of existing zero-shot prompting techniques and both proprietary and open-source LLMs reveals a general deficiency in CoLeG. To alleviate these challenges, we propose distinct approaches for different categories of LLMs. For proprietary LLMs, a new instructional prompt is proposed to mitigate the influence of long context. For open-source LLMs, a new data augmentation task is developed to improve CoLeG. Our comprehensive results demonstrate the effectiveness of our proposed methods, showing not only improved performance on E-GSM but also generalizability across several other MWP benchmarks. Our findings pave the way for future research in employing LLMs for complex, real-world applications, offering practical solutions to current limitations and opening avenues for further exploration of model generalizability and training methodologies.


title: A Seifert algorithm for integral homology spheres

abstract: From classical knot theory we know that every knot in $S^3$ is the boundary of an oriented, embedded surface. A standard demonstration of this fact achieved by elementary technique comes from taking a regular projection of any knot and employing Seifert's constructive algorithm. In this note we give a natural generalization of Seifert's algorithm to any closed integral homology 3-sphere. The starting point of our algorithm is presenting the handle structure of a Heegaard splitting of a given integral homology sphere as a planar diagram on the boundary of a $3$-ball. (For a well known example of such a planar presentation, see the Poincar\'e homology sphere planar presentation in {\em Knots and Links} by D. Rolfsen \cite{Rolfsen}.) An oriented link can then be represented by the regular projection of an oriented $k$-strand tangle. From there we give a natural way to find a ``Seifert circle" and associated half-twisted bands.


title: Lorentz-Equivariant Geometric Algebra Transformers for High-Energy Physics

abstract: Extracting scientific understanding from particle-physics experiments requires solving diverse learning problems with high precision and good data efficiency. We propose the Lorentz Geometric Algebra Transformer (L-GATr), a new multi-purpose architecture for high-energy physics. L-GATr represents high-energy data in a geometric algebra over four-dimensional space-time and is equivariant under Lorentz transformations, the symmetry group of relativistic kinematics. At the same time, the architecture is a Transformer, which makes it versatile and scalable to large systems. L-GATr is first demonstrated on regression and classification tasks from particle physics. We then construct the first Lorentz-equivariant generative model: a continuous normalizing flow based on an L-GATr network, trained with Riemannian flow matching. Across our experiments, L-GATr is on par with or outperforms strong domain-specific baselines.


title: Quantitative kinetic rules for plastic strain-induced $\alpha$-$\omega$ phase transformation in Zr under high pressure

abstract: Plastic strain-induced phase transformations (PTs) and chemical reactions under high pressure are broadly spread in modern technologies, friction and wear, geophysics, and astrogeology. However, because of very heterogeneous fields of plastic strain $\mathbf{E}^{p}$ and stress $\mathbf{\sigma}$ tensors and volume fraction $c$ of phases in a sample compressed in a diamond anvil cell (DAC) and impossibility of measurements of $\mathbf{\sigma}$ and $\mathbf{E}^{p}$, there are no strict kinetic equations for them. Here, we develop combined experimental-computational approaches to determine all fields in strongly plastically predeformed Zr and kinetic equation for $\alpha$-$\omega$ PT consistent with experimental data for the entire sample. Kinetic equation depends on accumulated plastic strain (instead of time) and pressure and is independent of plastic strain and deviatoric stress tensors, i.e., it can be applied for various above processes. Our results initiate kinetic studies of strain-induced PTs and provide efforts toward more comprehensive understanding of material behavior in extreme conditions.


title: Implicit Personalization in Language Models: A Systematic Study

abstract: Implicit Personalization (IP) is a phenomenon of language models inferring a user's background from the implicit cues in the input prompts and tailoring the response based on this inference. While previous work has touched upon various instances of this problem, there lacks a unified framework to study this behavior. This work systematically studies IP through a rigorous mathematical formulation, a multi-perspective moral reasoning framework, and a set of case studies. Our theoretical foundation for IP relies on a structural causal model and introduces a novel method, indirect intervention, to estimate the causal effect of a mediator variable that cannot be directly intervened upon. Beyond the technical approach, we also introduce a set of moral reasoning principles based on three schools of moral philosophy to study when IP may or may not be ethically appropriate. Equipped with both mathematical and ethical insights, we present three diverse case studies illustrating the varied nature of the IP problem and offer recommendations for future research. Our code and data are at https://github.com/jiarui-liu/IP.


title: Increasing AGN sample completeness using long-term near-infrared variability

abstract: In this work, we use 8 years of deep near-infrared imaging to select and study a new set of 601 active galaxies identified through long-term near-infrared (NIR) variability in the UKIDSS Ultra Deep Survey (UDS). These objects are compared to 710 X-ray bright AGN detected by the Chandra X-ray observatory. We show that infrared variability and X-ray emission select distinct sets of active galaxies, finding only a 37 per cent overlap of galaxies detected by both techniques and confirming NIR-variable AGN to be typically X-ray quiet. Examining the mass functions of the active galaxies shows that NIR variability detects AGN activity in galaxies over a significantly wider range of host stellar mass compared to X-ray detection. For example, at z $\sim$ 1, variable AGN are identified among approximately 1 per cent of galaxies in a roughly flat distribution above the stellar mass completeness limit (> 10$^{9}$M$_{\odot}$), while X-ray detection primarily identifies AGN in galaxies of higher mass (> 10$^{10}$M$_{\odot}$). We conclude that long-term near-infrared variability provides an important new tool for obtaining more complete samples of AGN in deep survey fields.


title: Prospective and retrospective coding in cortical neurons

abstract: Brains can process sensory information from different modalities at astonishing speed, this is surprising as already the integration of inputs through the membrane causes a delayed response. Neuronal recordings in vitro reveal a possible explanation for the fast processing through an advancement of the output firing rates of individual neurons with respect to the input, a concept which we refer to as prospective coding. The underlying mechanisms of prospective coding, however, is not completely understood. We propose a mechanistic explanation for individual neurons advancing their output on the level of single action potentials and instantaneous firing rates. Using the Hodgkin-Huxley model, we show that the spike generation mechanism can be the source for prospective (advanced) or retrospective (delayed) responses with respect the underlying somatic voltage. A simplified Hodgkin-Huxley model identifies the sodium inactivation as a source for the prospective firing, controlling the timing of the neuron's output as a function the voltage and its derivative. We also consider a slower spike-frequency adaptation as a mechanisms that generates prospective firings to inputs that undergo slow temporal modulations. In general, we show that adaptation processes at different time scales can cause advanced neuronal responses to time varying inputs that are modulated on the corresponding time scales.


title: Interacting phase diagram of twisted bilayer MoTe$_2$ in magnetic field

abstract: We study electron-electron interaction induced states of twisted bilayer MoTe$_2$ in an out-of-plane magnetic field $B\hat{\bf z}$ near one hole per moir\'e unit cell filling. The 3D phase diagram showing the evolution of competing phases with $B$, interaction strength and an out-of-plane electric field is presented at electron fillings that follow the Diophantine equation along Chern number $-\text{sign}\left(B\right)$ line, that is pointing away from the charge neutral filling, where we find prominent Chern insulators consistent with the experiments. We also explain the experimental absence of prominent Chern insulators along the Chern number $+\text{sign}\left(B\right)$ line.


title: As an AI Language Model, "Yes I Would Recommend Calling the Police'': Norm Inconsistency in LLM Decision-Making

abstract: We investigate the phenomenon of norm inconsistency: where LLMs apply different norms in similar situations. Specifically, we focus on the high-risk application of deciding whether to call the police in Amazon Ring home surveillance videos. We evaluate the decisions of three state-of-the-art LLMs -- GPT-4, Gemini 1.0, and Claude 3 Sonnet -- in relation to the activities portrayed in the videos, the subjects' skin-tone and gender, and the characteristics of the neighborhoods where the videos were recorded. Our analysis reveals significant norm inconsistencies: (1) a discordance between the recommendation to call the police and the actual presence of criminal activity, and (2) biases influenced by the racial demographics of the neighborhoods. These results highlight the arbitrariness of model decisions in the surveillance context and the limitations of current bias detection and mitigation strategies in normative decision-making.


title: Scalable Optimization in the Modular Norm

abstract: To improve performance in contemporary deep learning, one is interested in scaling up the neural network in terms of both the number and the size of the layers. When ramping up the width of a single layer, graceful scaling of training has been linked to the need to normalize the weights and their updates in the "natural norm" particular to that layer. In this paper, we significantly generalize this idea by defining the modular norm, which is the natural norm on the full weight space of any neural network architecture. The modular norm is defined recursively in tandem with the network architecture itself. We show that the modular norm has several promising applications. On the practical side, the modular norm can be used to normalize the updates of any base optimizer so that the learning rate becomes transferable across width and depth. This means that the user does not need to compute optimizer-specific scale factors in order to scale training. On the theoretical side, we show that for any neural network built from "well-behaved" atomic modules, the gradient of the network is Lipschitz-continuous in the modular norm, with the Lipschitz constant admitting a simple recursive formula. This characterization opens the door to porting standard ideas in optimization theory over to deep learning. We have created a Python package called Modula that automatically normalizes weight updates in the modular norm of the architecture. The package is available via "pip install modula" with source code at https://github.com/jxbz/modula.


title: Accelerated First-Principles Exploration of Structure and Reactivity in Graphene Oxide

abstract: Graphene oxide (GO) materials are widely studied, and yet their atomic-scale structures remain to be fully understood. Here we show that the chemical and configurational space of GO can be rapidly explored by advanced machine-learning methods, combining on-the-fly acceleration for first-principles molecular dynamics with message-passing neural-network potentials. The first step allows for the rapid sampling of chemical structures with very little prior knowledge required; the second step affords state-of-the-art accuracy and predictive power. We apply the method to the thermal reduction of GO, which we describe in a realistic (ten-nanometre scale) structural model. Our simulations are consistent with recent experimental findings and help to rationalise them in atomistic and mechanistic detail. More generally, our work provides a platform for routine, accurate, and predictive simulations of diverse carbonaceous materials.


title: Designing A Sustainable Marine Debris Clean-up Framework without Human Labels

abstract: Marine debris poses a significant ecological threat to birds, fish, and other animal life. Traditional methods for assessing debris accumulation involve labor-intensive and costly manual surveys. This study introduces a framework that utilizes aerial imagery captured by drones to conduct remote trash surveys. Leveraging computer vision techniques, our approach detects, classifies, and maps marine debris distributions. The framework uses Grounding DINO, a transformer-based zero-shot object detector, and CLIP, a vision-language model for zero-shot object classification, enabling the detection and classification of debris objects based on material type without the need for training labels. To mitigate over-counting due to different views of the same object, Scale-Invariant Feature Transform (SIFT) is employed for duplicate matching using local object features. Additionally, we have developed a user-friendly web application that facilitates end-to-end analysis of drone images, including object detection, classification, and visualization on a map to support cleanup efforts. Our method achieves competitive performance in detection (0.69 mean IoU) and classification (0.74 F1 score) across seven debris object classes without labeled data, comparable to state-of-the-art supervised methods. This framework has the potential to streamline automated trash sampling surveys, fostering efficient and sustainable community-led cleanup initiatives.


title: A noncollinear density functional theory ansatz for the phononic and thermodynamic properties of $\alpha$-Pu

abstract: Plutonium's phase diagram is host to complex structures and interactions that make the description of its ground state properties elusive. Using all-electron density functional theory, we study the thermodynamic properties of $\alpha$-Pu. To do this, we build on recent work in the literature by introducing a novel noncollinear magnetic ansatz for $\alpha$-Pu's ground state. The noncollinear ansatz accurately recovers the experimental phonon density of states, heat capacity, and thermal expansion. These new results on $\alpha$-Pu along with recent results on $\delta$-Pu demonstrate the efficacy of noncollinear ansatzes for the description of plutonium.


title: Unraveling electronic structure of GeS through ARPES and its correlation with anisotropic optical and transport behavior

abstract: Two-dimensional (2D) van der Waals (vdW) materials with lower symmetry (triclinic, monoclinic or orthorhombic) exhibit intrinsic anisotropic in-plane structure desirable for future optoelectronic surface operating devices. Herein, we report one such material, 2D $p$-type semiconductor germanium sulfide (GeS), a group IV monochalcogenide with puckered orthorhombic morphology, in which in-plane optical and transport properties can be correlated with its electronic structure. We systematically investigate the electronic band structure of the bulk GeS with micro-focused angle-resolved photoemission spectroscopy ($\mu$-ARPES) and correspond the charge transport properties using the field-effect transistor (FET) device architecture, and optical anisotropy $via$ angle-resolved polarization dependent Raman spectroscopy (ARPRS) on a micron-sized rectangle-shaped exfoliated bulk flake. The experimental valence band dispersion along the two high symmetry directions indicate highly anisotropic in-plane behavior of the charge carrier that agrees well with the density functional theory (DFT) calculations. In addition, we demonstrate the variation of the in-plane hole mobility (ratio $\sim$ 3.4) from the electrical conductivity with gate-sweep in a GeS-on-SiO$_2$ FET. Moreover, we use the angle-resolved fluctuation of the Raman intensity of the characteristic phonon modes to precisely determine the armchair and zigzag edges of the particular flake. The unique structural motif of GeS with correlated electronic and optical properties are of great interest both for the physical understanding of the all-optical switch and their applications in memory devices.


title: Gravitational-wave dark siren cosmology systematics from galaxy weighting

abstract: The discovery of GW170817 provided the first direct gravitational-wave measurement of the Hubble constant, $H_0$, demonstrating the potential power of standard-siren cosmology. The dark siren approach can be utilized for gravitational-wave sources in the absence of an electromagnetic counterpart: one considers all galaxies contained within the localization volume as potential hosts. When statistically averaging over the potential host galaxies, one can weight them by their luminosities to account for physically-motivated prescriptions (e.g., tracing star formation or stellar mass). Using mock galaxy catalogs, we explore the impact of these weightings on the measurement of $H_0$, focusing on the bias in $H_0$ inference that results from incorrectly-weighted prescriptions. We find that assuming an incorrect galaxy host probability can lead to significant biases in $H_0$, up to about five times off from typical values inferred by current experiments. These biases are due to inconsistent galaxy weighted redshift distributions as well as preferentially selecting the incorrect host during inference. The magnitudes of these biases are influenced by the galaxy number density along each line of sight, the uncertainty in the measurement of the gravitational-wave luminosity distance, and correlations in the parameter space of galaxies. These biases may be overcome with future GW detectors that contain better GW localization, using a strategic choice of weighting prescription, or with increasing the SNR cut. We propose using hierarchical inference as a diagnosis of incorrectly-weighted prescriptions, which can further be used to simultaneously infer the correct weighting scheme and cosmological parameters.

categories: astro-ph.CO astro-ph.GA astro-ph.HE gr-qc


title: Pathwise uniqueness in infinite dimension under weak structure conditions

abstract: Let $U,H$ be two separable Hilbert spaces and $T>0$. We consider an SDE which evolves in the Hilbert space $H$ of the form \begin{align} dX(t)=AX(t)dt+\widetilde{\mathscr L}B(X(t))dt+GdW(t), \quad t\in[0,T], \quad X(0)=x \in H, \end{align} where $A:D(A)\subseteq H\to H$ is the infinitesimal generator of a strongly continuous semigroup $(e^{tA})_{t\geq0}$, $W=(W(t))_{t\geq0}$ is a $U$-cylindrical Wiener process defined on a normal filtered probability space $(\Omega,\mathcal{F},\{\mathcal{F}_t\}_{t\in [0,T]},\mathbb{P})$, $B:H\to H$ is a bounded and $\theta$-H\"older continuous function, for some suitable $\theta\in(0,1)$, and $\widetilde{\mathscr L}:H\to H$ and $G:U\to H$ are linear bounded operators. We prove that, under suitable assumptions on the coefficients, the weak mild solution to the equation depends on the initial datum in a Lipschitz way. This implies that pathwise uniqueness holds true. Here, the presence of the operator $\Lambda$ plays a crucial role. In particular the conditions assumed on the coefficients cover the stochastic damped wave equation in dimension $1$ and the stochastic damped Euler--Bernoulli Beam equation upto dimension $3$ even in the hyperbolic case.


title: Identification of hot gas around low-mass protostars

abstract: The low carbon content of Earth and primitive meteorites compared to the Sun and interstellar grains suggests that carbon-rich grains were destroyed in the inner few astronomical units of the young solar system. A promising mechanism to selectively destroy carbonaceous grains is thermal sublimation within the soot line at $\gtrsim$ 300 K. To address whether such hot conditions are common amongst low-mass protostars, we observe CH$_3$CN transitions at 1, 2 and 3 mm with the NOrthern Extended Millimeter Array (NOEMA) toward seven low-mass and one intermediate-mass protostar ($L_{\rm{bol}} \sim2-300 L_\odot$), as CH$_3$CN is an excellent temperature tracer. We find $>$ 300 K gas toward all sources, indicating that hot gas may be prevalent. Moreover, the excitation temperature for CH$_3$OH obtained with the same observations is always lower ($\sim$135-250 K), suggesting that CH$_3$CN and CH$_3$OH have a different spatial distribution. A comparison of the column densities at 1 and 3 mm shows a stronger increase at 3 mm for CH$_3$CN than for CH$_3$OH. Since the dust opacity is lower at longer wavelengths, this indicates that CH$_3$CN is enhanced in the hot gas compared to CH$_3$OH. If this CH$_3$CN enhancement is the result of carbon-grain sublimation, these results suggests that Earth's initial formation conditions may not be rare.


title: Evaluating Vulnerability of Chiplet-Based Systems to Contactless Probing Techniques

abstract: Driven by a need for ever increasing chip performance and inclusion of innovative features, a growing number of semiconductor companies are opting for all-inclusive System-on-Chip (SoC) architectures. Although Moore's Law has been able to keep up with the demand for more complex logic, manufacturing large dies still poses a challenge. Increasingly the solution adopted to minimize the impact of silicon defects on manufacturing yield has been to split a design into multiple smaller dies called chiplets which are then brought together on a silicon interposer. Advanced 2.5D and 3D packaging techniques that enable this kind of integration also promise increased power efficiency and opportunities for heterogeneous integration. However, despite their advantages, chiplets are not without issues. Apart from manufacturing challenges that come with new packaging techniques, disaggregating a design into multiple logically and physically separate dies introduces new threats, including the possibility of tampering with and probing exposed data lines. In this paper we evaluate the exposure of chiplets to probing by applying laser contactless probing techniques to a chiplet-based AMD/Xilinx VU9P FPGA. First, we identify and map interposer wire drivers and show that probing them is easier compared to probing internal nodes. Lastly, we demonstrate that delay-based sensors, which can be used to protect against physical probes, are insufficient to protect against laser probing as the delay change due to laser probing is only 0.792ps even at 100\% laser power.


title: PaGoDA: Progressive Growing of a One-Step Generator from a Low-Resolution Diffusion Teacher

abstract: To accelerate sampling, diffusion models (DMs) are often distilled into generators that directly map noise to data in a single step. In this approach, the resolution of the generator is fundamentally limited by that of the teacher DM. To overcome this limitation, we propose Progressive Growing of Diffusion Autoencoder (PaGoDA), a technique to progressively grow the resolution of the generator beyond that of the original teacher DM. Our key insight is that a pre-trained, low-resolution DM can be used to deterministically encode high-resolution data to a structured latent space by solving the PF-ODE forward in time (data-to-noise), starting from an appropriately down-sampled image. Using this frozen encoder in an auto-encoder framework, we train a decoder by progressively growing its resolution. From the nature of progressively growing decoder, PaGoDA avoids re-training teacher/student models when we upsample the student model, making the whole training pipeline much cheaper. In experiments, we used our progressively growing decoder to upsample from the pre-trained model's 64x64 resolution to generate 512x512 samples, achieving 2x faster inference compared to single-step distilled Stable Diffusion like LCM. PaGoDA also achieved state-of-the-art FIDs on ImageNet across all resolutions from 64x64 to 512x512. Additionally, we demonstrated PaGoDA's effectiveness in solving inverse problems and enabling controllable generation.


title: Efficient first-principles approach to Gibbs free energy with thermal expansion

abstract: We propose a method to evaluate the Gibbs free energy from constant-volume first-principles calculations. The volume integral of the pressure is performed by determining the volume and the bulk modulus in equilibrium at finite temperatures, where the pressure and its volume derivative are evaluated utilizing first-principles calculations of the Gr\"uneisen parameter without varying the volume. As an example, the validity of our method is demonstrated for fcc-Al by comparing with the conventional quasiharmonic approximation that is much more computationally-demanding.


title: Camera Relocalization in Shadow-free Neural Radiance Fields

abstract: Camera relocalization is a crucial problem in computer vision and robotics. Recent advancements in neural radiance fields (NeRFs) have shown promise in synthesizing photo-realistic images. Several works have utilized NeRFs for refining camera poses, but they do not account for lighting changes that can affect scene appearance and shadow regions, causing a degraded pose optimization process. In this paper, we propose a two-staged pipeline that normalizes images with varying lighting and shadow conditions to improve camera relocalization. We implement our scene representation upon a hash-encoded NeRF which significantly boosts up the pose optimization process. To account for the noisy image gradient computing problem in grid-based NeRFs, we further propose a re-devised truncated dynamic low-pass filter (TDLF) and a numerical gradient averaging technique to smoothen the process. Experimental results on several datasets with varying lighting conditions demonstrate that our method achieves state-of-the-art results in camera relocalization under varying lighting conditions. Code and data will be made publicly available.


title: Lindbladian way for the relaxation time approximation, application to Kibble-Zurek processes due to environment temperature quench, and to Lindbladian perturbation theory

abstract: In the present paper, a global Lindbladian ansatz is constructed which leads to thermalization at temperature $T$ to the Gibs state of the investigated system. This ansatz connects every two eigenstates of the Hamiltonian and leads to a simple master equation known in the literature as the relaxation time approximation (RTA). The main message of this paper is that RTA, being a Lindbladian approach itself, can be used as Lindbladian securing thermalization when modeling physical processes, and can be consequently combined with other types of Lindbladians which would drive the system of the equilibrium state. I demonstrate it with two applications. The first application is the slow cooling (or heating) of quantum systems by varying the environment temperature to a critical point. With this RTA-Lindblad ansatz, one can directly relate to the equilibrium behavior of the system, and if an order parameter has the exponent $\Psi$, the remaining value at the phase transition will decrease with $1/\tau^{\Psi}$, where $\tau$ is the overall time of the slow process. In the second application, I investigate the change in the expectation value of a conserved quantity (an operator commuting with the Hamiltonian) due to an extra Lindbladian term which would drive the system out from equilibrium, while the thermalizing RTA-Lindbladian term is also present. I give a closed perturbative expression in the first order for the expectation value in the new steady state using only expectation values calculated in the original thermal equilibrium.


title: New limits on neutrino decay from high-energy astrophysical neutrinos

abstract: Since neutrinos have mass differences, they could decay into one another. But their lifetimes are likely long, even when shortened by new physics, so decay likely impacts neutrinos only during long trips. This makes high-energy astrophysical neutrinos, traveling for up to billions of light-years, sensitive probes of decay. However, their sensitivity must be tempered by reality. We derive from them thorough bounds on the neutrino lifetimes accounting for critical astrophysical unknowns and the nuances of neutrino detection. Using the diffuse neutrino flux, we disfavor lifetimes $\tau \lesssim 20$-450 s $(m/{\rm eV})$, based on present IceCube data, and forecast factor-of-10 improvements by upcoming detectors. Using, for the first time, neutrinos from the active galaxy NGC 1068, extant unknowns preclude placing lifetime bounds today, but upcoming detectors could disfavor $\tau \sim 100$-5000 s $(m/{\rm eV})$.


title: An augmented Lagrangian trust-region method with inexact gradient evaluations to accelerate constrained optimization problems using model hyperreduction

abstract: We present an augmented Lagrangian trust-region method to efficiently solve constrained optimization problems governed by large-scale nonlinear systems with application to partial differential equation-constrained optimization. At each major augmented Lagrangian iteration, the expensive optimization subproblem involving the full nonlinear system is replaced by an empirical quadrature-based hyperreduced model constructed on-the-fly. To ensure convergence of these inexact augmented Lagrangian subproblems, we develop a bound-constrained trust-region method that allows for inexact gradient evaluations, and specialize it to our specific setting that leverages hyperreduced models. This approach circumvents a traditional training phase because the models are built on-the-fly in accordance with the requirements of the trust-region convergence theory. Two numerical experiments (constrained aerodynamic shape design) demonstrate the convergence and efficiency of the proposed work. A speedup of 12.7x (for all computational costs, even costs traditionally considered "offline" such as snapshot collection and data compression) relative to a standard optimization approach that does not leverage model reduction is shown.


title: Good Seed Makes a Good Crop: Discovering Secret Seeds in Text-to-Image Diffusion Models

abstract: Recent advances in text-to-image (T2I) diffusion models have facilitated creative and photorealistic image synthesis. By varying the random seeds, we can generate various images for a fixed text prompt. Technically, the seed controls the initial noise and, in multi-step diffusion inference, the noise used for reparameterization at intermediate timesteps in the reverse diffusion process. However, the specific impact of the random seed on the generated images remains relatively unexplored. In this work, we conduct a large-scale scientific study into the impact of random seeds during diffusion inference. Remarkably, we reveal that the best 'golden' seed achieved an impressive FID of 21.60, compared to the worst 'inferior' seed's FID of 31.97. Additionally, a classifier can predict the seed number used to generate an image with over 99.9% accuracy in just a few epochs, establishing that seeds are highly distinguishable based on generated images. Encouraged by these findings, we examined the influence of seeds on interpretable visual dimensions. We find that certain seeds consistently produce grayscale images, prominent sky regions, or image borders. Seeds also affect image composition, including object location, size, and depth. Moreover, by leveraging these 'golden' seeds, we demonstrate improved image generation such as high-fidelity inference and diversified sampling. Our investigation extends to inpainting tasks, where we uncover some seeds that tend to insert unwanted text artifacts. Overall, our extensive analyses highlight the importance of selecting good seeds and offer practical utility for image generation.


title: Analog Counterdiabatic Quantum Computing

abstract: We propose analog counterdiabatic quantum computing (ACQC) to tackle combinatorial optimization problems on neutral-atom quantum processors. While these devices allow for the use of hundreds of qubits, adiabatic quantum computing struggles with non-adiabatic errors, which are inevitable due to the hardware's restricted coherence time. We design counterdiabatic protocols to circumvent those limitations via ACQC on analog quantum devices with ground-Rydberg qubits. To demonstrate the effectiveness of our paradigm, we experimentally apply it to the maximum independent set (MIS) problem with up to 100 qubits and show an enhancement in the approximation ratio with a short evolution time. We believe ACQC establishes a path toward quantum advantage for a variety of industry use cases.


title: Deep learning lattice gauge theories

abstract: Monte Carlo methods have led to profound insights into the strong-coupling behaviour of lattice gauge theories and produced remarkable results such as first-principles computations of hadron masses. Despite tremendous progress over the last four decades, fundamental challenges such as the sign problem and the inability to simulate real-time dynamics remain. Neural network quantum states have emerged as an alternative method that seeks to overcome these challenges. In this work, we use gauge-invariant neural network quantum states to accurately compute the ground state of $\mathbb{Z}_N$ lattice gauge theories in $2+1$ dimensions. Using transfer learning, we study the distinct topological phases and the confinement phase transition of these theories. For $\mathbb{Z}_2$, we identify a continuous transition and compute critical exponents, finding excellent agreement with existing numerics for the expected Ising universality class. In the $\mathbb{Z}_3$ case, we observe a weakly first-order transition and identify the critical coupling. Our findings suggest that neural network quantum states are a promising method for precise studies of lattice gauge theory.

categories: hep-lat cond-mat.dis-nn cond-mat.str-el cs.LG hep-th


title: HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models

abstract: In order to thrive in hostile and ever-changing natural environments, mammalian brains evolved to store large amounts of knowledge about the world and continually integrate new information while avoiding catastrophic forgetting. Despite the impressive accomplishments, large language models (LLMs), even with retrieval-augmented generation (RAG), still struggle to efficiently and effectively integrate a large amount of new experiences after pre-training. In this work, we introduce HippoRAG, a novel retrieval framework inspired by the hippocampal indexing theory of human long-term memory to enable deeper and more efficient knowledge integration over new experiences. HippoRAG synergistically orchestrates LLMs, knowledge graphs, and the Personalized PageRank algorithm to mimic the different roles of neocortex and hippocampus in human memory. We compare HippoRAG with existing RAG methods on multi-hop question answering and show that our method outperforms the state-of-the-art methods remarkably, by up to 20%. Single-step retrieval with HippoRAG achieves comparable or better performance than iterative retrieval like IRCoT while being 10-30 times cheaper and 6-13 times faster, and integrating HippoRAG into IRCoT brings further substantial gains. Finally, we show that our method can tackle new types of scenarios that are out of reach of existing methods. Code and data are available at https://github.com/OSU-NLP-Group/HippoRAG.


title: Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer

abstract: Generating high-quality 3D assets from text and images has long been challenging, primarily due to the absence of scalable 3D representations capable of capturing intricate geometry distributions. In this work, we introduce Direct3D, a native 3D generative model scalable to in-the-wild input images, without requiring a multiview diffusion model or SDS optimization. Our approach comprises two primary components: a Direct 3D Variational Auto-Encoder (D3D-VAE) and a Direct 3D Diffusion Transformer (D3D-DiT). D3D-VAE efficiently encodes high-resolution 3D shapes into a compact and continuous latent triplane space. Notably, our method directly supervises the decoded geometry using a semi-continuous surface sampling strategy, diverging from previous methods relying on rendered images as supervision signals. D3D-DiT models the distribution of encoded 3D latents and is specifically designed to fuse positional information from the three feature maps of the triplane latent, enabling a native 3D generative model scalable to large-scale 3D datasets. Additionally, we introduce an innovative image-to-3D generation pipeline incorporating semantic and pixel-level image conditions, allowing the model to produce 3D shapes consistent with the provided conditional image input. Extensive experiments demonstrate the superiority of our large-scale pre-trained Direct3D over previous image-to-3D approaches, achieving significantly better generation quality and generalization ability, thus establishing a new state-of-the-art for 3D content creation. Project page: https://nju-3dv.github.io/projects/Direct3D/.


title: A New Conjecture and Upper Bound on the Castelnuovo--Mumford Regularity of Binomial Edge Ideals

abstract: A famous theorem of Kalai and Meshulam is that $\mathrm{reg}(I + J) \leq \mathrm{reg}(I) + \mathrm{reg}(J) -1$ for any squarefree monomial ideals $I$ and $J$. This result was subsequently extended by Herzog to the case where $I$ and $J$ are any monomial ideals. In this paper we conjecture that the Castelnuovo--Mumford regularity is subadditive on binomial edge ideals. Specifically, we propose that $\mathrm{reg}(J_{G}) \leq \mathrm{reg}(J_{H_{1}}) + \mathrm{reg}(J_{H_{2}}) -1$ whenever $G$, $H_{1}$, and $H_{2}$ are graphs satisfying $E(G) = E(H_{1}) \cup E(H_{2})$ and $J_{\ast}$ is the associated binomial edge ideal. We prove a special case of this conjecture which strengthens the celebrated theorem of Malayeri--Madani--Kiani that $\mathrm{reg}(J_{G})$ is bounded above by the minimal number of maximal cliques covering the edges of the graph $G$. From this special case we obtain a new upper bound for $\mathrm{reg}(J_{G})$, namely that $\mathrm{reg}(J_{G}) \leq \mathrm{ht}(J_{G}) +1$. Our upper bound gives an analogue of the well-known result that $\mathrm{reg}(I(G)) \leq \mathrm{ht}(I(G)) +1$ where $I(G)$ is the edge ideal of the graph $G$. We additionally prove that this conjecture holds for graphs admitting a combinatorial description for its Castelnuovo--Mumford regularity, that is for closed graphs, bipartite graphs with $J_{G}$ Cohen--Macaulay, and block graphs. Finally, we give examples to show that our new upper bound is incomparable with Malayeri--Madani--Kiani's upper bound for $\mathrm{reg}(J_{G})$ given by the size of a maximal clique disjoint set of edges.


title: A central limit theorem for coefficients of L-functions in short intervals

abstract: Assuming the generalized Lindel\"{o}f hypothesis (GLH), a weak generalized Ramanujan conjecture and a Rankin--Selberg type partial sum estimate, we show that the sum of coefficients of a general $L$-function in short intervals of appropriate length has a Gaussian limiting distribution. The novelty lies in the degree aspect under GLH. In particular, this generalizes Hughes--Rudnick's result on lattice point counts in thin annuli.


title: Polynomial Pass Semi-Streaming Lower Bounds for K-Cores and Degeneracy

abstract: The following question arises naturally in the study of graph streaming algorithms: "Is there any graph problem which is "not too hard", in that it can be solved efficiently with total communication (nearly) linear in the number $n$ of vertices, and for which, nonetheless, any streaming algorithm with $\tilde{O}(n)$ space (i.e., a semi-streaming algorithm) needs a polynomial $n^{\Omega(1)}$ number of passes?" Assadi, Chen, and Khanna [STOC 2019] were the first to prove that this is indeed the case. However, the lower bounds that they obtained are for rather non-standard graph problems. Our first main contribution is to present the first polynomial-pass lower bounds for natural "not too hard" graph problems studied previously in the streaming model: $k$-cores and degeneracy. We devise a novel communication protocol for both problems with near-linear communication, thus showing that $k$-cores and degeneracy are natural examples of "not too hard" problems. Indeed, previous work have developed single-pass semi-streaming algorithms for approximating these problems. In contrast, we prove that any semi-streaming algorithm for exactly solving these problems requires (almost) $\Omega(n^{1/3})$ passes. Our second main contribution is improved round-communication lower bounds for the underlying communication problems at the basis of these reductions: * We improve the previous lower bound of Assadi, Chen, and Khanna for hidden pointer chasing (HPC) to achieve optimal bounds. * We observe that all current reductions from HPC can also work with a generalized version of this problem that we call MultiHPC, and prove an even stronger and optimal lower bound for this generalization. These two results collectively allow us to improve the resulting pass lower bounds for semi-streaming algorithms by a polynomial factor, namely, from $n^{1/5}$ to $n^{1/3}$ passes.


title: First Order Logic of Sparse Graphs with Given Degree Sequences

abstract: We consider limit probabilities of first order properties in random graphs with a given degree sequence. Under mild conditions on the degree sequence, we show that the closure set of limit probabilities is a finite union of closed intervals. Moreover, we characterize the degree sequences for which this closure set is the interval $[0,1]$, a property that is intimately related with the probability that the random graph is acyclic. As a side result, we compile a full description of the cycle distribution of random graphs and study their fragment (disjoint union of unicyclic components) in the subcritical regime. Finally, we amend the proof of the existence of limit probabilities for first order properties in random graphs with a given degree sequence; this result was already claimed by Lynch~[IEEE LICS 2003] but his proof contained some inaccuracies.


title: Analysis of Atom-level pretraining with Quantum Mechanics (QM) data for Graph Neural Networks Molecular property models

abstract: Despite the rapid and significant advancements in deep learning for Quantitative Structure-Activity Relationship (QSAR) models, the challenge of learning robust molecular representations that effectively generalize in real-world scenarios to novel compounds remains an elusive and unresolved task. This study examines how atom-level pretraining with quantum mechanics (QM) data can mitigate violations of assumptions regarding the distributional similarity between training and test data and therefore improve performance and generalization in downstream tasks. In the public dataset Therapeutics Data Commons (TDC), we show how pretraining on atom-level QM improves performance overall and makes the activation of the features distributes more Gaussian-like which results in a representation that is more robust to distribution shifts. To the best of our knowledge, this is the first time that hidden state molecular representations are analyzed to compare the effects of molecule-level and atom-level pretraining on QM data.


title: From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Step

abstract: When leveraging language models for reasoning tasks, generating explicit chain-of-thought (CoT) steps often proves essential for achieving high accuracy in final outputs. In this paper, we investigate if models can be taught to internalize these CoT steps. To this end, we propose a simple yet effective method for internalizing CoT steps: starting with a model trained for explicit CoT reasoning, we gradually remove the intermediate steps and finetune the model. This process allows the model to internalize the intermediate reasoning steps, thus simplifying the reasoning process while maintaining high performance. Our approach enables a GPT-2 Small model to solve 9-by-9 multiplication with up to 99% accuracy, whereas standard training cannot solve beyond 4-by-4 multiplication. Furthermore, our method proves effective on larger language models, such as Mistral 7B, achieving over 50% accuracy on GSM8K without producing any intermediate steps.


title: A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis

abstract: While deep networks have achieved broad success in analyzing natural images, when applied to medical scans, they often fail in unexcepted situations. We investigate this challenge and focus on model sensitivity to domain shifts, such as data sampled from different hospitals or data confounded by demographic variables such as sex, race, etc, in the context of chest X-rays and skin lesion images. A key finding we show empirically is that existing visual backbones lack an appropriate prior from the architecture for reliable generalization in these settings. Taking inspiration from medical training, we propose giving deep networks a prior grounded in explicit medical knowledge communicated in natural language. To this end, we introduce Knowledge-enhanced Bottlenecks (KnoBo), a class of concept bottleneck models that incorporates knowledge priors that constrain it to reason with clinically relevant factors found in medical textbooks or PubMed. KnoBo uses retrieval-augmented language models to design an appropriate concept space paired with an automatic training procedure for recognizing the concept. We evaluate different resources of knowledge and recognition architectures on a broad range of domain shifts across 20 datasets. In our comprehensive evaluation with two imaging modalities, KnoBo outperforms fine-tuned models on confounded datasets by 32.4% on average. Finally, evaluations reveal that PubMed is a promising resource for making medical models less sensitive to domain shift, outperforming other resources on both diversity of information and final prediction performance.


title: Differentiable Annealed Importance Sampling Minimizes The Jensen-Shannon Divergence Between Initial and Target Distribution

abstract: Differentiable annealed importance sampling (DAIS), proposed by Geffner & Domke (2021) and Zhang et al. (2021), allows optimizing, among others, over the initial distribution of AIS. In this paper, we show that, in the limit of many transitions, DAIS minimizes the symmetrized KL divergence (Jensen-Shannon divergence) between the initial and target distribution. Thus, DAIS can be seen as a form of variational inference (VI) in that its initial distribution is a parametric fit to an intractable target distribution. We empirically evaluate the usefulness of the initial distribution as a variational distribution on synthetic and real-world data, observing that it often provides more accurate uncertainty estimates than standard VI (optimizing the reverse KL divergence), importance weighted VI, and Markovian score climbing (optimizing the forward KL divergence).


title: Learning to Detect and Segment Mobile Objects from Unlabeled Videos

abstract: Embodied agents must detect and localize objects of interest, e.g. traffic participants for self-driving cars. Supervision in the form of bounding boxes for this task is extremely expensive. As such, prior work has looked at unsupervised object segmentation, but in the absence of annotated boxes, it is unclear how pixels must be grouped into objects and which objects are of interest. This results in over- / under-segmentation and irrelevant objects. Inspired both by the human visual system and by practical applications, we posit that the key missing cue is motion: objects of interest are typically mobile objects. We propose MOD-UV, a Mobile Object Detector learned from Unlabeled Videos only. We begin with pseudo-labels derived from motion segmentation, but introduce a novel training paradigm to progressively discover small objects and static-but-mobile objects that are missed by motion segmentation. As a result, though only learned from unlabeled videos, MOD-UV can detect and segment mobile objects from a single static image. Empirically, we achieve state-of-the-art performance in unsupervised mobile object detection on Waymo Open, nuScenes, and KITTI Dataset without using any external data or supervised models. Code is publicly available at https://github.com/YihongSun/MOD-UV.


title: Dual-comb correlation spectroscopy of thermal light

abstract: The detection of light of thermal origin is the principal means by which humanity has learned about our world and the cosmos. In optical astronomy, in particular, direct detection of thermal photons and the resolution of their spectra have enabled discoveries of the broadest scope and impact. Such measurements, however, do not capture the phase of the thermal fields--a parameter that has proven crucial to transformative techniques in radio astronomy such as synthetic aperture imaging. Over the last 25 years, tremendous progress has occurred in laser science, notably in the phase-sensitive, broad bandwidth, high resolution, and traceable spectroscopy enabled by the optical frequency comb. In this work, we directly connect the fields of frequency comb laser spectroscopy and passive optical sensing as applied to astronomy, remote sensing, and atmospheric science. We provide fundamental sensitivity analysis of dual-comb correlation spectroscopy (DCCS), whereby broadband thermal light is measured via interferometry with two optical frequency combs. We define and experimentally verify the sensitivity scaling of DCCS at black body temperatures relevant for astrophysical observations. Moreover, we provide comparison with direct detection techniques and more conventional laser heterodyne radiometry. Our work provides the foundation for future exploration of comb-based broadband synthetic aperture hyperspectral imaging across the infrared and optical spectrum.


title: Accretion onto supermassive black hole binaries

abstract: In this chapter, we give an overview of our current understanding of the physics of accreting massive black hole binaries (MBHBs), with a special focus on the latest developments in numerical simulations and General-Relativistic Magnetohydrodynamics (GRMHD) simulations in particular. We give a self-contained global picture of how to model accretion onto MBHBs, analyzing different aspects of the system such as the dynamics of the circumbinary disk, mini-disks, outflows, the role of magnetic fields, and electromagnetic signatures. We discuss important questions and open problems related to these systems, what are the advantages and disadvantages of the different numerical approaches, and what robust knowledge we have built from simulations.


title: Electric, thermal, and thermoelectric magnetoconductivity for Weyl/multi-Weyl semimetals in planar Hall set-ups induced by the combined effects of topology and strain

abstract: We continue our investigation of the response tensors in planar Hall (or planar thermal Hall) configurations where a three-dimensional Weyl/multi-Weyl semimetal is subjected to the combined influence of an electric field $\mathbf E $ (or temperature gradient $\nabla_{\mathbf r } T$) and an effective magnetic field $\mathbf B_\chi $, generalizing the considerations of Phys. Rev. B 108 (2023) 155132 and Physica E 159 (2024) 115914. The electromagnetic fields are oriented at a generic angle with respect to each other, thus leading to the possibility of having a collinear component, which does not arise in a Hall set-up. The net effective magnetic field $\mathbf B_\chi $ consists of two parts - (a) an actual/physical magnetic field $\mathbf B $ applied externally; and (b) an emergent magnetic field $\mathbf B_5 $ which quantifies the elastic deformations of the sample. $\mathbf B_5 $ is an axial pseudomagnetic field because it couples to conjugate nodal points with opposite chiralities with opposite signs. Using a semiclassical Boltzmann formalism, we derive the generic expressions for the response tensors, including the effects of the Berry curvature (BC) and the orbital magnetic moment (OMM), which arise due to a nontrivial topology of the bandstructures. We elucidate the interplay of the BC-only and the OMM-dependent parts in the longitudinal and transverse (or Hall) components of the electric, thermal, and thermoelectric response tensors. Especially, for the planar transverse components of the response tensors, the OMM part acts exclusively in opposition (sync) with the BC-only part for the Weyl (multi-Weyl) semimetals.


title: Li-Yau sub-gradient estimates and Perelman-type entropy formulas for the heat equation in quaternionic contact geometry

abstract: We establish in the present paper two sub-gradient estimates for the quaternionic contact (qc) heat equation on a compact qc manifold of dimension $4n+3$, provided some positivity conditions are satisfied. These are qc versions of the prominent Li-Yau gradient estimate in Riemannian geometry. Another goal of this paper is to get two Perelman-type entropy formulas for the qc heat equation on a compact qc-Einstein manifold of dimension $4n+3$ with non-negative qc scalar curvature (e.g. compact $3$-Sasakian manifold), as well as an integral sub-gradient estimate for the positive solutions of the qc heat equation.


title: Semiclassical analysis on principal bundles

abstract: Let $G$ be a compact Lie group. We introduce a semiclassical framework, called Borel-Weil calculus, to investigate $G$-equivariant (pseudo)differential operators acting on $G$-principal bundles over closed manifolds. In this calculus, the semiclassical parameters correspond to the highest roots in the Weyl chamber of the group $G$ that parametrize irreducible representations, and operators are pseudodifferential in the base variable, with values in Toeplitz operators on the flag manifold associated to the group. This monograph unfolds two main applications of our calculus. Firstly, in the realm of dynamical systems, we obtain explicit sufficient conditions for rapid mixing of volume-preserving partially hyperbolic flows obtained as extensions of an Anosov flow to a $G$-principal bundle (for an arbitrary $G$). In particular, when $G = \mathrm{U}(1)$, we prove that the flow on the extension is rapid mixing whenever the Anosov flow is not jointly integrable, and the circle bundle is not torsion. When $G$ is semisimple, we prove that ergodicity of the extension is equivalent to rapid mixing. Secondly, we study the spectral theory of sub-elliptic Laplacians obtained as horizontal Laplacians of a $G$-equivariant connection on a principal bundle. When $G$ is semisimple, we prove that the horizontal Laplacian is globally hypoelliptic as soon as the connection has a dense holonomy group in $G$. Notably, this result encompasses all flat bundles with a dense monodromy group in $G$. We also prove a quantum ergodicity result for flat principal bundles with dense holonomy group if the base space has Anosov geodesic flow (e.g. in negative sectional curvature). We believe that this monograph will serve as a cornerstone for future investigations applying the Borel-Weil calculus across different fields.


title: Neural Directional Encoding for Efficient and Accurate View-Dependent Appearance Modeling

abstract: Novel-view synthesis of specular objects like shiny metals or glossy paints remains a significant challenge. Not only the glossy appearance but also global illumination effects, including reflections of other objects in the environment, are critical components to faithfully reproduce a scene. In this paper, we present Neural Directional Encoding (NDE), a view-dependent appearance encoding of neural radiance fields (NeRF) for rendering specular objects. NDE transfers the concept of feature-grid-based spatial encoding to the angular domain, significantly improving the ability to model high-frequency angular signals. In contrast to previous methods that use encoding functions with only angular input, we additionally cone-trace spatial features to obtain a spatially varying directional encoding, which addresses the challenging interreflection effects. Extensive experiments on both synthetic and real datasets show that a NeRF model with NDE (1) outperforms the state of the art on view synthesis of specular objects, and (2) works with small networks to allow fast (real-time) inference. The project webpage and source code are available at: \url{https://lwwu2.github.io/nde/}.


title: Local Causal Discovery for Structural Evidence of Direct Discrimination

abstract: Fairness is a critical objective in policy design and algorithmic decision-making. Identifying the causal pathways of unfairness requires knowledge of the underlying structural causal model, which may be incomplete or unavailable. This limits the practicality of causal fairness analysis in complex or low-knowledge domains. To mitigate this practicality gap, we advocate for developing efficient causal discovery methods for fairness applications. To this end, we introduce local discovery for direct discrimination (LD3): a polynomial-time algorithm that recovers structural evidence of direct discrimination. LD3 performs a linear number of conditional independence tests with respect to variable set size. Moreover, we propose a graphical criterion for identifying the weighted controlled direct effect (CDE), a qualitative measure of direct discrimination. We prove that this criterion is satisfied by the knowledge returned by LD3, increasing the accessibility of the weighted CDE as a causal fairness measure. Taking liver transplant allocation as a case study, we highlight the potential impact of LD3 for modeling fairness in complex decision systems. Results on real-world data demonstrate more plausible causal relations than baselines, which took 197x to 5870x longer to execute.


title: Novel $H^\mathrm{dev}(\mathrm{Curl})$-conforming elements on regular triangulations and Clough--Tocher splits for the planar relaxed micromorphic model

abstract: In this work we present a consistent reduction of the relaxed micromorphic model to its corresponding two-dimensional planar model, such that its capacity to capture discontinuous dilatation fields is preserved. As a direct consequence of our approach, new conforming finite elements for $H^\mathrm{dev}(\mathrm{Curl},A)$ become necessary. We present two novel $H^\mathrm{dev}(\mathrm{Curl},A)$-conforming finite element spaces, of which one is a macro element based on Clough--Tocher splits, as well as primal and mixed variational formulations of the planar relaxed micromorphic model. Finally, we demonstrate the effectiveness of our approach with two numerical examples.