title: Offline Retraining for Online RL: Decoupled Policy Learning to Mitigate Exploration Bias

abstract: It is desirable for policies to optimistically explore new states and behaviors during online reinforcement learning (RL) or fine-tuning, especially when prior offline data does not provide enough state coverage. However, exploration bonuses can bias the learned policy, and our experiments find that naive, yet standard use of such bonuses can fail to recover a performant policy. Concurrently, pessimistic training in offline RL has enabled recovery of performant policies from static datasets. Can we leverage offline RL to recover better policies from online interaction? We make a simple observation that a policy can be trained from scratch on all interaction data with pessimistic objectives, thereby decoupling the policies used for data collection and for evaluation. Specifically, we propose offline retraining, a policy extraction step at the end of online fine-tuning in our Offline-to-Online-to-Offline (OOO) framework for reinforcement learning (RL). An optimistic (exploration) policy is used to interact with the environment, and a separate pessimistic (exploitation) policy is trained on all the observed data for evaluation. Such decoupling can reduce any bias from online interaction (intrinsic rewards, primacy bias) in the evaluation policy, and can allow more exploratory behaviors during online interaction which in turn can generate better data for exploitation. OOO is complementary to several offline-to-online RL and online RL methods, and improves their average performance by 14% to 26% in our fine-tuning experiments, achieves state-of-the-art performance on several environments in the D4RL benchmarks, and improves online RL performance by 165% on two OpenAI gym environments. Further, OOO can enable fine-tuning from incomplete offline datasets where prior methods can fail to recover a performant policy. Implementation: https://github.com/MaxSobolMark/OOO


title: Phenomenal Yet Puzzling: Testing Inductive Reasoning Capabilities of Language Models with Hypothesis Refinement

abstract: The ability to derive underlying principles from a handful of observations and then generalize to novel situations -- known as inductive reasoning -- is central to human intelligence. Prior work suggests that language models (LMs) often fall short on inductive reasoning, despite achieving impressive success on research benchmarks. In this work, we conduct a systematic study of the inductive reasoning capabilities of LMs through iterative hypothesis refinement, a technique that more closely mirrors the human inductive process than standard input-output prompting. Iterative hypothesis refinement employs a three-step process: proposing, selecting, and refining hypotheses in the form of textual rules. By examining the intermediate rules, we observe that LMs are phenomenal hypothesis proposers (i.e., generating candidate rules), and when coupled with a (task-specific) symbolic interpreter that is able to systematically filter the proposed set of rules, this hybrid approach achieves strong results across inductive reasoning benchmarks that require inducing causal relations, language-like instructions, and symbolic concepts. However, they also behave as puzzling inductive reasoners, showing notable performance gaps between rule induction (i.e., identifying plausible rules) and rule application (i.e., applying proposed rules to instances), suggesting that LMs are proposing hypotheses without being able to actually apply the rules. Through empirical and human analyses, we further reveal several discrepancies between the inductive reasoning processes of LMs and humans, shedding light on both the potentials and limitations of using LMs in inductive reasoning tasks.


title: MemGPT: Towards LLMs as Operating Systems

abstract: Large language models (LLMs) have revolutionized AI, but are constrained by limited context windows, hindering their utility in tasks like extended conversations and document analysis. To enable using context beyond limited context windows, we propose virtual context management, a technique drawing inspiration from hierarchical memory systems in traditional operating systems that provide the appearance of large memory resources through data movement between fast and slow memory. Using this technique, we introduce MemGPT (Memory-GPT), a system that intelligently manages different memory tiers in order to effectively provide extended context within the LLM's limited context window, and utilizes interrupts to manage control flow between itself and the user. We evaluate our OS-inspired design in two domains where the limited context windows of modern LLMs severely handicaps their performance: document analysis, where MemGPT is able to analyze large documents that far exceed the underlying LLM's context window, and multi-session chat, where MemGPT can create conversational agents that remember, reflect, and evolve dynamically through long-term interactions with their users. We release MemGPT code and data for our experiments at https://memgpt.ai.


title: An extensively validated C/H/O/N chemical network for hot exoplanet disequilibrium chemistry

abstract: We aimed to build a new and updated C0-C2 chemical network to study the CHON disequilibrium chemistry of warm and hot exoplanet atmospheres that relies on extensively validated and recent state-of-the-art combustion networks. The reliability range of this network was aimed for conditions between 500 - 2500 K and 100 - 10^-6 bar. We compared the predictions of seven networks over a large set of experiments, covering a wide range of conditions (pressures, temperatures, and initial compositions). To examine the consequences of this new chemical network on exoplanets atmospheric studies, we generated abundances profiles for GJ 436 b, GJ 1214 b, HD 189733 b, and HD 209458 b, using the 1D kinetic model FRECKLL and calculated the corresponding transmission spectra using TauREx 3.1. These spectra and abundance profiles have been compared with results obtained with our previous chemical network. Our new kinetic network is composed of 174 species and 1293 reactions mostly reversible. This network proves to be more accurate than our previous one for the tested experimental conditions. The nitrogen chemistry update is found to be impactful on the abundance profiles, particularly for HCN, with differences up to four orders of magnitude. The CO2 profiles are also significantly affected, with important repercussions on the transmission spectrum of GJ 436 b. These effects highlight the importance of using extensively validated chemical networks to gain confidence in our models predictions. As shown with CH2NH, the coupling between carbon and nitrogen chemistry combined with radicals produced by photolysis can have huge effects impacting the transmission spectra.


title: Kinetic description and convergence analysis of genetic algorithms for global optimization

abstract: Genetic Algorithms (GA) are a class of metaheuristic global optimization methods inspired by the process of natural selection among individuals in a population. Despite their widespread use, a comprehensive theoretical analysis of these methods remains challenging due to the complexity of the heuristic mechanisms involved. In this work, relying on the tools of statistical physics, we take a first step towards a mathematical understanding of GA by showing how their behavior for a large number of individuals can be approximated through a time-discrete kinetic model. This allows us to prove the convergence of the algorithm towards a global minimum under mild assumptions on the objective function for a popular choice of selection mechanism. Furthermore, we derive a time-continuous model of GA, represented by a Boltzmann-like partial differential equation, and establish relations with other kinetic and mean-field dynamics in optimization. Numerical experiments support the validity of the proposed kinetic approximation and investigate the asymptotic configurations of the GA particle system for different selection mechanisms and benchmark problems.


title: Tverberg Partition Graphs

abstract: Given a finite set of points in $\mathbb{R}^d$, Tverberg's theorem guarantees the existence of partitions of this set into parts whose convex hulls intersect. We introduce a graph structured on the family of Tverberg partitions of a given set of points, whose edges describe closeness between different Tverberg partitions. We prove bounds on the minimum and maximum degree of this graph, the number of vertices of maximal degree, its clique number, and its connectedness.


title: The geometry of maximal development and shock formation for the Euler equations in multiple space dimensions

abstract: We construct a fundamental piece of the boundary of the maximal globally hyperbolic development (MGHD) of Cauchy data for the multi-dimensional compressible Euler equations, which is necessary for the local shock development problem. For an open set of compressive and generic $H^7$ initial data, we construct unique $H^7$ solutions to the Euler equations in the maximal spacetime region below a given time-slice, beyond the time of the first singularity; at any point in this spacetime, the solution can be smoothly and uniquely computed by tracing both the fast and slow acoustic characteristic surfaces backward-in-time, until reaching the Cauchy data prescribed along the initial time-slice. The future temporal boundary of this spacetime region is a singular hypersurface, containing the union of three sets: first, a co-dimension-$2$ surface of ``first singularities'' called the pre-shock; second, a downstream hypersurface called the singular set emanating from the pre-shock, on which the Euler solution experiences a continuum of gradient catastrophes; third, an upstream hypersurface consisting of a Cauchy horizon emanating from the pre-shock, which the Euler solution cannot reach. We develop a new geometric framework for the description of the acoustic characteristic surfaces which is based on the Arbitrary Lagrangian Eulerian (ALE) framework, and combine this with a new type of differentiated Riemann variables which are linear combinations of gradients of velocity, sound speed, and the curvature of the fast acoustic characteristic surfaces. With these new variables, we establish uniform $H^7$ Sobolev bounds for solutions to the Euler equations without derivative loss and with optimal regularity.


title: Security Considerations in AI-Robotics: A Survey of Current Methods, Challenges, and Opportunities

abstract: Robotics and Artificial Intelligence (AI) have been inextricably intertwined since their inception. Today, AI-Robotics systems have become an integral part of our daily lives, from robotic vacuum cleaners to semi-autonomous cars. These systems are built upon three fundamental architectural elements: perception, navigation and planning, and control. However, while the integration of AI-Robotics systems has enhanced the quality our lives, it has also presented a serious problem - these systems are vulnerable to security attacks. The physical components, algorithms, and data that make up AI-Robotics systems can be exploited by malicious actors, potentially leading to dire consequences. Motivated by the need to address the security concerns in AI-Robotics systems, this paper presents a comprehensive survey and taxonomy across three dimensions: attack surfaces, ethical and legal concerns, and Human-Robot Interaction (HRI) security. Our goal is to provide users, developers and other stakeholders with a holistic understanding of these areas to enhance the overall AI-Robotics system security. We begin by surveying potential attack surfaces and provide mitigating defensive strategies. We then delve into ethical issues, such as dependency and psychological impact, as well as the legal concerns regarding accountability for these systems. Besides, emerging trends such as HRI are discussed, considering privacy, integrity, safety, trustworthiness, and explainability concerns. Finally, we present our vision for future research directions in this dynamic and promising field.


title: Transformers as Decision Makers: Provable In-Context Reinforcement Learning via Supervised Pretraining

abstract: Large transformer models pretrained on offline reinforcement learning datasets have demonstrated remarkable in-context reinforcement learning (ICRL) capabilities, where they can make good decisions when prompted with interaction trajectories from unseen environments. However, when and how transformers can be trained to perform ICRL have not been theoretically well-understood. In particular, it is unclear which reinforcement-learning algorithms transformers can perform in context, and how distribution mismatch in offline training data affects the learned algorithms. This paper provides a theoretical framework that analyzes supervised pretraining for ICRL. This includes two recently proposed training methods -- algorithm distillation and decision-pretrained transformers. First, assuming model realizability, we prove the supervised-pretrained transformer will imitate the conditional expectation of the expert algorithm given the observed trajectory. The generalization error will scale with model capacity and a distribution divergence factor between the expert and offline algorithms. Second, we show transformers with ReLU attention can efficiently approximate near-optimal online reinforcement learning algorithms like LinUCB and Thompson sampling for stochastic linear bandits, and UCB-VI for tabular Markov decision processes. This provides the first quantitative analysis of the ICRL capabilities of transformers pretrained from offline trajectories.

categories: cs.LG cs.AI cs.CL math.ST stat.ML stat.TH


title: Macrostates vs. Microstates in the Classical Simulation of Critical Phenomena in Quench Dynamics of 1D Ising Models

abstract: We study the tractability of classically simulating critical phenomena in the quench dynamics of one-dimensional transverse field Ising models (TFIMs) using highly truncated matrix product states (MPS). We focus on two paradigmatic examples: a dynamical quantum phase transition (DQPT) that occurs in nonintegrable long-range TFIMs, and the infinite-time correlation length of the integrable nearest-neighbor TFIM when quenched to the critical point. For the DQPT, we show that the order parameters can be efficiently simulated with surprisingly heavy truncation of the MPS bond dimension. This can be used to reliably extract critical properties of the phase transition, including critical exponents, even when the full many-body state is not simulated with high fidelity. The long-time correlation length near the critical point is more sensitive to the full many-body state fidelity, and generally requires a large bond dimension MPS. Nonetheless, we find that this can still be efficiently simulated with strongly truncated MPS because it can be extracted from the short-time behavior of the dynamics where entanglement is low. Our results demonstrate that while accurate calculation of the full many-body state (microstate) is typically intractable due to the volume-law growth of entanglement, a precise specification of an exact microstate may not be required when simulating phases of matter of many-body systems (macrostates). We also study the tractability of simulation using truncated MPS based on quantum chaos and equilibration in the models. We find a counterintuitive inverse relationship, whereby local expectation values are most easily approximated for chaotic systems whose exact many-body state is most intractable.


title: Placement Optimization of Substitutable Products

abstract: Strategic product placement can have a strong influence on customer purchase behavior in physical stores as well as online platforms. Motivated by this, we consider the problem of optimizing the placement of substitutable products in designated display locations to maximize the expected revenue of the seller. We model the customer behavior as a two-stage process: first, the customer visits a subset of display locations according to a browsing distribution; second, the customer chooses at most one product from the displayed products at those locations according to a choice model. Our goal is to design a general algorithm that can select and place the products optimally for any browsing distribution and choice model, and we call this the Placement problem. We give a randomized algorithm that utilizes an $\alpha$-approximate algorithm for cardinality constrained assortment optimization and outputs a $\frac{\Theta(\alpha)}{\log m}$-approximate solution (in expectation) for Placement with $m$ display locations, i.e., our algorithm outputs a solution with value at least $\frac{\Omega(\alpha)}{\log m}$ factor of the optimal and this is tight in the worst case. We also give algorithms with stronger guarantees in some special cases. In particular, we give a deterministic $\frac{\Omega(1)}{\log m}$-approximation algorithm for the Markov choice model, and a tight $(1-1/e)$-approximation algorithm for the problem when products have identical prices.


title: A Lightweight Calibrated Simulation Enabling Efficient Offline Learning for Optimal Control of Real Buildings

abstract: Modern commercial Heating, Ventilation, and Air Conditioning (HVAC) devices form a complex and interconnected thermodynamic system with the building and outside weather conditions, and current setpoint control policies are not fully optimized for minimizing energy use and carbon emission. Given a suitable training environment, a Reinforcement Learning (RL) model is able to improve upon these policies, but training such a model, especially in a way that scales to thousands of buildings, presents many real world challenges. We propose a novel simulation-based approach, where a customized simulator is used to train the agent for each building. Our open-source simulator (available online: https://github.com/google/sbsim) is lightweight and calibrated via telemetry from the building to reach a higher level of fidelity. On a two-story, 68,000 square foot building, with 127 devices, we were able to calibrate our simulator to have just over half a degree of drift from the real world over a six-hour interval. This approach is an important step toward having a real-world RL control system that can be scaled to many buildings, allowing for greater efficiency and resulting in reduced energy consumption and carbon emissions.


title: Non-symmetric stable processes: Dirichlet heat kernel, Martin kernel and Yaglom limit

abstract: We study a $d$-dimensional non-symmetric strictly $\alpha$-stable L\'{e}vy process $\mathbf{X}$, whose spherical density is bounded and bounded away from the origin. First, we give sharp two-sided estimates on the transition density of $\mathbf{X}$ killed when leaving an arbitrary $\kappa$-fat set. We apply these results to get the existence of the Yaglom limit for arbitrary $\kappa$-fat cone. In the meantime we also obtain the spacial asymptotics of the survival probability at the vertex of the cone expressed by means of the Martin kernel for $\Gamma$ and its homogeneity exponent. Our results hold for the dual process $\widehat{\mathbf{X}}$, too.


title: Bucks for Buckets (B4B): Active Defenses Against Stealing Encoders

abstract: Machine Learning as a Service (MLaaS) APIs provide ready-to-use and high-utility encoders that generate vector representations for given inputs. Since these encoders are very costly to train, they become lucrative targets for model stealing attacks during which an adversary leverages query access to the API to replicate the encoder locally at a fraction of the original training costs. We propose Bucks for Buckets (B4B), the first active defense that prevents stealing while the attack is happening without degrading representation quality for legitimate API users. Our defense relies on the observation that the representations returned to adversaries who try to steal the encoder's functionality cover a significantly larger fraction of the embedding space than representations of legitimate users who utilize the encoder to solve a particular downstream task.vB4B leverages this to adaptively adjust the utility of the returned representations according to a user's coverage of the embedding space. To prevent adaptive adversaries from eluding our defense by simply creating multiple user accounts (sybils), B4B also individually transforms each user's representations. This prevents the adversary from directly aggregating representations over multiple accounts to create their stolen encoder copy. Our active defense opens a new path towards securely sharing and democratizing encoders over public APIs.


title: Non-Bloch band theory for non-Hermitian continuum systems

abstract: One of the most pronounced non-Hermitian phenomena is the non-Hermitian skin effect, which refers to the exponential localization of bulk eigenstates near the boundaries of non-Hermitian systems. Whereas non-Bloch band theory has been developed to describe the non-Hermitian skin effect in lattice systems, its counterpart in continuum systems still lacks a quantitative characterization. Here, we generalize the non-Bloch band theory to non-Hermitian continuum systems. In contrast to lattice systems for which the bulk Hamiltonian alone determines the non-Hermitian skin effect and energy spectrum, we find for continuum systems that the number of boundary conditions must also be included as essential information. We show that the appropriate discretization of continuum systems into lattice models requires matching the hopping range of the latter to the number of boundary conditions in the former. Furthermore, in periodic non-Hermitian continuum systems, we highlight the application of the transfer matrix in determining the generalized Brillouin zone. Our theory serves as a useful toolbox for investigating the rich non-Bloch physics in non-Hermitian continuum systems, such as photonic crystals, elastic media, and certain cold-atom systems.

categories: cond-mat.mes-hall cond-mat.quant-gas physics.optics quant-ph


title: PolyTask: Learning Unified Policies through Behavior Distillation

abstract: Unified models capable of solving a wide variety of tasks have gained traction in vision and NLP due to their ability to share regularities and structures across tasks, which improves individual task performance and reduces computational footprint. However, the impact of such models remains limited in embodied learning problems, which present unique challenges due to interactivity, sample inefficiency, and sequential task presentation. In this work, we present PolyTask, a novel method for learning a single unified model that can solve various embodied tasks through a 'learn then distill' mechanism. In the 'learn' step, PolyTask leverages a few demonstrations for each task to train task-specific policies. Then, in the 'distill' step, task-specific policies are distilled into a single policy using a new distillation method called Behavior Distillation. Given a unified policy, individual task behavior can be extracted through conditioning variables. PolyTask is designed to be conceptually simple while being able to leverage well-established algorithms in RL to enable interactivity, a handful of expert demonstrations to allow for sample efficiency, and preventing interactive access to tasks during distillation to enable lifelong learning. Experiments across three simulated environment suites and a real-robot suite show that PolyTask outperforms prior state-of-the-art approaches in multi-task and lifelong learning settings by significant margins.


title: Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models

abstract: Recent advancements in AI foundation models have made it possible for them to be utilized off-the-shelf for creative tasks, including ideating design concepts or generating visual prototypes. However, integrating these models into the creative process can be challenging as they often exist as standalone applications tailored to specific tasks. To address this challenge, we introduce Jigsaw, a prototype system that employs puzzle pieces as metaphors to represent foundation models. Jigsaw allows designers to combine different foundation model capabilities across various modalities by assembling compatible puzzle pieces. To inform the design of Jigsaw, we interviewed ten designers and distilled design goals. In a user study, we showed that Jigsaw enhanced designers' understanding of available foundation model capabilities, provided guidance on combining capabilities across different modalities and tasks, and served as a canvas to support design exploration, prototyping, and documentation.


title: Exact and asymptotic distribution theory for the empirical correlation of two AR(1) processes

abstract: This paper begins with a study of both the exact distribution and the asymptotic distribution of the empirical correlation of two independent AR(1) processes with Gaussian innovations. We proceed to develop rates of convergence for the distribution of the scaled empirical correlation %(i.e. the empirical correlation times the square root of the number of data points times a normalized constant) to the standard Gaussian distribution in both Wasserstein distance and in Kolmogorov distance. Given $n$ data points, we prove the convergence rate in Wasserstein distance is $n^{-1/2}$ and the convergence rate in Kolmogorov distance is $n^{-1/2} \sqrt{\ln n}$. We then compute rates of convergence of the scaled empirical correlation to the standard Gaussian distribution for two additional classes of AR(1) processes: (i) two AR(1) processes with correlated Gaussian increments and (ii) two independent AR(1) processes driven by white noise in the second Wiener chaos.


title: Learning to Act from Actionless Videos through Dense Correspondences

abstract: In this work, we present an approach to construct a video-based robot policy capable of reliably executing diverse tasks across different robots and environments from few video demonstrations without using any action annotations. Our method leverages images as a task-agnostic representation, encoding both the state and action information, and text as a general representation for specifying robot goals. By synthesizing videos that ``hallucinate'' robot executing actions and in combination with dense correspondences between frames, our approach can infer the closed-formed action to execute to an environment without the need of any explicit action labels. This unique capability allows us to train the policy solely based on RGB videos and deploy learned policies to various robotic tasks. We demonstrate the efficacy of our approach in learning policies on table-top manipulation and navigation tasks. Additionally, we contribute an open-source framework for efficient video modeling, enabling the training of high-fidelity policy models with four GPUs within a single day.


title: Visual Data-Type Understanding does not emerge from Scaling Vision-Language Models

abstract: Recent advances in the development of vision-language models (VLMs) are yielding remarkable success in recognizing visual semantic content, including impressive instances of compositional image understanding. Here, we introduce the novel task of Visual Data-Type Identification, a basic perceptual skill with implications for data curation (e.g., noisy data-removal from large datasets, domain-specific retrieval) and autonomous vision (e.g., distinguishing changing weather conditions from camera lens staining). We develop two datasets consisting of animal images altered across a diverse set of 27 visual data-types, spanning four broad categories. An extensive zero-shot evaluation of 39 VLMs, ranging from 100M to 80B parameters, shows a nuanced performance landscape. While VLMs are reasonably good at identifying certain stylistic \textit{data-types}, such as cartoons and sketches, they struggle with simpler data-types arising from basic manipulations like image rotations or additive noise. Our findings reveal that (i) model scaling alone yields marginal gains for contrastively-trained models like CLIP, and (ii) there is a pronounced drop in performance for the largest auto-regressively trained VLMs like OpenFlamingo. This finding points to a blind spot in current frontier VLMs: they excel in recognizing semantic content but fail to acquire an understanding of visual data-types through scaling. By analyzing the pre-training distributions of these models and incorporating data-type information into the captions during fine-tuning, we achieve a significant enhancement in performance. By exploring this previously uncharted task, we aim to set the stage for further advancing VLMs to equip them with visual data-type understanding. Code and datasets are released at https://github.com/bethgelab/DataTypeIdentification.


title: Neural network approach to quasiparticle dispersions in doped antiferromagnets

abstract: Numerically simulating spinful, fermionic systems is of great interest from the perspective of condensed matter physics. However, the exponential growth of the Hilbert space dimension with system size renders an exact parameterization of large quantum systems prohibitively demanding. This is a perfect playground for neural networks, owing to their immense representative power that often allows to use only a fraction of the parameters that are needed in exact methods. Here, we investigate the ability of neural quantum states (NQS) to represent the bosonic and fermionic $t-J$ model - the high interaction limit of the Fermi-Hubbard model - on different 1D and 2D lattices. Using autoregressive recurrent neural networks (RNNs) with 2D tensorized gated recurrent units, we study the ground state representations upon doping the half-filled system with holes. Moreover, we present a method to calculate dispersion relations from the neural network state representation, applicable to any neural network architecture and any lattice geometry, that allows to infer the low-energy physics from the NQS. To demonstrate our approach, we calculate the dispersion of a single hole in the $t-J$ model on different 1D and 2D square and triangular lattices. Furthermore, we analyze the strengths and weaknesses of the RNN approach for fermionic systems, pointing the way for an accurate and efficient parameterization of fermionic quantum systems using neural quantum states.


title: HyperHuman: Hyper-Realistic Human Generation with Latent Structural Diffusion

abstract: Despite significant advances in large-scale text-to-image models, achieving hyper-realistic human image generation remains a desirable yet unsolved task. Existing models like Stable Diffusion and DALL-E 2 tend to generate human images with incoherent parts or unnatural poses. To tackle these challenges, our key insight is that human image is inherently structural over multiple granularities, from the coarse-level body skeleton to fine-grained spatial geometry. Therefore, capturing such correlations between the explicit appearance and latent structure in one model is essential to generate coherent and natural human images. To this end, we propose a unified framework, HyperHuman, that generates in-the-wild human images of high realism and diverse layouts. Specifically, 1) we first build a large-scale human-centric dataset, named HumanVerse, which consists of 340M images with comprehensive annotations like human pose, depth, and surface normal. 2) Next, we propose a Latent Structural Diffusion Model that simultaneously denoises the depth and surface normal along with the synthesized RGB image. Our model enforces the joint learning of image appearance, spatial relationship, and geometry in a unified network, where each branch in the model complements to each other with both structural awareness and textural richness. 3) Finally, to further boost the visual quality, we propose a Structure-Guided Refiner to compose the predicted conditions for more detailed generation of higher resolution. Extensive experiments demonstrate that our framework yields the state-of-the-art performance, generating hyper-realistic human images under diverse scenarios. Project Page: https://snap-research.github.io/HyperHuman/


title: OmniControl: Control Any Joint at Any Time for Human Motion Generation

abstract: We present a novel approach named OmniControl for incorporating flexible spatial control signals into a text-conditioned human motion generation model based on the diffusion process. Unlike previous methods that can only control the pelvis trajectory, OmniControl can incorporate flexible spatial control signals over different joints at different times with only one model. Specifically, we propose analytic spatial guidance that ensures the generated motion can tightly conform to the input control signals. At the same time, realism guidance is introduced to refine all the joints to generate more coherent motion. Both the spatial and realism guidance are essential and they are highly complementary for balancing control accuracy and motion realism. By combining them, OmniControl generates motions that are realistic, coherent, and consistent with the spatial constraints. Experiments on HumanML3D and KIT-ML datasets show that OmniControl not only achieves significant improvement over state-of-the-art methods on pelvis control but also shows promising results when incorporating the constraints over other joints.


title: Universal Visual Decomposer: Long-Horizon Manipulation Made Easy

abstract: Real-world robotic tasks stretch over extended horizons and encompass multiple stages. Learning long-horizon manipulation tasks, however, is a long-standing challenge, and demands decomposing the overarching task into several manageable subtasks to facilitate policy learning and generalization to unseen tasks. Prior task decomposition methods require task-specific knowledge, are computationally intensive, and cannot readily be applied to new tasks. To address these shortcomings, we propose Universal Visual Decomposer (UVD), an off-the-shelf task decomposition method for visual long horizon manipulation using pre-trained visual representations designed for robotic control. At a high level, UVD discovers subgoals by detecting phase shifts in the embedding space of the pre-trained representation. Operating purely on visual demonstrations without auxiliary information, UVD can effectively extract visual subgoals embedded in the videos, while incurring zero additional training cost on top of standard visuomotor policy training. Goal-conditioned policies learned with UVD-discovered subgoals exhibit significantly improved compositional generalization at test time to unseen tasks. Furthermore, UVD-discovered subgoals can be used to construct goal-based reward shaping that jump-starts temporally extended exploration for reinforcement learning. We extensively evaluate UVD on both simulation and real-world tasks, and in all cases, UVD substantially outperforms baselines across imitation and reinforcement learning settings on in-domain and out-of-domain task sequences alike, validating the clear advantage of automated visual task decomposition within the simple, compact UVD framework.


title: Tree-Planner: Efficient Close-loop Task Planning with Large Language Models

abstract: This paper studies close-loop task planning, which refers to the process of generating a sequence of skills (a plan) to accomplish a specific goal while adapting the plan based on real-time observations. Recently, prompting Large Language Models (LLMs) to generate actions iteratively has become a prevalent paradigm due to its superior performance and user-friendliness. However, this paradigm is plagued by two inefficiencies: high token consumption and redundant error correction, both of which hinder its scalability for large-scale testing and applications. To address these issues, we propose Tree-Planner, which reframes task planning with LLMs into three distinct phases: plan sampling, action tree construction, and grounded deciding. Tree-Planner starts by using an LLM to sample a set of potential plans before execution, followed by the aggregation of them to form an action tree. Finally, the LLM performs a top-down decision-making process on the tree, taking into account real-time environmental information. Experiments show that Tree-Planner achieves state-of-the-art performance while maintaining high efficiency. By decomposing LLM queries into a single plan-sampling call and multiple grounded-deciding calls, a considerable part of the prompt are less likely to be repeatedly consumed. As a result, token consumption is reduced by 92.2% compared to the previously best-performing model. Additionally, by enabling backtracking on the action tree as needed, the correction process becomes more flexible, leading to a 40.5% decrease in error corrections. Project page: https://tree-planner.github.io/


title: Discovering Fatigued Movements for Virtual Character Animation

abstract: Virtual character animation and movement synthesis have advanced rapidly during recent years, especially through a combination of extensive motion capture datasets and machine learning. A remaining challenge is interactively simulating characters that fatigue when performing extended motions, which is indispensable for the realism of generated animations. However, capturing such movements is problematic, as performing movements like backflips with fatigued variations up to exhaustion raises capture cost and risk of injury. Surprisingly, little research has been done on faithful fatigue modeling. To address this, we propose a deep reinforcement learning-based approach, which -- for the first time in literature -- generates control policies for full-body physically simulated agents aware of cumulative fatigue. For this, we first leverage Generative Adversarial Imitation Learning (GAIL) to learn an expert policy for the skill; Second, we learn a fatigue policy by limiting the generated constant torque bounds based on endurance time to non-linear, state- and time-dependent limits in the joint-actuation space using a Three-Compartment Controller (3CC) model. Our results demonstrate that agents can adapt to different fatigue and rest rates interactively, and discover realistic recovery strategies without the need for any captured data of fatigued movement.


title: Is ImageNet worth 1 video? Learning strong image encoders from 1 long unlabelled video

abstract: Self-supervised learning has unlocked the potential of scaling up pretraining to billions of images, since annotation is unnecessary. But are we making the best use of data? How more economical can we be? In this work, we attempt to answer this question by making two contributions. First, we investigate first-person videos and introduce a "Walking Tours" dataset. These videos are high-resolution, hours-long, captured in a single uninterrupted take, depicting a large number of objects and actions with natural scene transitions. They are unlabeled and uncurated, thus realistic for self-supervision and comparable with human learning. Second, we introduce a novel self-supervised image pretraining method tailored for learning from continuous videos. Existing methods typically adapt image-based pretraining approaches to incorporate more frames. Instead, we advocate a "tracking to learn to recognize" approach. Our method called DoRA, leads to attention maps that Discover and tRAck objects over time in an end-to-end manner, using transformer cross-attention. We derive multiple views from the tracks and use them in a classical self-supervised distillation loss. Using our novel approach, a single Walking Tours video remarkably becomes a strong competitor to ImageNet for several image and video downstream tasks.


title: Im4D: High-Fidelity and Real-Time Novel View Synthesis for Dynamic Scenes

abstract: This paper aims to tackle the challenge of dynamic view synthesis from multi-view videos. The key observation is that while previous grid-based methods offer consistent rendering, they fall short in capturing appearance details of a complex dynamic scene, a domain where multi-view image-based rendering methods demonstrate the opposite properties. To combine the best of two worlds, we introduce Im4D, a hybrid scene representation that consists of a grid-based geometry representation and a multi-view image-based appearance representation. Specifically, the dynamic geometry is encoded as a 4D density function composed of spatiotemporal feature planes and a small MLP network, which globally models the scene structure and facilitates the rendering consistency. We represent the scene appearance by the original multi-view videos and a network that learns to predict the color of a 3D point from image features, instead of memorizing detailed appearance totally with networks, thereby naturally making the learning of networks easier. Our method is evaluated on five dynamic view synthesis datasets including DyNeRF, ZJU-MoCap, NHR, DNA-Rendering and ENeRF-Outdoor datasets. The results show that Im4D exhibits state-of-the-art performance in rendering quality and can be trained efficiently, while realizing real-time rendering with a speed of 79.8 FPS for 512x512 images, on a single RTX 3090 GPU.


title: PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm

abstract: In contrast to numerous NLP and 2D vision foundational models, learning a 3D foundational model poses considerably greater challenges. This is primarily due to the inherent data variability and diversity of downstream tasks. In this paper, we introduce a novel universal 3D pre-training framework designed to facilitate the acquisition of efficient 3D representation, thereby establishing a pathway to 3D foundational models. Considering that informative 3D features should encode rich geometry and appearance cues that can be utilized to render realistic images, we propose to learn 3D representations by differentiable neural rendering. We train a 3D backbone with a devised volumetric neural renderer by comparing the rendered with the real images. Notably, our approach seamlessly integrates the learned 3D encoder into various downstream tasks. These tasks encompass not only high-level challenges such as 3D detection and segmentation but also low-level objectives like 3D reconstruction and image synthesis, spanning both indoor and outdoor scenarios. Besides, we also illustrate the capability of pre-training a 2D backbone using the proposed methodology, surpassing conventional pre-training methods by a large margin. For the first time, PonderV2 achieves state-of-the-art performance on 11 indoor and outdoor benchmarks, implying its effectiveness. Code and models are available at https://github.com/OpenGVLab/PonderV2.


title: Pseudo-Generalized Dynamic View Synthesis from a Video

abstract: Rendering scenes observed in a monocular video from novel viewpoints is a challenging problem. For static scenes the community has studied both scene-specific optimization techniques, which optimize on every test scene, and generalized techniques, which only run a deep net forward pass on a test scene. In contrast, for dynamic scenes, scene-specific optimization techniques exist, but, to our best knowledge, there is currently no generalized method for dynamic novel view synthesis from a given monocular video. To answer whether generalized dynamic novel view synthesis from monocular videos is possible today, we establish an analysis framework based on existing techniques and work toward the generalized approach. We find a pseudo-generalized process without scene-specific appearance optimization is possible, but geometrically and temporally consistent depth estimates are needed. Despite no scene-specific appearance optimization, the pseudo-generalized approach improves upon some scene-specific methods.


title: Octopus: Embodied Vision-Language Programmer from Environmental Feedback

abstract: Large vision-language models (VLMs) have achieved substantial progress in multimodal perception and reasoning. Furthermore, when seamlessly integrated into an embodied agent, it signifies a crucial stride towards the creation of autonomous and context-aware systems capable of formulating plans and executing commands with precision. In this paper, we introduce Octopus, a novel VLM designed to proficiently decipher an agent's vision and textual task objectives and to formulate intricate action sequences and generate executable code. Our design allows the agent to adeptly handle a wide spectrum of tasks, ranging from mundane daily chores in simulators to sophisticated interactions in complex video games. Octopus is trained by leveraging GPT-4 to control an explorative agent to generate training data, i.e., action blueprints and the corresponding executable code, within our experimental environment called OctoVerse. We also collect the feedback that allows the enhanced training scheme of Reinforcement Learning with Environmental Feedback (RLEF). Through a series of experiments, we illuminate Octopus's functionality and present compelling results, and the proposed RLEF turns out to refine the agent's decision-making. By open-sourcing our model architecture, simulator, and dataset, we aspire to ignite further innovation and foster collaborative applications within the broader embodied AI community.


title: Protoplanetary disks in $K_s$-band total intensity and polarized light

abstract: Diverse protoplanetary disk morphology can result from planet-disk interaction, suggesting planetary presence. To date, most scattered light imaging campaigns have probed polarized light, which is only a fraction of the total light and not very sensitive to planets. To observe and characterize protoplanetary disk systems in the near-infrared in both polarized and total intensity light, we carried out an unprecedented study of scattering properties of disks, as well as of any planetary companions. Using SPHERE with star-hopping at the Very Large Telescope, we observed 29 disk hosts and their reference stars in $K_s$-band polarized light. We extracted disks in total intensity by adopting the data imputation concept with sequential non-negative matrix factorization (DI-sNMF). We obtained high-quality disk images in total intensity for 15 systems and in polarized light for 23. For well-recovered disks in polarized light and total intensity, we parameterized the polarization fraction phase functions using scaled beta distribution: the peak of polarization fraction tentatively correlates with the peak scattering angle, which could be reproduced using certain compact dust, yet more detailed modeling studies are needed. We investigated the empirical DI-sNMF detectability of disks using logistic regression: total intensity detectability of disks primarily depends on host star brightness. For disks with SPHERE data in $Y$-/$J$-/$H$-band, we summarized their polarized color at ~90 deg scattering angle: most of disks are blue in polarized $J-K_s$ color, and they are relatively redder as stellar luminosity increases, indicating larger scatterers. High-quality disk imagery in both total intensity and polarized light thus allows for disk characterization in polarization fraction, and reduces the confusion between disk and planetary signals.


title: Insight into the melt processed Polylimonene oxide/Polylactic acid blends

abstract: In this work, the polymerization of limonene oxide (LO) has been optimized at room temperature with two different aluminium-based catalysts [AlMeX{2,6-(CHPh$_2$)$_2$-4-tBu-C$_6$H$_2$O}] (X = Me (1), Cl (2)). A fully bio-based ether, polylimonene oxide (PLO), has been synthesized with low molecular weight and good thermal stability, being a potential sustainable polymeric additive for other bio-based and biodegradable polymers such as polylactic acid (PLA). Hence, we have explored its ability to influence the thermal, mechanical and morphological properties of PLA by preparing their blends by melt processing. The addition of a low amount of PLO led to a nearly 10 $^\circ$C decrease in the PLA glass transition temperature. Moreover, a decrease in the PLA melting temperature and the degree of crystallinity was observed. Interestingly, a remarkable increase in the flexibility of PLA-based films was noticed. All the results point to the existence of strong interactions between the components, suggesting their partial miscibility.


title: Spin-orbit coupling and Jahn-Teller effect in $T_d$ symmetry: an \textit{ab initio} study on the substitutional nickel defect in diamond

abstract: We analyze the spin-orbit and Jahn-Teller interactions in $T_d$ symmetry that are relevant for substitutional transition metal defects in semiconductors. We apply our theory to the substitutional nickel defect in diamond and compute the appropriate fine-leve structure and magneto-optical parameters by means of hybrid density functional theory. Our calculations confirm the intepretations of previous experimental findings that the 2.56-eV and 2.51-eV optical centres are associated with this defect. Our analysis of the electronic structure unravels possible mechanisms behind the observed optical transitions and the optically detected magnetic resonance signal, too.


title: Exploring Thermal Transport in Electrochemical Energy Storage Systems Utilizing Two-Dimensional Materials: Prospects and Hurdles

abstract: Two-dimensional materials and their heterostructures have enormous applications in Electrochemical Energy Storage Systems (EESS) such as batteries. A comprehensive and solid understanding of these materials' thermal transport and mechanism is essential for the practical design of EESS. Experiments have challenges in providing improved control and characterization of complex structures, especially for low dimensional materials. Theoretical and simulation tools such as first-principles calculations, boltzmann transport equations, molecular dynamics simulations, lattice dynamics simulation, and non-equilibrium Green's function provide reliable predictions of thermal conductivity and physical insights to understand the underlying thermal transport mechanism in materials. However, doing these calculations require high computational resources. The development of new materials synthesis technology and fast-growing demand for rapid and accurate prediction of physical properties require novel computational approaches. The machine learning (ML) method provides a promising solution to address such needs. This review details the recent development in atomistic/molecular studies and ML of thermal transport in EESS. The paper also addresses the latest significant experimental advances. However, designing the best low-dimensional materials-based heterostructures is like a multivariate optimization problem. For example, a particular heterostructure may be suitable for thermal transport but can have lower mechanical strength/stability. For bi/multilayer structures, the interlayer distance may influence the thermal transport properties and interlayer strength. Therefore, the last part addresses the future research direction in low-dimensional materials-based heterostructure design for thermal transport in EESS.


title: Data-driven methods for diffusivity prediction in nuclear fuels

abstract: The growth rate of structural defects in nuclear fuels under irradiation is intrinsically related to the diffusion rates of the defects in the fuel lattice. The generation and growth of atomistic structural defects can significantly alter the performance characteristics of the fuel. This alteration of functionality must be accurately captured to qualify a nuclear fuel for use in reactors. Predicting the diffusion coefficients of defects and how they impact macroscale properties such as swelling, gas release, and creep is therefore of significant importance in both the design of new nuclear fuels and the assessment of current fuel types. In this article, we apply data-driven methods focusing on machine learning (ML) to determine various diffusion properties of two nuclear fuels, uranium oxide and uranium nitride. We show that using ML can increase, often significantly, the accuracy of predicting diffusivity in nuclear fuels in comparison to current analytical models. We also illustrate how ML can be used to quickly develop fuel models with parameter dependencies that are more complex and robust than what is currently available in the literature. These results suggest there is potential for ML to accelerate the design, qualification, and implementation of nuclear fuels.


title: Investigation into the nature behind the interesting half levitation behavior of claimed superconductor LK-99

abstract: A recent article published by Lee et.al. claimed to have successfully achieved superconductivity at room temperature (RT) has become a topical issue. Besides the research paper, Lee and his team provided a demonstration video of LK-99 half levitating (HL) on a magnet. Such interesting HL appearance has drawn tremendous sensation both in academia and the network. However, the true identity of LK-99 still remains unclear, i.e., whether the HL behavior can necessarily indicate the diamagnetism behavior of the sample. Here, we fabricated our own LK-99 samples following the procedures reported by Lee et al. We found quite a few sample pieces showing the typical HL that is similar to those reported. Meanwhile, oxidation during the sample preparation was found to deleterious to acquiring HL in the sample, while furnace cooling or water quenching in the last step revealed little effect. However, our careful observations indicated that those HL pieces are more likely simple ferromagnetic. Then we conducted a comprehensive study on the behavior patterns of typical diamagnetism and ferromagnetic substances interacting with a Nd2Fe14B magnet, and provided instructions to distinguish the characteristics between ferromagnetic and diamagnetic to prevent misunderstanding of LK-99 like levitation behavior.


title: Deep Reinforcement Learning for Autonomous Vehicle Intersection Navigation

abstract: In this paper, we explore the challenges associated with navigating complex T-intersections in dense traffic scenarios for autonomous vehicles (AVs). Reinforcement learning algorithms have emerged as a promising approach to address these challenges by enabling AVs to make safe and efficient decisions in real-time. Here, we address the problem of efficiently and safely navigating T-intersections using a lower-cost, single-agent approach based on the Twin Delayed Deep Deterministic Policy Gradient (TD3) reinforcement learning algorithm. We show that our TD3-based method, when trained and tested in the CARLA simulation platform, demonstrates stable convergence and improved safety performance in various traffic densities. Our results reveal that the proposed approach enables the AV to effectively navigate T-intersections, outperforming previous methods in terms of travel delays, collision minimization, and overall cost. This study contributes to the growing body of knowledge on reinforcement learning applications in autonomous driving and highlights the potential of single-agent, cost-effective methods for addressing more complex driving scenarios and advancing reinforcement learning algorithms in the future.


title: Predicting Lung Cancer's Metastats' Locations Using Bioclinical Model

abstract: Lung cancer is a leading cause of cancer-related deaths worldwide. The spread of the disease from its primary site to other parts of the lungs, known as metastasis, significantly impacts the course of treatment. Early identification of metastatic lesions is crucial for prompt and effective treatment, but conventional imaging techniques have limitations in detecting small metastases. In this study, we develop a bioclinical model for predicting the spatial spread of lung cancer's metastasis using a three-dimensional computed tomography (CT) scan. We used a three-layer biological model of cancer spread to predict locations with a high probability of metastasis colonization. We validated the bioclinical model on real-world data from 10 patients, showing promising 74% accuracy in the metastasis location prediction. Our study highlights the potential of the combination of biophysical and ML models to advance the way that lung cancer is diagnosed and treated, by providing a more comprehensive understanding of the spread of the disease and informing treatment decisions.


title: A Method for Multi-Robot Asynchronous Trajectory Execution in MoveIt2

abstract: This work presents an extension to the MoveIt2 planning library supporting asynchronous execution for multi-robot / multi-arm robotic setups. The proposed method introduces a unified way for the execution of both synchronous and asynchronous trajectories by implementing a simple scheduler and guarantees collision-free operation by continuous collision checking while the robots are moving.


title: Domain Generalization for Medical Image Analysis: A Survey

abstract: Medical image analysis (MedIA) has become an essential tool in medicine and healthcare, aiding in disease diagnosis, prognosis, and treatment planning, and recent successes in deep learning (DL) have made significant contributions to its advances. However, deploying DL models for MedIA in real-world situations remains challenging due to their failure to generalize across the distributional gap between training and testing samples - a problem known as domain shift. Researchers have dedicated their efforts to developing various DL methods to adapt and perform robustly on unknown and out-of-distribution data distributions. This paper comprehensively reviews domain generalization studies specifically tailored for MedIA. We provide a holistic view of how domain generalization techniques interact within the broader MedIA system, going beyond methodologies to consider the operational implications on the entire MedIA workflow. Specifically, we categorize domain generalization methods into data-level, feature-level, model-level, and analysis-level methods. We show how those methods can be used in various stages of the MedIA workflow with DL equipped from data acquisition to model prediction and analysis. Furthermore, we critically analyze the strengths and weaknesses of various methods, unveiling future research opportunities.


title: A Survey of Multi-Robot Motion Planning

abstract: Multi-robot Motion Planning (MRMP) is an active research field which has gained attention over the years. MRMP has significant roles to improve the efficiency and reliability of multi-robot system in a wide range of applications from delivery robots to collaborative assembly lines. This survey provides an overview of MRMP taxonomy, state-of-the-art algorithms, and approaches which have been developed for multi-robot systems. This study also discusses the strengths and limitations of each algorithm and their applications in various scenarios. Moreover, based on this, we can draw out open problems for future research.


title: Ill-posedness of time-dependent inverse problems in Lebesgue-Bochner spaces

abstract: We consider time-dependent inverse problems in a mathematical setting using Lebesgue-Bochner spaces. Such problems arise when one aims to recover parameters from given observations where the parameters or the data depend on time. There are various important applications being subject of current research that belong to this class of problems. Typically inverse problems are ill-posed in the sense that already small noise in the data causes tremendous errors in the solution. In this article we present two different concepts of ill-posedness: temporally (pointwise) ill-posedness and uniform ill-posedness with respect to the Lebesgue-Bochner setting. We investigate the two concepts by means of a typical setting consisting of a time-depending observation operator composed by a compact operator. Furthermore we develop regularization methods that are adapted to the respective class of ill-posedness.


title: Unit Commitment Predictor With a Performance Guarantee: A Support Vector Machine Classifier

abstract: The system operators usually need to solve large-scale unit commitment problems within limited time frame for computation. This paper provides a pragmatic solution, showing how by learning and predicting the on/off commitment decisions of conventional units, there is a potential for system operators to warm start their solver and speed up their computation significantly. For the prediction, we train linear and kernelized support vector machine classifiers, providing an out-of-sample performance guarantee if properly regularized, converting to distributionally robust classifiers. For the unit commitment problem, we solve a mixed-integer second-order cone problem. Our results based on the IEEE 6- and 118-bus test systems show that the kernelized SVM with proper regularization outperforms other classifiers, reducing the computational time by a factor of 1.7. In addition, if there is a tight computational limit, while the unit commitment problem without warm start is far away from the optimal solution, its warmly-started version can be solved to (near) optimality within the time limit.


title: Safe Deep Policy Adaptation

abstract: A critical goal of autonomy and artificial intelligence is enabling autonomous robots to rapidly adapt in dynamic and uncertain environments. Classic adaptive control and safe control provide stability and safety guarantees but are limited to specific system classes. In contrast, policy adaptation based on reinforcement learning (RL) offers versatility and generalizability but presents safety and robustness challenges. We propose SafeDPA, a novel RL and control framework that simultaneously tackles the problems of policy adaptation and safe reinforcement learning. SafeDPA jointly learns adaptive policy and dynamics models in simulation, predicts environment configurations, and fine-tunes dynamics models with few-shot real-world data. A safety filter based on the Control Barrier Function (CBF) on top of the RL policy is introduced to ensure safety during real-world deployment. We provide theoretical safety guarantees of SafeDPA and show the robustness of SafeDPA against learning errors and extra perturbations. Comprehensive experiments on (1) classic control problems (Inverted Pendulum), (2) simulation benchmarks (Safety Gym), and (3) a real-world agile robotics platform (RC Car) demonstrate great superiority of SafeDPA in both safety and task performance, over state-of-the-art baselines. Particularly, SafeDPA demonstrates notable generalizability, achieving a 300% increase in safety rate compared to the baselines, under unseen disturbances in real-world experiments.


title: Sufficient Conditions for Distance Reduction between the Minimizers of Non-convex Quadratic Functions in the Trust Region

abstract: This paper analyzes the sufficient conditions for distance reduction between minimizers of non-convex quadratic functions with diagonal Hessian in the $\ell^2$-norm trust regions after two iterations. This paper also presents some examples corresponding to the theoretical results.


title: Pontryagin Maximum Principle for Incommensurate Fractional-Orders Optimal Control Problems

abstract: We introduce a new optimal control problem where the controlled dynamical system depends on multi-order (incommensurate) fractional differential equations. The cost functional to be maximized is of Bolza type and depends on incommensurate Caputo fractional-orders derivatives. We establish continuity and differentiability of the state solutions with respect to perturbed trajectories. Then, we state and prove a Pontryagin maximum principle for incommensurate Caputo fractional optimal control problems. Finally, we give an example, illustrating the applicability of our Pontryagin maximum principle.


title: Detection of Iron in Nanoclustered Cytochrome C Proteins Using Nitrogen-Vacancy Magnetic Relaxometry

abstract: Nitrogen-vacancy (NV) magnetometry offers an alternative tool to detect iron levels in neurons and cells with a favorable combination of magnetic sensitivity and spatial resolution. Here we employ NV-T1 relaxometry to detect Fe in cytochrome C (Cyt-C) nanoclusters. Cyt-C is a water-soluble protein that contains a single heme group and plays a vital role in the electron transport chain of mitochondria. Under ambient conditions, the heme group remains in the Fe+3 paramagnetic state. We perform NV-T1 relaxometry on a functionalized diamond chip and vary the concentration of Cyt-C from 6 uM to 54 uM, resulting in a decrease of T1 from 1.2 ms to 150 us, respectively. This reduction is attributed to spin-noise originating from the Fe spins present within the Cyt-C. We perform relaxometry imaging of Cyt-C proteins on a nanostructured diamond chip by varying the density of adsorbed iron from 1.44 x 10^6 to 1.7 x 10^7 per um^2.


title: Multiscale Fusion for Abnormality Detection and Localization of Distributed Parameter Systems

abstract: Numerous industrial thermal processes and fluid processes can be described by distributed parameter systems (DPSs), wherein many process parameters and variables vary in space and time. Early internal abnormalities in the DPS may develop into uncontrollable thermal failures, causing serious safety incidents. In this study, the multiscale information fusion is proposed for internal abnormality detection and localization of DPSs under different scenarios. We introduce the dissimilarity statistic as a means to identify anomalies for lumped variables, whereas spatial and temporal statistic measures are presented for the anomaly detection for distributed variables. Through appropriate parameter optimization, these statistic functions are integrated into the comprehensive multiscale detection index, which outperforms traditional single-scale detection methods. The proposed multiscale statistic has good physical interpretability from the system disorder degree. Experiments on the internal short circuit (ISC) of a battery system have demonstrated that our proposed method can swiftly identify ISC abnormalities and accurately pinpoint problematic battery cells under various working conditions.


title: Infrared Cloud Monitoring with UCIRC2

abstract: The second generation of the Extreme Universe Space Observatory on a Super Pressure Balloon (EUSO-SPB2) is a balloon instrument that searched for ultra high energy cosmic rays (UHECRs) with energies above 1 EeV and very high energy neutrinos with energies above 1 PeV. EUSO-SPB2 consists of two telescopes: a fluorescence telescope pointed downward for the detection of UHECRs and a Cherenkov telescope toward the limb for the detection of PeV-scale showers produced by neutrino-sourced tau decay (just below the limb) and by cosmic rays (just above the limb). Clouds inside the fields of view of these telescopes--particularly that of the fluorescence telescope--reduce EUSO-SPB2's geometric aperture. As such, cloud coverage and cloud-top altitude within the field of view of the fluorescence telescope must be monitored throughout data-taking. The University of Chicago Infrared Camera (UCIRC2) monitored these clouds using two infrared cameras centered at 10 and 12 $\mu$m. By capturing images at wavelengths spanning the cloud thermal emission peak, UCIRC2 measured cloud color-temperatures and thus cloud-top altitudes. In this contribution, we provide an overview of UCIRC2, including an update on its construction and performance. We also show first results from the flight.


title: BrainVoxGen: Deep learning framework for synthesis of Ultrasound to MRI

abstract: The study presents a deep learning framework aimed at synthesizing 3D MRI volumes from three-dimensional ultrasound images of the brain utilizing the Pix2Pix GAN model. The process involves inputting a 3D volume of ultrasounds into a UNET generator and patch discriminator, generating a corresponding 3D volume of MRI. Model performance was evaluated using losses on the discriminator and generator applied to a dataset of 3D ultrasound and MRI images. The results indicate that the synthesized MRI images exhibit some similarity to the expected outcomes. Despite challenges related to dataset size, computational resources, and technical complexities, the method successfully generated MRI volume with a satisfactory similarity score meant to serve as a baseline for further research. It underscores the potential of deep learning-based volume synthesis techniques for ultrasound to MRI conversion, showcasing their viability for medical applications. Further refinement and exploration are warranted for enhanced clinical relevance.


title: Optimized shock-protecting microstructures

abstract: Mechanical shock is a common occurrence in various settings, there are two different scenarios for shock protection: catastrophic protection (e.g. car collisions and falls) and routine protection (e.g. shoe soles and shock absorbers for car seats). The former protects against one-time events, the latter against periodic shocks and loads. Common shock absorbers based on plasticity and fracturing materials are suitable for the former, while our focus is on the latter, where elastic structures are useful. Improved elastic materials protecting against shock can be used in applications such as automotive suspension, furniture like sofas and mattresses, landing gear systems, etc. Materials offering optimal protection against shock have a highly non-linear elastic response: their reaction force needs to be as close as possible to constant with respect to deformation. In this paper, we use shape optimization and topology search to design 2D families of microstructures approximating the ideal behavior across a range of deformations, leading to superior shock protection. We present an algorithmic pipeline for the optimal design of such families combining differentiable nonlinear homogenization with self-contact and an optimization algorithm. These advanced 2D designs can be extruded and fabricated with existing 3D printing technologies. We validate their effectiveness through experimental testing.


title: Geometric regularity of blow-up limits of the K\"ahler-Ricci flow

abstract: We establish geometric regularity for Type I blow-up limits of the K\"ahler-Ricci flow based at any sequence of Ricci vertices. As a consequence, the limiting flow is continuous in time in both Gromov-Hausdorff and Gromov-$W_1$ distance. In particular, the singular sets of each time slice and its tangent cones are close and of codimension no less than $4$.


title: Energy estimates for the Einstein-Yang-Mills fields and applications

abstract: We prove exterior energy estimates for tensorial non-linear wave equations, where the background metric is a perturbation of the Minkowski space-time, and where the derivatives are the Minkowski covariant derivatives. We obtain bounds in the exterior region of the Minkowski space-time, for the weighted $L^2$ norm on each component, separately, of the covariant derivative of the tensorial solutions, and we also control a space-time integral in the exterior of the covariant tangential derivatives of the solutions. As a special application, we use here these energy estimates to prove the exterior stability of the Minkowski space-time, $\mathbb{R}^{1+4}$, as solution to the coupled Einstein-Yang-Mills system associated to any compact Lie group $G$, in the Lorenz gauge and in wave coordinates. The bounds in the exterior for the $L^2$ norm on the covariant derivatives of each component, separately, of the tensor solution, as well as the bound on the space-time integral of the covariant tangential derivatives, are motivated by a problem that we will address in a paper that follows to prove the exterior stability of the $(1+3)$-Minkowski space-time for perturbations governed by the Einstein-Yang-Mills equations.


title: Realization of an electromechanical nano-string device

abstract: Electromechanics is the field of studying the interaction between microwave resonators and mechanical oscillators. It has been an interesting topic in the recent decade due to its numerous potential applications in science and technology, including ground-state cooling of macroscopic objects, quantum sensing, quantum memory, and quantum transduction. This thesis presents a comprehensive analysis of a project focused on simulating, designing, and modeling electromechanical devices with the ultimate objective of achieving their successful implementation. Through the thesis, after an overview of the theoretical model of electromechanics, I will introduce our design for the device and explain how we simulated it to optimize its characteristics. Next, I will discuss the nanofabrication process we have developed for the device, along with the fundamental aspects of the characterization method and setup. Subsequently, I will present the theoretical model I have developed based on electromechanics. This model has significant potential to open up new avenues for future research, building upon the foundation laid by the current project.


title: Individual Variation Affects Outbreak Magnitude and Predictability in an Extended Multi-Pathogen SIR Model of Pigeons Vising Dairy Farms

abstract: Zoonotic disease transmission between animals and humans is a growing risk and the agricultural context acts as a likely point of transition, with individual heterogeneity acting as an important contributor. Thus, understanding the dynamics of disease spread in the wildlife-livestock interface is crucial for mitigating these risks of transmission. Specifically, the interactions between pigeons and in-door cows at dairy farms can lead to significant disease transmission and economic losses for farmers; putting livestock, adjacent human populations, and other wildlife species at risk. In this paper, we propose a novel spatio-temporal multi-pathogen model with continuous spatial movement. The model expands on the Susceptible-Exposed-Infected-Recovered-Dead (SEIRD) framework and accounts for both within-species and cross-species transmission of pathogens, as well as the exploration-exploitation movement dynamics of pigeons, which play a critical role in the spread of infection agents. In addition to model formulation, we also implement it as an agent-based simulation approach and use empirical field data to investigate different biologically realistic scenarios, evaluating the effect of various parameters on the epidemic spread. Namely, in agreement with theoretical expectations, the model predicts that the heterogeneity of the pigeons' movement dynamics can drastically affect both the magnitude and stability of outbreaks. In addition, joint infection by multiple pathogens can have an interactive effect unobservable in single-pathogen SIR models, reflecting a non-intuitive inhibition of the outbreak. Our findings highlight the impact of heterogeneity in host behavior on their pathogens and allow realistic predictions of outbreak dynamics in the multi-pathogen wildlife-livestock interface with consequences to zoonotic diseases in various systems.


title: Analysing of 3D MIMO Communication Beamforming in Linear and Planar Arrays

abstract: Massive multiple-input multiple-output (MIMO) systems are expected to play a crucial role in the 5G wireless communication systems. These advanced systems, which are being deployed since 2021, offer significant advantages over conventional communications generations. Unlike previous versions of communication, MIMO systems can transmit various probing signals through their antennas, which may or may not be correlated with each other. This waveform diversity provided by MIMO communication enables enhanced capabilities and improved performance. Numerous research papers have proposed different approaches for beamforming in MIMO communication. We anticipate that our research will provide valuable insights into the performance of different beamforming techniques for MIMO communication systems with planar arrays. We will investigate the 3D beam patterns generated by these constellations using the covariance-based MIMO communication waveform method. MATLAB simulations will be utilized to analyze and evaluate the performance of these methods.


title: Alternative combinatorial sum for the probability mass function of the Poisson distribution of order $k$

abstract: Kostadinova and Minkova published an expression for the probability mass function (pmf) of the Poisson distribution of order $k$, as a combinatorial sum ($\mathit{Pliska~Stud.~Math.~Bulgar.}\ {\bf 22},\ 117-128\ (2013)$). Inspired by their elegant solution, this note presents an alternative combinatorial sum for the pmf of the Poisson distribution of order $k$. The terms are partitioned into blocks of length $k$ (as opposed to $k+1$ by Kostadinova and Minkova). The new sum offers an advantage in the following sense. For $n\in[rk+1,(r+1)k]$, the lowest power of $\lambda$ in the pmf is $\lambda^{r+1}$. Hence the lower limit of summation can be increased, to avoid needlessly calculating terms which cancel to identically zero.


title: Ground observations of a space laser for the assessment of its in-orbit performance

abstract: The wind mission Aeolus of the European Space Agency was a groundbreaking achievement for Earth observation. Between 2018 and 2023, the space-borne lidar instrument ALADIN onboard the Aeolus satellite measured atmospheric wind profiles with global coverage which contributed to improving the accuracy of numerical weather prediction. The precision of the wind observations, however, declined over the course of the mission due to a progressive loss of the atmospheric backscatter signal. The analysis of the root cause was supported by the Pierre Auger Observatory in Argentina whose fluorescence detector registered the ultraviolet laser pulses emitted from the instrument in space, thereby offering an estimation of the laser energy at the exit of the instrument for several days in 2019, 2020 and 2021. The reconstruction of the laser beam not only allowed for an independent assessment of the Aeolus performance, but also helped to improve the accuracy in the determination of the laser beam's ground track on single pulse level. The results presented in this paper set a precedent for the monitoring of space lasers by ground-based telescopes and open new possibilities for the calibration of cosmic-ray observatories.


title: The Impact of Explanations on Fairness in Human-AI Decision-Making: Protected vs Proxy Features

abstract: AI systems have been known to amplify biases in real-world data. Explanations may help human-AI teams address these biases for fairer decision-making. Typically, explanations focus on salient input features. If a model is biased against some protected group, explanations may include features that demonstrate this bias, but when biases are realized through proxy features, the relationship between this proxy feature and the protected one may be less clear to a human. In this work, we study the effect of the presence of protected and proxy features on participants' perception of model fairness and their ability to improve demographic parity over an AI alone. Further, we examine how different treatments -- explanations, model bias disclosure and proxy correlation disclosure -- affect fairness perception and parity. We find that explanations help people detect direct but not indirect biases. Additionally, regardless of bias type, explanations tend to increase agreement with model biases. Disclosures can help mitigate this effect for indirect biases, improving both unfairness recognition and decision-making fairness. We hope that our findings can help guide further research into advancing explanations in support of fair human-AI decision-making.


title: Deep learning for nano-photonic materials -- The solution to everything!?

abstract: Deep learning is currently being hyped as an almost magical tool for solving all kinds of difficult problems that computers have not been able to solve in the past. Particularly in the fields of computer vision and natural language processing, spectacular results have been achieved. The hype has now infiltrated several scientific communities. In (nano-)photonics, researchers are trying to apply deep learning to all kinds of forward and inverse problems. A particularly challenging problem is for instance the rational design of nanophotonic materials and devices. In this opinion article, I will first discuss the public expectations of deep learning and give an overview of the quite different scales at which actors from industry and research are operating their deep learning models. I then examine the weaknesses and dangers associated with deep learning. Finally, I'll discuss the key strengths that make this new set of statistical methods so attractive, and review a personal selection of opportunities that shouldn't be missed in the current developments.


title: Unlocking the capabilities of explainable fewshot learning in remote sensing

abstract: Recent advancements have significantly improved the efficiency and effectiveness of deep learning methods for imagebased remote sensing tasks. However, the requirement for large amounts of labeled data can limit the applicability of deep neural networks to existing remote sensing datasets. To overcome this challenge, fewshot learning has emerged as a valuable approach for enabling learning with limited data. While previous research has evaluated the effectiveness of fewshot learning methods on satellite based datasets, little attention has been paid to exploring the applications of these methods to datasets obtained from UAVs, which are increasingly used in remote sensing studies. In this review, we provide an up to date overview of both existing and newly proposed fewshot classification techniques, along with appropriate datasets that are used for both satellite based and UAV based data. Our systematic approach demonstrates that fewshot learning can effectively adapt to the broader and more diverse perspectives that UAVbased platforms can provide. We also evaluate some SOTA fewshot approaches on a UAV disaster scene classification dataset, yielding promising results. We emphasize the importance of integrating XAI techniques like attention maps and prototype analysis to increase the transparency, accountability, and trustworthiness of fewshot models for remote sensing. Key challenges and future research directions are identified, including tailored fewshot methods for UAVs, extending to unseen tasks like segmentation, and developing optimized XAI techniques suited for fewshot remote sensing problems. This review aims to provide researchers and practitioners with an improved understanding of fewshot learnings capabilities and limitations in remote sensing, while highlighting open problems to guide future progress in efficient, reliable, and interpretable fewshot methods.


title: Divorce Prediction with Machine Learning: Insights and LIME Interpretability

abstract: Divorce is one of the most common social issues in developed countries like in the United States. Almost 50% of the recent marriages turn into an involuntary divorce or separation. While it is evident that people vary to a different extent, and even over time, an incident like Divorce does not interrupt the individual's daily activities; still, Divorce has a severe effect on the individual's mental health, and personal life. Within the scope of this research, the divorce prediction was carried out by evaluating a dataset named by the 'divorce predictor dataset' to correctly classify between married and Divorce people using six different machine learning algorithms- Logistic Regression (LR), Linear Discriminant Analysis (LDA), K-Nearest Neighbors (KNN), Classification and Regression Trees (CART), Gaussian Na\"ive Bayes (NB), and, Support Vector Machines (SVM). Preliminary computational results show that algorithms such as SVM, KNN, and LDA, can perform that task with an accuracy of 98.57%. This work's additional novel contribution is the detailed and comprehensive explanation of prediction probabilities using Local Interpretable Model-Agnostic Explanations (LIME). Utilizing LIME to analyze test results illustrates the possibility of differentiating between divorced and married couples. Finally, we have developed a divorce predictor app considering ten most important features that potentially affect couples in making decisions in their divorce, such tools can be used by any one in order to identify their relationship condition.


title: Phase Noise in Real-World Twin-Field Quantum Key Distribution

abstract: The impact of noise sources in real-world implementations of Twin-Field Quantum Key Distribution (TF-QKD) protocols is investigated, focusing on phase noise from photon sources and connecting fibers. This work emphasizes the role of laser quality, network topology, fiber length, arm balance, and detector performance in determining key rates. Remarkably, it reveals that the leading TF-QKD protocols are similarly affected by phase noise despite different mechanisms. This study demonstrates duty cycle improvements of over a factor of two through narrow-linewidth lasers and phase-control techniques, highlighting the potential synergy with high-precision time/frequency distribution services. Ultrastable lasers, evolving toward integration and miniaturization, offer promise for agile TF-QKD implementations on existing networks. Properly addressing phase noise and practical constraints allows for consistent key rate predictions, protocol selection, and layout design, crucial for establishing secure long-haul links for the Quantum Communication Infrastructures under development in several countries.


title: Theoretical strong line metallicity diagnostics for the JWST era

abstract: The ratios of strong rest-frame optical emission lines are the dominant indicator of metallicities in high-redshift galaxies. Since typical strong-line based metallicity indicators are calibrated on auroral lines at $z=0$, their applicability for galaxies in the distant Universe is unclear. In this paper, we make use of mock emission line data from cosmological simulations to investigate the calibration of rest-frame optical emission lines as metallicity indicators at high redshift. Our model, which couples the SIMBA cosmological galaxy formation simulation with cloudy photoionization calculations, includes contributions from HII regions, post-AGB stars and Diffuse Ionized Gas (DIG). We find mild redshift evolution in the 12 indicators that we study, which implies that the dominant physical properties that evolve in our simulations do have a discernible impact on the metallicity calibrations at high redshifts. When comparing our calibrations with high redshift auroral line observations from James Webb Space Telescope we find a slight offset between our model results and the observations and find that a higher ionization parameter at high redshifts can be one of the possible explanations. We explore the physics that drives the shapes of strong-line metallicity relationships and propose calibrations for hitherto unexplored low-metallicity regimes. Finally, we study the contribution of DIG to total line fluxes. We find that the contribution of DIG increases with metallicity at z $\sim$ 0 for singly ionized oxygen and sulfur lines and can be as high as 70% making it crucial to include their contribution when modeling nebular emission.


title: Self-consistent MHD simulation of jet launching in a neutron star - white dwarf merger

abstract: The merger of a white dwarf (WD) and a neutron star (NS) is a relatively common event that will produce an observable electromagnetic signal. Furthermore, the compactness of these stellar objects makes them an interesting candidate for gravitational wave (GW) astronomy, potentially being in the frequency range of LISA and other missions. To date, three-dimensional simulations of these mergers have not fully modelled the WD disruption, or have used lower resolutions and have not included magnetic fields even though they potentially shape the evolution of the merger remnant. In this work, we simulate the merger of a 1.4$M_\odot$ NS with a 1$M_\odot$ carbon oxygen WD in the magnetohydrodynamic moving mesh code \AREPO. We find that the disruption of the WD forms an accretion disk around the NS, and the subsequent accretion by the NS powers the launch of strongly magnetized, mildly relativistic jets perpendicular to the orbital plane. Although the exact properties of the jets could be altered by unresolved physics around the NS, the event could result in a transient with a larger luminosity than kilonovae. We discuss possible connections to fast blue optical transients (FBOTs) and long-duration gamma-ray bursts. We find that the frequency of GWs released during the merger is too high to be detectable by the LISA mission, but suitable for deci-hertz observatories such as LGWA, BBO or DECIGO.


title: SAGUARO: Time-domain Infrastructure for the Fourth Gravitational-wave Observing Run and Beyond

abstract: We present upgraded infrastructure for Searches after Gravitational Waves Using ARizona Observatories (SAGUARO) during LIGO, Virgo, and KAGRA's fourth gravitational-wave (GW) observing run (O4). These upgrades implement many of the lessons we learned after a comprehensive analysis of potential electromagnetic counterparts to the GWs discovered during the previous observing run. We have developed a new web-based target and observation manager (TOM) that allows us to coordinate sky surveys, vet potential counterparts, and trigger follow-up observations from one centralized portal. The TOM includes software that aggregates all publicly available information on the light curves and possible host galaxies of targets, allowing us to rule out potential contaminants like active galactic nuclei, variable stars, solar-system objects, and preexisting supernovae, as well as to assess the viability of any plausible counterparts. We have also upgraded our image-subtraction pipeline by assembling deeper reference images and training a new neural network-based real-bogus classifier. These infrastructure upgrades will aid coordination by enabling the prompt reporting of observations, discoveries, and analysis to the GW follow-up community, and put SAGUARO in an advantageous position to discover kilonovae in the remainder of O4 and beyond. Many elements of our open-source software stack have broad utility beyond multimessenger astronomy, and will be particularly relevant in the "big data" era of transient discoveries by the Vera C. Rubin Observatory.


title: The Basso-Dixon Formula and Calabi-Yau Geometry

abstract: We analyse the family of Calabi-Yau varieties attached to four-point fishnet integrals in two dimensions. We find that the Picard-Fuchs operators for fishnet integrals are exterior powers of the Picard-Fuchs operators for ladder integrals. This implies that the periods of the Calabi-Yau varieties for fishnet integrals can be written as determinants of periods for ladder integrals. The representation theory of the geometric monodromy group plays an important role in this context. We then show how the determinant form of the periods immediately leads to the well-known Basso-Dixon formula for four-point fishnet integrals in two dimensions. Notably, the relation to Calabi-Yau geometry implies that the volume is also expressible via a determinant formula of Basso-Dixon type. Finally, we show how the fishnet integrals can be written in terms of iterated integrals naturally attached to the Calabi-Yau varieties.


title: Gauge Defects

abstract: Gauging a symmetry can be thought of as the insertion of a spacetime-filling defect. Accordingly, we regard each gaugeable symmetry in a theory as defining a $-1$-form symmetry via condensation. The resulting operators, called gauge defects, have a natural fusion product, generally non-invertible, which we explore in a variety of two-dimensional theories.


title: On probing turbulence in core-collapse supernovae in upcoming neutrino detectors

abstract: Neutrino propagation through a turbulent medium can be highly non-adiabatic leading to distinct signatures in the survival probabilities. A core-collapse supernova can be host to a number of hydrodynamic instabilities which occur behind the shockfront. Such instabilities between the forward shock and a possible reverse shock can lead to cascades introducing turbulence in the associated matter profile, which can imprint itself in the neutrino signal. In this work, we consider realistic matter profiles and seed in the turbulence using a randomization scheme to study its effects on neutrino propagation in an effective two-flavor framework. In particular, we find that the double-dip feature, originally predicted in the neutrino spectra associated with forward and reverse shocks, can be completely washed away in the presence of turbulence, leading to total flavor depolarization. We also study the sensitivity of upcoming neutrino detectors - DUNE and Hyper-Kamiokande- to the power spectrum of turbulence to check for deviations from the usual Kolmogorov ($5/3$) inverse power law. We find that while these experiments can effectively constrain the parameter space for the amplitude of the turbulence power spectra, they will only be mildly sensitive to the spectral index.


title: From electronic structure to magnetism and skyrmions (Topical review)

abstract: Solid state theory, density functional theory and its generalizations for correlated systems together with numerical simulations on supercomputers allow nowadays to model magnetic systems realistically and in detail and can be even used to predict new materials, paving the way for more rapid material development for applications in energy storage and conversion, information technologies, sensors, actuators etc. Modelling magnets on different length scales (between a few \r{A}ngstr\"om and several micrometers) requires, however, approaches with very different mathematical formulations. Parameters defining the material in each formulation can be determined either by fitting experimental data or from theoretical calculations and there exists a well-established approach for obtaining model parameters for each length scale using the information from the smaller length scale. In this review, this approach will be explained step-by-step in textbook style with examples of successful multiscale modelling of different classes of magnetic materials from the research literature as well as based on results newly obtained for this review.


title: Axions and Superfluidity in Weyl Semimetals

abstract: An effective field theory (EFT) for dynamical axions in Weyl semimetals (WSMs) is presented. A pseudoscalar axion excitation is predicted in WSMs at sufficiently low temperatures, independently of the strength of the Weyl fermion self-coupling. For strong fermion self-coupling the axion is the gapless Goldstone boson of chiral $U(1)^{\text{ch}}$ spontaneous symmetry breaking. For weak fermion self-coupling an axion is also generated at non-zero chiral density for Weyl nodes displaced in energy, as a gapless collective mode of correlated fermion pair excitations of the Fermi surface. This is an explicit example of the extension of Goldstone's theorem to symmetry breaking by the axial anomaly itself. In both cases the axion is a chiral density wave or phason mode of the superfluid state of the WSM, and the Weyl fermions form a chiral condensate $\langle\bar{\psi}\psi\rangle$ at low temperatures. In the presence of an applied magnetic field the axion mode becomes gapped, in analogy to the Anderson-Higgs mechanism in a superconductor. 't Hooft anomaly matching from ultraviolet to infrared scales is directly verified in the EFT approach. WSMs thus provide an interesting quantum system in which superfluid, non-Fermi liquid behavior, and a dynamical axion are predicted to follow directly from the axial anomaly in a consistent EFT that may be tested experimentally.


title: Entanglement-induced collective many-body interference

abstract: Entanglement and interference are both hallmark effects of quantum physics. Particularly rich dynamics arise when multiple (at least partially) indistinguishable particles are subjected to either of these phenomena. By combining both entanglement and many-particle interference, we propose an interferometric setting through which N-particle interference can be observed, while any interference of lower orders is strictly suppressed. We experimentally demonstrate this effect in a four-photon interferometer, where the interference is nonlocal, in principle, as only pairs of photons interfere at two separate and independent beam splitters. A joint detection of all four photons identifies a high-visibility interference pattern varying as a function of their collective four-particle phase, a genuine four-body property.


title: The Rapid Optical Variability of the Nearby Radio-Loud AGN Pictor A: Introducing the Quaver Pipeline for AGN Science with TESS

abstract: The sampling strategy of the Transiting Exoplanet Survey Satellite (TESS) make TESS light curves extremely valuable to investigate high cadence optical variability of AGN. However, because the TESS instrument was primarily designed for exoplanet science, the use of the satellite for other applications requires careful treatment of the data. In this paper we introduce Quaver, a new software tool designed specifically to extract TESS light curves of extended and faint sources presenting stochastic variability. We then use this new tool to extract light curves of the nearby radio-loud AGN Pictor A, and perform a temporal and power spectral analysis of its high cadence optical variability. The obtained light curves are well fit with a damped random walk (DRW) model, exhibiting both stochastic AGN variations and flaring behavior. The DRW characteristic timescales $\tau_{\rm DRW} \sim 3-6$ days during more quiet periods, and $\tau_{\rm DRW} \sim 0.8$ days for periods with strong flares, even when the flares themselves are masked from the DRW fit. The observed timescales are consistent with the dynamical, orbital and thermal timescales expected for the low black hole mass of Pictor A.