title: A Unified Sequence Interface for Vision Tasks

abstract: While language tasks are naturally expressed in a single, unified, modeling framework, i.e., generating sequences of tokens, this has not been the case in computer vision. As a result, there is a proliferation of distinct architectures and loss functions for different vision tasks. In this work we show that a diverse set of "core" computer vision tasks can also be unified if formulated in terms of a shared pixel-to-sequence interface. We focus on four tasks, namely, object detection, instance segmentation, keypoint detection, and image captioning, all with diverse types of outputs, e.g., bounding boxes or dense masks. Despite that, by formulating the output of each task as a sequence of discrete tokens with a unified interface, we show that one can train a neural network with a single model architecture and loss function on all these tasks, with no task-specific customization. To solve a specific task, we use a short prompt as task description, and the sequence output adapts to the prompt so it can produce task-specific output. We show that such a model can achieve competitive performance compared to well-established task-specific models.


title: Energy Transport between Strange Quantum Baths

abstract: Energy transport in quantum many-body systems with well defined quasiparticles has recently attracted interest across different fields, including out of equilibrium conformal field theories, one dimensional quantum lattice models and holographic matter. Here we study energy transport between \emph{strange quantum baths} without quasiparticles, made by two Sachdev-Ye-Kitaev (SYK) models at temperatures $T_L\neq T_R$ and connected by a Fermi-Liquid system. We obtain an exact expression for the nonequilibrium energy current, valid in the limit of large bath and system size and for any system-bath coupling $V$. We show that the peculiar criticality of the SYK baths has direct consequences on the thermal conductance, which above a temperature $T^*(V)\sim V^4$ is parametrically enhanced with respect to the linear-$T$ behavior expected in systems with quasiparticles. Interestingly, below $T^*(V)$ the linear thermal conductance behavior is restored, yet transport is not due to quasiparticles. Rather the system gets strongly renormalized by the strange bath and becomes Non-Fermi-Liquid and maximally chaotic. Finally, we discuss the full nonequilibrium energy current and show that its form is compatible with the structure $\mathcal{J}=\Phi(T_L)-\Phi(T_R)$, with $\Phi(T)\sim T^{\gamma}$ and power law crossing over from $\gamma=3/2$ to $\gamma=2$ below $T^*$.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.stat-mech hep-th


title: Dust polarization spectral dependence from Planck HFI data. Turning point on CMB polarization foregrounds modelling

abstract: The search for the primordial B-modes of the cosmic microwave background (CMB) relies on the separation from the brighter foreground dust signal. In this context, the characterisation of the spectral energy distribution (SED) of thermal dust in polarization has become a critical subject of study. We present a power-spectra analysis of Planck data, which improves on previous studies by using the newly released SRoll2 maps that correct residual data systematics, and by extending the analysis to regions near the Galactic plane. Our analysis focuses on the lowest multipoles between l=4 and 32, and three sky areas with sky fractions of fsky = 80%, 90%, and 97%. The mean dust SED for polarization and the 353 GHz Q and U maps are used to compute residual maps at 100, 143 and 217 GHz, highlighting spatial variations of the dust polarization SED. Residuals are detected at the three frequencies for the three sky areas. We show that models based on total intensity data are underestimating by a significant factor the complexity of dust polarized CMB foreground. Our analysis emphasizes the need to include variations of polarization angles of the dust polarized CMB foreground. The frequency dependence of the EE and BB power spectra of the residual maps yields further insight. We find that the moments expansion to the first order of the modified black-body (MBB) spectrum provides a good fit to the EE power-spectra. This result suggests that the residuals could follow mainly from variations of dust MBB spectral parameters. However, this conclusion is challenged by cross-spectra showing that the residuals maps at the three frequencies are not fully correlated, and the fact that the BB power-spectra do not match the first order moment expansion of a MBB SED. This work sets new requirements for simulations of the dust polarized foreground and component separation methods (abridged)


title: Reconstructing Ultrametric Trees from Noisy Experiments

abstract: The problem of reconstructing evolutionary trees or phylogenies is of great interest in computational biology. A popular model for this problem assumes that we are given the set of leaves (current species) of an unknown binary tree and the results of `experiments' on triples of leaves (a,b,c), which return the pair with the deepest least common ancestor. If the tree is assumed to be an ultrametric (i.e., all root-leaf paths have the same length), the experiment can be equivalently seen to return the closest pair of leaves. In this model, efficient algorithms are known for tree reconstruction. In reality, since the data on which these `experiments' are run is itself generated by the stochastic process of evolution, these experiments are noisy. In all reasonable models of evolution, if the branches leading to the leaves in a triple separate from each other at common ancestors that are very close to each other in the tree, the result of the experiment should be close to uniformly random. Motivated by this, we consider a model where the noise on any triple is just dependent on the three pairwise distances (referred to as distance based noise). Our results are the following: 1. Suppose the length of every edge in the unknown tree is at least $\tilde{O}(\frac{1}{\sqrt n})$ fraction of the length of a root-leaf path. Then, we give an efficient algorithm to reconstruct the topology of the tree for a broad family of distance-based noise models. Further, we show that if the edges are asymptotically shorter, then topology reconstruction is information-theoretically impossible. 2. Further, for a specific distance-based noise model--which we refer to as the homogeneous noise model--we show that the edge weights can also be approximately reconstructed under the same quantitative lower bound on the edge lengths.


title: Wide Bayesian neural networks have a simple weight posterior: theory and accelerated sampling

abstract: We introduce repriorisation, a data-dependent reparameterisation which transforms a Bayesian neural network (BNN) posterior to a distribution whose KL divergence to the BNN prior vanishes as layer widths grow. The repriorisation map acts directly on parameters, and its analytic simplicity complements the known neural network Gaussian process (NNGP) behaviour of wide BNNs in function space. Exploiting the repriorisation, we develop a Markov chain Monte Carlo (MCMC) posterior sampling algorithm which mixes faster the wider the BNN. This contrasts with the typically poor performance of MCMC in high dimensions. We observe up to 50x higher effective sample size relative to no reparametrisation for both fully-connected and residual networks. Improvements are achieved at all widths, with the margin between reparametrised and standard BNNs growing with layer width.


title: Summarizing Labeled Multi-Graphs

abstract: Real-world graphs can be difficult to interpret and visualize beyond a certain size. To address this issue, graph summarization aims to simplify and shrink a graph, while maintaining its high-level structure and characteristics. Most summarization methods are designed for homogeneous, undirected, simple graphs; however, many real-world graphs are ornate; with characteristics including node labels, directed edges, edge multiplicities, and self-loops. In this paper we propose LM-Gsum, a versatile yet rigorous graph summarization model that (to the best of our knowledge, for the first time) can handle graphs with all the aforementioned characteristics (and any combination thereof). Moreover, our proposed model captures basic sub-structures that are prevalent in real-world graphs, such as cliques, stars, etc. LM-Gsum compactly quantifies the information content of a complex graph using a novel encoding scheme, where it seeks to minimize the total number of bits required to encode (i) the summary graph, as well as (ii) the corrections required for reconstructing the input graph losslessly. To accelerate the summary construction, it creates super-nodes efficiently by merging nodes in groups. Experiments demonstrate that LM-Gsum facilitates the visualization of real-world complex graphs, revealing interpretable structures and high- level relationships. Furthermore, LM-Gsum achieves better trade-off between compression rate and running time, relative to existing methods (only) on comparable settings.


title: A solution for the rare type match problem when using the DIP-STR marker system

abstract: The rare type match problem is an evaluative challenging situation in which the analysis of a DNA profile reveals the presence of (at least) one allele which is not contained in the reference database. This situation is challenging because an estimate for the frequency of occurrence of the profile in a given population needs sophisticated evaluative procedures. The rare type match problem is very common when the DIP-STR marker system, which has proven itself very useful for dealing with unbalanced DNA mixtures, is used, essentially due to the limited size of the available database. The object-oriented Bayesian network proposed in Cereda, Biedermann, Hall and Taroni (2014) to assess the value of the evidence for general scenarios, was not designed to deal with this particular situation. In this paper, the model is extended and partially modified to be able to calculate the full Bayesian likelihood ratio in presence of any (observed and not yet observed) allele of a given profile. The method is based on the approach developed in Cereda (2017) for Y-STR data. Alternative solutions, such as the plug-in approximation and an empirical Bayesian methodology are also proposed and compared with the results obtained with the full Bayesian approach.


title: A note on higher rank descriptions of massless and massive spin-1 particles

abstract: The Maxwell theory can be written as a first order model with the help of a two-form auxiliary field, such master action allows the proof of duality between $1$-form and $D-3$ forms. Here we show that the replacement of the two-form auxiliary field by an arbitrary (non symmetric) rank-2 tensor leads to a new massless spin-1 dual theory in terms of a partially antisymmetric rank-3 tensor. In the massive spin-1 case we have a non symmetric generalization of the massive two-form theory (Kalb-Ramond). The coupling of the massive non symmetric spin-1 model to matter fields is investigated via master actions. We also show that massive models with severe discontinuity in their massless limit can also be obtained from Kaluza-Klein dimensional reduction of massless higher rank tensors which become Stueckelberg fields after the reduction.


title: Fredholm determinants, Evans functions and Maslov indices for partial differential equations

abstract: The Evans function is a well known tool for locating spectra of differential operators in one spatial dimension. In this paper we construct a multidimensional analogue as the modified Fredholm determinant of a ratio of Dirichlet-to-Robin operators on the boundary. This gives a tool for studying the eigenvalue counting functions of second-order elliptic operators that need not be self-adjoint. To do this we use local representation theory for meromorphic operator-valued pencils, and relate the algebraic multiplicities of eigenvalues of elliptic operators to those of the Robin-to-Robin and Robin-to-Dirichlet operator pencils. In the self-adjoint case we relate our construction to the Maslov index, another well known tool in the spectral theory of differential operators. This gives new insight into the Maslov index and allows us to obtain crucial monotonicity results by complex analytic methods.


title: An Energy Recovery Linac for the LHeC

abstract: The LHeC provides an intense, high energy electron beam to collide with the LHC. It represents the highest energy application of energy recovery linac (ERL) technology which is increasingly recognized as one of the major pilot technologies for the development of particle physics because it utilizes and stimulates superconducting RF technology progress, and it increases intensity while keeping the power consumption low. The LHeC instantaneous luminosity is determined through the integrated luminosity goal. The electron beam energy is chosen to achieve TeV cms collision energy and enable competitive searches and precision Higgs boson measurements. The wall-plug power has been constrained to 100 MW. Two super-conducting linacs of about 900 m length, which are placed opposite to each other, accelerate the passing electrons by 8.3 GeV each. This leads to a final electron beam energy of about 50 GeV in a 3-turn racetrack energy recovery linac configuration.


title: Beamforming in Integrated Sensing and Communication Systems with Reconfigurable Intelligent Surfaces

abstract: We consider transmit beamforming and reflection pattern design in reconfigurable intelligent surface (RIS)-assisted integrated sensing and communication (ISAC) systems to jointly precode communication symbols and radar waveforms. We treat two settings of multiple users and targets. In the first, we use a single RIS to enhance the communication performance of the ISAC system and design beams with good cross-correlation properties to match a desired beam pattern while guaranteeing a desired signal-to-interference plus noise ratio (SINR) for each user. In the second setting, we use two dedicated RISs to aid the ISAC system, wherein the beams are designed to maximize the worst-case target illumination power while guaranteeing a desired SINR for each user. We propose solvers based on alternating optimization as the design problems in both cases are non-convex optimization problems. Through a number of numerical simulations, we demonstrate the advantages of RIS-assisted ISAC systems. In particular, we show that the proposed single-RIS assisted ISAC system improves the minimum user SINR while suffering from a moderate loss in radar target illumination power. On the other hand, the dual-RIS assisted ISAC system improves both minimum user SINR as well as worst-case target illumination power at the targets, especially when the users and targets are not directly visible.


title: Learning Large-scale Subsurface Simulations with a Hybrid Graph Network Simulator

abstract: Subsurface simulations use computational models to predict the flow of fluids (e.g., oil, water, gas) through porous media. These simulations are pivotal in industrial applications such as petroleum production, where fast and accurate models are needed for high-stake decision making, for example, for well placement optimization and field development planning. Classical finite difference numerical simulators require massive computational resources to model large-scale real-world reservoirs. Alternatively, streamline simulators and data-driven surrogate models are computationally more efficient by relying on approximate physics models, however they are insufficient to model complex reservoir dynamics at scale. Here we introduce Hybrid Graph Network Simulator (HGNS), which is a data-driven surrogate model for learning reservoir simulations of 3D subsurface fluid flows. To model complex reservoir dynamics at both local and global scale, HGNS consists of a subsurface graph neural network (SGNN) to model the evolution of fluid flows, and a 3D-U-Net to model the evolution of pressure. HGNS is able to scale to grids with millions of cells per time step, two orders of magnitude higher than previous surrogate models, and can accurately predict the fluid flow for tens of time steps (years into the future). Using an industry-standard subsurface flow dataset (SPE-10) with 1.1 million cells, we demonstrate that HGNS is able to reduce the inference time up to 18 times compared to standard subsurface simulators, and that it outperforms other learning-based models by reducing long-term prediction errors by up to 21%.


title: Learning to Accelerate Partial Differential Equations via Latent Global Evolution

abstract: Simulating the time evolution of Partial Differential Equations (PDEs) of large-scale systems is crucial in many scientific and engineering domains such as fluid dynamics, weather forecasting and their inverse optimization problems. However, both classical solvers and recent deep learning-based surrogate models are typically extremely computationally intensive, because of their local evolution: they need to update the state of each discretized cell at each time step during inference. Here we develop Latent Evolution of PDEs (LE-PDE), a simple, fast and scalable method to accelerate the simulation and inverse optimization of PDEs. LE-PDE learns a compact, global representation of the system and efficiently evolves it fully in the latent space with learned latent evolution models. LE-PDE achieves speed-up by having a much smaller latent dimension to update during long rollout as compared to updating in the input space. We introduce new learning objectives to effectively learn such latent dynamics to ensure long-term stability. We further introduce techniques for speeding-up inverse optimization of boundary conditions for PDEs via backpropagation through time in latent space, and an annealing technique to address the non-differentiability and sparse interaction of boundary conditions. We test our method in a 1D benchmark of nonlinear PDEs, 2D Navier-Stokes flows into turbulent phase and an inverse optimization of boundary conditions in 2D Navier-Stokes flow. Compared to state-of-the-art deep learning-based surrogate models and other strong baselines, we demonstrate up to 128x reduction in the dimensions to update, and up to 15x improvement in speed, while achieving competitive accuracy.


title: Emergent Abilities of Large Language Models

abstract: Scaling up language models has been shown to predictably improve performance and sample efficiency on a wide range of downstream tasks. This paper instead discusses an unpredictable phenomenon that we refer to as emergent abilities of large language models. We consider an ability to be emergent if it is not present in smaller models but is present in larger models. Thus, emergent abilities cannot be predicted simply by extrapolating the performance of smaller models. The existence of such emergence implies that additional scaling could further expand the range of capabilities of language models.


title: Deep-field Metacalibration

abstract: We introduce deep-field metacalibration, a new technique that reduces the pixel noise in metacalibration estimators of weak lensing shear signals by using a deeper imaging survey for calibration. In standard metacalibration, when estimating the object's shear response, extra noise is added to correct the effect of shearing the noise in the image, increasing the uncertainty on shear estimates by ~ 20%. Our new deep-field metacalibration technique leverages a separate, deeper imaging survey to calculate calibrations with less degradation in image noise. We demonstrate that weak lensing shear measurement with deep-field metacalibration is unbiased up to second-order shear effects. We provide algorithms to apply this technique to imaging surveys and describe how to generalize it to shear estimators that rely explicitly on object detection (e.g., metacalibration). For the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), the improvement in weak lensing precision will depend on the somewhat unknown details of the LSST Deep Drilling Field (DDF) observations in terms of area and depth, the relative point-spread function properties of the DDF and main LSST surveys, and the relative contribution of pixel noise vs. intrinsic shape noise to the total shape noise in the survey. We conservatively estimate that the degradation in precision is reduced from 20% for metacalibration to ~ 5% or less for deep-field metacalibration, which we attribute primarily to the increased source density and reduced pixel noise contributions to the overall shape noise. Finally, we show that the technique is robust to sample variance in the LSST DDFs due to their large area, with the equivalent calibration error being ~ 0.1%. The deep-field metacalibration technique provides higher signal-to-noise weak lensing measurements while still meeting the stringent systematic error requirements of future surveys.


title: AVATAR: Unconstrained Audiovisual Speech Recognition

abstract: Audio-visual automatic speech recognition (AV-ASR) is an extension of ASR that incorporates visual cues, often from the movements of a speaker's mouth. Unlike works that simply focus on the lip motion, we investigate the contribution of entire visual frames (visual actions, objects, background etc.). This is particularly useful for unconstrained videos, where the speaker is not necessarily visible. To solve this task, we propose a new sequence-to-sequence AudioVisual ASR TrAnsformeR (AVATAR) which is trained end-to-end from spectrograms and full-frame RGB. To prevent the audio stream from dominating training, we propose different word-masking strategies, thereby encouraging our model to pay attention to the visual stream. We demonstrate the contribution of the visual modality on the How2 AV-ASR benchmark, especially in the presence of simulated noise, and show that our model outperforms all other prior work by a large margin. Finally, we also create a new, real-world test bed for AV-ASR called VisSpeech, which demonstrates the contribution of the visual modality under challenging audio conditions.


title: Decentralized WebRCT P2P network using Kademlia

abstract: Web Real-Time Communication (WebRTC) is a new standard and industry effort that extends the web browsing model. For the first time, browsers are able to directly exchange real-time media with other browsers in a peer-to-peer fashion. Before WebRTC was introduced, it was cumbersome to build smooth chat and video applications, users often experience unstable connections, blurry videos, and unclear sounds. WebRTC's peer-to-peer communication paradigm establishes the real-time connection between browsers using the SIP(Session Initiation Protocol) Trapezoid. A wide set of protocols are bundled in WebRTC API, such as connection management, encoding/decoding negotiation, media control, selection and control, firewall and NAT element traversal, etc. However, almost all current WebRTC applications are using centralized signaling infrastructure which brings the problems of scalability, stability, and fault-tolerance. In this paper, I am presenting a decentralized architecture by introducing the Kademlia network into WebRTC to reduce the need for a centralized signaling service for WebRTC.


title: From near-symplectic constructions to trisections of 4-manifolds

abstract: This is an expository account of the author's collaboration with Rob Kirby leading up to the theory of trisections of smooth 4-manifolds. This article was written for inclusion in an upcoming issue of Celebratio Mathematica dedicated to Rob Kirby's mathematical work.


title: Structured Sparsity Learning for Efficient Video Super-Resolution

abstract: The high computational costs of video super-resolution (VSR) models hinder their deployment on resource-limited devices, (e.g., smartphones and drones). Existing VSR models contain considerable redundant filters, which drag down the inference efficiency. To prune these unimportant filters, we develop a structured pruning scheme called Structured Sparsity Learning (SSL) according to the properties of VSR. In SSL, we design pruning schemes for several key components in VSR models, including residual blocks, recurrent networks, and upsampling networks. Specifically, we develop a Residual Sparsity Connection (RSC) scheme for residual blocks of recurrent networks to liberate pruning restrictions and preserve the restoration information. For upsampling networks, we design a pixel-shuffle pruning scheme to guarantee the accuracy of feature channel-space conversion. In addition, we observe that pruning error would be amplified as the hidden states propagate along with recurrent networks. To alleviate the issue, we design Temporal Finetuning (TF). Extensive experiments show that SSL can significantly outperform recent methods quantitatively and qualitatively.


title: Spectra of infinite graphs with summable weight functions

abstract: In this paper we study spectra of Laplacians of infinite weighted graphs. Instead of the assumption of local finiteness we impose the condition of summability of the weight function. Such graphs correspond to reversible Markov chains with countable state spaces. We adopt the concept of the Cheeger constant to this setting and prove an analogue of the Cheeger inequality characterising the spectral gap. We also analyse the concept of the dual Cheeger constant originally introduced in \cite{B14}, which allows estimating the top of the spectrum. In this paper we also introduce a new combinatorial invariant, k$(G,m)$, which allows a complete characterisation of bipartite graphs and measures the asymmetry of the spectrum (the Hausdorff distance between the spectrum and its reflection at point $1\in \Bbb R$). We compare k$(G, m)$ to the Cheeger and the dual Cheeger constants. Finally, we analyse in full detail a class of infinite complete graphs and their spectra.


title: Structured Video Tokens @ Ego4D PNR Temporal Localization Challenge 2022

abstract: This technical report describes the SViT approach for the Ego4D Point of No Return (PNR) Temporal Localization Challenge. We propose a learning framework StructureViT (SViT for short), which demonstrates how utilizing the structure of a small number of images only available during training can improve a video model. SViT relies on two key insights. First, as both images and videos contain structured information, we enrich a transformer model with a set of \emph{object tokens} that can be used across images and videos. Second, the scene representations of individual frames in video should "align" with those of still images. This is achieved via a "Frame-Clip Consistency" loss, which ensures the flow of structured information between images and videos. SViT obtains strong performance on the challenge test set with 0.656 absolute temporal localization error.


title: ELUDE: Generating interpretable explanations via a decomposition into labelled and unlabelled features

abstract: Deep learning models have achieved remarkable success in different areas of machine learning over the past decade; however, the size and complexity of these models make them difficult to understand. In an effort to make them more interpretable, several recent works focus on explaining parts of a deep neural network through human-interpretable, semantic attributes. However, it may be impossible to completely explain complex models using only semantic attributes. In this work, we propose to augment these attributes with a small set of uninterpretable features. Specifically, we develop a novel explanation framework ELUDE (Explanation via Labelled and Unlabelled DEcomposition) that decomposes a model's prediction into two parts: one that is explainable through a linear combination of the semantic attributes, and another that is dependent on the set of uninterpretable features. By identifying the latter, we are able to analyze the "unexplained" portion of the model, obtaining insights into the information used by the model. We show that the set of unlabelled features can generalize to multiple models trained with the same feature space and compare our work to two popular attribute-oriented methods, Interpretable Basis Decomposition and Concept Bottleneck, and discuss the additional insights ELUDE provides.


title: Geodesic complexity via fibered decompositions of cut loci

abstract: The geodesic complexity of a Riemannian manifold is a numerical isometry invariant that is determined by the structure of its cut loci. In this article we study decompositions of cut loci over whose components the tangent cut loci fiber in a convenient way. We establish a new upper bound for geodesic complexity in terms of such decompositions. As an application, we obtain estimates for the geodesic complexity of certain classes of homogeneous manifolds. In particular, we compute the geodesic complexity of complex and quaternionic projective spaces with their standard symmetric metrics.


title: A Simple Data Mixing Prior for Improving Self-Supervised Learning

abstract: Data mixing (e.g., Mixup, Cutmix, ResizeMix) is an essential component for advancing recognition models. In this paper, we focus on studying its effectiveness in the self-supervised setting. By noticing the mixed images that share the same source images are intrinsically related to each other, we hereby propose SDMP, short for $\textbf{S}$imple $\textbf{D}$ata $\textbf{M}$ixing $\textbf{P}$rior, to capture this straightforward yet essential prior, and position such mixed images as additional $\textbf{positive pairs}$ to facilitate self-supervised representation learning. Our experiments verify that the proposed SDMP enables data mixing to help a set of self-supervised learning frameworks (e.g., MoCo) achieve better accuracy and out-of-distribution robustness. More notably, our SDMP is the first method that successfully leverages data mixing to improve (rather than hurt) the performance of Vision Transformers in the self-supervised setting. Code is publicly available at https://github.com/OliverRensu/SDMP


title: Splitting quasireductive supergroups and volumes of supergrassmannians

abstract: We introduce the notion of splitting subgroups of quasireducitve supergroups, and explain their significance. For $GL(m|n)$, $Q(n)$, and defect one basic classical supergroups, we give explicit splitting subgroups. We further prove they are minimal up to conjugacy, except in the $GL(m|n)$ case where it remains a conjecture. A key tool in the proof is the computation of the volumes of complex supergrassmannians, which is of interest in its own right.


title: DIRECTOR: Generator-Classifiers For Supervised Language Modeling

abstract: Current language models achieve low perplexity but their resulting generations still suffer from toxic responses, repetitiveness and contradictions. The standard language modeling setup fails to address these issues. In this paper, we introduce a new architecture, {\sc Director}, that consists of a unified generator-classifier with both a language modeling and a classification head for each output token. Training is conducted jointly using both standard language modeling data, and data labeled with desirable and undesirable sequences. Experiments in several settings show that the model has competitive training and decoding speed compared to standard language models while yielding superior results, alleviating known issues while maintaining generation quality. It also outperforms existing model guiding approaches in terms of both accuracy and efficiency.


title: VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Grids

abstract: State-of-the-art 3D-aware generative models rely on coordinate-based MLPs to parameterize 3D radiance fields. While demonstrating impressive results, querying an MLP for every sample along each ray leads to slow rendering. Therefore, existing approaches often render low-resolution feature maps and process them with an upsampling network to obtain the final image. Albeit efficient, neural rendering often entangles viewpoint and content such that changing the camera pose results in unwanted changes of geometry or appearance. Motivated by recent results in voxel-based novel view synthesis, we investigate the utility of sparse voxel grid representations for fast and 3D-consistent generative modeling in this paper. Our results demonstrate that monolithic MLPs can indeed be replaced by 3D convolutions when combining sparse voxel grids with progressive growing, free space pruning and appropriate regularization. To obtain a compact representation of the scene and allow for scaling to higher voxel resolutions, our model disentangles the foreground object (modeled in 3D) from the background (modeled in 2D). In contrast to existing approaches, our method requires only a single forward pass to generate a full 3D scene. It hence allows for efficient rendering from arbitrary viewpoints while yielding 3D consistent results with high visual fidelity.


title: Diffusion Models for Video Prediction and Infilling

abstract: Predicting and anticipating future outcomes or reasoning about missing information in a sequence are critical skills for agents to be able to make intelligent decisions. This requires strong, temporally coherent generative capabilities. Diffusion models have shown remarkable success in several generative tasks, but have not been extensively explored in the video domain. We present Random-Mask Video Diffusion (RaMViD), which extends image diffusion models to videos using 3D convolutions, and introduces a new conditioning technique during training. By varying the mask we condition on, the model is able to perform video prediction, infilling, and upsampling. Due to our simple conditioning scheme, we can utilize the same architecture as used for unconditional training, which allows us to train the model in a conditional and unconditional fashion at the same time. We evaluate RaMViD on two benchmark datasets for video prediction, on which we achieve state-of-the-art results, and one for video generation. High-resolution videos are provided at https://sites.google.com/view/video-diffusion-prediction.


title: MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fields

abstract: Creating fast and accurate force fields is a long-standing challenge in computational chemistry and materials science. Recently, several equivariant message passing neural networks (MPNNs) have been shown to outperform models built using other approaches in terms of accuracy. However, most MPNNs suffer from high computational cost and poor scalability. We propose that these limitations arise because MPNNs only pass two-body messages leading to a direct relationship between the number of layers and the expressivity of the network. In this work, we introduce MACE, a new equivariant MPNN model that uses higher body order messages. In particular, we show that using four-body messages reduces the required number of message passing iterations to just two, resulting in a fast and highly parallelizable model, reaching or exceeding state-of-the-art accuracy on the rMD17, 3BPA, and AcAc benchmark tasks. We also demonstrate that using higher order messages leads to an improved steepness of the learning curves.

categories: stat.ML cond-mat.mtrl-sci cs.LG physics.chem-ph


title: Neural Deformable Voxel Grid for Fast Optimization of Dynamic View Synthesis

abstract: Recently, Neural Radiance Fields (NeRF) is revolutionizing the task of novel view synthesis (NVS) for its superior performance. In this paper, we propose to synthesize dynamic scenes. Extending the methods for static scenes to dynamic scenes is not straightforward as both the scene geometry and appearance change over time, especially under monocular setup. Also, the existing dynamic NeRF methods generally require a lengthy per-scene training procedure, where multi-layer perceptrons (MLP) are fitted to model both motions and radiance. In this paper, built on top of the recent advances in voxel-grid optimization, we propose a fast deformable radiance field method to handle dynamic scenes. Our method consists of two modules. The first module adopts a deformation grid to store 3D dynamic features, and a light-weight MLP for decoding the deformation that maps a 3D point in the observation space to the canonical space using the interpolated features. The second module contains a density and a color grid to model the geometry and density of the scene. The occlusion is explicitly modeled to further improve the rendering quality. Experimental results show that our method achieves comparable performance to D-NeRF using only 20 minutes for training, which is more than 70x faster than D-NeRF, clearly demonstrating the efficiency of our proposed method.


title: Write and Paint: Generative Vision-Language Models are Unified Modal Learners

abstract: Recent advances in vision-language pre-training have pushed the state-of-the-art on various vision-language tasks, making machines more capable of multi-modal writing (image-to-text generation) and painting (text-to-image generation). However, few studies investigate if these two essential capabilities can be learned together and boost each other, making a versatile and powerful multi-modal foundation model. In this work, we disclose the potential of symmetric generative vision-language pre-training in learning to write and paint concurrently, and propose a new unified modal model, named DaVinci, trained with prefix language modeling and prefix image modeling, a simple generative self-supervised objective on image-text pairs. Thanks to the proposed prefix multi-modal modeling framework, DaVinci is simple to train, scalable to huge data, adaptable to both writing and painting tasks, and also strong on other vision, text, and multi-modal understanding tasks. DaVinci achieves competitive performance on a wide range of 27 generation/understanding tasks and demonstrates the superiority of combining vision/language generative pre-training. Furthermore, we carefully benchmark the performance of different vision-language pre-training objectives on different scales of pre-training datasets on a heterogeneous and broad distribution coverage. Our results demonstrate the potential of exploiting self-supervision in both language and vision inputs, and establish new, stronger baselines for future comparisons at different data scales. The code and pre-trained models are available at https://github.com/shizhediao/DaVinci.


title: Masked Siamese ConvNets

abstract: Self-supervised learning has shown superior performances over supervised methods on various vision benchmarks. The siamese network, which encourages embeddings to be invariant to distortions, is one of the most successful self-supervised visual representation learning approaches. Among all the augmentation methods, masking is the most general and straightforward method that has the potential to be applied to all kinds of input and requires the least amount of domain knowledge. However, masked siamese networks require particular inductive bias and practically only work well with Vision Transformers. This work empirically studies the problems behind masked siamese networks with ConvNets. We propose several empirical designs to overcome these problems gradually. Our method performs competitively on low-shot image classification and outperforms previous methods on object detection benchmarks. We discuss several remaining issues and hope this work can provide useful data points for future general-purpose self-supervised learning.


title: Evaluation of the Management of Hospital Radiological Protection

abstract: To maintain quality in hospital services, management strategies are fundamental. The objective of this article was to elaborate and validate the contents of an instrument for the management of hospital radiological protection. Therefore, a study was conducted in two Portuguese-speaking countries, Brazil and Portugal. Initially, a data collection instrument was created to elaborate essential items for the management of hospital radiological protection, followed by the validation of the contents of this instrument, using the Delphi technique. The validation of the instrument content was performed by a group of judges, following the steps of the Delphi technique. The questionnaire answered 33 professionals, of these, 25 Brazilians and 8 Portuguese. The affirmative statements among the professionals are related to the instructions on radiological protection for the radiodiagnostic team and the radiological protection program. It is concluded that the instrument built and validated for the management of radiological protection contributes to the organization of diagnostic imaging services and may be adapted for the management of specific services.


title: Predictions of Astrometric Jitter for Sun-like Stars. III. Fast Rotators

abstract: A breakthrough in exoplanet detections is foreseen with the unprecedented astrometric measurement capabilities offered by instrumentation aboard Gaia space observatory. Besides, astrometric discoveries of exoplanets are expected from the planned space mission, Small-JASMINE. In this setting, the present series of papers focuses on estimating the effect of magnetic activity of G2V-type host stars on the astrometric signal. This effect interferes with the astrometric detections of Earth-mass planets. While the first two papers considered stars rotating at the solar rotation rate, this paper focuses on stars having solar effective temperature and metallicity but rotating faster than the Sun, and consequently more active. By simulating the distribution of active regions on such stars using the Flux Emergence And Transport model, we show that the contribution of magnetic activity to the astrometric measurements becomes increasingly significant with increasing rotation rates. We further show that the jitter for the most variable periodic Kepler stars is high enough to be detected by Gaia. Furthermore, due to a decrease in the facula-to-spot area ratio for more active stars, the magnetic jitter is found to be spot-dominated for rapid rotators. Our simulations of the astrometric jitter has the potential to aid the interpretation of data from Gaia and upcoming space astrometry missions.


title: Hubble Space Telescope Observations of Active Asteroid P/2020 O1 (Lemmon-PANSTARRS)

abstract: We present Hubble Space Telescope observations of active asteroid P/2020 O1 taken to examine its development for a year after perihelion. We find that the mass loss peaks <~1 kg/s in 2020 August and then declines to nearly zero over four months. Long-duration mass loss (~180 days) is consistent with a sublimation origin, indicating that this object is likely an ice-bearing main-belt comet. Equilibrium sublimation of water ice from an area as small as 1580 m^2 can supply the observed mass loss. Time-series photometry shows tentative evidence for extremely rapid rotation (double-peaked period < 2 hr) of the small nucleus (effective radius ~420 m). Ejection velocities of 0.1 mm particles are comparable to the 0.3 m/s gravitational escape speed from the nucleus, while larger particles are ejected at speeds less than the escape velocity. These properties are consistent with the sublimation of near-surface ice aided by centripetal acceleration. If water ice sublimation is confirmed, P/2020 O1 would be the icy asteroid with the smallest semimajor axis (highest temperature), setting new bounds on the distribution of ice in the asteroid belt.


abstract: Panoptic image segmentation is the computer vision task of finding groups of pixels in an image and assigning semantic classes and object instance identifiers to them. Research in image segmentation has become increasingly popular due to its critical applications in robotics and autonomous driving. The research community thereby relies on publicly available benchmark dataset to advance the state-of-the-art in computer vision. Due to the high costs of densely labeling the images, however, there is a shortage of publicly available ground truth labels that are suitable for panoptic segmentation. The high labeling costs also make it challenging to extend existing datasets to the video domain and to multi-camera setups. We therefore present the Waymo Open Dataset: Panoramic Video Panoptic Segmentation Dataset, a large-scale dataset that offers high-quality panoptic segmentation labels for autonomous driving. We generate our dataset using the publicly available Waymo Open Dataset, leveraging the diverse set of camera images. Our labels are consistent over time for video processing and consistent across multiple cameras mounted on the vehicles for full panoramic scene understanding. Specifically, we offer labels for 28 semantic categories and 2,860 temporal sequences that were captured by five cameras mounted on autonomous vehicles driving in three different geographical locations, leading to a total of 100k labeled camera images. To the best of our knowledge, this makes our dataset an order of magnitude larger than existing datasets that offer video panoptic segmentation labels. We further propose a new benchmark for Panoramic Video Panoptic Segmentation and establish a number of strong baselines based on the DeepLab family of models. We will make the benchmark and the code publicly available. Find the dataset at https://waymo.com/open.


title: LET-3D-AP: Longitudinal Error Tolerant 3D Average Precision for Camera-Only 3D Detection

abstract: The 3D Average Precision (3D AP) relies on the intersection over union between predictions and ground truth objects. However, camera-only detectors have limited depth accuracy, which may cause otherwise reasonable predictions that suffer from such longitudinal localization errors to be treated as false positives. We therefore propose variants of the 3D AP metric to be more permissive with respect to depth estimation errors. Specifically, our novel longitudinal error tolerant metrics, LET-3D-AP and LET-3D-APL, allow longitudinal localization errors of the prediction boxes up to a given tolerance. To evaluate the proposed metrics, we also construct a new test set for the Waymo Open Dataset, tailored to camera-only 3D detection methods. Surprisingly, we find that state-of-the-art camera-based detectors can outperform popular LiDAR-based detectors with our new metrics past at 10% depth error tolerance, suggesting that existing camera-based detectors already have the potential to surpass LiDAR-based detectors in downstream applications. We believe the proposed metrics and the new benchmark dataset will facilitate advances in the field of camera-only 3D detection by providing more informative signals that can better indicate the system-level performance.


title: Masked Frequency Modeling for Self-Supervised Visual Pre-Training

abstract: We present Masked Frequency Modeling (MFM), a unified frequency-domain-based approach for self-supervised pre-training of visual models. Instead of randomly inserting mask tokens to the input embeddings in the spatial domain, in this paper, we shift the perspective to the frequency domain. Specifically, MFM first masks out a portion of frequency components of the input image and then predicts the missing frequencies on the frequency spectrum. Our key insight is that predicting masked components in the frequency domain is more ideal to reveal underlying image patterns rather than predicting masked patches in the spatial domain, due to the heavy spatial redundancy. Our findings suggest that with the right configuration of mask-and-predict strategy, both the structural information within high-frequency components and the low-level statistics among low-frequency counterparts are useful in learning good representations. For the first time, MFM demonstrates that, for both ViT and CNN, a simple non-Siamese framework can learn meaningful representations even using none of the following: (i) extra data, (ii) extra model, (iii) mask token. Experimental results on image classification and semantic segmentation, as well as several robustness benchmarks show the competitive performance and advanced robustness of MFM compared with recent masked image modeling approaches. Furthermore, we also comprehensively investigate the effectiveness of classical image restoration tasks for representation learning from a unified frequency perspective and reveal their intriguing relations with our MFM approach.


title: Variable Bitrate Neural Fields

abstract: Neural approximations of scalar and vector fields, such as signed distance functions and radiance fields, have emerged as accurate, high-quality representations. State-of-the-art results are obtained by conditioning a neural approximation with a lookup from trainable feature grids that take on part of the learning task and allow for smaller, more efficient neural networks. Unfortunately, these feature grids usually come at the cost of significantly increased memory consumption compared to stand-alone neural network models. We present a dictionary method for compressing such feature grids, reducing their memory consumption by up to 100x and permitting a multiresolution representation which can be useful for out-of-core streaming. We formulate the dictionary optimization as a vector-quantized auto-decoder problem which lets us learn end-to-end discrete neural representations in a space where no direct supervision is available and with dynamic topology and structure. Our source code will be available at https://github.com/nv-tlabs/vqad.


title: Finding Control Synthesis for Kinematic Shortest Paths

abstract: This work presents the analysis of the properties of the shortest path control synthesis for the rigid body system. The systems we focus on in this work have only kinematic constraints. However, even for seemingly simple systems and constraints, the shortest paths for generic rigid body systems were only found recently, especially for 3D systems. Based on the Pontraygon's Maximum Principle (MPM) and Lagrange equations, we present the necessary conditions for optimal switches, which form the control synthesis boundaries. We formally show that the shortest path for nearby configurations will have similar adjoint functions and parameters, i.e., Lagrange multipliers. We further show that the gradients of the necessary condition equation can be used to verify whether a configuration is inside a control synthesis region or on the boundary. We present a procedure to find the shortest kinematic paths and control synthesis, using the gradients of the control constraints. Given the shortest path and the corresponding control sequences, the optimal control sequence for nearby configurations can be derived if and only if they belong to the same control synthesis region. The proposed procedure can work for both 2D and 3D rigid body systems. We use a 2D Dubins vehicle system to verify the correctness of the proposed approach. More verifications and experiments will be presented in the extensions of this work.


title: On the Grothendieck ring of a quasireductive Lie superalgebra

abstract: Given a Lie superalgebra $\mathfrak{g}$ and a maximal quasitoral subalgebra $\mathfrak{h}$, we consider properties of restrictions of $\mathfrak{g}$-modules to $\mathfrak{h}$. This is a natural generalization of the study of characters in the case when $\mathfrak{h}$ is an even maximal torus. We study the case of $\mathfrak{g}=\mathfrak{q}_n$ with $\mathfrak{h}$ a Cartan subalgebra, and prove several special properties of the restriction in this case, including an explicit realization of the $\mathfrak{h}$-supercharacter ring.


title: PlanarRecon: Real-time 3D Plane Detection and Reconstruction from Posed Monocular Videos

abstract: We present PlanarRecon -- a novel framework for globally coherent detection and reconstruction of 3D planes from a posed monocular video. Unlike previous works that detect planes in 2D from a single image, PlanarRecon incrementally detects planes in 3D for each video fragment, which consists of a set of key frames, from a volumetric representation of the scene using neural networks. A learning-based tracking and fusion module is designed to merge planes from previous fragments to form a coherent global plane reconstruction. Such design allows PlanarRecon to integrate observations from multiple views within each fragment and temporal information across different ones, resulting in an accurate and coherent reconstruction of the scene abstraction with low-polygonal geometry. Experiments show that the proposed approach achieves state-of-the-art performances on the ScanNet dataset while being real-time.


title: On the Eve of True Explainability for OWL Ontologies: Description Logic Proofs with Evee and Evonne (Extended Version)

abstract: When working with description logic ontologies, understanding entailments derived by a description logic reasoner is not always straightforward. So far, the standard ontology editor Prot\'eg\'e offers two services to help: (black-box) justifications for OWL 2 DL ontologies, and (glass-box) proofs for lightweight OWL EL ontologies, where the latter exploits the proof facilities of reasoner ELK. Since justifications are often insufficient in explaining inferences, there is thus only little tool support for explaining inferences in more expressive DLs. In this paper, we introduce EVEE-LIBS, a Java library for computing proofs for DLs up to ALCH, and EVEE-PROTEGE, a collection of Prot\'eg\'e plugins for displaying those proofs in Prot\'eg\'e. We also give a short glimpse of the latest version of EVONNE, a more advanced standalone application for displaying and interacting with proofs computed with EVEE-LIBS.


title: On the application of the Adomian-based methods

abstract: We analyze a recent application of two Adomian-based approximate methods to the Chen-Lee-Liu equation. We prove that the outcome of these approaches is merely the Taylor expansion of the solution about $t=0$ and, consequently, they are valid only for sufficiently small values of the time variable $t$.


title: A Stimulating Explanation of the Extragalactic Radio Background

abstract: Despite an intense theoretical and experimental effort over the past decade, observations of the extragalactic radio background at multiple frequencies below 10 GHz are not understood in terms of known radio sources, and may represent a sign of new physics. In this Letter we identify a new class of dark sector models with feebly interacting particles, where dark photons oscillate into ordinary photons that contribute to the radio background. Our scenario can explain both the magnitude and the spectral index of the radio background, while being consistent with other cosmological and astrophysical constraints. These models predict new relativistic degrees of freedom and spectral distortions of the cosmic microwave background, which could be detected in the next generation of experiments.


title: Gravitationally lensed quasars in Gaia -- IV. 150 new lenses, quasar pairs, and projected quasars

abstract: We report the spectroscopic follow-up of 175 lensed quasar candidates selected using Gaia Data Release 2 observations following Lemon et al. 2019. Systems include 86 confirmed lensed quasars and a further 17 likely lensed quasars based on imaging and/or similar spectra. We also confirm 11 projected quasar pairs and 11 physical quasar pairs, while 25 systems are left as unclassified quasar pairs -- pairs of quasars at the same redshift, which could be either distinct quasars or potential lensed quasars. Especially interesting objects include 8 quadruply imaged quasars of which two have BAL sources, an apparent triple, and a doubly lensed LoBaL quasar. The source redshifts and image separations of these new lenses range between 0.65 - 3.59 and 0.78 - 6.23 arcseconds respectively. We compare the known population of lensed quasars to an updated mock catalogue at image separations between 1 and 4 arcseconds, showing a very good match at z<1.5. At z>1.5, only 47% of the predicted number are known, with 56% of these missing lenses at image separations below 1.5 arcseconds. The missing higher-redshift, small-separation systems will have fainter lensing galaxies, and are partially explained by the unclassified quasar pairs and likely lenses presented in this work, which require deeper imaging. Of the 11 new reported projected quasar pairs, 5 have impact parameters below 10 kpc, almost tripling the number of such systems, which can probe the innermost regions of quasar host galaxies through absorption studies. We also report four new lensed galaxies discovered through our searches, with source redshifts ranging from 0.62 to 2.79.


title: Dynamical evolution of fermion-boson stars with realistic equations of state

abstract: Fermion-boson stars are mixtures of the ordinary nuclear matter of a neutron star and bosonic dark matter. We dynamically evolve fermion-boson stars for the first time using a realistic equation of state for nuclear matter. We use our dynamical solutions to make a detailed study of the evolution of weakly and strongly perturbed static solutions. As examples of our findings, we identify a region of parameter space where weakly perturbed unstable static solutions migrate to a stable configuration and we determine the criteria under which strongly perturbed stable static solutions will always move to a stable configuration instead of collapsing to a black hole.


title: Implementing two-qubit gates at the quantum speed limit

abstract: The speed of elementary quantum gates, particularly two-qubit gates, ultimately sets the limit on the speed at which quantum circuits can operate. In this work, we experimentally demonstrate commonly used two-qubit gates at nearly the fastest possible speed allowed by the physical interaction strength between two superconducting transmon qubits. We achieve this quantum speed limit by implementing experimental gates designed using a machine learning inspired optimal control method. Importantly, our method only requires the single-qubit drive strength to be moderately larger than the interaction strength to achieve an arbitrary two-qubit gate close to its analytical speed limit with high fidelity. Thus, the method is applicable to a variety of platforms including those with comparable single-qubit and two-qubit gate speeds, or those with always-on interactions. We expect our method to offer significant speedups for non-native two-qubit gates that are typically achieved with a long sequence of single-qubit and native two-qubit gates.


title: Magnetic Bloch Theorem and Reentrant Flat Bands in Twisted Bilayer Graphene at $2\pi$ Flux

abstract: Bloch's theorem is the centerpiece of topological band theory, which itself has defined an era of quantum materials research. However, Bloch's theorem is broken by a perpendicular magnetic field, making it difficult to study topological systems in strong flux. For the first time, moir\'e materials have made this problem experimentally relevant, and its solution is the focus of this work. We construct gauge-invariant irreps of the magnetic translation group at $2\pi$ flux on infinite boundary conditions, allowing us to give analytical expressions in terms of the Siegel theta function for the magnetic Bloch Hamiltonian, non-Abelian Wilson loop, and many-body form factors. We illustrate our formalism using a simple square lattice model and the Bistritzer-MacDonald Hamiltonian of twisted bilayer graphene, obtaining reentrant ground states at $2\pi$ flux under the Coulomb interaction.


title: Fluctuation-driven thermal transport in graphene double-layers at charge neutrality

abstract: We develop a theory of fluctuation-driven phenomena in thermal transport in graphene double-layers. We work in the regime of electron hydrodynamics and focus on the double charge neutrality point. Although at the neutrality point charge transport is decoupled from the hydrodynamic flow, thermal fluctuations of electron density cause both drag and heat transfer between the layers. The thermal transport in the bilayer system is governed by these two phenomena. We express the drag friction coefficient and the interlayer thermal conductivity in terms of the interlayer distance and the intrinsic conductivity of the electron liquid. We then obtain the thermal conductance matrix and determine the spatial dependence of the hydrodynamic velocity and temperature in the system. For shorter system the thermal drag resistance is determined by drag. In longer systems the situation of perfect thermal drag is realized, in which the hydrodynamic velocities in both layers become equal in the interior of the systems. Estimates are given for the monolayer and bilayer graphene devices. The predictions of our theory can be tested by the high-resolution thermal imaging and Johnson-Nyquist nonlocal noise thermometry.


title: Spectral Distortions from Axion Monodromy Inflation

abstract: With the advent of new missions to probe spectral distortions of the cosmic microwave background with unprecedented precision, the study of theoretical predictions of these signals becomes a promising avenue to test our description of the early Universe. Meanwhile, axion monodromy still offers a viable framework to describe cosmic inflation. In order to explore new constraints on inflationary models based on axion monodromy while aiming at falsifying this scenario, we compute the spectral distortions predicted by this model, revealing oscillatory features that are compatible with Planck data. Further, the predicted distortions are up to 10% larger than the signals obtained from the fiducial LCDM model and are observable in principle. However, contrasting with the predictions of the simplest power-law inflationary potentials challenges the falsifiability of axion monodromy as it would require to reduce at least 100 times the current forecast error of the PIXIE satellite, which shall be possible at some projected observational setups.


title: Holographic thermal correlators from supersymmetric instantons

abstract: We present an exact formula for the thermal scalar two-point function in four-dimensional holographic conformal field theories. The problem of finding it reduces to the analysis of the wave equation on the AdS-Schwarzschild background. The two-point function is computed from the connection coefficients of the Heun equation, which can be expressed in terms of the Nekrasov-Shatashvili partition function of an SU(2) supersymmetric gauge theory with four fundamental hypermultiplets. The result is amenable to numerical evaluation upon truncating the number of instantons in the convergent expansion of the partition function. We also examine it analytically in various limits. At large spin the instanton expansion of the thermal two-point function directly maps to the light-cone bootstrap analysis of the heavy-light four-point function. Using this connection, we compute the OPE data of heavy-light double-twist operators. We compare our prediction to the perturbative results available in the literature and find perfect agreement.


title: Spectroscopy of Kerr-AdS$_5$ spacetime with the Heun function: Quasinormal modes, greybody factor, and evaporation

abstract: We investigate quasinormal modes, greybody factor, and Hawking evaporation of a five-dimensional Kerr-anti de Sitter (AdS$_5$) black hole by solving a wave equation for a test massive scalar field in terms of the local Heun function. We clarify the distribution of the quasinormal modes satisfying the ingoing and decaying boundary conditions at the event horizon and conformal infinity, respectively, and their splitting behaviors in the complex frequency plane with respect to a variation of spin parameters. We also point out the existence of purely imaginary modes. Further, we develop a method to extract in/outgoing waves near the AdS boundary, which enables us to define the greybody factor for a wide range of parameter space complementary to previous works. Using the greybody factor, we compute evaporation rates for mass and spins for the Kerr-AdS$_5$ black hole via the Hawking radiation of the scalar field.


title: Complete NLO Operators in the Higgs Effective Field Theory

abstract: We enumerate the complete and independent sets of operators at the next-to-leading order (NLO) in the Higgs effective field theory (HEFT), based on the Young tensor technique on the Lorentz, gauge and flavor structures. The operator-amplitude correspondence tells a type of operators forms the on-shell amplitude basis, and for operators involving in Nambu-Goldstone bosons, the amplitude basis is further reduced to the subspace satisfying the Adler's zero condition in the soft momentum limit. Different from dynamical field, the spurion should not enter into the Lorentz sector, instead it only plays a role of forming the $SU(2)$ invariant together with other dynamical fields. With these new treatments, for the first time we could obtain the 224 (7704) operators for one (three) generation fermions, 295 (11307) with right-handed neutrinos, and find there were 6 (9) terms of operators missing and many redundant operators can be removed in the effective theory without (with) right-handed neutrinos.


title: What are the spectroscopic binaries with high mass functions near the Gaia DR3 main sequence?

abstract: The 3rd data release of the Gaia mission includes orbital solutions for $> 10^5$ single-lined spectroscopic binaries, representing more than an order of magnitude increase in sample size over all previous studies. This dataset is a treasure trove for searches for quiescent black hole + normal star binaries. We investigate one population of black hole candidate binaries highlighted in the data release: sources near the main sequence in the color-magnitude diagram (CMD) with dynamically-inferred companion masses $M_2$ larger than the CMD-inferred mass of the luminous star. We model light curves, spectral energy distributions, and archival spectra of the 14 such objects in DR3 with high-significance orbital solutions and inferred $M_2 > 3\,M_{\odot}$. We find that 100\% of these sources are mass-transfer binaries containing a highly stripped lower giant donor ($0.2 \lesssim M/M_{\odot} \lesssim 0.4$) and much more massive ($2 \lesssim M/M_{\odot} \lesssim 2.5$) main-sequence accretor. The Gaia orbital solutions are for the donors, which contribute about half the light in the Gaia RVS bandpass but only $\lesssim 20\%$ in the $g-$band. The accretors' broad spectral features likely prevented the sources from being classified as double-lined. The donors are all close to Roche lobe-filling ($R/R_{\rm Roche\,lobe}>0.8$), but modeling suggests that a majority are detached ($R/R_{\rm Roche\,lobe}<1$). Binary evolution models predict that these systems will soon become detached helium white dwarf + main sequence "EL CVn" binaries. Our investigation highlights both the power of Gaia data for selecting interesting sub-populations of binaries and the ways in which binary evolution can bamboozle standard CMD-based stellar mass estimates.


title: Constrained Dynamics and Directed Percolation

abstract: In a recent work [A. Deger et al., Phys. Rev. Lett. 129, 160601 (2022)] we have shown that kinetic constraints can completely arrest many-body chaos in the dynamics of a classical, deterministic, translationally-invariant spin system with the strength of the constraint driving a dynamical phase transition. Using extensive numerical simulations and scaling analyses we demonstrate here that this constraint-induced phase transition lies in the directed percolation universality class in both one and two spatial dimensions.


title: Theory of oblique topological insulators

abstract: A long-standing problem in the study of topological phases of matter has been to understand the types of fractional topological insulator (FTI) phases possible in 3+1 dimensions. Unlike ordinary topological insulators of free fermions, FTI phases are characterized by fractional $\Theta$-angles, long-range entanglement, and fractionalization. Starting from a simple family of $\mathbb{Z}_N$ lattice gauge theories due to Cardy and Rabinovici, we develop a class of FTI phases based on the physical mechanism of oblique confinement and the modern language of generalized global symmetries. We dub these phases oblique topological insulators. Oblique TIs arise when dyons -- bound states of electric charges and monopoles -- condense, leading to FTI phases characterized by topological order, emergent one-form symmetries, and gapped boundary states not realizable in 2+1-D alone. Based on the lattice gauge theory, we present continuum topological quantum field theories (TQFTs) for oblique TI phases involving fluctuating one-form and two-form gauge fields. We show explicitly that these TQFTs capture both the generalized global symmetries and topological orders seen in the lattice gauge theory. We also demonstrate that these theories exhibit a universal "generalized magnetoelectric effect" in the presence of two-form background gauge fields. Moreover, we characterize the possible boundary topological orders of oblique TIs, finding a new set of boundary states not studied previously for these kinds of TQFTs.


title: A Green Pea starburst arising from a galaxy-galaxy merger

abstract: Green Pea galaxies are low-redshift starburst dwarf galaxies, with properties similar to those of the high-redshift galaxies that reionized the Universe. We report the first mapping of the spatial distribution of atomic hydrogen (HI) in and around a Green Pea, GP J0213+0056 at z=0.0399, using the Giant Metrewave Radio Telescope (GMRT). Like many Green Peas, GP J0213+0056 shows strong HI 21 cm emission in single-dish spectroscopy, strong Ly-alpha emission, and a high [OIII]$\lambda$5007/[OIII]$\lambda$3727 luminosity ratio, O32 $\approx$ 8.8, consistent with a high leakage of Lyman-continuum radiation. Our GMRT HI 21 cm images show that the HI 21 cm emission in the field of GP J0213+0056 arises from an extended broken-ring structure around the Green Pea, with the strongest emission coming from a region between GP J0213+0056 and a companion galaxy lying $\approx$ 4.7 kpc away, and little HI 21cm emission coming from the Green Pea itself. We find that the merger between GP J0213+0056 and its companion is likely to have triggered the starburst, and led to a disturbed HI spatial and velocity distribution, which in turn allowed Ly-alpha (and, possibly, Lyman-continuum) emission to escape the Green Pea. Our results suggest that such mergers, and the resulting holes in the HI distribution, are a natural way to explain the tension between the requirements of cold gas to fuel the starburst and the observed leakage of Ly-alpha and Lyman-continuum emission in Green Pea galaxies and their high-redshift counterparts.


title: Quantum Hall and Synthetic Magnetic-Field Effects in Ultra-Cold Atomic Systems

abstract: In this Chapter, we give a brief review of the state of the art of theoretical and experimental studies of synthetic magnetic fields and quantum Hall effects in ultracold atomic gases. We focus on integer, spin, and fractional Hall effects, indicate connections to topological matter, and discuss prospects for the realization of full-fledged gauge field theories where the synthetic magnetic field has its own dynamics. The advantages of these systems over traditional electronic systems are highlighted. Finally, interdisciplinary comparisons with other synthetic matter platforms based on photonic and trapped-ion systems are drawn. We hope this chapter to illustrate the exciting progress that the field has experienced in recent years.

categories: cond-mat.quant-gas cond-mat.str-el hep-lat quant-ph


title: Jacobi-Trudi formulas and determinantal varieties

abstract: Gessel gave a determinantal expression for certain sums of Schur functions which visually looks like the classical Jacobi-Trudi formula. We explain the commonality of these formulas using a construction of Zelevinsky involving BGG complexes and use this explanation to generalize this formula in a few different directions.


title: Taxonomy of Benchmarks in Graph Representation Learning

abstract: Graph Neural Networks (GNNs) extend the success of neural networks to graph-structured data by accounting for their intrinsic geometry. While extensive research has been done on developing GNN models with superior performance according to a collection of graph representation learning benchmarks, it is currently not well understood what aspects of a given model are probed by them. For example, to what extent do they test the ability of a model to leverage graph structure vs. node features? Here, we develop a principled approach to taxonomize benchmarking datasets according to a $\textit{sensitivity profile}$ that is based on how much GNN performance changes due to a collection of graph perturbations. Our data-driven analysis provides a deeper understanding of which benchmarking data characteristics are leveraged by GNNs. Consequently, our taxonomy can aid in selection and development of adequate graph benchmarks, and better informed evaluation of future GNN methods. Finally, our approach and implementation in $\texttt{GTaxoGym}$ package are extendable to multiple graph prediction task types and future datasets.


title: Magnetic memory and spontaneous vortices in a van der Waals superconductor

abstract: Doped Mott insulators exhibit some of the most intriguing quantum phases of matter, including quantum spin-liquids, unconventional superconductors, and non-Fermi liquid metals. Such phases often arise when itinerant electrons are close to a Mott insulating state, and thus experience strong spatial correlations. Proximity between different layers of van der Waals heterostructures naturally realizes a platform for experimentally studying the relationship between localized, correlated electrons and itinerant electrons. Here, we explore this relationship by studying the magnetic landscape of 4Hb-TaS2, which realizes an alternate stack of a candidate spin liquid and a superconductor. We report on a spontaneous vortex phase whose vortex density can be trained in the normal state. We show that time reversal symmetry is broken above Tc, indicating the presence of a magnetic phase independent of the superconductor. Strikingly, this phase does not generate detectable magnetic signals. We use scanning superconducting quantum interference device (SQUID) microscopy to show that it is incompatible with ferromagnetic ordering. The discovery of this new form of hidden magnetism illustrates how combining superconductivity with a strongly correlated system can lead to new, unexpected physics.


title: Controlling gain with loss: Bounds on localizable entanglement in multi-qubit systems

abstract: We investigate the relation between the amount of entanglement localized on a chosen subsystem of a multi-qubit system via local measurements on the rest of the system, and the bipartite entanglement that is lost during this measurement process. We study a number of paradigmatic pure states, including the generalized GHZ, the generalized W, Dicke, and the generalized Dicke states. For the generalized GHZ and W states, we analytically derive bounds on localizable entanglement in terms of the entanglement present in the system prior to the measurement. Also, for the Dicke and the generalized Dicke states, we demonstrate that with increasing system size, localizable entanglement tends to be equal to the bipartite entanglement present in the system over a specific partition before measurement. We extend the investigation numerically in the case of arbitrary multi-qubit pure states. We also analytically determine the modification of these results, including the proposed bounds, in situations where these pure states are subjected to single-qubit phase-flip noise on all qubits. Additionally, we study one-dimensional paradigmatic quantum spin models, namely the transverse-field XY model and the XXZ model in an external field, and numerically demonstrate a quadratic dependence of the localized entanglement on the lost entanglement. We show that this relation is robust even in the presence of disorder in the strength of the external field.


title: A model predictive control (MPC)-integrated multiphase immersed boundary (IB) framework for simulating wave energy converters (WECs)

abstract: In this work, we present a novel MPC-integrated multiphase IB framework that can compute the optimal energy-maximizing control force on-the-fly by dynamically interacting with a high-fidelity numerical wave tank (NWT). Due to the requirement of solving a constrained optimization problem at each time step of the IB simulation, the MPC algorithm utilizes a low-dimensional dynamical model of the device that is based on the linear potential theory (LPT). The multiphase IB solver, on the other hand, is based on the high-dimensional fictitious domain Brinkman penalization (FD/BP) method, which fully-resolves the hydrodynamic nonlinearities associated with the wave-structure interaction (WSI). A time-series forecasting auto-regressive model is implemented that predicts wave heights to estimate the future wave excitation/Froude- Krylov forces for the MPC algorithm. Moreover, we also experiment with non-linear Froude-Krylov (NLFK) forces for the first time in an MPC formulation. Under varying sea conditions, the predictions of the MPC-integrated multiphase IB solver are compared to the widely popular LPT-based solvers. Overall, six WSI/MPC solver combinations are compared for a heaving vertical cylinder. We also determine the pathway of energy transfer from the waves to the power take-off (PTO) system and verify the relationships using IB simulations. Additionally, three different sea states are simulated within the IB simulation to test the adaptive capability of MPC for WECs. MPC is demonstrated to adapt to changing sea conditions and find the optimal solution for each sea state.


title: The quasi-adiabatic relaxation of haloes in the IllustrisTNG and EAGLE cosmological simulations

abstract: The dark matter content of a gravitationally bound halo is known to be affected by the galaxy and gas it hosts. We characterise this response for haloes spanning over four orders of magnitude in mass in the hydrodynamical simulation suites IllustrisTNG and EAGLE. We present simple fitting functions in the spherically averaged quasi-adiabatic relaxation framework that accurately capture the dark matter response over the full range of halo mass and halo-centric distance we explore. We show that commonly employed schemes, which consider the relative change in radius $r_f/r_i-1$ of a spherical dark matter shell to be a function of only the relative change in its mass $M_i/M_f-1$, do not accurately describe the measured response of most haloes in IllustrisTNG and EAGLE. Rather, $r_f/r_i$ additionally explicitly depends upon halo-centric distance $r_f/R_{\rm vir}$ for haloes with virial radius $R_{\rm vir}$, being very similar between IllustrisTNG and EAGLE and across halo mass. We also account for a previously unmodelled effect, likely driven by feedback-related outflows, in which shells having $r_f/r_i\simeq1$ (i.e., no relaxation) have $M_i/M_f$ significantly different from unity. Our results are immediately applicable to a number of semi-analytical tools for modelling galactic and large-scale structure. We also study the dependence of this response on several halo and galaxy properties beyond total mass, finding that it is primarily related to halo concentration and star formation rate. We discuss possible extensions of these results to build a deeper physical understanding of the small-scale connection between dark matter and baryons.


title: Hamilton's Principle with Phase Changes and Conservation Principles for Moist Potential Vorticity

abstract: Many definitions of moist potential vorticity (PV) have been proposed to extend the dry theory of Ertel PV. None of the moist PV definitions seem to have all of the desirable properties of the dry Ertel PV. For instance, dry PV is not only a globally conserved quantity, but also a material invariant that is conserved along fluid parcel trajectories. Therefore, an open question remains: is there a moist PV that is a material invariant, if clouds and phase changes of water are present? In prior studies, definitions of moist PV have been proposed based on physical and mathematical intuition. Here, a systematic approach is used. In particular, a particle relabeling symmetry is devised for a moist atmosphere and then Noether's theorem is employed to arrive at the associated conservation laws for moist PV. A priori, it is not clear whether this systematic approach will be viable, since it relies on variational derivatives in Hamilton's principle, and phase changes introduce singularities that could potentially prevent derivatives at cloud edge. However, it is shown that the energy and the Lagrangian density are sufficiently smooth to allow variational derivatives, in a moist Boussinesq system with reversible phase transitions between water vapor and liquid cloud water.. From the particle relabeling symmetry, a moist Kelvin circulation theorem is found, along with a moist PV conservation law that applies not for each individual parcel but for parcel-integrated PV, integrated over certain local volumes.


title: Lusin spaces as images of locally compact Polish spaces

abstract: A Lusin space is a Hausdorff space being the image of a Polish space under a continuous bijection. Such spaces have multiple applications, in particular, as state spaces of various stochastic systems. In this work, we consider the spaces obtained as the images of a noncompact and locally compact Polish space $(X, \mathcal{T})$, which we call $c$-Lusin. The main result is the statement that a $c$-Lusin space $Y=f(X)$, can be written as $Z\cup Y_1$, where $Z$ is a locally compact Polish space whereas $Y_1$ is $c$-Lusin. At the same time, $Y_1$ is the set of the discontinuity points of $f^{-1}$ which is a closed subset of $Y$. Moreover, $Y_1$ is nowhere dense if (and only if) $Y$ is a Baire space. By the same arguments, $Y_1$ can also be decomposed as $Z_1 \cup Y_2$ with the properties as above. In the case where $f$ can be extended to a continuous map $f:X\cup \{\infty\} \to Y$, and thus $Y_1$ is a singleton, we construct a metric on $X$ such that the corresponding metric space is compact and homeomorphic to the $c$-Lusin space $(f(X), \mathcal{T}')$.


title: Improving Diversity with Adversarially Learned Transformations for Domain Generalization

abstract: To be successful in single source domain generalization, maximizing diversity of synthesized domains has emerged as one of the most effective strategies. Many of the recent successes have come from methods that pre-specify the types of diversity that a model is exposed to during training, so that it can ultimately generalize well to new domains. However, na\"ive diversity based augmentations do not work effectively for domain generalization either because they cannot model large domain shift, or because the span of transforms that are pre-specified do not cover the types of shift commonly occurring in domain generalization. To address this issue, we present a novel framework that uses adversarially learned transformations (ALT) using a neural network to model plausible, yet hard image transformations that fool the classifier. This network is randomly initialized for each batch and trained for a fixed number of steps to maximize classification error. Further, we enforce consistency between the classifier's predictions on the clean and transformed images. With extensive empirical analysis, we find that this new form of adversarial transformations achieve both objectives of diversity and hardness simultaneously, outperforming all existing techniques on competitive benchmarks for single source domain generalization. We also show that ALT can naturally work with existing diversity modules to produce highly distinct, and large transformations of the source domain leading to state-of-the-art performance.


title: Disparate Impact in Differential Privacy from Gradient Misalignment

abstract: As machine learning becomes more widespread throughout society, aspects including data privacy and fairness must be carefully considered, and are crucial for deployment in highly regulated industries. Unfortunately, the application of privacy enhancing technologies can worsen unfair tendencies in models. In particular, one of the most widely used techniques for private model training, differentially private stochastic gradient descent (DPSGD), frequently intensifies disparate impact on groups within data. In this work we study the fine-grained causes of unfairness in DPSGD and identify gradient misalignment due to inequitable gradient clipping as the most significant source. This observation leads us to a new method for reducing unfairness by preventing gradient misalignment in DPSGD.


title: Bond Ordering and Molecular Spin-Orbital Fluctuations in the Cluster Mott Insulator GaTa$_4$Se$_8$

abstract: For materials where spin-orbit coupling is competitive with electronic correlations, the spatially anisotropic spin-orbital wavefunctions can stabilize degenerate states that lead to many and diverse quantum phases of matter. Here, we find evidence for a dynamical spin-orbital state preceding a T$^*$=50 K order-disorder spin-orbital ordering transition in the $j\!=\!3/2$ lacunar spinel GaTa$_4$Se$_8$. Above T$^*$, GaTa$_4$Se$_8$ has an average cubic crystal structure, but total scattering measurements indicate local non-cubic distortions of Ta$_4$ tetrahedral clusters for all measured temperatures $2 < T < 300$ K. Inelastic neutron scattering measurements reveal the dynamic nature of these local distortions through symmetry forbidden optical phonon modes that modulate $j\!=\!3/2$ molecular orbital occupation as well as intercluster Ta-Se bonds. Spin-orbital ordering at T$^*$ cannot be attributed to a classic Jahn-Teller mechanism and based on our findings, we propose that intercluster interactions acting on the scale of T$^*$ act to break global symmetry. The resulting staggered intercluster dimerization pattern doubles the unit cell, reflecting a spin-orbital valence bond ground state.


title: Radio Pulsar Beam Geometry at Lower Frequencies: Bright Sources Outside the Arecibo Sky

abstract: We present pulsar emission beam analyses and models in an effort to examine pulsar geometry and physics at the lowest frequencies scattering permits. We consider two populations of well-studied pulsars that lie outside the Arecibo sky, the first drawing on the Jodrell Bank Gould & Lyne survey down to -35{\deg} declination and a second using Parkes surveys in the far south. These assemble the full sky population of 487 pulsars known before the late 1990s which conveniently all have "B" names. We make full use of the core/double-cone emission beam model to assess its efficacy at lower frequencies, and we outline how different pair plasma sources probably underlie its validity. The analysis shows that with a very few exceptions pulsar radio emission beams can be modeled quantitatively with two concentric conal beams and a core beam of regular angular dimensions at 1 GHz. Further, the beamforms at lower frequencies change progressively in size but not in configuration. Pulsar emission-beam properties divide strongly depending on whether the plasma excitation is central within the polar fluxtube producing a core beam or peripheral along the edges generating conal beams, and this seems largely determined by whether their spindown energy is greater or less than about 10$^{32.5}$ ergs/s. Core emission dominated pulsars tend concentrate closely along the Galactic plane and in the direction of the Galactic center; whereas conal pulsars are somewhat more uniformly distributed both in Galactic longitude and latitude. Core dominated pulsars also tend to be more distant and particularly so in the inner Galaxy region.


title: A matrix product operator approach to non-equilibrium Floquet steady states

abstract: We present a numerical method to simulate non-equilibrium Floquet steady states of one-dimensional periodically-driven (Floquet) many-body systems coupled to a dissipative bath, called open-system Floquet DMRG (OFDMRG). This method is based on a matrix product operator ansatz for the Floquet density matrix in frequency-space, and enables access to large systems beyond the reach of exact master-equation or quantum trajectory simulations, while retaining information about the periodic micro-motion in Floquet steady states. An excited-state extension of this technique also allows computation of the dynamical approach to the steady state on asymptotically long timescales. We benchmark the OFDMRG approach with a driven-dissipative Ising model, and apply it to study the possibility of dissipatively stabilizing pre-thermal discrete time-crystalline order by coupling to a cold bath.

categories: quant-ph cond-mat.quant-gas cond-mat.stat-mech cond-mat.str-el


title: Edge Inference with Fully Differentiable Quantized Mixed Precision Neural Networks

abstract: The large computing and memory cost of deep neural networks (DNNs) often precludes their use in resource-constrained devices. Quantizing the parameters and operations to lower bit-precision offers substantial memory and energy savings for neural network inference, facilitating the use of DNNs on edge computing platforms. Recent efforts at quantizing DNNs have employed a range of techniques encompassing progressive quantization, step-size adaptation, and gradient scaling. This paper proposes a new quantization approach for mixed precision convolutional neural networks (CNNs) targeting edge-computing. Our method establishes a new pareto frontier in model accuracy and memory footprint demonstrating a range of quantized models, delivering best-in-class accuracy below 4.3 MB of weights (wgts.) and activations (acts.). Our main contributions are: (i) hardware-aware heterogeneous differentiable quantization with tensor-sliced learned precision, (ii) targeted gradient modification for wgts. and acts. to mitigate quantization errors, and (iii) a multi-phase learning schedule to address instability in learning arising from updates to the learned quantizer and model parameters. We demonstrate the effectiveness of our techniques on the ImageNet dataset across a range of models including EfficientNet-Lite0 (e.g., 4.14MB of wgts. and acts. at 67.66% accuracy) and MobileNetV2 (e.g., 3.51MB wgts. and acts. at 65.39% accuracy).


title: Estimates for the shifted convolution sum involving Fourier coefficients of cusp forms of half-integral weight

abstract: In this article, we obtain certain estimate for the shifted convolution sum involving the Fourier coefficients of half-integral weight cusp forms.


title: Feature Overcorrelation in Deep Graph Neural Networks: A New Perspective

abstract: Recent years have witnessed remarkable success achieved by graph neural networks (GNNs) in many real-world applications such as recommendation and drug discovery. Despite the success, oversmoothing has been identified as one of the key issues which limit the performance of deep GNNs. It indicates that the learned node representations are highly indistinguishable due to the stacked aggregators. In this paper, we propose a new perspective to look at the performance degradation of deep GNNs, i.e., feature overcorrelation. Through empirical and theoretical study on this matter, we demonstrate the existence of feature overcorrelation in deeper GNNs and reveal potential reasons leading to this issue. To reduce the feature correlation, we propose a general framework DeCorr which can encourage GNNs to encode less redundant information. Extensive experiments have demonstrated that DeCorr can help enable deeper GNNs and is complementary to existing techniques tackling the oversmoothing issue.


title: Milky Way's eccentric constituents with $Gaia$, APOGEE $\&$ GALAH

abstract: We report the results of an unsupervised decomposition of the local stellar halo in the chemo-dynamical space spanned by the abundance measurements from APOGEE DR17 and GALAH DR3. In our Gaussian Mixture Model, only four independent components dominate the halo in the Solar neighborhood, three previously known $Aurora$, $Splash$ and Gaia-Sausage/Enceladus (GS/E) and one new, $Eos$. Only one of these four is of accreted origin, namely the GS/E, thus supporting the earlier claims that the GS/E is the main progenitor of the Galactic stellar halo. We show that $Aurora$ is entirely consistent with the chemical properties of the so-called Heracles merger. In our analysis in which no predefined chemical selection cuts are applied, $Aurora$ spans a wide range of [Al/Fe] with a metallicity correlation indicative of a fast chemical enrichment in a massive galaxy, the young Milky Way. The new halo component dubbed $Eos$ is classified as $in situ$ given its high mean [Al/Fe]. $Eos$ shows strong evolution as a function of [Fe/H], where it changes from being the closest to GS/E at its lowest [Fe/H] to being indistinguishable from the Galactic low-$\alpha$ population at its highest [Fe/H]. We surmise that at least some of the outer thin disk of the Galaxy started its evolution in the gas polluted by the GS/E, and $Eos$ is an evidence of this process.


title: When to intervene? Prescriptive Process Monitoring Under Uncertainty and Resource Constraints

abstract: Prescriptive process monitoring approaches leverage historical data to prescribe runtime interventions that will likely prevent negative case outcomes or improve a process's performance. A centerpiece of a prescriptive process monitoring method is its intervention policy: a decision function determining if and when to trigger an intervention on an ongoing case. Previous proposals in this field rely on intervention policies that consider only the current state of a given case. These approaches do not consider the tradeoff between triggering an intervention in the current state, given the level of uncertainty of the underlying predictive models, versus delaying the intervention to a later state. Moreover, they assume that a resource is always available to perform an intervention (infinite capacity). This paper addresses these gaps by introducing a prescriptive process monitoring method that filters and ranks ongoing cases based on prediction scores, prediction uncertainty, and causal effect of the intervention, and triggers interventions to maximize a gain function, considering the available resources. The proposal is evaluated using a real-life event log. The results show that the proposed method outperforms existing baselines regarding total gain.


title: Condensing Graphs via One-Step Gradient Matching

abstract: As training deep learning models on large dataset takes a lot of time and resources, it is desired to construct a small synthetic dataset with which we can train deep learning models sufficiently. There are recent works that have explored solutions on condensing image datasets through complex bi-level optimization. For instance, dataset condensation (DC) matches network gradients w.r.t. large-real data and small-synthetic data, where the network weights are optimized for multiple steps at each outer iteration. However, existing approaches have their inherent limitations: (1) they are not directly applicable to graphs where the data is discrete; and (2) the condensation process is computationally expensive due to the involved nested optimization. To bridge the gap, we investigate efficient dataset condensation tailored for graph datasets where we model the discrete graph structure as a probabilistic model. We further propose a one-step gradient matching scheme, which performs gradient matching for only one single step without training the network weights. Our theoretical analysis shows this strategy can generate synthetic graphs that lead to lower classification loss on real graphs. Extensive experiments on various graph datasets demonstrate the effectiveness and efficiency of the proposed method. In particular, we are able to reduce the dataset size by 90% while approximating up to 98% of the original performance and our method is significantly faster than multi-step gradient matching (e.g. 15x in CIFAR10 for synthesizing 500 graphs). Code is available at \url{https://github.com/amazon-research/DosCond}.


title: Cosmological constraints from the power spectrum and bispectrum of 21cm intensity maps

abstract: The 21cm emission of neutral hydrogen is a potential probe of the matter distribution in the Universe after reionisation. Cosmological surveys of this line intensity will be conducted in the coming years by the SKAO and HIRAX experiments, complementary to upcoming galaxy surveys. We present the first forecasts of the cosmological constraints from the combination of the 21cm power spectrum and bispectrum. Fisher forecasts are computed for the constraining power of these surveys on cosmological parameters, the BAO distance functions and the growth function. We also estimate the constraining power on dynamical dark energy and modified gravity. Finally we investigate the constraints on the 21cm clustering bias, up to second order. We consider the effects on the 21cm correlators of the telescope beam, instrumental noise, foreground avoidance, the Alcock-Paczynski effect and theoretical errors in the modelling of the correlators. Adding Planck priors, and marginalising over nuisance parameters, HIRAX achieves sub-percent precision on the $\Lambda$CDM parameters, with SKAO delivering slightly lower precision. The modified gravity parameter $\gamma$ is constrained at 1% (HIRAX) and 5% (SKAO). For the dark energy parameters $w_0,w_a$, HIRAX delivers percent-level precision while SKAO constraints are weaker. HIRAX achieves sub-percent precision on the BAO distance functions $D_A,H$, while SKAO reaches 1-2% for $0.6\lesssim z\lesssim 1$. The growth rate $f$ is constrained at a few-percent level for the whole redshift range of HIRAX and for $0.6\lesssim z\lesssim 1$ by SKAO. The different performances arise mainly since HIRAX is a packed inteferometer that is optimised for BAO measurements, while SKAO is not optimised for interferometer cosmology and operates better in single-dish mode, where the telescope beam limits access to the smaller scales that are covered by an interferometer.