title: Higher integrability and the number of singular points for the Navier-Stokes equations with a scale-invariant bound

abstract: First, we show that if the pressure $p$ (associated to a weak Leray-Hopf solution $v$ of the Navier-Stokes equations) satisfies $\|p\|_{L^{\infty}_{t}(0,T^*; L^{\frac{3}{2},\infty}(\mathbb{R}^3))}\leq M^2$, then $v$ possesses higher integrability up to the first potential blow-up time $T^*$. Our method is concise and is based upon energy estimates applied to powers of $|v|$ and the utilization of a `small exponent'. As a consequence, we show that if a weak Leray-Hopf solution $v$ first blows up at $T^*$ and satisfies the Type I condition $\|v\|_{L^{\infty}_{t}(0,T^*; L^{3,\infty}(\mathbb{R}^3))}\leq M$, then $$\nabla v\in L^{2+O(\frac{1}{M})}(\mathbb{R}^3\times (\tfrac{1}{2}T^*,T^*)).$$ This is the first result of its kind, improving the integrability exponent of $\nabla v$ under the Type I assumption in the three-dimensional setting. Finally, we show that if $v:\mathbb{R}^3\times [-1,0]\rightarrow \mathbb{R}^3$ is a weak Leray-Hopf solution to the Navier-Stokes equations with $s_{n}\uparrow 0$ such that $$\sup_{n}\|v(\cdot,s_{n})\|_{L^{3,\infty}(\mathbb{R}^3)}\leq M $$ then $v$ possesses at most $O(M^{20})$ singular points at $t=0$. Our method is direct and concise. It is based upon known $\varepsilon$-regularity, global bounds on a Navier-Stokes solution with initial data in $L^{3,\infty}(\mathbb{R}^3)$ and rescaling arguments. We do not require arguments based on backward uniqueness nor unique continuation results for parabolic operators.


title: Deep Decomposition for Stochastic Normal-Abnormal Transport

abstract: Advection-diffusion equations describe a large family of natural transport processes, e.g., fluid flow, heat transfer, and wind transport. They are also used for optical flow and perfusion imaging computations. We develop a machine learning model, D^2-SONATA, built upon a stochastic advection-diffusion equation, which predicts the velocity and diffusion fields that drive 2D/3D image time-series of transport. In particular, our proposed model incorporates a model of transport atypicality, which isolates abnormal differences between expected normal transport behavior and the observed transport. In a medical context such a normal-abnormal decomposition can be used, for example, to quantify pathologies. Specifically, our model identifies the advection and diffusion contributions from the transport time-series and simultaneously predicts an anomaly value field to provide a decomposition into normal and abnormal advection and diffusion behavior. To achieve improved estimation performance for the velocity and diffusion-tensor fields underlying the advection-diffusion process and for the estimation of the anomaly fields, we create a 2D/3D anomaly-encoded advection-diffusion simulator, which allows for supervised learning. We further apply our model on a brain perfusion dataset from ischemic stroke patients via transfer learning. Extensive comparisons demonstrate that our model successfully distinguishes stroke lesions (abnormal) from normal brain regions, while reconstructing the underlying velocity and diffusion tensor fields.


title: Contextual Combinatorial Multi-output GP Bandits with Group Constraints

abstract: In federated multi-armed bandit problems, maximizing global reward while satisfying minimum privacy requirements to protect clients is the main goal. To formulate such problems, we consider a combinatorial contextual bandit setting with groups and changing action sets, where similar base arms arrive in groups and a set of base arms, called a super arm, must be chosen in each round to maximize super arm reward while satisfying the constraints of the rewards of groups from which base arms were chosen. To allow for greater flexibility, we let each base arm have two outcomes, modeled as the output of a two-output Gaussian process (GP), where one outcome is used to compute super arm reward and the other for group reward. We then propose a novel double-UCB GP-bandit algorithm, called Thresholded Combinatorial Gaussian Process Upper Confidence Bounds (TCGP-UCB), which balances between maximizing cumulative super arm reward and satisfying group reward constraints and can be tuned to prefer one over the other. We also define a new notion of regret that combines super arm regret with group reward constraint satisfaction and prove that TCGP-UCB incurs $\tilde{O}(\sqrt{\lambda^*(K)KT\overline{\gamma}_{T}} )$ regret with high probability, where $\overline{\gamma}_{T}$ is the maximum information gain associated with the set of base arm contexts that appeared in the first $T$ rounds and $K$ is the maximum super arm cardinality over all rounds. We lastly show in experiments using synthetic and real-world data and based on a federated learning setup as well as a content-recommendation one that our algorithm performs better then the current non-GP state-of-the-art combinatorial bandit algorithm, while satisfying group constraints.


title: Nanoparticle acts as a light source to make atom interferometers

abstract: Atomic Kapitza-Dirac (KD) scattering in the classical standing wave of lights is widely used to make the laser-pulsed atom interferometers. In this theoretical work, we show that the dielectric nanoparticle can be used as a weak light source to generate atomic KD scattering and make atom interferometer. We consider a cavity system consisting of atoms and a single nanoparticle, where the nanoparticle is illuminated by the external laser pulses. Atoms and the cavity mirrors are not illuminated by the laser beam, so nanoparticle acts as a pulsed source to excite the cavity mode which non-resonantly excites atomic internal state and generates a weak KD scattering of atomic external motion. We use twice such scattering to split atomic path and consequently use two classical laser pulses to recombine the separated paths for generating the Ramsey-Bord\'{e} atom interferometer. This atom interferometer is entangled with the centre-of-mass motion of nanoparticle and could be developed to search the small nonclassicality of motional nanoparticle, because the cavity mode excitation is associated with nanoparticle's position relative to the node or antinode of that optical mode.


title: Harmonic Retrieval with $L_1$-Tucker Tensor Decomposition

abstract: Harmonic retrieval (HR) has a wide range of applications in the scenes where signals are modelled as a summation of sinusoids. Past works have developed a number of approaches to recover the original signals. Most of them rely on classical singular value decomposition, which are vulnerable to unexpected outliers. In this paper, we present new decomposition algorithms of third-order complex-valued tensors with $L_1$-principle component analysis ($L_1$-PCA) of complex data and apply them to a novel random access HR model in presence of outliers. We also develop a novel subcarrier recovery method for the proposed model. Simulations are designed to compare our proposed method with some existing tensor-based algorithms for HR. The results demonstrate the outlier-insensitivity of the proposed method.


title: Machine Learning for Real-Time, Automatic, and Early Diagnosis of Parkinson's Disease by Extracting Signs of Micrographia from Handwriting Images

abstract: Parkinson's disease (PD) is debilitating, progressive, and clinically marked by motor symptoms. As the second most common neurodegenerative disease in the world, it affects over 10 million lives globally. Existing diagnoses methods have limitations, such as the expense of visiting doctors and the challenge of automated early detection, considering that behavioral differences in patients and healthy individuals are often indistinguishable in the early stages. However, micrographia, a handwriting disorder that leads to abnormally small handwriting, tremors, dystonia, and slow movement in the hands and fingers, is commonly observed in the early stages of PD. In this work, we apply machine learning techniques to extract signs of micrographia from drawing samples gathered from two open-source datasets and achieve a predictive accuracy of 94%. This work also sets the foundations for a publicly available and user-friendly web portal that anyone with access to a pen, printer, and phone can use for early PD detection.


title: The inviscid limit for the $2d$ Navier-Stokes equations in bounded domains

abstract: We prove the inviscid limit for the incompressible Navier-Stokes equations for data that are analytic only near the boundary in a general two-dimensional bounded domain. Our proof is direct, using the vorticity formulation with a nonlocal boundary condition, the explicit semigroup of the linear Stokes problem near the flatten boundary, and the standard wellposedness theory of Navier-Stokes equations in Sobolev spaces away from the boundary.


title: On the planar free energy of matrix models

abstract: In this work we obtain the planar free energy for the Hermitian one-matrix model with various choices of the potential. We accomplish this by applying an approach that bypasses the usual diagonalization of the matrices and the introduction of the eigenvalue density, to directly zero in the evaluation of the planar free energy. In the first part of the paper, we focus on potentials with finitely many terms. For various choices of potentials, we manage to find closed expressions for the planar free energy, and in some cases determine or bound their radius of convergence as a series in the 't Hooft coupling. In the second part of the paper we consider specific examples of potentials with infinitely many terms, that arise in the study of ${\cal N}=2$ super Yang-Mills theories on $S^4$, via supersymmetric localization. In particular, we manage to write the planar free energy of two non-conformal examples: SU(N) with $N_f<2N$, and ${\cal N}=2^*$.


title: $\Theta$-Hilbertianity and strong $\Theta$-Hilbertianity

abstract: $\Theta$-Hilbertianity and its strengthening, strong $\Theta$-Hilbertianity, are two generalizations of Hilbertianity inspired by Jarden's definition of $p$-Hilbertianity and strong $p$-Hilbertianity. Jarden has asked whether the two notions defined by him are actually the same. We address this question in its more general version of $\Theta$-Hilbertianity and show that for PRC, and, in particular, for PAC fields, $p$-Hilbertianity and strong $p$-Hilbertianity coincide.


title: BICEP Array: 150 GHz detector module development

abstract: The BICEP/Keck Collaboration is currently leading the quest to the highest sensitivity measurements of the polarized CMB anisotropies on degree scale with a series of cryogenic telescopes, of which BICEP Array is the latest Stage-3 upgrade with a total of $\sim32,000$ detectors. The instrument comprises 4 receivers spanning 30 to 270 GHz, with the low-frequency 30/40 GHz deployed to the South Pole Station in late 2019. The full complement of receivers is forecast to set the most stringent constraints on the tensor to scalar ratio $r$. Building on these advances, the overarching small-aperture telescope concept is already being used as the reference for further Stage-4 experiment design. In this paper I will present the development of the BICEP Array 150 GHz detector module and its fabrication requirements, with highlights on the high-density time division multiplexing (TDM) design of the cryogenic circuit boards. The low-impedance wiring required between the detectors and the first-stage SQUID amplifiers is crucial to maintain a stiff voltage bias on the detectors. A novel multi-layer FR4 Printed Circuit Board (PCB) with superconducting traces, capable of reading out up to 648 detectors, is presented along with its validation tests. I will also describe an ultra-high density TDM detector module we developed for a CMB-S4-like experiment that allows up to 1,920 detectors to be read out. TDM has been chosen as the detector readout technology for the Cosmic Microwave Background Stage-4 (CMB-S4) experiment based on its proven low-noise performance, predictable costs and overall maturity of the architecture. The heritage for TDM is rooted in mm- and submm-wave experiments dating back 20 years and has since evolved to support a multiplexing factor of 64x in Stage-3 experiments.


title: Autonomous optimization of nonaqueous battery electrolytes via robotic experimentation and machine learning

abstract: In this work, we introduce a novel workflow that couples robotics to machine-learning for efficient optimization of a non-aqueous battery electrolyte. A custom-built automated experiment named "Clio" is coupled to Dragonfly - a Bayesian optimization-based experiment planner. Clio autonomously optimizes electrolyte conductivity over a single-salt, ternary solvent design space. Using this workflow, we identify 6 fast-charging electrolytes in 2 work-days and 42 experiments (compared with 60 days using exhaustive search of the 1000 possible candidates, or 6 days assuming only 10% of candidates are evaluated). Our method finds the highest reported conductivity electrolyte in a design space heavily explored by previous literature, converging on a high-conductivity mixture that demonstrates subtle electrolyte chemical physics.


title: Comparison of Models for Training Optical Matrix Multipliers in Neuromorphic PICs

abstract: We experimentally compare simple physics-based vs. data-driven neural-network-based models for offline training of programmable photonic chips using Mach-Zehnder interferometer meshes. The neural-network model outperforms physics-based models for a chip with thermal crosstalk, yielding increased testing accuracy.


title: Comparing Machine Learning and Interpolation Methods for Loop-Level Calculations

abstract: The need to approximate functions is ubiquitous in science, either due to empirical constraints or high computational cost of accessing the function. In high-energy physics, the precise computation of the scattering cross-section of a process requires the evaluation of computationally intensive integrals. A wide variety of methods in machine learning have been used to tackle this problem, but often the motivation of using one method over another is lacking. Comparing these methods is typically highly dependent on the problem at hand, so we specify to the case where we can evaluate the function a large number of times, after which quick and accurate evaluation can take place. We consider four interpolation and three machine learning techniques and compare their performance on three toy functions, the four-point scalar Passarino-Veltman $D_0$ function, and the two-loop self-energy master integral $M$. We find that in low dimensions ($d = 3$), traditional interpolation techniques like the Radial Basis Function perform very well, but in higher dimensions ($d=5, 6, 9$) we find that multi-layer perceptrons (a.k.a neural networks) do not suffer as much from the curse of dimensionality and provide the fastest and most accurate predictions.


title: Dynamic Network-Assisted D2D-Aided Coded Distributed Learning

abstract: Today, various machine learning (ML) applications offer continuous data processing and real-time data analytics at the edge of a wireless network. Distributed real-time ML solutions are highly sensitive to the so-called straggler effect caused by resource heterogeneity and alleviated by various computation offloading mechanisms that seriously challenge the communication efficiency, especially in large-scale scenarios. To decrease the communication overhead, we rely on device-to-device (D2D) connectivity that improves spectrum utilization and allows efficient data exchange between devices in proximity. In particular, we design a novel D2D-aided coded federated learning method (D2D-CFL) for efficient load balancing across devices. The proposed solution captures system dynamics, including data (time-dependent learning model, varied intensity of data arrivals), device (diverse computational resources and volume of training data), and deployment (varied locations and D2D graph connectivity). To minimize the number of communication rounds, we derive an optimal compression rate for achieving minimum processing time and establish its connection with the convergence time. The resulting optimization problem provides suboptimal compression parameters, which improve the total training time. Our proposed method is beneficial for real-time collaborative applications, where the users continuously generate training data resulting in the model drift.


title: Solving classification problems using Traceless Genetic Programming

abstract: Traceless Genetic Programming (TGP) is a new Genetic Programming (GP) that may be used for solving difficult real-world problems. The main difference between TGP and other GP techniques is that TGP does not explicitly store the evolved computer programs. In this paper, TGP is used for solving real-world classification problems taken from PROBEN1. Numerical experiments show that TGP performs similar and sometimes even better than other GP techniques for the considered test problems.


title: Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis

abstract: Vision Transformers (ViT)s have shown great performance in self-supervised learning of global and local representations that can be transferred to downstream applications. Inspired by these results, we introduce a novel self-supervised learning framework with tailored proxy tasks for medical image analysis. Specifically, we propose: (i) a new 3D transformer-based model, dubbed Swin UNEt TRansformers (Swin UNETR), with a hierarchical encoder for self-supervised pre-training; (ii) tailored proxy tasks for learning the underlying pattern of human anatomy. We demonstrate successful pre-training of the proposed model on 5,050 publicly available computed tomography (CT) images from various body organs. The effectiveness of our approach is validated by fine-tuning the pre-trained models on the Beyond the Cranial Vault (BTCV) Segmentation Challenge with 13 abdominal organs and segmentation tasks from the Medical Segmentation Decathlon (MSD) dataset. Our model is currently the state-of-the-art (i.e. ranked 1st) on the public test leaderboards of both MSD and BTCV datasets. Code: https://monai.io/research/swin-unetr


title: Classification-Regression for Chart Comprehension

abstract: Chart question answering (CQA) is a task used for assessing chart comprehension, which is fundamentally different from understanding natural images. CQA requires analyzing the relationships between the textual and the visual components of a chart, in order to answer general questions or infer numerical values. Most existing CQA datasets and models are based on simplifying assumptions that often enable surpassing human performance. In this work, we address this outcome and propose a new model that jointly learns classification and regression. Our language-vision setup uses co-attention transformers to capture the complex real-world interactions between the question and the textual elements. We validate our design with extensive experiments on the realistic PlotQA dataset, outperforming previous approaches by a large margin, while showing competitive performance on FigureQA. Our model is particularly well suited for realistic questions with out-of-vocabulary answers that require regression.


title: Bailey pairs for the q-hypergeometric integral pentagon identity

abstract: In this work, we construct a new Bailey pairs for the integral pentagon identity in terms of q-hypergeometric functions. The pentagon identity considered here represents equality of the partition functions of a certain three-dimensional supersymmetric dual theories. It can be also interpreted as the star-triangle relation for the Ising-type integrable lattice model.


title: Gauge structure of the Einstein field equations in Bondi-like coordinates

abstract: The characteristic initial (boundary) value problem has numerous applications in general relativity (GR) involving numerical studies, and is often formulated using Bondi-like coordinates. Recently it was shown that several prototype formulations of this type are only weakly hyperbolic. Presently we examine the root cause of this result. In a linear analysis we identify the gauge, constraint and physical blocks in the principal part of the Einstein field equations in such a gauge, and show that the subsystem related to the gauge variables is only weakly hyperbolic. Weak hyperbolicity of the full system follows as a consequence in many cases. We demonstrate this explicitly in specific examples, and thus argue that Bondi-like gauges result in weakly hyperbolic free evolution systems under quite general conditions. Consequently the characteristic initial (boundary) value problem of GR in these gauges is rendered ill-posed in the simplest norms one would like to employ. The possibility of finding good alternative norms, in which well-posedness is achieved, is discussed. So motivated, we present numerical convergence tests with an implementation of full GR which demonstrate the effect of weak hyperbolicity in practice.


title: Type Ia Supernovae and their Explosive Nucleosynthesis: Constraints on Progenitors

abstract: What the progenitors of Type Ia supernovae (SNe Ia) are, whether they are near-Chandrasekhar mass or sub-Chandrasekhar mass white dwarfs, has been the matter of debate for decades. Various observational hints are supporting both models as the main progenitors. In this paper, we review the explosion physics and the chemical abundance patterns of SNe Ia from these two classes of progenitors. We will discuss how the observational data of SNe Ia, their remnants, the Milky Way Galaxy, and galactic clusters can help us to determine the essential features where numerical models of SNe Ia need to match.


title: Familial Monads as Higher Category Theories

abstract: Categories, $n$-categories, double categories, and multicategories (among others) all have similar definitions as collections of cells with composition operations. We give an explicit description of the information required to define any higher category structure which arises as algebras for a familially representable monad on a presheaf category, then use this to describe various examples relating to higher category theory and cubical sets. The proof of this characterization avoids tedious naturality arguments by passing through the theory of categorical polynomials.


title: A walk in my lattice path garden

abstract: Various lattice path models are reviewed. The enumeration is done using generating functions. A few bijective considerations are woven in as well. The kernel method is often used. Computer algebra was an essential tool. Some results are new, some have appeared before. The lattice path models we treated, are: Hoppy's walks, the combinatorics of sequence A002212 in \cite{OEIS} (skew Dyck paths, Schr\"oder paths, Hex-trees, decorated ordered trees, multi-edge trees, etc.) Weighted unary-binary trees also occur, and we could improve on our old paper on Horton-Strahler numbers \cite{FlPr86}, by using a different substitution. Some material on ternary trees appears as well, as on Motzkin numbers and paths (a model due to Retakh), and a new concept called amplitude that was found in \cite{irene}. Some new results on Deutsch paths in a strip are included as well. During the Covid period, I spent much time with this beautiful concept that I dare to call Deutsch paths, since Emeric Deutsch stands at the beginning with a problem that he posted in the American Mathematical Monthly some 20 years ago. Peaks and valleys, studied by Rainer Kemp 40 years under the names \textsc{max}-turns and \textsc{min}-turns, are revisited with a more modern approach, streamlining the analysis, relying on the `subcritical case' (named so by Philippe Flajolet), the adding a new slice technique and once again the kernel method.


title: Semi-supervised Implicit Scene Completion from Sparse LiDAR

abstract: Recent advances show that semi-supervised implicit representation learning can be achieved through physical constraints like Eikonal equations. However, this scheme has not yet been successfully used for LiDAR point cloud data, due to its spatially varying sparsity. In this paper, we develop a novel formulation that conditions the semi-supervised implicit function on localized shape embeddings. It exploits the strong representation learning power of sparse convolutional networks to generate shape-aware dense feature volumes, while still allows semi-supervised signed distance function learning without knowing its exact values at free space. With extensive quantitative and qualitative results, we demonstrate intrinsic properties of this new learning system and its usefulness in real-world road scenes. Notably, we improve IoU from 26.3% to 51.0% on SemanticKITTI. Moreover, we explore two paradigms to integrate semantic label predictions, achieving implicit semantic completion. Code and models can be accessed at https://github.com/OPEN-AIR-SUN/SISC.


title: UBoCo : Unsupervised Boundary Contrastive Learning for Generic Event Boundary Detection

abstract: Generic Event Boundary Detection (GEBD) is a newly suggested video understanding task that aims to find one level deeper semantic boundaries of events. Bridging the gap between natural human perception and video understanding, it has various potential applications, including interpretable and semantically valid video parsing. Still at an early development stage, existing GEBD solvers are simple extensions of relevant video understanding tasks, disregarding GEBD's distinctive characteristics. In this paper, we propose a novel framework for unsupervised/supervised GEBD, by using the Temporal Self-similarity Matrix (TSM) as the video representation. The new Recursive TSM Parsing (RTP) algorithm exploits local diagonal patterns in TSM to detect boundaries, and it is combined with the Boundary Contrastive (BoCo) loss to train our encoder to generate more informative TSMs. Our framework can be applied to both unsupervised and supervised settings, with both achieving state-of-the-art performance by a huge margin in GEBD benchmark. Especially, our unsupervised method outperforms the previous state-of-the-art "supervised" model, implying its exceptional efficacy.


title: The lattice of nil-Hecke algebras over real and complex reflection groups

abstract: Associated to every complex reflection group, we construct a lattice of quotients of its braid monoid-algebra, which we term nil-Hecke algebras, and which are obtained by killing all braid words that are "sufficiently long", as well as some integer power of each generator. These include usual nil-Coxeter algebras, nil-Temperley-Lieb algebras, and their variants, and lead to symmetric semigroup module categories which necessarily cannot be monoidal. Motivated by classical work of Coxeter (1957) and the Broue-Malle-Rouquier freeness conjecture [Crelle 1998], and continuing beyond work of the second author [Trans. Amer. Math. Soc. 2018], we obtain a complete classification of the finite-dimensional nil-Hecke algebras for all complex reflection groups $W$. These comprise the usual nil-Coxeter algebras for $W$ of finite type, their "fully commutative" analogues for $W$ of FC-finite type, three exceptional algebras (of types $F_4,H_3,H_4$), and three exceptional series (of types $B_n$ and $A_n$, two of them novel). In particular, we find the first - and only two - finite-dimensional nil-Hecke algebras over discrete complex reflection groups; this breaks from the nil-Coxeter case (where no braid words are further killed, and) where Marin [J. Pure Appl. Alg. 2014] and Khare [Trans. Amer. Math. Soc. 2018] showed that such algebras do not exist. In addition to these algebras, and also algebraic connections (to PBW deformations and non-monoidal tensor categories), we further uncover combinatorial bases of algebras, both known (fully commutative elements) and novel ($\bar{12}$-avoiding signed permutations). Our classification draws from and brings together results of Popov [Comm. Math. Inst. Utrecht 1982], Stembridge [J. Alg. Combin. 1996, 1998], Malle [Transform. Groups} 1996], Postnikov via Gowravaram-Khovanova (2015), Hart [J. Group Th. 2017], and Khare [Trans. Amer. Math. Soc. 2018].


title: Concavity properties for solutions to $p$-Laplace equations with concave nonlinearities

abstract: We obtain new concavity results, up to a suitable transformation, for a class of quasi-linear equations in a convex domain involving the $p$-Laplace operator and a general nonlinearity satisfying concavity type assumptions. This provides an extension of results previously known in the literature only for the torsion and the eigenfunction equations. In the semilinear case $p = 2$ the results are already new since they include new admissible nonlinearities.


title: Fractional Quantum Hall Effect for Extended Objects: from Skyrmionic Membranes to Dyonic Strings

abstract: It is well known that in two spatial dimensions the fractional quantum Hall effect (FQHE) deals with point-like anyons that carry fractional electric charge and statistics. Moreover, in presence of a SO(3) order parameter, point-like skyrmions emerge and play a central role in the corresponding quantum Hall ferromagnetic phase. In this work, we show that in six spatial dimensions, the FQHE for extended objects shares very similar features with its two-dimensional counterpart. In the higher-dimensional case, the electromagnetic and hydrodynamical one-form gauge fields are replaced by three-form gauge fields and the usual point-like anyons are replaced by membranes, namely two-dimensional extended objects that can carry fractional charge and statistics. We focus on skyrmionic membranes, which are associated to a SO(5) order parameter and give rise to an higher-dimensional generalizaton of the quantum Hall ferromagnetism. We show that skyrmionic membranes naturally couple to the curved background through a generalized Wen-Zee term and can give us some insights about the chiral conformal field theory on the boundary. We then present a generalization of the Witten effect in six spatial dimensions by showing that one-dimensional extended monopoles (magnetic strings) in the bulk of the FQH states can acquire electric charge through an axion field by becoming dyonic strings.


title: Computer Vision Aided Beam Tracking in A Real-World Millimeter Wave Deployment

abstract: Millimeter-wave (mmWave) and terahertz (THz) communications require beamforming to acquire adequate receive signal-to-noise ratio (SNR). To find the optimal beam, current beam management solutions perform beam training over a large number of beams in pre-defined codebooks. The beam training overhead increases the access latency and can become infeasible for high-mobility applications. To reduce or even eliminate this beam training overhead, we propose to utilize the visual data, captured for example by cameras at the base stations, to guide the beam tracking/refining process. We propose a machine learning (ML) framework, based on an encoder-decoder architecture, that can predict the future beams using the previously obtained visual sensing information. Our proposed approach is evaluated on a large-scale real-world dataset, where it achieves an accuracy of $64.47\%$ (and a normalized receive power of $97.66\%$) in predicting the future beam. This is achieved while requiring less than $1\%$ of the beam training overhead of a corresponding baseline solution that uses a sequence of previous beams to predict the future one. This high performance and low overhead obtained on the real-world dataset demonstrate the potential of the proposed vision-aided beam tracking approach in real-world applications.


title: Unsupervised cross domain learning with applications to 7 layer segmentation of OCTs

abstract: Unsupervised cross domain adaptation for OCT 7 layer segmentation and other medical applications where labeled training data is only available in a source domain and unavailable in the target domain. Our proposed method helps generalize of deep learning to many areas in the medical field where labeled training data are expensive and time consuming to acquire or where target domains are too novel to have had labelling.


title: Radar Aided Proactive Blockage Prediction in Real-World Millimeter Wave Systems

abstract: Millimeter wave (mmWave) and sub-terahertz communication systems rely mainly on line-of-sight (LOS) links between the transmitters and receivers. The sensitivity of these high-frequency LOS links to blockages, however, challenges the reliability and latency requirements of these communication networks. In this paper, we propose to utilize radar sensors to provide sensing information about the surrounding environment and moving objects, and leverage this information to proactively predict future link blockages before they happen. This is motivated by the low cost of the radar sensors, their ability to efficiently capture important features such as the range, angle, velocity of the moving scatterers (candidate blockages), and their capability to capture radar frames at relatively high speed. We formulate the radar-aided proactive blockage prediction problem and develop two solutions for this problem based on classical radar object tracking and deep neural networks. The two solutions are designed to leverage domain knowledge and the understanding of the blockage prediction problem. To accurately evaluate the proposed solutions, we build a large-scale real-world dataset, based on the DeepSense framework, gathering co-existing radar and mmWave communication measurements of more than $10$ thousand data points and various blockage objects (vehicles, bikes, humans, etc.). The evaluation results, based on this dataset, show that the proposed approaches can predict future blockages $1$ second before they happen with more than $90\%$ $F_1$ score (and more than $90\%$ accuracy). These results, among others, highlight a promising solution for blockage prediction and reliability enhancement in future wireless mmWave and terahertz communication systems.


title: Coarse-To-Fine Incremental Few-Shot Learning

abstract: Different from fine-tuning models pre-trained on a large-scale dataset of preset classes, class-incremental learning (CIL) aims to recognize novel classes over time without forgetting pre-trained classes. However, a given model will be challenged by test images with finer-grained classes, e.g., a basenji is at most recognized as a dog. Such images form a new training set (i.e., support set) so that the incremental model is hoped to recognize a basenji (i.e., query) as a basenji next time. This paper formulates such a hybrid natural problem of coarse-to-fine few-shot (C2FS) recognition as a CIL problem named C2FSCIL, and proposes a simple, effective, and theoretically-sound strategy Knowe: to learn, normalize, and freeze a classifier's weights from fine labels, once learning an embedding space contrastively from coarse labels. Besides, as CIL aims at a stability-plasticity balance, new overall performance metrics are proposed. In that sense, on CIFAR-100, BREEDS, and tieredImageNet, Knowe outperforms all recent relevant CIL/FSCIL methods that are tailored to the new problem setting for the first time.


title: On formally undecidable propositions in nondeterministic languages

abstract: Any class of languages $\mathbf{L}$ accepted in time $\mathbf{T}$ has a counterpart $\mathbf{NL}$ accepted in nondeterministic time $\mathbf{NT}$. It follows from the definition of nondeterministic languages that $\mathbf{L} \subseteq \mathbf{NL}$. This work shows that every sufficiently powerful language in $\mathbf{L}$ contains a string corresponding to G\"{o}del's undecidable proposition, but this string is not contained in its nondeterministic counterpart. This inconsistency in the definition of nondeterministic languages shows that certain questions regarding nondeterministic time complexity equivalences are irrevocably ill-posed.


title: Dark Matter abundance via thermal decays and leptoquark mediators

abstract: We explore a new mechanism for reproducing the Dark Matter (DM) abundance: scatterings of one DM particle on light Standard Model particles. Strong bounds on its decays can be satisfied if DM undergoes freeze-in and has a mass around or below the pion mass. This happens, for example, in theories with a right-handed neutrino interacting with charged fermions through a leptoquark exchange. These leptoquarks can be linked to the ones motivated by the B-physics anomalies if assumptions about the flavour structure are made. DM signals are unusual, with interesting possibilities for direct and indirect detection. Achieving thermal freeze-out instead requires models with more than one DM flavour, and couplings parametrically smaller than what needed by the usual pair annihilations.


title: Five-dimensional electrostatic black holes in a background field

abstract: We consider $5$ dimensional electrostatic solutions to Einstein-Maxwell gravity with $2$ commuting spacelike Killing fields. Taking two distinct reductions from $5$ dimensions to a $3$ dimensional base space, we write the Einstein-Maxwell equations using some axially symmetric functions on $\mathbb{R}^3$. These equations can be viewed as arising from a harmonic map coupled to 3-dimensional gravity with the isometries of the target space of this map revealing a hidden $SL(2,\mathbb{R})$ symmetry of this sector of the theory. Depending on the choice of reduction this symmetry then gives rise to two different 1-parameter families of transformations corresponding to either charging a black hole or immersing it in a background electric field. We use these transformations to charge a static black Saturn and a static $L(n,1)$ black lens spacetime and by tuning the strength of the external field, we cure the conical singularities to give new regular solutions. Notably the electrified black lens generated is the first example of a regular black lens in Einstein-Maxwell gravity with topologically trivial asymptotics.


title: Mysterious Triality and Rational Homotopy Theory

abstract: Mysterious Duality was discovered by Iqbal, Neitzke, and Vafa in 2001 as a convincing, yet mysterious correspondence between certain symmetry patterns in toroidal compactifications of M-theory and del Pezzo surfaces, both governed by the root system series $E_k$. It turns out that the sequence of del Pezzo surfaces is not the only sequence of objects in mathematics that gives rise to the same $E_k$ symmetry pattern. We present a sequence of topological spaces, starting with the four-sphere $S^4$, and then forming its iterated cyclic loop spaces $\mathcal{L}_c^k S^4$, within which we discover the $E_k$ symmetry pattern via rational homotopy theory. For this sequence of spaces, the correspondence between its $E_k$ symmetry pattern and that of toroidal compactifications of M-theory is no longer a mystery, as each space $\mathcal{L}_c^k S^4$ is naturally related to the compactification of M-theory on the $k$-torus via identification of the equations of motion of $(11-k)$-dimensional supergravity as the defining equations of the Sullivan minimal model of $\mathcal{L}_c^k S^4$. This gives an explicit duality between algebraic topology and physics. Thereby, we extend Iqbal-Neitzke-Vafa's Mysterious Duality between algebraic geometry and physics into a triality, also involving algebraic topology. Via this triality, duality between physics and mathematics is demystified, and the mystery is transferred to the mathematical realm as duality between algebraic geometry and algebraic topology. Now the question is: Is there an explicit relation between the del Pezzo surfaces $\mathbb{B}_k$ and iterated cyclic loop spaces of $S^4$ which would explain the common $E_k$ symmetry pattern?


title: On the ergodicity of the frame flow on even-dimensional manifolds

abstract: It is known that the frame flow on a closed $n$-dimensional Riemannian manifold with negative sectional curvature is ergodic if $n$ is odd and $n \neq 7$. In this paper we study its ergodicity for $n \geq 4$ even and $n = 7$, and we show that: if $n \equiv 2$ mod $4$, or $n=4$, the frame flow is ergodic if the manifold is $\sim 0.3$-pinched, if $n \equiv 0$ mod $4$, it is ergodic if the manifold is $\sim 0.6$-pinched, except in the three dimensions $n=7,8,134$, where the respective pinching conditions are $0.4962...$, $0.6212...$, and $0.5788...$. In particular, if $n = 4$ or $n \equiv 2$ mod $4$, this almost solves a long-standing conjecture of Brin asserting that $1/4$-pinched even-dimensional manifolds have an ergodic frame flow.


title: Probing nuclear structure with mean transverse momentum in relativistic isobar collisions

abstract: Transverse momentum ($p_{T}$) generation in relativistic heavy ion collisions is sensitive to the initial geometry and the final-state bulk evolution. We demonstrate with hydrodynamic calculations that the mean $p_T$ ratio ($R_{\langle p_{T}\rangle}$) between the highly similar isobar $^{96}_{44}$Ru+$^{96}_{44}$Ru and $^{96}_{40}$Zr+$^{96}_{40}$Zr collisions is insensitive to the bulk evolution and remains sensitive to the small difference in the initial nuclear structure (neutron skin and deformation) between the Ru and Zr nuclei.We further find that nuclear deformation can produce an anticorrelation between $R_{\langle p_{T}\rangle}$ and eccentricity (or elliptic flow) in central collisions. These findings suggest that the $R_{\langle p_{T}\rangle}$ between the isobar systems can be used to measure the neutron skin thickness and deformation parameters, which can in turn constrain the nuclear symmetry energy slope parameter.


title: TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions

abstract: Removing adverse weather conditions like rain, fog, and snow from images is an important problem in many applications. Most methods proposed in the literature have been designed to deal with just removing one type of degradation. Recently, a CNN-based method using neural architecture search (All-in-One) was proposed to remove all the weather conditions at once. However, it has a large number of parameters as it uses multiple encoders to cater to each weather removal task and still has scope for improvement in its performance. In this work, we focus on developing an efficient solution for the all adverse weather removal problem. To this end, we propose TransWeather, a transformer-based end-to-end model with just a single encoder and a decoder that can restore an image degraded by any weather condition. Specifically, we utilize a novel transformer encoder using intra-patch transformer blocks to enhance attention inside the patches to effectively remove smaller weather degradations. We also introduce a transformer decoder with learnable weather type embeddings to adjust to the weather degradation at hand. TransWeather achieves improvements across multiple test datasets over both All-in-One network as well as methods fine-tuned for specific tasks. TransWeather is also validated on real world test images and found to be more effective than previous methods. Implementation code can be accessed at https://github.com/jeya-maria-jose/TransWeather .


title: Dynamics of dirac concentrations in the evolution of quantitative alleles with sexual reproduction

abstract: A proper understanding of the links between varying gene expression levels and complex trait adaptation is still lacking, despite recent advances in sequencing techniques leading to new insights on their importance in some evolutionary processes. This calls for extensions of the continuum-of-alleles framework first introduced by Kimura (1965) that bypass the classical Gaussian approximation. Here, we propose a novel mathematical framework to study the evolutionary dynamics of quantitative alleles for sexually reproducing populations under natural selection and competition through an integro-differential equation. It involves a new reproduction operator which allows to use techniques based on the maximum principle, unlike the infinitesimal model operator used in other studies with sexual reproduction. In an asymptotic regime where initially the population has a small phenotypic variance, we analyse the long-term dynamics of the phenotypic distributions according to the methodology of small variance (Diekmann et al. 2005). Under some assumptions on the limit equation, we show that the population remains monomorphic, that is the phenotypic distribution remains concentrated as a moving Dirac mass. Moreover, in the case of a monomorphic distribution we derive a canonical equation describing the dynamics of the dominant alleles.


title: Predicting the Neutrino Emission for the Sources in the H.E.S.S. Galactic Plane Survey

abstract: The H.E.S.S. Galactic Plane Survey has detected very-high-energy (VHE) gamma-ray emission from 78 sources in the Milky Way. These sources belong to different object classes (pulsar wind nebulae, supernova remnants or binary systems) and some of these sources remain unidentified. The gamma-ray emission of these objects may be of leptonic or hadronic origin and gamma-ray observations alone cannot distinguish between these two scenarios. The detection of neutrino emission would provide evidence for a hadronic scenario in these objects. Based on the observed gamma-ray spectra we predict the neutrino emission of these sources under the hypothesis that the emission is solely of hadronic origin. This prediction relies entirely on observation and is independent of the source class, the distance or the ambient target material. We use these predictions to create an empirical model for the neutrino emission of the Milky Way. This model can be used to search for neutrino emission from individual gamma-ray sources as well as testing for neutrino emission from potential source populations in the Milky Way.


title: Ocean wave transmission, reflection and absorption by rows of vertical structures along the coastline

abstract: Large arrays of wave-absorbing structures could serve the double objective of coastal protection against erosion and clean, renewable electrical power production. In this work, the principle of an artificial canopy is explored, which consists of vertical structures, arranged in rows parallel to the coastline. Sea waves, which propagate towards the shore, interact with the obstacle rows. A part of the wave energy is reflected back towards the ocean, another part is transmitted to the shoreline, while the rest of the energy is, in theory, available for energy production (although losses, due to viscous effects within the fluid, or imperfect efficiency of the power conversion mechanism, will unavoidably take place). First, a simple geometric representation of the reflection/transmission properties of individual, fixed rows is presented. In the case of moving rows, relationships are drawn between the internal stiffness and damping parameters of the devices, on the one hand, and their reflection, transmission and absorption characteristics, on the other hand. Array properties are then examined, depending on both individual row design parameters and row-to-row spacing values, using the wide-spacing approximation. A numerical case study illustrates the capabilities of the proposed modelling framework, with arrays of vertical, oscillating rectangular plates. The transmitted, reflected and absorbed wave spectra are examined, along with their dependencies on individual oscillator control tuning and array design parameters.


title: Symmetrically colored Gaussian graphical models with toric vanishing ideal

abstract: A colored Gaussian graphical model is a linear concentration model in which equalities among the concentrations are specified by a coloring of an underlying graph. The model is called RCOP if this coloring is given by the edge and vertex orbits of a subgroup of the automorphism group of the graph. We show that RCOP Gaussian graphical models on block graphs are toric in the space of covariance matrices and we describe Markov bases for them. To this end, we learn more about the combinatorial structure of these models and their connection with Jordan algebras.


title: Blended Diffusion for Text-driven Editing of Natural Images

abstract: Natural language offers a highly intuitive interface for image editing. In this paper, we introduce the first solution for performing local (region-based) edits in generic natural images, based on a natural language description along with an ROI mask. We achieve our goal by leveraging and combining a pretrained language-image model (CLIP), to steer the edit towards a user-provided text prompt, with a denoising diffusion probabilistic model (DDPM) to generate natural-looking results. To seamlessly fuse the edited region with the unchanged parts of the image, we spatially blend noised versions of the input image with the local text-guided diffusion latent at a progression of noise levels. In addition, we show that adding augmentations to the diffusion process mitigates adversarial results. We compare against several baselines and related methods, both qualitatively and quantitatively, and show that our method outperforms these solutions in terms of overall realism, ability to preserve the background and matching the text. Finally, we show several text-driven editing applications, including adding a new object to an image, removing/replacing/altering existing objects, background replacement, and image extrapolation. Code is available at: https://omriavrahami.com/blended-diffusion-page/


title: Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling

abstract: We present Point-BERT, a new paradigm for learning Transformers to generalize the concept of BERT to 3D point cloud. Inspired by BERT, we devise a Masked Point Modeling (MPM) task to pre-train point cloud Transformers. Specifically, we first divide a point cloud into several local point patches, and a point cloud Tokenizer with a discrete Variational AutoEncoder (dVAE) is designed to generate discrete point tokens containing meaningful local information. Then, we randomly mask out some patches of input point clouds and feed them into the backbone Transformers. The pre-training objective is to recover the original point tokens at the masked locations under the supervision of point tokens obtained by the Tokenizer. Extensive experiments demonstrate that the proposed BERT-style pre-training strategy significantly improves the performance of standard point cloud Transformers. Equipped with our pre-training strategy, we show that a pure Transformer architecture attains 93.8% accuracy on ModelNet40 and 83.1% accuracy on the hardest setting of ScanObjectNN, surpassing carefully designed point cloud models with much fewer hand-made designs. We also demonstrate that the representations learned by Point-BERT transfer well to new tasks and domains, where our models largely advance the state-of-the-art of few-shot point cloud classification task. The code and pre-trained models are available at https://github.com/lulutang0608/Point-BERT


title: Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspective

abstract: Learning behavioral patterns from observational data has been a de-facto approach to motion forecasting. Yet, the current paradigm suffers from two shortcomings: brittle under distribution shifts and inefficient for knowledge transfer. In this work, we propose to address these challenges from a causal representation perspective. We first introduce a causal formalism of motion forecasting, which casts the problem as a dynamic process with three groups of latent variables, namely invariant variables, style confounders, and spurious features. We then introduce a learning framework that treats each group separately: (i) unlike the common practice mixing datasets collected from different locations, we exploit their subtle distinctions by means of an invariance loss encouraging the model to suppress spurious correlations; (ii) we devise a modular architecture that factorizes the representations of invariant mechanisms and style confounders to approximate a sparse causal graph; (iii) we introduce a style contrastive loss that not only enforces the structure of style representations but also serves as a self-supervisory signal for test-time refinement on the fly. Experiments on synthetic and real datasets show that our proposed method improves the robustness and reusability of learned motion representations, significantly outperforming prior state-of-the-art motion forecasting models for out-of-distribution generalization and low-shot transfer.


title: End-to-End Referring Video Object Segmentation with Multimodal Transformers

abstract: The referring video object segmentation task (RVOS) involves segmentation of a text-referred object instance in the frames of a given video. Due to the complex nature of this multimodal task, which combines text reasoning, video understanding, instance segmentation and tracking, existing approaches typically rely on sophisticated pipelines in order to tackle it. In this paper, we propose a simple Transformer-based approach to RVOS. Our framework, termed Multimodal Tracking Transformer (MTTR), models the RVOS task as a sequence prediction problem. Following recent advancements in computer vision and natural language processing, MTTR is based on the realization that video and text can be processed together effectively and elegantly by a single multimodal Transformer model. MTTR is end-to-end trainable, free of text-related inductive bias components and requires no additional mask-refinement post-processing steps. As such, it simplifies the RVOS pipeline considerably compared to existing methods. Evaluation on standard benchmarks reveals that MTTR significantly outperforms previous art across multiple metrics. In particular, MTTR shows impressive +5.7 and +5.0 mAP gains on the A2D-Sentences and JHMDB-Sentences datasets respectively, while processing 76 frames per second. In addition, we report strong results on the public validation set of Refer-YouTube-VOS, a more challenging RVOS dataset that has yet to receive the attention of researchers. The code to reproduce our experiments is available at https://github.com/mttr2021/MTTR


title: Vector Quantized Diffusion Model for Text-to-Image Synthesis

abstract: We present the vector quantized diffusion (VQ-Diffusion) model for text-to-image generation. This method is based on a vector quantized variational autoencoder (VQ-VAE) whose latent space is modeled by a conditional variant of the recently developed Denoising Diffusion Probabilistic Model (DDPM). We find that this latent-space method is well-suited for text-to-image generation tasks because it not only eliminates the unidirectional bias with existing methods but also allows us to incorporate a mask-and-replace diffusion strategy to avoid the accumulation of errors, which is a serious problem with existing methods. Our experiments show that the VQ-Diffusion produces significantly better text-to-image generation results when compared with conventional autoregressive (AR) models with similar numbers of parameters. Compared with previous GAN-based text-to-image methods, our VQ-Diffusion can handle more complex scenes and improve the synthesized image quality by a large margin. Finally, we show that the image generation computation in our method can be made highly efficient by reparameterization. With traditional AR methods, the text-to-image generation time increases linearly with the output image resolution and hence is quite time consuming even for normal size images. The VQ-Diffusion allows us to achieve a better trade-off between quality and speed. Our experiments indicate that the VQ-Diffusion model with the reparameterization is fifteen times faster than traditional AR methods while achieving a better image quality.


title: Quantum entanglement in a four-partite hybrid system containing three macroscopic subsystems

abstract: The combination of different quantum systems may allow the exploration of the distinctive features of each system for the investigation of fundamental phenomena as well as for quantum technologies. In this work we consider a setup consisting of an atomic ensemble enclosed within a laser-driven optomechanical cavity, having the moving mirror further (capacitively) coupled to a low frequency LC circuit. This constitutes a four-partite optoelectromechanical quantum system containing three macroscopic quantum subsystems of a different nature, viz, the atomic ensemble, the massive mirror and the LC circuit. The quantized cavity field plays the role of an auxiliary system that allows the coupling of two other quantum subsystems. We show that for experimentally achievable parameters, it is possible to generate steady state bipartite Gaussian entanglement between pairs of macroscopic systems. In particular, we find under which conditions it is possible to obtain a reasonable amount of entanglement between the atomic ensemble and the LC circuit, systems that might be suitable for constituting a quantum memory and for quantum processing, respectively. For complementarity, we discuss the effect of the environmental temperature on quantum entanglement.


title: Learning to Fit Morphable Models

abstract: Fitting parametric models of human bodies, hands or faces to sparse input signals in an accurate, robust, and fast manner has the promise of significantly improving immersion in AR and VR scenarios. A common first step in systems that tackle these problems is to regress the parameters of the parametric model directly from the input data. This approach is fast, robust, and is a good starting point for an iterative minimization algorithm. The latter searches for the minimum of an energy function, typically composed of a data term and priors that encode our knowledge about the problem's structure. While this is undoubtedly a very successful recipe, priors are often hand defined heuristics and finding the right balance between the different terms to achieve high quality results is a non-trivial task. Furthermore, converting and optimizing these systems to run in a performant way requires custom implementations that demand significant time investments from both engineers and domain experts. In this work, we build upon recent advances in learned optimization and propose an update rule inspired by the classic Levenberg-Marquardt algorithm. We show the effectiveness of the proposed neural optimizer on three problems, 3D body estimation from a head-mounted device, 3D body estimation from sparse 2D keypoints and face surface estimation from dense 2D landmarks. Our method can easily be applied to new model fitting problems and offers a competitive alternative to well-tuned 'traditional' model fitting pipelines, both in terms of accuracy and speed.


title: Latent Transformations via NeuralODEs for GAN-based Image Editing

abstract: Recent advances in high-fidelity semantic image editing heavily rely on the presumably disentangled latent spaces of the state-of-the-art generative models, such as StyleGAN. Specifically, recent works show that it is possible to achieve decent controllability of attributes in face images via linear shifts along with latent directions. Several recent methods address the discovery of such directions, implicitly assuming that the state-of-the-art GANs learn the latent spaces with inherently linearly separable attribute distributions and semantic vector arithmetic properties. In our work, we show that nonlinear latent code manipulations realized as flows of a trainable Neural ODE are beneficial for many practical non-face image domains with more complex non-textured factors of variation. In particular, we investigate a large number of datasets with known attributes and demonstrate that certain attribute manipulations are challenging to obtain with linear shifts only.


title: Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation

abstract: The nonuniform quantization strategy for compressing neural networks usually achieves better performance than its counterpart, i.e., uniform strategy, due to its superior representational capacity. However, many nonuniform quantization methods overlook the complicated projection process in implementing the nonuniformly quantized weights/activations, which incurs non-negligible time and space overhead in hardware deployment. In this study, we propose Nonuniform-to-Uniform Quantization (N2UQ), a method that can maintain the strong representation ability of nonuniform methods while being hardware-friendly and efficient as the uniform quantization for model inference. We achieve this through learning the flexible in-equidistant input thresholds to better fit the underlying distribution while quantizing these real-valued inputs into equidistant output levels. To train the quantized network with learnable input thresholds, we introduce a generalized straight-through estimator (G-STE) for intractable backward derivative calculation w.r.t. threshold parameters. Additionally, we consider entropy preserving regularization to further reduce information loss in weight quantization. Even under this adverse constraint of imposing uniformly quantized weights and activations, our N2UQ outperforms state-of-the-art nonuniform quantization methods by 0.5~1.7 on ImageNet, demonstrating the contribution of N2UQ design. Code and models are available at: https://github.com/liuzechun/Nonuniform-to-Uniform-Quantization.


title: (3+1)D path integral state sums on curved U(1) bundles and U(1) anomalies of (2+1)D topological phases

abstract: Given the algebraic data characterizing any (2+1)D bosonic or fermionic topological order with a global symmetry group $G = \mathrm{U}(1) \rtimes H$, we construct a (3+1)D topologically invariant path integral in the presence of a curved background $G$ gauge field, as an exact combinatorial state sum. Specifically, the $\mathrm{U}(1)$ component of the $G$ gauge field can have a non-trivial second Chern class, extending previous work that was restricted to flat $G$ bundles. Our construction expresses the $\mathrm{U}(1)$ gauge field in terms of a Villain formulation on the triangulation, which includes a 1-form $\mathbb{R}$ gauge field and 2-form $\mathbb{Z}$ gauge field. We develop a new graphical calculus for anyons interacting with "Villain symmetry defects", associated with the 1-form and 2-form background gauge fields. This graphical calculus is used to define the (3+1)D path integral, which can describe either a bosonic or fermionic symmetry-protected topological (SPT) phase. For example, we can construct the topological path integral on curved $\mathrm{U}(1)$ bundles for the (3+1)D fermionic topological insulator in class AII and topological superconductor in class AIII given appropriate (2+1)D fermionic symmetry fractionalization data; these then give invariants of 4-manifolds with Spin$^c$ or Pin$^c$ structures and their generalizations. The (3+1)D path integrals define anomaly indicators for the (2+1)D topological orders; in the case of Abelian (2+1)D topological orders, we derive by explicit computation all of the mixed $\mathrm{U}(1)$ anomaly indicator formulas proposed by Lapa and Levin. We also propose a Spin$^c$ generalization of the Gauss-Milgram sum, valid for super-modular categories.

categories: cond-mat.str-el hep-th math-ph math.MP math.QA


title: Dynamical wormholes in Lovelock gravity

abstract: In this study we present evolving wormhole configurations in third-order {Lovelock} gravity and investigate the possibility that these solutions satisfy the energy conditions. Using a generalized Friedmann-Robertson-Walker spacetime, we derive evolving wormhole geometries by considering a constraint on the Ricci scalar. In standard cosmological models, the Ricci scalar is independent of the radial coordinate $r$ and is only a function of time. We use this property to introduce dynamic wormhole solutions expanding in an inflationary cosmological background and explore the effects of higher-order {Lovelock} terms on the dynamics of such wormholes. Our analysis shows that for suitable third-order {Lovelock} coefficients, there are wormhole solutions that respect the weak energy condition {(WEC)}. In addition to this, we also present other wormhole solutions that satisfy the WEC throughout their respective evolution.


title: Nonparametric Topological Layers in Neural Networks

abstract: Various topological techniques and tools have been applied to neural networks in terms of network complexity, explainability, and performance. One fundamental assumption of this line of research is the existence of a global (Euclidean) coordinate system upon which the topological layer is constructed. Despite promising results, such a \textit{topologization} method has yet to be widely adopted because the parametrization of a topologization layer takes a considerable amount of time and more importantly, lacks a theoretical foundation without which the performance of the neural network only achieves suboptimal performance. This paper proposes a learnable topological layer for neural networks without requiring a Euclidean space; Instead, the proposed construction requires nothing more than a general metric space except for an inner product, i.e., a Hilbert space. Accordingly, the according parametrization for the proposed topological layer is free of user-specified hyperparameters, which precludes the costly parametrization stage and the corresponding possibility of suboptimal networks.


title: Abusive and Threatening Language Detection in Urdu using Boosting based and BERT based models: A Comparative Approach

abstract: Online hatred is a growing concern on many social media platforms. To address this issue, different social media platforms have introduced moderation policies for such content. They also employ moderators who can check the posts violating moderation policies and take appropriate action. Academicians in the abusive language research domain also perform various studies to detect such content better. Although there is extensive research in abusive language detection in English, there is a lacuna in abusive language detection in low resource languages like Hindi, Urdu etc. In this FIRE 2021 shared task - "HASOC- Abusive and Threatening language detection in Urdu" the organizers propose an abusive language detection dataset in Urdu along with threatening language detection. In this paper, we explored several machine learning models such as XGboost, LGBM, m-BERT based models for abusive and threatening content detection in Urdu based on the shared task. We observed the Transformer model specifically trained on abusive language dataset in Arabic helps in getting the best performance. Our model came First for both abusive and threatening content detection with an F1scoreof 0.88 and 0.54, respectively.


title: Multi-domain Integrative Swin Transformer network for Sparse-View Tomographic Reconstruction

abstract: Decreasing projection views to lower X-ray radiation dose usually leads to severe streak artifacts. To improve image quality from sparse-view data, a Multi-domain Integrative Swin Transformer network (MIST-net) was developed in this article. First, MIST-net incorporated lavish domain features from data, residual-data, image, and residual-image using flexible network architectures, where residual-data and residual-image sub-network was considered as data consistency module to eliminate interpolation and reconstruction errors. Second, a trainable edge enhancement filter was incorporated to detect and protect image edges. Third, a high-quality reconstruction Swin transformer (i.e., Recformer) was designed to capture image global features. The experiment results on numerical and real cardiac clinical datasets with 48-views demonstrated that our proposed MIST-net provided better image quality with more small features and sharp edges than other competitors.


title: Observations of rapidly growing whistler waves in front of space plasma shock

abstract: Whistler mode wave is a fundamental perturbation of electromagnetic fields and plasmas in various environments including planetary space, laboratory and astrophysics. The origin and evolution of the waves are a long-standing question due to the limited instrumental capability in resolving highly variable plasma and electromagnetic fields. Here, we analyse data with the high time resolution from the multi-scale magnetospheric spacecraft in the weak magnetic environment (i.e., foreshock) enabling a relatively long gyro-period of whistler mode wave. Moreover, we develop a novel approach to separate the three-dimensional fluctuating electron velocity distributions from their background, and have successfully captured the coherent resonance between electrons and electromagnetic fields at high frequency, providing the resultant growth rate of unstable whistler waves. Regarding the energy origin for the waves, the ion distributions are found to also play crucial roles in determining the eigenmode disturbances of fields and electrons. The quantification of wave growth rate can significantly advance the understandings of the wave evolution and the energy conversion with particles.


title: Adversarial Attacks in Cooperative AI

abstract: Single-agent reinforcement learning algorithms in a multi-agent environment are inadequate for fostering cooperation. If intelligent agents are to interact and work together to solve complex problems, methods that counter non-cooperative behavior are needed to facilitate the training of multiple agents. This is the goal of cooperative AI. Recent research in adversarial machine learning, however, shows that models (e.g., image classifiers) can be easily deceived into making inferior decisions. Meanwhile, an important line of research in cooperative AI has focused on introducing algorithmic improvements that accelerate learning of optimally cooperative behavior. We argue that prominent methods of cooperative AI are exposed to weaknesses analogous to those studied in prior machine learning research. More specifically, we show that three algorithms inspired by human-like social intelligence are, in principle, vulnerable to attacks that exploit weaknesses introduced by cooperative AI's algorithmic improvements and report experimental findings that illustrate how these vulnerabilities can be exploited in practice.


title: Self-supervised Autoregressive Domain Adaptation for Time Series Data

abstract: Unsupervised domain adaptation (UDA) has successfully addressed the domain shift problem for visual applications. Yet, these approaches may have limited performance for time series data due to the following reasons. First, they mainly rely on large-scale dataset (i.e., ImageNet) for the source pretraining, which is not applicable for time-series data. Second, they ignore the temporal dimension on the feature space of the source and target domains during the domain alignment step. Last, most of prior UDA methods can only align the global features without considering the fine-grained class distribution of the target domain. To address these limitations, we propose a Self-supervised Autoregressive Domain Adaptation (SLARDA) framework. In particular, we first design a self-supervised learning module that utilizes forecasting as an auxiliary task to improve the transferability of the source features. Second, we propose a novel autoregressive domain adaptation technique that incorporates temporal dependency of both source and target features during domain alignment. Finally, we develop an ensemble teacher model to align the class-wise distribution in the target domain via a confident pseudo labeling approach. Extensive experiments have been conducted on three real-world time series applications with 30 cross-domain scenarios. Results demonstrate that our proposed SLARDA method significantly outperforms the state-of-the-art approaches for time series domain adaptation.


title: Smooth solutions to the Schr\"odinger flow for maps from smooth bounded domains in Euclidean spaces into $\mathbb{S}^2$

abstract: The results of this paper are twofold. One is that we show the local existence and uniqueness of very regular or smooth solution to the initial-Neumann boundary value problem of the Schr\"{o}dinger flow for maps from a smooth bounded domain $\Omega\subset \mathbb{R}^m$ with $m=1,2,3$ into $\mathbb{S}^2$ in the scale of Sobolev spaces. In this part, we provide a precise description of the compatibility conditions at the boundary for the initial data. The other is that we further prove that the locally smooth solution to the initial-Neumann boundary value problem of the 1-dimensional Schr\"{o}dinger flow can be extended to a global smooth one.


title: Low-bit Quantization of Recurrent Neural Network Language Models Using Alternating Direction Methods of Multipliers

abstract: The high memory consumption and computational costs of Recurrent neural network language models (RNNLMs) limit their wider application on resource constrained devices. In recent years, neural network quantization techniques that are capable of producing extremely low-bit compression, for example, binarized RNNLMs, are gaining increasing research interests. Directly training of quantized neural networks is difficult. By formulating quantized RNNLMs training as an optimization problem, this paper presents a novel method to train quantized RNNLMs from scratch using alternating direction methods of multipliers (ADMM). This method can also flexibly adjust the trade-off between the compression rate and model performance using tied low-bit quantization tables. Experiments on two tasks: Penn Treebank (PTB), and Switchboard (SWBD) suggest the proposed ADMM quantization achieved a model size compression factor of up to 31 times over the full precision baseline RNNLMs. Faster convergence of 5 times in model training over the baseline binarized RNNLM quantization was also obtained. Index Terms: Language models, Recurrent neural networks, Quantization, Alternating direction methods of multipliers.


title: p2pGNN: A Decentralized Graph Neural Network for Node Classification in Peer-to-Peer Networks

abstract: In this work, we aim to classify nodes of unstructured peer-to-peer networks with communication uncertainty, such as users of decentralized social networks. Graph Neural Networks (GNNs) are known to improve the accuracy of simple classifiers in centralized settings by leveraging naturally occurring network links, but graph convolutional layers are challenging to implement in decentralized settings when node neighbors are not constantly available. We address this problem by employing decoupled GNNs, where base classifier predictions and errors are diffused through graphs after training. For these, we deploy pre-trained and gossip-trained base classifiers and implement peer-to-peer graph diffusion under communication uncertainty. In particular, we develop an asynchronous decentralized formulation of diffusion that converges to centralized predictions in distribution and linearly with respect to communication rates. We experiment on three real-world graphs with node features and labels and simulate peer-to-peer networks with uniformly random communication frequencies; given a portion of known labels, our decentralized graph diffusion achieves comparable accuracy to centralized GNNs with minimal communication overhead (less than 3% of what gossip training already adds).


title: Evaluating Privacy-Preserving Machine Learning in Critical Infrastructures: A Case Study on Time-Series Classification

abstract: With the advent of machine learning in applications of critical infrastructure such as healthcare and energy, privacy is a growing concern in the minds of stakeholders. It is pivotal to ensure that neither the model nor the data can be used to extract sensitive information used by attackers against individuals or to harm whole societies through the exploitation of critical infrastructure. The applicability of machine learning in these domains is mostly limited due to a lack of trust regarding the transparency and the privacy constraints. Various safety-critical use cases (mostly relying on time-series data) are currently underrepresented in privacy-related considerations. By evaluating several privacy-preserving methods regarding their applicability on time-series data, we validated the inefficacy of encryption for deep learning, the strong dataset dependence of differential privacy, and the broad applicability of federated methods.


title: New PCA-based Category Encoder for Cybersecurity and Processing Data in IoT Devices

abstract: Increasing the cardinality of categorical variables might decrease the overall performance of machine learning (ML) algorithms. This paper presents a novel computational preprocessing method to convert categorical to numerical variables ML algorithms. It uses a supervised binary classifier to extract additional context-related features from the categorical values. Up to two numerical variables per categorical variable are created, depending on the compression achieved by the Principal Component Analysis (PCA). The method requires two hyperparameters: a threshold related to the distribution of categories in the variables and the PCA representativeness. This paper applies the proposed approach to the well-known cybersecurity NSLKDD dataset to select and convert three categorical features to numerical features. After choosing the threshold parameter, we use conditional probabilities to convert the three categorical variables into six new numerical variables. After that, we feed these numerical variables to the PCA algorithm and select the whole or partial numbers of the Principal Components (PCs). Finally, by applying binary classification with ten different classifiers, we measure the performance of the new encoder and compare it with the other 17 well-known category encoders. The new technique achieves the highest performance related to accuracy and Area Under the Curve (AUC) on high cardinality categorical variables. Also, we define the harmonic average metrics to find the best trade-off between train and test performances and prevent underfitting and overfitting. Ultimately, the number of newly created numerical variables is minimal. This data reduction improves computational processing time in Internet of things (IoT) devices in future telecommunication networks.


title: A Generalized Determinant of Matrices and Applications

abstract: A generalized definition of the determinant of matrices is given, which is compatible with the usual determinant for square matrices and keeps many important properties, such as being an alternating multilinear function, keeping multiplication formula and partly keeping the Cauchy-Binet's formula. As applications of the new theory, the generalized Cramer's rule and the generalized oriented volume are obtained.


title: Beyond-mean-field calculations of allowed and first-forbidden $\beta^-$ decays of $r$-process waiting-point nuclei

abstract: $\beta$-decay rates of neutron-rich nuclei, in particular those located at neutron shell closures, play a central role in simulations of the heavy-element nucleosynthesis and resulting abundance distributions. We present $\beta$-decay half-lives of even-even $N=82$ and $N=126$ $r$-process waiting-point nuclei calculated in the approach based on relativistic quasiparticle random phase approximation with quasiparticle-vibration coupling. The calculations include both allowed and first-forbidden transitions. In the $N=82$ chain, the quasiparticle-vibration coupling has an important impact close to stability, as it increases the contribution of Gamow-Teller modes and improves the agreement with the available data. In the $N=126$ chain, we find the decay to proceed dominantly via first-forbidden transitions, even when the coupling to vibrations is included.


title: Do We Still Need Automatic Speech Recognition for Spoken Language Understanding?

abstract: Spoken language understanding (SLU) tasks are usually solved by first transcribing an utterance with automatic speech recognition (ASR) and then feeding the output to a text-based model. Recent advances in self-supervised representation learning for speech data have focused on improving the ASR component. We investigate whether representation learning for speech has matured enough to replace ASR in SLU. We compare learned speech features from wav2vec 2.0, state-of-the-art ASR transcripts, and the ground truth text as input for a novel speech-based named entity recognition task, a cardiac arrest detection task on real-world emergency calls and two existing SLU benchmarks. We show that learned speech features are superior to ASR transcripts on three classification tasks. For machine translation, ASR transcripts are still the better choice. We highlight the intrinsic robustness of wav2vec 2.0 representations to out-of-vocabulary words as key to better performance.


title: Catch Me If You Hear Me: Audio-Visual Navigation in Complex Unmapped Environments with Moving Sounds

abstract: Audio-visual navigation combines sight and hearing to navigate to a sound-emitting source in an unmapped environment. While recent approaches have demonstrated the benefits of audio input to detect and find the goal, they focus on clean and static sound sources and struggle to generalize to unheard sounds. In this work, we propose the novel dynamic audio-visual navigation benchmark which requires catching a moving sound source in an environment with noisy and distracting sounds, posing a range of new challenges. We introduce a reinforcement learning approach that learns a robust navigation policy for these complex settings. To achieve this, we propose an architecture that fuses audio-visual information in the spatial feature space to learn correlations of geometric information inherent in both local maps and audio signals. We demonstrate that our approach consistently outperforms the current state-of-the-art by a large margin across all tasks of moving sounds, unheard sounds, and noisy environments, on two challenging 3D scanned real-world environments, namely Matterport3D and Replica. The benchmark is available at http://dav-nav.cs.uni-freiburg.de.


title: Evaluation of Machine Learning Techniques for Forecast Uncertainty Quantification

abstract: Ensemble forecasting is, so far, the most successful approach to produce relevant forecasts with an estimation of their uncertainty. The main limitations of ensemble forecasting are the high computational cost and the difficulty to capture and quantify different sources of uncertainty, particularly those associated with model errors. In this work we perform toy-model and state-of-the-art model experiments to analyze to what extent artificial neural networks (ANNs) are able to model the different sources of uncertainty present in a forecast. In particular those associated with the accuracy of the initial conditions and those introduced by the model error. We also compare different training strategies: one based on a direct training using the mean and spread of an ensemble forecast as target, the other ones rely on an indirect training strategy using an analyzed state as target in which the uncertainty is implicitly learned from the data. Experiments using the Lorenz'96 model show that the ANNs are able to emulate some of the properties of ensemble forecasts like the filtering of the most unpredictable modes and a state-dependent quantification of the forecast uncertainty. Moreover, ANNs provide a reliable estimation of the forecast uncertainty in the presence of model error. Preliminary experiments conducted with a state-of-the-art forecasting system also confirm the ability of ANNs to produce a reliable quantification of the forecast uncertainty.


title: Wormhole inducing inflation with Einstein Gauss Bonnet dilaton interaction

abstract: We present a few Euclidean wormhole configurations using both the analytic and numerical solutions of the field equations considering Einstein Gauss-Bonnet dilaton interaction in 4-dimensional Robertson Walker Euclidean background. In one analytic solution we present transition from a wormhole to an exponential expansion with Lorentzian time $t$ using $\tau=it$ after passing through an era of oscillating Euclidean wormhole. The numerical solutions of the scale factor $a(\tau)$ show multiple local maxima and minima about a global minimum for inverse power law potentials, while for exponential potential the wormholes have a single minimum. The Hubble parameter and deceleration parameter obtained by curve fit of $a(\tau)$ of the numerical solution show an inflation away from the throat of the wormhole invoking analytic continuation by $\tau=it$. A sharp decay of the potential is also observed.


title: On Certified Randomness from Fourier Sampling or Random Circuit Sampling

abstract: Certified randomness has a long history in quantum information, with many potential applications. Recently Aaronson (2018, 2020) proposed a novel public certified randomness protocol based on existing random circuit sampling (RCS) experiments. The security of his protocol, however, relies on non-standard complexity-theoretic conjectures which were not previously studied in the literature. Inspired by Aaronson's work, we study certified randomness in the quantum random oracle model (QROM). We show that quantum Fourier Sampling can be used to define a publicly verifiable certified randomness protocol, with unconditional black-box security. In addition to giving a certified randomness protocol in the QROM, our work can also be seen as supporting Aaronson's conjectures for RCS-based randomness generation, as our protocol is in some sense the "black-box version" of Aaronson's protocol. In further support of Aaronson's proposal, we prove a Fourier Sampling version of Aaronson's conjecture by extending Raz and Tal's separation of BQP vs PH. Our work complements the subsequent certified randomness protocol of Yamakawa and Zhandry (2022) in the QROM. Whereas the security of that protocol relied on the Aaronson-Ambainis conjecture, our protocol is unconditionally secure - at the expense of requiring exponential-time classical verification. Our protocol also has a simple heuristic implementation.


title: Coherent spin-valley oscillations in silicon

abstract: Electron spins in silicon quantum dots are excellent qubits because they have long coherence times, high gate fidelities, and are compatible with advanced semiconductor manufacturing techniques. The valley degree of freedom, which results from the specific character of the Si band structure, is a unique feature of electrons in Si spin qubits. However, the small difference in energy between different valley levels often poses a challenge for quantum computing in Si. Here, we show that the spin-valley coupling in Si, which enables transitions between states with different spin and valley quantum numbers, enables coherent control of electron spins in Si. We demonstrate coherent manipulation of effective single- and two-electron spin states in a Si/SiGe double quantum dot without ac magnetic or electric fields. Our results illustrate that the valley degree of freedom, which is often regarded as an inconvenience, can itself enable quantum manipulation of electron spin states.


title: Diagnosing DASH: A Catalog of Structural Properties for the COSMOS-DASH Survey

abstract: We present the $H_{160}$ morphological catalogs for the COSMOS-DASH survey, the largest area near-IR survey using HST-WFC3 to date. Utilizing the "Drift And SHift" observing technique for HST-WFC3 imaging, the COSMOS-DASH survey imaged approximately 0.5 deg$^2$ of the UltraVISTA deep stripes (0.7 deg$^2$ when combined with archival data). Global structural parameters are measured for 51,586 galaxies within COSMOS-DASH using GALFIT (excluding the CANDELS area) with detection using a deep multi-band HST image. We recover consistent results with those from the deeper 3D-HST morphological catalogs, finding that, in general, sizes and S\'ersic indices of typical galaxies are accurate to limiting magnitudes of $H_{160}<23$ and $H_{160}<22$ ABmag, respectively. In size-mass parameter space, galaxies in COSMOS-DASH demonstrate robust morphological measurements out to $z\sim2$ and down to $\log(M_\star/M_\odot)\sim9$. With the advantage of the larger area of COSMOS-DASH, we measure a flattening of the quiescent size-mass relation below $\log(M_\star/M_\odot)\sim10.5$ that persists out to $z\sim2$. We show that environment is not the primary driver of this flattening, at least out to $z=1.2$, whereas internal physical processes may instead govern the structural evolution.


title: The Lick AGN Monitoring Project 2016: Velocity-Resolved H{\beta} Lags in Luminous Seyfert Galaxies

abstract: We carried out spectroscopic monitoring of 21 low-redshift Seyfert 1 galaxies using the Kast double spectrograph on the 3-m Shane telescope at Lick Observatory from April 2016 to May 2017. Targeting active galactic nuclei (AGN) with luminosities of {\lambda}L{\lambda} (5100 {\AA}) = 10^44 erg/s and predicted H{\beta} lags of 20-30 days or black hole masses of 10^7-10^8.5 Msun, our campaign probes luminosity-dependent trends in broad-line region (BLR) structure and dynamics as well as to improve calibrations for single-epoch estimates of quasar black hole masses. Here we present the first results from the campaign, including H{\beta} emission-line light curves, integrated H{\beta} lag times (8-30 days) measured against V-band continuum light curves, velocity-resolved reverberation lags, line widths of the broad H{\beta} components, and virial black hole mass estimates (10^7.1-10^8.1 Msun). Our results add significantly to the number of existing velocity-resolved lag measurements and reveal a diversity of BLR gas kinematics at moderately high AGN luminosities. AGN continuum luminosity appears not to be correlated with the type of kinematics that its BLR gas may exhibit. Follow-up direct modeling of this dataset will elucidate the detailed kinematics and provide robust dynamical black hole masses for several objects in this sample.


title: A Physical Model of Delayed Rebrightenings in Shock-interacting Supernovae without Narrow Line Emission

abstract: Core-collapse supernovae can display evidence of interaction with pre-existing, circumstellar shells of material by rebrightening and forming spectral lines, and can even change types as Hydrogen appears in previously Hydrogen-poor spectra. However, a recently observed core-collapse supernova -- SN 2019tsf -- was found to brighten after roughly 100 days after it was first observed, suggesting that the supernova ejecta was interacting with surrounding material, but it lacked any observable emission lines and thereby challenged the standard supernova-interaction picture. We show through linear perturbation theory that delayed rebrightenings without the formation of spectral lines are generated as a consequence of the finite sound crossing time of the post-shock gas left in the wake of a supernova explosion. In particular, we demonstrate that sound waves -- generated in the post-shock flow as a consequence of the interaction between a shock and a density enhancement -- traverse the shocked ejecta and impinge upon the shock from behind in a finite time, generating sudden changes in the shock properties in the absence of ambient density enhancements. We also show that a blastwave dominated by gas pressure and propagating in a wind-fed medium is unstable from the standpoint that small perturbations lead to the formation of reverse shocks within the post-shock flow, implying that the gas within the inner regions of these blastwaves should be highly turbulent.


title: NGC5846-UDG1: A galaxy formed mostly by star formation in massive, extremely dense clumps of gas

abstract: It has been shown that ultra-diffuse galaxies (UDGs) have higher specific frequencies of globular clusters on average than other dwarf galaxies with similar luminosities. The UDG NGC5846-UDG1 is among the most extreme examples of globular cluster-rich galaxies found so far. Here we present new Hubble Space Telescope (HST) observations and analysis of this galaxy and its globular cluster system. We find that NGC5846-UDG1 hosts $54 \pm 9$ globular clusters, three to four times more than any previously known galaxy with a similar luminosity, and higher than reported in previous studies. With a galaxy luminosity of $L_{V,\mathrm{gal}} \approx 6 \times 10^7\,{\rm L}_{\odot}$ ($M_\star \approx 1.2 \times 10^8\,{\rm M}_\odot$) and a total globular cluster luminosity of $L_{V,\mathrm{GCs}} \approx 7.6 \times 10^6\,{\rm L}_{\odot}$, we find that the clusters currently comprise $\sim 13 \%$ of the total light. Taking into account the effects of mass loss from clusters during their formation and throughout their lifetime, we infer that most of the stars in the galaxy likely formed in globular clusters, and very little to no "normal" low-density star formation occurred. This result implies that the most extreme conditions during early galaxy formation promoted star formation in massive and dense clumps, in contrast to the dispersed star formation observed in galaxies today.


title: Thermodynamics of an Exactly Solvable Model for Superconductivity in a Doped Mott Insulator

abstract: Computing superconducting properties starting from an exactly solvable model for a doped Mott insulator stands as a grand challenge. We have recently shown that this can be done starting from the Hatsugai-Kohmoto (HK) model which can be understood generally as the minimal model that breaks the non-local $\mathbb Z_2$ symmetry of a Fermi liquid, thereby constituting a new quartic fixed point for Mott physics [Phillips et al., Nature Physics 16, 1175 (2020); Huang et al., Nature Physics (2022)]. In the current work, we compute the thermodynamics, condensation energy, and electronic properties such as the NMR relaxation rate $1/T_1$ and ultrasonic attenuation rate. Key differences arise with the standard BCS analysis from a Fermi liquid: 1) the free energy exhibits a local minimum at $T_p$ where the pairing gap turns on discontinuously above a critical value of the repulsive HK interaction, thereby indicating a first-order transition, 2) a tri-critical point emerges, thereby demarcating the boundary between the standard second-order superconducting transition and the novel first-order regime, 3) Mottness changes the sign of the quartic coefficient in the Landau-Ginzburg free-energy fuctional relative to that in BCS, 4) as this obtains in the strongly interacting regime, it is Mott physics that underlies the generic first-order transition, 5) the condensation energy exceeds that in BCS theory suggesting that multiple Mott bands might be a way of enhancing superconducting, 6) the heat-capacity jump is non-universal and increases with the Mott scale, 7) Mottness destroys the Hebel-Slichter peak in NMR, and 8) Mottness enhances the fall-off of the ultrasonic attenuation at the pairing temperature $T_p$. As several of these properties are observed in the cuprates, our analysis here points a way forward in computing superconducting properties of strongly correlated electron matter.


title: Predictions for gravity-mode periods and surface abundances in intermediate-mass dwarfs from shear mixing and radiative levitation

abstract: The treatment of chemical mixing in the radiative envelopes of intermediate-mass stars has hardly been calibrated so far. Recent asteroseismic studies demonstrated that a constant diffusion coefficient in the radiative envelope is not able to explain the periods of trapped gravity modes in the oscillation spectra of $\gamma$ Doradus pulsators. We present a new generation of MESA stellar models with two major improvements. First, we present a new implementation for computing radiative accelerations and Rosseland mean opacities that requires significantly less CPU time. Second, the inclusion of shear mixing based on rotation profiles computed with the 2D stellar structure code ESTER is considered. We show predictions for the mode periods of these models covering stellar masses from 1.4 to 3.0${\rm M_\odot}$ across the main sequence (MS), computed for different metallicities. The morphology of the chemical mixing profile resulting from shear mixing in combination with atomic diffusion and radiative levitation does allow for mode trapping, while the diffusion coefficient in the outer envelope is large ($>10^{6}\,{\rm cm^2\,s^{-1}}$). Furthermore, we make predictions for the evolution of surface abundances for which radiative accelerations can be computed. We find that the N/C and C/O abundance ratios correlate with stellar age. We predict that these correlations are observable with precisions $\lesssim 0.1$ dex on these ratios, given that a precise age estimate can be made.


title: First direct dynamical detection of a dual supermassive black hole system at sub-kiloparsec separation

abstract: We investigated whether the two recently discovered nuclei in NGC7727 both host a super-massive black hole (SMBH). We used the high spatial resolution mode of the integral-field spectrograph MUSE on the VLT in adaptive optics mode to resolve the stellar kinematics within the sphere of influence of both putative black holes. We combined the kinematic data with an HST-based mass model and used Jeans models to measure their SMBH mass. We report the discovery of a dual SMBH system in NGC7727. We detect a SMBH in the photometric center of the galaxy in Nucleus 1, with a mass of $M_{\rm SMBH}=1.54^{+0.18}_{-0.15} \times10^{8}M_{\odot}$. In the second nucleus, which is 500pc offset from the main nucleus, we also find a clear signal for a SMBH with a mass of $M_{\rm BH}=6.33^{+3.32}_{-1.40}\times10^{6}M_{\odot}$. Both SMBHs are detected at high significance. The off-axis nature of Nucleus 2 makes modeling the system challenging; but a number of robustness tests suggest that a black hole is required to explain the kinematics. The SMBH in the offset Nucleus 2 makes up 3.0% of its total mass, which means its SMBH is over-massive compared to the $M_{\rm BH}-M_{\rm Bulge}$ scaling relation. This confirms it as the surviving nuclear star cluster of a galaxy that has merged with NGC7727. This discovery is the first dynamically confirmed dual SMBH system with a projected separation of less than a kiloparsec and the nearest dynamically confirmed dual SMBH at a distance of 27.4Mpc. The second Nucleus is in an advanced state of inspiral, and it will eventually result in a 1:24 mass ratio SMBH merger. Optical emission lines suggest Nucleus 2 is a Seyfert galaxy, making it a low-luminosity Active Galactic Nuclei (AGN). There are likely many more quiescent SMBHs as well as dual SMBH pairs in the local Universe that have been missed by surveys that focus on bright accretion signatures.