title: On the Dynamics of Free-Fermionic Tau-Functions at Finite Temperature

abstract: In this work we explore an instance of the $\tau$-function of vertex type operators, specified in terms of a constant phase shift in a free-fermionic basis. From the physical point of view this $\tau$-function has multiple interpretations: as a correlator of Jordan-Wigner strings, a Loschmidt Echo in the Aharonov-Bohm effect, or the generating function of the local densities in the Tonks-Girardeau gas. We present the $\tau$-function as a form-factors series and tackle it from four vantage points: (i) we perform an exact summation and express it in terms of a Fredholm determinant in the thermodynamic limit, (ii) we use bosonization techniques to perform partial summations of soft modes around the Fermi surface to acquire the scaling at zero temperature, (iii) we derive large space and time asymptotic behavior for the thermal Fredholm determinant by relating it to effective form-factors with an asymptotically similar kernel, and (iv) we identify and sum the important basis elements directly through a tailor-made numerical algorithm for finite-entropy states in a free-fermionic Hilbert space. All methods confirm each other. We find that, in addition to the exponential decay in the finite-temperature case the dynamic correlation functions exhibit an extra power law in time, universal over any distribution and time scale.

categories: cond-mat.stat-mech cond-mat.quant-gas cond-mat.str-el math-ph math.MP


title: The condensation of a trapped dilute Bose gas with three-body interactions

abstract: We consider a trapped dilute gas of $N$ bosons in $\mathbb{R}^3$ interacting via a three-body interaction potential of the form $N\, V(N^{1/2}(x-y,x-z))$. In the limit $N\to \infty$, we prove that every approximate ground state of the system is a convex superposition of minimizers of a 3D energy-critical nonlinear Schr\"odinger functional where the nonlinear coupling constant is proportional to the scattering energy of the interaction potential. In particular, the $N$-body ground state exhibits complete Bose--Einstein condensation if the nonlinear Schr\"odinger minimizer is unique up to a complex phase.


title: The Pebble-Relation Comonad in Finite Model Theory

abstract: The pebbling comonad, introduced by Abramsky, Dawar and Wang, provides a categorical interpretation for the k-pebble games from finite model theory. The coKleisli category of the pebbling comonad specifies equivalences under different fragments and extensions of infinitary k-variable logic. Moreover, the coalgebras over this pebbling comonad characterise treewidth and correspond to tree decompositions. In this paper we introduce the pebble-relation comonad, which characterises pathwidth and whose coalgebras correspond to path decompositions. We further show that the existence of a coKleisli morphism in this comonad is equivalent to truth preservation in the restricted conjunction fragment of k-variable infinitary logic. We do this using Dalmau's pebble-relation game and an equivalent all-in-one pebble game. We then provide a similar treatment to the corresponding coKleisli isomorphisms via a bijective version of the all-in-one pebble game. Finally, we show as a consequence a new Lov\'asz-type theorem relating pathwidth to the restricted conjunction fragment of k-variable infinitary logic with counting quantifiers.


title: Borel-Moore homology of determinantal varieties

abstract: We compute the rational Borel-Moore homology groups for affine determinantal varieties in the spaces of general, symmetric, and skew-symmetric matrices, solving a problem suggested by the work of Pragacz and Ratajski. The main ingredient is the relation with Hartshorne's algebraic de Rham homology theory, and the calculation of the singular cohomology of matrix orbits, using the methods of Cartan and Borel. We also establish the degeneration of the \v{C}ech-de Rham spectral sequence for determinantal varieties, and compute explicitly the dimensions of de Rham cohomology groups of local cohomology with determinantal support, which are analogues of Lyubeznik numbers first introduced by Switala. Additionally, in the case of general matrices we further determine the Hodge numbers of the singular cohomology of matrix orbits and of the Borel-Moore homology of their closures, based on Saito's theory of mixed Hodge modules.


title: Pinwheel valence-bond-crystal ground state of the spin-$\frac{1}{2}$ Heisenberg antiferromagnet on the $shuriken$ lattice

abstract: We investigate the nature of the ground-state of the spin-$\frac{1}{2}$ Heisenberg antiferromagnet on the $shuriken$ lattice by complementary state-of-the-art numerical techniques, such as variational Monte Carlo (VMC) with versatile Gutzwiller-projected Jastrow wave functions, unconstrained multi-variable variational Monte Carlo (mVMC), and pseudo-fermion/Majorana functional renormalization group (PF/PM-FRG) methods. We establish the presence of a quantum paramagnetic ground state and investigate its nature, by classifying symmetric and chiral quantum spin liquids, and inspecting their instabilities towards competing valence-bond-crystal (VBC) orders. Our VMC analysis reveals that a VBC with a pinwheel structure emerges as the lowest-energy variational ground state, and it is obtained as an instability of the U(1) Dirac spin liquid. Analogous conclusions are drawn from mVMC calculations employing accurate BCS pairing states supplemented by symmetry projectors, which confirm the presence of pinwheel VBC order by a thorough analysis of dimer-dimer correlation functions. Our work highlights the nontrivial role of quantum fluctuations via the Gutzwiller projector in resolving the subtle interplay between competing orders.


title: On characterization of smoothness of complex analytic sets

abstract: The paper is devoted to metric properties of singularities. We investigate the relations among topology, metric properties and smoothness. In particular, we present some higher dimensional analogous of Mumford's theorem on smoothness of normal surfaces. For example, we prove that a complex analytic set, with an isolated singularity at $0$, is smooth at $0$ if and only if it is locally metrically conical at $0$ and its link at $0$ is a homotopy sphere.


title: Lognormals, Power Laws and Double Power Laws in the Distribution of Frequencies of Harmonic Codewords from Classical Music

abstract: Zipf's law is a paradigm describing the importance of different elements in communication systems, especially in linguistics. Despite the complexity of the hierarchical structure of language, music has in some sense an even more complex structure, due to its multidimensional character (melody, harmony, rhythm, timbre...). Thus, the relevance of Zipf's law in music is still an open question. Using discrete codewords representing harmonic content obtained from a large-scale analysis of classical composers, we show that a nearly universal Zipf-like law holds at a qualitative level. However, in an in-depth quantitative analysis, where we introduce the double power-law distribution as a new player in the classical debate between the superiority of Zipf's (power) law and that of the lognormal distribution, we conclude not only that universality does not hold, but that there is not a unique probability distribution that best describes the usage of the different codewords by each composer.


title: Face numbers of high-dimensional Poisson zero cells

abstract: Let $\mathcal Z_d$ be the zero cell of a $d$-dimensional, isotropic and stationary Poisson hyperplane tessellation. We study the asymptotic behavior of the expected number of $k$-dimensional faces of $\mathcal Z_d$, as $d\to\infty$. For example, we show that the expected number of hyperfaces of $\mathcal Z_d$ is asymptotically equivalent to $\sqrt{2\pi/3}\, d^{3/2}$, as $d\to\infty$. We also prove that the expected solid angle of a random cone spanned by $d$ random vectors that are independent and uniformly distributed on the unit upper half-sphere in $\mathbb R^{d}$ is asymptotic to $\sqrt 3 \pi^{-d}$, as $d\to\infty$.


title: Evaluation of Hyperparameter-Optimization Approaches in an Industrial Federated Learning System

abstract: Federated Learning (FL) decouples model training from the need for direct access to the data and allows organizations to collaborate with industry partners to reach a satisfying level of performance without sharing vulnerable business information. The performance of a machine learning algorithm is highly sensitive to the choice of its hyperparameters. In an FL setting, hyperparameter optimization poses new challenges. In this work, we investigated the impact of different hyperparameter optimization approaches in an FL system. In an effort to reduce communication costs, a critical bottleneck in FL, we investigated a local hyperparameter optimization approach that -- in contrast to a global hyperparameter optimization approach -- allows every client to have its own hyperparameter configuration. We implemented these approaches based on grid search and Bayesian optimization and evaluated the algorithms on the MNIST data set using an i.i.d. partition and on an Internet of Things (IoT) sensor based industrial data set using a non-i.i.d. partition.


title: Shared Visual Representations of Drawing for Communication: How do different biases affect human interpretability and intent?

abstract: We present an investigation into how representational losses can affect the drawings produced by artificial agents playing a communication game. Building upon recent advances, we show that a combination of powerful pretrained encoder networks, with appropriate inductive biases, can lead to agents that draw recognisable sketches, whilst still communicating well. Further, we start to develop an approach to help automatically analyse the semantic content being conveyed by a sketch and demonstrate that current approaches to inducing perceptual biases lead to a notion of objectness being a key feature despite the agent training being self-supervised.


title: Fabrication of Fiber-Reinforced Polymer Ceramic Composites by Wet Electrospinning

abstract: We propose a novel approach of wet electrospinning to yield fiber-reinforced polymer ceramic composites, where a reactive ceramic precursor gel is used as a collector. We illustrate our approach by generating polyethylene oxide (PEO) fibers in a potassium silicate gel; the gel is later activated using metakaolin to yield a ceramic-0.5 wt% PEO fiber composite. An increase of 29% and 22% is recorded for the fabricated polymer ceramic composites in terms of indentation modulus and indentation hardness respectively. Our initial findings demonstrate the process viability and might lead to a potentially scalable manufacturing approach for fiber-reinforced polymer ceramic composites.


title: Fast Online Changepoint Detection via Functional Pruning CUSUM statistics

abstract: Many modern applications of online changepoint detection require the ability to process high-frequency observations, sometimes with limited available computational resources. Online algorithms for detecting a change in mean often involve using a moving window, or specifying the expected size of change. Such choices affect which changes the algorithms have most power to detect. We introduce an algorithm, Functional Online CuSUM (FOCuS), which is equivalent to running these earlier methods simultaneously for all sizes of window, or all possible values for the size of change. Our theoretical results give tight bounds on the expected computational cost per iteration of FOCuS, with this being logarithmic in the number of observations. We show how FOCuS can be applied to a number of different change in mean scenarios, and demonstrate its practical utility through its state-of-the art performance at detecting anomalous behaviour in computer server data.


title: Preservers of totally positive kernels and Polya frequency functions

abstract: Fractional powers and polynomial maps preserving structured totally positive matrices, one-sided Polya frequency functions, or totally positive kernels are treated from a unifying perspective. Besides the stark rigidity of the polynomial transforms, we unveil an ubiquitous separation between discrete and continuous spectra of such inner fractional powers. Classical works of Schoenberg, Karlin, Hirschman, and Widder are completed by our classification. Concepts of probability theory, multivariate statistics, and group representation theory naturally enter into the picture.


title: Multitask Prompted Training Enables Zero-Shot Task Generalization

abstract: Large language models have recently been shown to attain reasonable zero-shot generalization on a diverse set of tasks (Brown et al., 2020). It has been hypothesized that this is a consequence of implicit multitask learning in language models' pretraining (Radford et al., 2019). Can zero-shot generalization instead be directly induced by explicit multitask learning? To test this question at scale, we develop a system for easily mapping any natural language tasks into a human-readable prompted form. We convert a large set of supervised datasets, each with multiple prompts with diverse wording. These prompted datasets allow for benchmarking the ability of a model to perform completely held-out tasks. We fine-tune a pretrained encoder-decoder model (Raffel et al., 2020; Lester et al., 2021) on this multitask mixture covering a wide variety of tasks. The model attains strong zero-shot performance on several standard datasets, often outperforming models up to 16x its size. Further, our approach attains strong performance on a subset of tasks from the BIG-bench benchmark, outperforming models up to 6x its size. All trained models are available at https://github.com/bigscience-workshop/t-zero and all prompts are available at https://github.com/bigscience-workshop/promptsource.


title: The Convergence of Discrete Uniformizations for Genus Zero Surfaces

abstract: The notion of discrete conformality proposed by Luo and Bobenko-Pinkall-Springborn on triangle meshes has rich mathematical theories and wide applications. Gu et al. proved that the discrete uniformizations approximate the continuous uniformization for closed surfaces of genus $\geq 1$, given that the approximating triangle meshes are reasonably good. In this paper, we generalize this result to the remaining case of genus-zero surfaces, by reducing it to planar cases via stereographic projections.


title: cellanneal: A User-Friendly Deconvolution Software for Omics Data

abstract: We introduce cellanneal, a python-based software for deconvolving bulk RNA sequencing data. cellanneal relies on the optimization of Spearman's rank correlation coefficient between experimental and computational mixture gene expression vectors using simulated annealing. cellanneal can be used as a python package or via a command line interface, but importantly also provides a simple graphical user interface which is distributed as a single executable file for user convenience. The python package is available at https://github.com/LiBuchauer/cellanneal , the graphical software can be downloaded at http://shalevlab.weizmann.ac.il/resources .


title: Comment on "Flavor invariants and renormalization-group equations in the leptonic sector with massive Majorana neutrinos"

abstract: Recently in [JHEP 09 (2021) 053], Wang et al. discussed the polynomial ring formed by flavor invariants in the leptonic sector with massive Majorana neutrinos. They have explicitly constructed the finite generating sets of the polynomial rings for both two-generation scenario and three-generation scenario. However, Wang et al.'s claim of the finiteness of the generating sets of the polynomial rings and their calculation by the approach of Hilbert series with generalized Molien-Weyl formula are both based on their assertion that the unitary group ${\rm U}(n,\mathbb{C})$ is reductive, which is unfortunately incorrect. The property of being reductive is only applicable to linear algebraic groups. And it is well-known that the unitary group ${\rm U}(n,\mathbb{C})$ is not even a linear algebraic group. In this paper, we point out the above issue and provide a solution to fill in the accompanying logical gaps in [JHEP 09 (2021) 053]. Some important results from the theory of linear algebraic group, the invariant theory of square matrices and group theory are needed in the analysis. We also clarify some somewhat misleading or vague statements in [JHEP 09 (2021) 053] about the scope of flavor invariants. Note that, although built from incorrect assertion, Wang et al.'s calculation results in [JHEP 09 (2021) 053] are nonetheless correct, which is ultimately because the ring of invariants of ${\rm U}(n,\mathbb{C})$ is isomorphic to that of ${\rm GL}(n,\mathbb{C})$ which is itself reductive.


title: Astronomical source finding services for the CIRASA visual analytic platform

abstract: Innovative developments in data processing, archiving, analysis, and visualization are nowadays unavoidable to deal with the data deluge expected in next-generation facilities for radio astronomy, such as the Square Kilometre Array (SKA) and its precursors. In this context, the integration of source extraction and analysis algorithms into data visualization tools could significantly improve and speed up the cataloguing process of large area surveys, boosting astronomer productivity and shortening publication time. To this aim, we are developing a visual analytic platform (CIRASA) for advanced source finding and classification, integrating state-of-the-art tools, such as the CAESAR source finder, the ViaLactea Visual Analytic (VLVA) and Knowledge Base (VLKB). In this work, we present the project objectives and the platform architecture, focusing on the implemented source finding services.


title: NNK-Means: Data summarization using dictionary learning with non-negative kernel regression

abstract: An increasing number of systems are being designed by gathering significant amounts of data and then optimizing the system parameters directly using the obtained data. Often this is done without analyzing the dataset structure. As task complexity, data size, and parameters all increase to millions or even billions, data summarization is becoming a major challenge. In this work, we investigate data summarization via dictionary learning~(DL), leveraging the properties of recently introduced non-negative kernel regression (NNK) graphs. Our proposed NNK-Means, unlike previous DL techniques, such as kSVD, learns geometric dictionaries with atoms that are representative of the input data space. Experiments show that summarization using NNK-Means can provide better class separation compared to linear and kernel versions of kMeans and kSVD. Moreover, NNK-Means is scalable, with runtime complexity similar to that of kMeans.


title: Towards Identity Preserving Normal to Dysarthric Voice Conversion

abstract: We present a voice conversion framework that converts normal speech into dysarthric speech while preserving the speaker identity. Such a framework is essential for (1) clinical decision making processes and alleviation of patient stress, (2) data augmentation for dysarthric speech recognition. This is an especially challenging task since the converted samples should capture the severity of dysarthric speech while being highly natural and possessing the speaker identity of the normal speaker. To this end, we adopted a two-stage framework, which consists of a sequence-to-sequence model and a nonparallel frame-wise model. Objective and subjective evaluations were conducted on the UASpeech dataset, and results showed that the method was able to yield reasonable naturalness and capture severity aspects of the pathological speech. On the other hand, the similarity to the normal source speaker's voice was limited and requires further improvements.


title: From Start to Finish: Latency Reduction Strategies for Incremental Speech Synthesis in Simultaneous Speech-to-Speech Translation

abstract: Speech-to-speech translation (S2ST) converts input speech to speech in another language. A challenge of delivering S2ST in real time is the accumulated delay between the translation and speech synthesis modules. While recently incremental text-to-speech (iTTS) models have shown large quality improvements, they typically require additional future text inputs to reach optimal performance. In this work, we minimize the initial waiting time of iTTS by adapting the upstream speech translator to generate high-quality pseudo lookahead for the speech synthesizer. After mitigating the initial delay, we demonstrate that the duration of synthesized speech also plays a crucial role on latency. We formalize this as a latency metric and then present a simple yet effective duration-scaling approach for latency reduction. Our approaches consistently reduce latency by 0.2-0.5 second without sacrificing speech translation quality.


title: Holographic QCD model for $N_f=4$

abstract: We establish a holographic QCD model for four flavors, where a light scalar field $X$ and a heavy scalar field $H$ are introduced, separately. The $H$ field is responsible for the breaking of $SU(N_f=4)$ to $SU(N_f=3)$. The ground state and its Regge excitation of meson spectra in the light flavor sector and heavy flavor sector as well as the ligh-heavy mesons are well in agreement with the Particle data group (PDG). Due to the additional introduction of the $H$ field in the model, different Regge slopes for light and heavy mesons can be achieved.


title: Totimorphic assemblies from neutrally-stable units

abstract: Inspired by the quest for shape-shifting structures in a range of applications, we show how to create morphable structural materials using a neutrally stable unit cell as a building block. This unit cell is a self-stressed hinged structure with a one-parameter family of morphing motions that are all energetically equivalent; however, unlike kinematic mechanisms, it is not infinitely floppy and instead exhibits a tunable mechanical response akin to that of an ideal rigid-plastic material. Theory and simulations allow us to explore the properties of planar and spatial assemblies of neutrally-stable elements and also pose and solve the inverse problem of designing assemblies that can morph from one given shape into another. Simple experimental prototypes of these assemblies corroborate our theoretical results and show that the addition of switchable hinges allows us to create load-bearing structures. All together, totimorphs pave the way for structural materials whose geometry and deformation response can be controlled independently and at multiple scales.


title: Choice functions based multi-objective Bayesian optimisation

abstract: In this work we introduce a new framework for multi-objective Bayesian optimisation where the multi-objective functions can only be accessed via choice judgements, such as ``I pick options A,B,C among this set of five options A,B,C,D,E''. The fact that the option D is rejected means that there is at least one option among the selected ones A,B,C that I strictly prefer over D (but I do not have to specify which one). We assume that there is a latent vector function f for some dimension $n_e$ which embeds the options into the real vector space of dimension n, so that the choice set can be represented through a Pareto set of non-dominated options. By placing a Gaussian process prior on f and deriving a novel likelihood model for choice data, we propose a Bayesian framework for choice functions learning. We then apply this surrogate model to solve a novel multi-objective Bayesian optimisation from choice data problem.


title: Asymptotic distribution of Nodal Intersections for ARW against a Surface

abstract: We investigate Gaussian Laplacian eigenfunctions (Arithmetic Random Waves) on the three-dimensional standard flat torus, in particular the asymptotic distribution of the nodal intersection length against a fixed regular reference surface. Expectation and variance have been addressed by Maffucci (2019) who found that the expected length is proportional to the square root of the eigenvalue times the area of the surface, while the asymptotic variance only depends on the geometry of the surface, the projected lattice points being equidistributed on the two-dimensional unit sphere in the high-energy limit. He also noticed that there are ``special'' surfaces, so-called static, for which the variance is of smaller order; however he did not prescribe the precise asymptotic law in this case. In this paper, we study second order fluctuations of the nodal intersection length. Our first main result is a Central Limit Theorem for ``generic'' surfaces, while for static ones, a sphere or a hemisphere e.g., our main results are a non-Central Limit Theorem and a precise asymptotic law for the variance of the nodal intersection length, conditioned on the existence of so-called well-separated sequences of Laplacian eigenvalues. It turns out that, in this regime, the nodal area investigated by Cammarota (2019) is asymptotically fully correlated with the length of the nodal intersections against any sphere. The main ingredients for our proofs are the Kac-Rice formula for moments, the chaotic decomposition for square integrable functionals of Gaussian fields, and some arithmetic estimates that may be of independent interest.


title: Measurements of the branching fractions for $B \to K^{*}\gamma$ decays at Belle II

abstract: This paper reports a study of $B \to K^{*}\gamma$ decays using $62.8\pm 0.6$ fb$^{-1}$ of data collected during 2019--2020 by the Belle II experiment at the SuperKEKB $e^{+}e^{-}$ asymmetric-energy collider, corresponding to $(68.2 \pm 0.8) \times 10^6$ $B\overline{B}$ events. We find $454 \pm 28$, $50 \pm 10$, $169 \pm 18$, and $160 \pm 17$ signal events in the decay modes $B^{0} \to K^{*0}[K^{+}\pi^{-}]\gamma$, $B^{0} \to K^{*0}[K^0_{\rm S}\pi^{0}]\gamma$, $B^{+} \to K^{*+}[K^{+}\pi^{0}]\gamma$, and $B^{+} \to K^{*+}[K^{+}\pi^{0}]\gamma$, respectively. The uncertainties quoted for the signal yield are statistical only. We report the branching fractions of these decays: $$\mathcal{B} [B^{0} \to K^{*0}[K^{+}\pi^{-}]\gamma] = (4.5 \pm 0.3 \pm 0.2) \times 10^{-5}, $$ $$\mathcal{B} [B^{0} \to K^{*0}[K^0_{\rm S}\pi^{0}]\gamma] = (4.4 \pm 0.9 \pm 0.6) \times 10^{-5},$$ $$\mathcal{B} [B^{+} \to K^{*+}[K^{+}\pi^{0}]\gamma] = (5.0 \pm 0.5 \pm 0.4)\times 10^{-5},\text{ and}$$ $$\mathcal{B} [B^{+} \to K^{*+}[K^0_{\rm S}\pi^{+}]\gamma] = (5.4 \pm 0.6 \pm 0.4) \times 10^{-5},$$ where the first uncertainty is statistical, and the second is systematic. The results are consistent with world-average values.


title: Combining Diverse Feature Priors

abstract: To improve model generalization, model designers often restrict the features that their models use, either implicitly or explicitly. In this work, we explore the design space of leveraging such feature priors by viewing them as distinct perspectives on the data. Specifically, we find that models trained with diverse sets of feature priors have less overlapping failure modes, and can thus be combined more effectively. Moreover, we demonstrate that jointly training such models on additional (unlabeled) data allows them to correct each other's mistakes, which, in turn, leads to better generalization and resilience to spurious correlations. Code available at https://github.com/MadryLab/copriors


title: Metrics and Design of an Instruction Roofline Model for AMD GPUs

abstract: Due to the recent announcement of the Frontier supercomputer, many scientific application developers are working to make their applications compatible with AMD architectures (CPU-GPU), which means moving away from the traditional CPU and NVIDIA-GPU systems. Due to the current limitations of profiling tools for AMD GPUs, this shift leaves a void in how to measure application performance on AMD GPUs. In this paper, we design an instruction roofline model for AMD GPUs using AMD's ROCProfiler and a benchmarking tool, BabelStream (the HIP implementation), as a way to measure an application's performance in instructions and memory transactions on new AMD hardware. Specifically, we create instruction roofline models for a case study scientific application, PIConGPU, an open source particle-in-cell (PIC) simulations application used for plasma and laser-plasma physics on the NVIDIA V100, AMD Radeon Instinct MI60, and AMD Instinct MI100 GPUs. When looking at the performance of multiple kernels of interest in PIConGPU we find that although the AMD MI100 GPU achieves a similar, or better, execution time compared to the NVIDIA V100 GPU, profiling tool differences make comparing performance of these two architectures hard. When looking at execution time, GIPS, and instruction intensity, the AMD MI60 achieves the worst performance out of the three GPUs used in this work.


title: DialFact: A Benchmark for Fact-Checking in Dialogue

abstract: Fact-checking is an essential tool to mitigate the spread of misinformation and disinformation. We introduce the task of fact-checking in dialogue, which is a relatively unexplored area. We construct DialFact, a testing benchmark dataset of 22,245 annotated conversational claims, paired with pieces of evidence from Wikipedia. There are three sub-tasks in DialFact: 1) Verifiable claim detection task distinguishes whether a response carries verifiable factual information; 2) Evidence retrieval task retrieves the most relevant Wikipedia snippets as evidence; 3) Claim verification task predicts a dialogue response to be supported, refuted, or not enough information. We found that existing fact-checking models trained on non-dialogue data like FEVER fail to perform well on our task, and thus, we propose a simple yet data-efficient solution to effectively improve fact-checking performance in dialogue. We point out unique challenges in DialFact such as handling the colloquialisms, coreferences and retrieval ambiguities in the error analysis to shed light on future research in this direction.


title: Simultaneous Missing Value Imputation and Structure Learning with Groups

abstract: Learning structures between groups of variables from data with missing values is an important task in the real world, yet difficult to solve. One typical scenario is discovering the structure among topics in the education domain to identify learning pathways. Here, the observations are student performances for questions under each topic which contain missing values. However, most existing methods focus on learning structures between a few individual variables from the complete data. In this work, we propose VISL, a novel scalable structure learning approach that can simultaneously infer structures between groups of variables under missing data and perform missing value imputations with deep learning. Particularly, we propose a generative model with a structured latent space and a graph neural network-based architecture, scaling to a large number of variables. Empirically, we conduct extensive experiments on synthetic, semi-synthetic, and real-world education data sets. We show improved performances on both imputation and structure learning accuracy compared to popular and recent approaches.


title: On the fractional Dunkl Laplacian

abstract: In this paper, we present an approach to the fractional Dunkl Laplacian in a framework emerging from certain reflection symmetries in Euclidean spaces. Our main result is pointwise formulas, Bochner subordination, and an extension problem for the fractional Dunkl Laplacian as well


title: Relativistic mechanics of constant curvature

abstract: We consider an inverse variational problem for the lines of constant curvature in (pseudo-)Euclidean two-, three-, and four-dimensional spaces. The accumulated results are physically meaningful in the case of relativistic mechanics of particles.


title: Guiding Visual Question Generation

abstract: In traditional Visual Question Generation (VQG), most images have multiple concepts (e.g. objects and categories) for which a question could be generated, but models are trained to mimic an arbitrary choice of concept as given in their training data. This makes training difficult and also poses issues for evaluation -- multiple valid questions exist for most images but only one or a few are captured by the human references. We present Guiding Visual Question Generation - a variant of VQG which conditions the question generator on categorical information based on expectations on the type of question and the objects it should explore. We propose two variants: (i) an explicitly guided model that enables an actor (human or automated) to select which objects and categories to generate a question for; and (ii) an implicitly guided model that learns which objects and categories to condition on, based on discrete latent variables. The proposed models are evaluated on an answer-category augmented VQA dataset and our quantitative results show a substantial improvement over the current state of the art (over 9 BLEU-4 increase). Human evaluation validates that guidance helps the generation of questions that are grammatically coherent and relevant to the given image and objects.


title: Bi-filtrations and persistence paths for 2-Morse functions

abstract: This paper studies the homotopy-type of bi-filtrations of compact manifolds induced as the pre-image of filtrations of the plane for generic smooth functions f : M --> R^2. The primary goal of the paper is to allow for a simple description of the multi-graded persistent homology associated to such filtrations. The main result of the paper is a description of the evolution of the bi-filtration of f in terms of cellular attachments. An analogy of Morse-Conley equation and Morse inequalities along so called persistence paths are derived. A scheme for computing path-wise barcodes is proposed.


title: Cross-Domain Data Integration for Named Entity Disambiguation in Biomedical Text

abstract: Named entity disambiguation (NED), which involves mapping textual mentions to structured entities, is particularly challenging in the medical domain due to the presence of rare entities. Existing approaches are limited by the presence of coarse-grained structural resources in biomedical knowledge bases as well as the use of training datasets that provide low coverage over uncommon resources. In this work, we address these issues by proposing a cross-domain data integration method that transfers structural knowledge from a general text knowledge base to the medical domain. We utilize our integration scheme to augment structural resources and generate a large biomedical NED dataset for pretraining. Our pretrained model with injected structural knowledge achieves state-of-the-art performance on two benchmark medical NED datasets: MedMentions and BC5CDR. Furthermore, we improve disambiguation of rare entities by up to 57 accuracy points.


title: Influencing Towards Stable Multi-Agent Interactions

abstract: Learning in multi-agent environments is difficult due to the non-stationarity introduced by an opponent's or partner's changing behaviors. Instead of reactively adapting to the other agent's (opponent or partner) behavior, we propose an algorithm to proactively influence the other agent's strategy to stabilize -- which can restrain the non-stationarity caused by the other agent. We learn a low-dimensional latent representation of the other agent's strategy and the dynamics of how the latent strategy evolves with respect to our robot's behavior. With this learned dynamics model, we can define an unsupervised stability reward to train our robot to deliberately influence the other agent to stabilize towards a single strategy. We demonstrate the effectiveness of stabilizing in improving efficiency of maximizing the task reward in a variety of simulated environments, including autonomous driving, emergent communication, and robotic manipulation. We show qualitative results on our website: https://sites.google.com/view/stable-marl/.


title: Ground state of Ce$_{3}$Bi$_{4}$Pd$_{3}$ unraveled by hydrostatic pressure

abstract: Noncentrosymmetric Ce$_{3}$Bi$_{4}$Pd$_{3}$ has attracted a lot of attention as a candidate for strongly correlated topological material, yet its experimental ground state remains a matter of contention. Two conflicting scenarios have emerged from a comparison to prototypical Kondo insulator Ce$_{3}$Bi$_{4}$Pt$_{3}$: either Ce$_{3}$Bi$_{4}$Pd$_{3}$ is a spin-orbit-driven topological semimetal or a Kondo insulator with smaller Kondo coupling than its Pt counterpart. Here we determine the ground state of Ce$_{3}$Bi$_{4}$Pd$_{3}$ via electrical resistivity measurements under hydrostatic pressure, which is a clean symmetry-preserving tuning parameter that increases hybridization but virtually preserves spin-orbit coupling. Ce$_{3}$Bi$_{4}$Pd$_{3}$ becomes more insulating under pressure, which is a signature of Ce-based Kondo insulating materials. Its small zero-pressure gap increases quadratically with pressure, similar to the behavior observed in the series Ce$_{3}$Bi$_{4}$(Pt$_{1-x}$Pd$_{x}$)$_{3}$, which indicates that Pt substitution and applied pressure have a similar effect. Our result not only demonstrates that Kondo coupling, rather than spin-orbit coupling, is the main tuning parameter in this class of materials, but it also establishes that Ce$_{3}$Bi$_{4}$Pd$_{3}$ has a narrow-gap Kondo insulating ground state.


title: Unified picture of nucleon pairs playing leading roles in nuclear collectivity

abstract: Proxy-SU(3) symmetry is an approximation scheme extending the Elliott SU(3) algebra of the sd shell to heavier shells. When introduced in 2017, the approximation had been justified by calculations carried out within the Nilsson model, with nucleon pairs differing by $\Delta K [\Delta N \Delta n_z \Delta \Lambda]=0[110]$ in the Nilsson quantum numbers playing a major role in the approximation. Recently our group managed to map the cartesian basis of the Elliott SU(3) model onto the spherical shell model basis, fully clarifying the approximations used within the proxy-SU(3) scheme and paving the way for using the proxy-SU(3) approximation in shell model calculations for heavy nuclei. As a by-product, the relation of the 0[110] Nilsson pairs used in proxy-SU(3) to the earlier used de Shalit-Goldhaber pairs $|\Delta n \Delta l \Delta j \Delta m_j\rangle = | 0110\rangle$ in spherical shell model notation is clarified, while the Federman-Pittel (FP) pairs known to play a major role at the onset of deformation are identified as $| 0010\rangle$ pairs, and the FP pairs further increasing the deformation after its onset are found to be $| 0110\rangle$ pairs, i.e. identical to the de-Shalit-Goldhaber pairs. The connection between the proxy-SU(3) scheme and the spherical shell model has also been worked out in the original framework of the Nilsson model, with identical results.


title: Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction

abstract: Dynamic model pruning is a recent direction that allows for the inference of a different sub-network for each input sample during deployment. However, current dynamic methods rely on learning a continuous channel gating through regularization by inducing sparsity loss. This formulation introduces complexity in balancing different losses (e.g task loss, regularization loss). In addition, regularization based methods lack transparent tradeoff hyperparameter selection to realize a computational budget. Our contribution is two-fold: 1) decoupled task and pruning losses. 2) Simple hyperparameter selection that enables FLOPs reduction estimation before training. Inspired by the Hebbian theory in Neuroscience: "neurons that fire together wire together", we propose to predict a mask to process k filters in a layer based on the activation of its previous layer. We pose the problem as a self-supervised binary classification problem. Each mask predictor module is trained to predict if the log-likelihood for each filter in the current layer belongs to the top-k activated filters. The value k is dynamically estimated for each input based on a novel criterion using the mass of heatmaps. We show experiments on several neural architectures, such as VGG, ResNet and MobileNet on CIFAR and ImageNet datasets. On CIFAR, we reach similar accuracy to SOTA methods with 15% and 24% higher FLOPs reduction. Similarly in ImageNet, we achieve lower drop in accuracy with up to 13% improvement in FLOPs reduction.


title: The Power of Many: A Physarum Swarm Steiner Tree Algorithm

abstract: We create a novel Physarum Steiner algorithm designed to solve the Euclidean Steiner tree problem. Physarum is a unicellular slime mold with the ability to form networks and fuse with other Physarum organisms. We use the simplicity and fusion of Physarum to create large swarms which independently operate to solve the Steiner problem. The Physarum Steiner tree algorithm then utilizes a swarm of Physarum organisms which gradually find terminals and fuse with each other, sharing intelligence. The algorithm is also highly capable of solving the obstacle avoidance Steiner tree problem and is a strong alternative to the current leading algorithm. The algorithm is of particular interest due to its novel approach, rectilinear properties, and ability to run on varying shapes and topological surfaces.


title: Terahertz Kerr effect in a methylammonium lead bromide perovskite crystal

abstract: We have observed short-lived optical birefringence in a CH$_3$NH$_3$PbBr$_3$ single crystal induced by a powerful nearly single-cycle terahertz pulse. Apart from the instantaneous contribution that follows the profile of the squared pump electric field, the recorded anisotropy signal contains an exponential component decaying in $\sim$ 350 fs, underdamped oscillations at the frequency of $\sim$ 0.16 THz and an intermediate picosecond relaxation process with a Gaussian tail. We associate these three non-trivial features with, respectively, Kerr effect in the inorganic lattice, terahertz-induced transient alignment of CH$_3$NH$_3^+$ cations, and their coherent rotation excited by the terahertz pulse in a Raman process.


title: Plane one-dimensional MHD flows: symmetries and conservation laws

abstract: The paper considers the plane one-dimensional flows for magnetohydrodynamics in the mass Lagrangian coordinates. The inviscid, thermally non-conducting medium is modeled by a polytropic gas. The equations are examined for symmetries and conservation laws. For the case of the finite electric conductivity we establish Lie group classification, i.e. we describe all cases of the conductivity $ \sigma ( \rho , p)$ for which there are symmetry extensions. The conservation laws are derived by the direct computation. For the case of the infinite electrical conductivity the equations can be brought into a variational form in the Lagrangian coordinates. Lie group classification is performed for the entropy function as an arbitrary element. Using the variational structure, we employ the Noether theorem for obtaining conservation laws. The conservation laws are also given in the physical variables.


title: Arquile varieties -- varieties consisting of power series in a single variable

abstract: Arquile varieties are zerosets of polynomial, algebraic, analytic, or formal equations f(t,y_1,...,y_m) = 0 with solutions y(t) = (y_1(t),...,y_m(t)) in affine m-space over an algebraic, convergent or formal power series ring k<t>, k{t}, or k[[t]]. As such they generalize the concept of the arc space of an algebraic variety. In the article, the geometry of arquile varieties is studied in detail. Among other things, it is shown that, after a suitable stratification, their singularities, once defined appropriately, are confined to a finite dimensional part. The main technique to do this is to combine, as is standard in the theory of arc spaces, tools from algebraic geometry and commutative algebra with the additional knowledge that the points of arquile varieties are not just abstract objects (as they are in classical algebraic and analytic geometry) but concrete power series having their proper series expansion.


title: Exact DG-categories and fully faithful triangulated inclusion functors

abstract: We construct an "almost involution" assigning a new DG-category to a given one, and use this construction in order to recover, say, the abelian category of graded modules over the graded ring $R^*$ from the DG-category of DG-modules over a DG-ring $(R^*,d)$. This provides an appropriate technical background for the definition and discussion of abelian and exact DG-categories. In the setting of exact DG-categories, derived categories of the second kind are defined in the maximal natural generality. We develop the related abstract category-theoretic language and use it in order to formulate and prove several full-and-faithfulness theorems for triangulated functors induced by the inclusions of fully exact DG-subcategories. Such functors are fully faithful for derived categories of the second kind more often than for the conventional derived categories. Examples and applications range from the categories of complexes in abelian/exact categories to matrix factorization categories, and from curved DG-modules over curved DG-rings to quasi-coherent CDG-modules over quasi-coherent CDG-quasi-algebras over schemes.


title: Spectral heat content on a class of fractal sets for subordinate killed Brownian motions

abstract: We study the spectral heat content for a class of open sets with fractal boundaries determined by similitudes in $\mathbb{R}^{d}$, $d\geq 1$, with respect to subordinate killed Brownian motions via $\alpha/2$-stable subordinators and establish the asymptotic behavior of the spectral heat content as $t\to 0$ for the full range of $\alpha\in (0,2)$. Our main theorems show that these asymptotic behaviors depend on whether the sequence of logarithms of the coefficients of the similitudes is arithmetic when $\alpha\in [d-\b,2)$, where $\b$ is the interior Minkowski dimension of the boundary of the open set. The main tools for proving the theorems are the previous results on the spectral heat content for Brownian motions and the renewal theorem.


title: Learn Proportional Derivative Controllable Latent Space from Pixels

abstract: Recent advances in latent space dynamics model from pixels show promising progress in vision-based model predictive control (MPC). However, executing MPC in real time can be challenging due to its intensive computational cost in each timestep. We propose to introduce additional learning objectives to enforce that the learned latent space is proportional derivative controllable. In execution time, the simple PD-controller can be applied directly to the latent space encoded from pixels, to produce simple and effective control to systems with visual observations. We show that our method outperforms baseline methods to produce robust goal reaching and trajectory tracking in various environments.


title: Revisiting the conservativity of fixpoints over intuitionistic arithmetic

abstract: This paper presents a novel proof of the conservativity of the intuitionistic theory of strictly positive fixpoints, $\widehat{\mathrm{ID}}{}_{1}^{\mathrm{i}}$, over Heyting arithmetic (HA), originally proved in full generality by Arai (2011). The proof embeds $\widehat{\mathrm{ID}}{}_{1}^{\mathrm{i}}$ into the corresponding theory over Beeson's logic of partial terms and then uses two consecutive interpretations, a realizability interpretation of this theory into the subtheory generated by almost negative fixpoints, and a direct interpretation into Heyting arithmetic with partial terms using a hierarchy of satisfaction predicates for almost negative formulae. It concludes by applying van den Berg and van Slooten's result (2018) that Heyting arithmetic with partial terms plus the schema of self realizability for arithmetic formulae is conservative over HA.


title: Intent-based Product Collections for E-commerce using Pretrained Language Models

abstract: Building a shopping product collection has been primarily a human job. With the manual efforts of craftsmanship, experts collect related but diverse products with common shopping intent that are effective when displayed together, e.g., backpacks, laptop bags, and messenger bags for freshman bag gifts. Automatically constructing a collection requires an ML system to learn a complex relationship between the customer's intent and the product's attributes. However, there have been challenging points, such as 1) long and complicated intent sentences, 2) rich and diverse product attributes, and 3) a huge semantic gap between them, making the problem difficult. In this paper, we use a pretrained language model (PLM) that leverages textual attributes of web-scale products to make intent-based product collections. Specifically, we train a BERT with triplet loss by setting an intent sentence to an anchor and corresponding products to positive examples. Also, we improve the performance of the model by search-based negative sampling and category-wise positive pair augmentation. Our model significantly outperforms the search-based baseline model for intent-based product matching in offline evaluations. Furthermore, online experimental results on our e-commerce platform show that the PLM-based method can construct collections of products with increased CTR, CVR, and order-diversity compared to expert-crafted collections.


title: Evolving spiking neuron cellular automata and networks to emulate in vitro neuronal activity

abstract: Neuro-inspired models and systems have great potential for applications in unconventional computing. Often, the mechanisms of biological neurons are modeled or mimicked in simulated or physical systems in an attempt to harness some of the computational power of the brain. However, the biological mechanisms at play in neural systems are complicated and challenging to capture and engineer; thus, it can be simpler to turn to a data-driven approach to transfer features of neural behavior to artificial substrates. In the present study, we used an evolutionary algorithm (EA) to produce spiking neural systems that emulate the patterns of behavior of biological neurons in vitro. The aim of this approach was to develop a method of producing models capable of exhibiting complex behavior that may be suitable for use as computational substrates. Our models were able to produce a level of network-wide synchrony and showed a range of behaviors depending on the target data used for their evolution, which was from a range of neuronal culture densities and maturities. The genomes of the top-performing models indicate the excitability and density of connections in the model play an important role in determining the complexity of the produced activity.


title: Neural Dubber: Dubbing for Videos According to Scripts

abstract: Dubbing is a post-production process of re-recording actors' dialogues, which is extensively used in filmmaking and video production. It is usually performed manually by professional voice actors who read lines with proper prosody, and in synchronization with the pre-recorded videos. In this work, we propose Neural Dubber, the first neural network model to solve a novel automatic video dubbing (AVD) task: synthesizing human speech synchronized with the given video from the text. Neural Dubber is a multi-modal text-to-speech (TTS) model that utilizes the lip movement in the video to control the prosody of the generated speech. Furthermore, an image-based speaker embedding (ISE) module is developed for the multi-speaker setting, which enables Neural Dubber to generate speech with a reasonable timbre according to the speaker's face. Experiments on the chemistry lecture single-speaker dataset and LRS2 multi-speaker dataset show that Neural Dubber can generate speech audios on par with state-of-the-art TTS models in terms of speech quality. Most importantly, both qualitative and quantitative evaluations show that Neural Dubber can control the prosody of synthesized speech by the video, and generate high-fidelity speech temporally synchronized with the video. Our project page is at https://tsinghua-mars-lab.github.io/NeuralDubber/ .


title: Performance, Successes and Limitations of Deep Learning Semantic Segmentation of Multiple Defects in Transmission Electron Micrographs

abstract: In this work, we perform semantic segmentation of multiple defect types in electron microscopy images of irradiated FeCrAl alloys using a deep learning Mask Regional Convolutional Neural Network (Mask R-CNN) model. We conduct an in-depth analysis of key model performance statistics, with a focus on quantities such as predicted distributions of defect shapes, defect sizes, and defect areal densities relevant to informing modeling and understanding of irradiated Fe-based materials properties. To better understand the performance and present limitations of the model, we provide examples of useful evaluation tests which include a suite of random splits, and dataset size-dependent and domain-targeted cross validation tests. Overall, we find that the current model is a fast, effective tool for automatically characterizing and quantifying multiple defect types in microscopy images, with a level of accuracy on par with human domain expert labelers. More specifically, the model can achieve average defect identification F1 scores as high as 0.8, and, based on random cross validation, have low overall average (+/- standard deviation) defect size and density percentage errors of 7.3 (+/- 3.8)% and 12.7 (+/- 5.3)%, respectively. Further, our model predicts the expected material hardening to within 10-20 MPa (about 10% of total hardening), which is about the same error level as experiments. Our targeted evaluation tests also suggest the best path toward improving future models is not expanding existing databases with more labeled images but instead data additions that target weak points of the model domain, such as images from different microscopes, imaging conditions, irradiation environments, and alloy types. Finally, we discuss the first phase of an effort to provide an easy-to-use, open-source object detection tool to the broader community for identifying defects in new images.


title: Rule Induction in Knowledge Graphs Using Linear Programming

abstract: We present a simple linear programming (LP) based method to learn compact and interpretable sets of rules encoding the facts in a knowledge graph (KG) and use these rules to solve the KG completion problem. Our LP model chooses a set of rules of bounded complexity from a list of candidate first-order logic rules and assigns weights to them. The complexity bound is enforced via explicit constraints. We combine simple rule generation heuristics with our rule selection LP to obtain predictions with accuracy comparable to state-of-the-art codes, even while generating much more compact rule sets. Furthermore, when we take as input rules generated by other codes, we often improve interpretability by reducing the number of chosen rules, while maintaining accuracy.


title: Tricks for Training Sparse Translation Models

abstract: Multi-task learning with an unbalanced data distribution skews model learning towards high resource tasks, especially when model capacity is fixed and fully shared across all tasks. Sparse scaling architectures, such as BASELayers, provide flexible mechanisms for different tasks to have a variable number of parameters, which can be useful to counterbalance skewed data distributions. We find that that sparse architectures for multilingual machine translation can perform poorly out of the box, and propose two straightforward techniques to mitigate this - a temperature heating mechanism and dense pre-training. Overall, these methods improve performance on two multilingual translation benchmarks compared to standard BASELayers and Dense scaling baselines, and in combination, more than 2x model convergence speed.


title: Textual Backdoor Attacks Can Be More Harmful via Two Simple Tricks

abstract: Backdoor attacks are a kind of emergent security threat in deep learning. After being injected with a backdoor, a deep neural model will behave normally on standard inputs but give adversary-specified predictions once the input contains specific backdoor triggers. In this paper, we find two simple tricks that can make existing textual backdoor attacks much more harmful. The first trick is to add an extra training task to distinguish poisoned and clean data during the training of the victim model, and the second one is to use all the clean training data rather than remove the original clean data corresponding to the poisoned data. These two tricks are universally applicable to different attack models. We conduct experiments in three tough situations including clean data fine-tuning, low-poisoning-rate, and label-consistent attacks. Experimental results show that the two tricks can significantly improve attack performance. This paper exhibits the great potential harmfulness of backdoor attacks. All the code and data can be obtained at \url{https://github.com/thunlp/StyleAttack}.


title: Probabilistic Time Series Forecasts with Autoregressive Transformation Models

abstract: Probabilistic forecasting of time series is an important matter in many applications and research fields. In order to draw conclusions from a probabilistic forecast, we must ensure that the model class used to approximate the true forecasting distribution is expressive enough. Yet, characteristics of the model itself, such as its uncertainty or its feature-outcome relationship are not of lesser importance. This paper proposes Autoregressive Transformation Models (ATMs), a model class inspired by various research directions to unite expressive distributional forecasts using a semi-parametric distribution assumption with an interpretable model specification. We demonstrate the properties of ATMs both theoretically and through empirical evaluation on several simulated and real-world forecasting datasets.


title: Thermally driven winds in ULXs

abstract: The presence of radiatively driven outflows is well established in ultraluminous X-ray sources (ULXs). These outflows are optically thick and can reprocess a significant fraction of the accretion luminosity. Assuming isotropic emission, escaping radiation from the outflow's photosphere has the potential to irradiate the outer disc. Here, we explore how the atmosphere of the outer disc would respond to such irradiation, and specifically whether unstable heating may lead to significant mass loss via thermally-driven winds. We find that, for a range of physically relevant system parameters, this mass loss may actually switch off the inflow entirely and potentially drive limit-cycle behaviour (likely modulated on the timescale of the outer disc). In ULXs harbouring neutron stars, magnetic fields tend to have a slight destabilizing effect; for the strongest magnetic fields and highest accretion rates, this can push otherwise stable systems into the unstable regime. We explore the prevalence of the instability in a simulated sample of ULXs obtained from a binary population synthesis calculation. We find that almost all neutron star and black hole ULXs with Eddington-scaled accretion rates of $\dot{m}_0 < 100$ should be able to drive powerful outflows from their outer discs. Several known ULXs are expected to lie in this regime; the persistence of accretion in these sources implies the irradiation may be anisotropic which can be reconciled with the inferred reprocessed (optical) emission if some of this originates in the wind photosphere or irradiation of the secondary star.


title: Direct Simultaneous Speech-to-Speech Translation with Variational Monotonic Multihead Attention

abstract: We present a direct simultaneous speech-to-speech translation (Simul-S2ST) model, Furthermore, the generation of translation is independent from intermediate text representations. Our approach leverages recent progress on direct speech-to-speech translation with discrete units, in which a sequence of discrete representations, instead of continuous spectrogram features, learned in an unsupervised manner, are predicted from the model and passed directly to a vocoder for speech synthesis on-the-fly. We also introduce the variational monotonic multihead attention (V-MMA), to handle the challenge of inefficient policy learning in speech simultaneous translation. The simultaneous policy then operates on source speech features and target discrete units. We carry out empirical studies to compare cascaded and direct approach on the Fisher Spanish-English and MuST-C English-Spanish datasets. Direct simultaneous model is shown to outperform the cascaded model by achieving a better tradeoff between translation quality and latency.


title: Floquet engineering of individual band gaps in an optical lattice using a two-tone drive

abstract: The dynamic engineering of band structures for ultracold atoms in optical lattices represents an innovative approach to understand and explore the fundamental principles of topological matter. In particular, the folded Floquet spectrum determines the associated band topology via band inversion. We experimentally and theoretically study two-frequency phase modulation to asymmetrically hybridize the lowest two bands of a one-dimensional lattice. Using quasi-degenerate perturbation theory in the extended Floquet space we derive an effective two-band model that quantitatively describes our setting. The energy gaps are experimentally probed via Landau-Zener transitions between Floquet-Bloch bands using an accelerated Bose-Einstein condensate. Separate and simultaneous control over the closing and reopening of these band gaps is demonstrated. We find good agreement between experiment and theory, establishing an analytic description for resonant Floquet-Bloch engineering that includes single- and multi-photon couplings, as well as interference effects between several commensurate drives.


title: A Rate-Distortion Framework for Explaining Black-box Model Decisions

abstract: We present the Rate-Distortion Explanation (RDE) framework, a mathematically well-founded method for explaining black-box model decisions. The framework is based on perturbations of the target input signal and applies to any differentiable pre-trained model such as neural networks. Our experiments demonstrate the framework's adaptability to diverse data modalities, particularly images, audio, and physical simulations of urban environments.


title: A Field Guide to Scientific XAI: Transparent and Interpretable Deep Learning for Bioinformatics Research

abstract: Deep learning has become popular because of its potential to achieve high accuracy in prediction tasks. However, accuracy is not always the only goal of statistical modelling, especially for models developed as part of scientific research. Rather, many scientific models are developed to facilitate scientific discovery, by which we mean to abstract a human-understandable representation of the natural world. Unfortunately, the opacity of deep neural networks limit their role in scientific discovery, creating a new demand for models that are transparently interpretable. This article is a field guide to transparent model design. It provides a taxonomy of transparent model design concepts, a practical workflow for putting design concepts into practice, and a general template for reporting design choices. We hope this field guide will help researchers more effectively design transparently interpretable models, and thus enable them to use deep learning for scientific discovery.


title: Inconsistent Few-Shot Relation Classification via Cross-Attentional Prototype Networks with Contrastive Learning

abstract: Standard few-shot relation classification (RC) is designed to learn a robust classifier with only few labeled data for each class. However, previous works rarely investigate the effects of a different number of classes (i.e., $N$-way) and number of labeled data per class (i.e., $K$-shot) during training vs. testing. In this work, we define a new task, \textit{inconsistent few-shot RC}, where the model needs to handle the inconsistency of $N$ and $K$ between training and testing. To address this new task, we propose Prototype Network-based cross-attention contrastive learning (ProtoCACL) to capture the rich mutual interactions between the support set and query set. Experimental results demonstrate that our ProtoCACL can outperform the state-of-the-art baseline model under both inconsistent $K$ and inconsistent $N$ settings, owing to its more robust and discriminate representations. Moreover, we identify that in the inconsistent few-shot learning setting, models can achieve better performance with \textit{less data} than the standard few-shot setting with carefully-selected $N$ and $K$. In the end of the paper, we provide further analyses and suggestions to systematically guide the selection of $N$ and $K$ under different scenarios.


title: Yformer: U-Net Inspired Transformer Architecture for Far Horizon Time Series Forecasting

abstract: Time series data is ubiquitous in research as well as in a wide variety of industrial applications. Effectively analyzing the available historical data and providing insights into the far future allows us to make effective decisions. Recent research has witnessed the superior performance of transformer-based architectures, especially in the regime of far horizon time series forecasting. However, the current state of the art sparse Transformer architectures fail to couple down- and upsampling procedures to produce outputs in a similar resolution as the input. We propose the Yformer model, based on a novel Y-shaped encoder-decoder architecture that (1) uses direct connection from the downscaled encoder layer to the corresponding upsampled decoder layer in a U-Net inspired architecture, (2) Combines the downscaling/upsampling with sparse attention to capture long-range effects, and (3) stabilizes the encoder-decoder stacks with the addition of an auxiliary reconstruction loss. Extensive experiments have been conducted with relevant baselines on four benchmark datasets, demonstrating an average improvement of 19.82, 18.41 percentage MSE and 13.62, 11.85 percentage MAE in comparison to the current state of the art for the univariate and the multivariate settings respectively.


title: Model-Agnostic Meta-Attack: Towards Reliable Evaluation of Adversarial Robustness

abstract: The vulnerability of deep neural networks to adversarial examples has motivated an increasing number of defense strategies for promoting model robustness. However, the progress is usually hampered by insufficient robustness evaluations. As the de facto standard to evaluate adversarial robustness, adversarial attacks typically solve an optimization problem of crafting adversarial examples with an iterative process. In this work, we propose a Model-Agnostic Meta-Attack (MAMA) approach to discover stronger attack algorithms automatically. Our method learns the optimizer in adversarial attacks parameterized by a recurrent neural network, which is trained over a class of data samples and defenses to produce effective update directions during adversarial example generation. Furthermore, we develop a model-agnostic training algorithm to improve the generalization ability of the learned optimizer when attacking unseen defenses. Our approach can be flexibly incorporated with various attacks and consistently improves the performance with little extra computational cost. Extensive experiments demonstrate the effectiveness of the learned attacks by MAMA compared to the state-of-the-art attacks on different defenses, leading to a more reliable evaluation of adversarial robustness.


title: C-AllOut: Catching & Calling Outliers by Type

abstract: Given an unlabeled dataset, wherein we have access only to pairwise similarities (or distances), how can we effectively (1) detect outliers, and (2) annotate/tag the outliers by type? Outlier detection has a large literature, yet we find a key gap in the field: to our knowledge, no existing work addresses the outlier annotation problem. Outliers are broadly classified into 3 types, representing distinct patterns that could be valuable to analysts: (a) global outliers are severe yet isolate cases that do not repeat, e.g., a data collection error; (b) local outliers diverge from their peers within a context, e.g., a particularly short basketball player; and (c) collective outliers are isolated micro-clusters that may indicate coalition or repetitions, e.g., frauds that exploit the same loophole. This paper presents C-AllOut: a novel and effective outlier detector that annotates outliers by type. It is parameter-free and scalable, besides working only with pairwise similarities (or distances) when it is needed. We show that C-AllOut achieves on par or significantly better performance than state-of-the-art detectors when spotting outliers regardless of their type. It is also highly effective in annotating outliers of particular types, a task that none of the baselines can perform.


title: A Framework for Learning to Request Rich and Contextually Useful Information from Humans

abstract: When deployed, AI agents will encounter problems that are beyond their autonomous problem-solving capabilities. Leveraging human assistance can help agents overcome their inherent limitations and robustly cope with unfamiliar situations. We present a general interactive framework that enables an agent to request and interpret rich, contextually useful information from an assistant that has knowledge about the task and the environment. We demonstrate the practicality of our framework on a simulated human-assisted navigation problem. Aided with an assistance-requesting policy learned by our method, a navigation agent achieves up to a 7x improvement in success rate on tasks that take place in previously unseen environments, compared to fully autonomous behavior. We show that the agent can take advantage of different types of information depending on the context, and analyze the benefits and challenges of learning the assistance-requesting policy when the assistant can recursively decompose tasks into subtasks.


title: Training Neural Networks for Solving 1-D Optimal Piecewise Linear Approximation

abstract: Recently, the interpretability of deep learning has attracted a lot of attention. A plethora of methods have attempted to explain neural networks by feature visualization, saliency maps, model distillation, and so on. However, it is hard for these methods to reveal the intrinsic properties of neural networks. In this work, we studied the 1-D optimal piecewise linear approximation (PWLA) problem, and associated it with a designed neural network, named lattice neural network (LNN). We asked four essential questions as following: (1) What are the characters of the optimal solution of the PWLA problem? (2) Can an LNN converge to the global optimum? (3) Can an LNN converge to the local optimum? (4) Can an LNN solve the PWLA problem? Our main contributions are that we propose the theorems to characterize the optimal solution of the PWLA problem and present the LNN method for solving it. We evaluated the proposed LNNs on approximation tasks, forged an empirical method to improve the performance of LNNs. The experiments verified that our LNN method is competitive with the start-of-the-art method.


title: Abstract Interpretation of Fixpoint Iterators with Applications to Neural Networks

abstract: We present a new abstract interpretation framework for the precise over-approximation of numerical fixpoint iterators. Our key observation is that unlike in standard abstract interpretation (AI), typically used to over-approximate all reachable program states, in this setting, one only needs to abstract the concrete fixpoints, i.e., the final program states. Our framework targets numerical fixpoint iterators with convergence and uniqueness guarantees in the concrete and is based on two major technical contributions: (i) theoretical insights which allow us to compute sound and precise fixpoint abstractions without using joins, and (ii) a new abstract domain, CH-Zonotope, which admits efficient propagation and inclusion checks while retaining high precision. We implement our framework in a tool called CRAFT and evaluate it on a novel fixpoint-based neural network architecture (monDEQ) that is particularly challenging to verify. Our extensive evaluation demonstrates that CRAFT exceeds the state-of-the-art performance in terms of speed (two orders of magnitude), scalability (one order of magnitude), and precision (25% higher certified accuracies).


title: Track Recognition for the $\Delta E-E$ Telescopes with Silicon Strip Detectors

abstract: For the high granularity and high energy resolution, Silicon Strip Detector (SSD) is widely applied in assembling telescopes to measure the charged particles in heavy ion reactions. In this paper, we present a novel method to achieve track recognition in the SSD telescopes of the Compact Spectrometer for Heavy Ion Experiment (CSHINE). Each telescope consists of a single-sided silicon strip detector (SSSSD) and a double-sided silicon strip detector (DSSSD) backed by $3 \times 3$ CsI(Tl) crystals. Detector calibration and track reconstruction are implemented. Special decoding algorithm is developed for the multi-track recognition procedure to deal with the multi-hit effect convoluted by charge sharing and the missing signals with certain probability. It is demonstrated that the track recognition efficiency of the method is approximately 90\% and 80\% for the DSSSD-CsI and SSSSD-DSSSD events, respectively.


title: Generation of Intense Phase-Stable Femtosecond Hard X-ray Pulse Pairs

abstract: Coherent nonlinear spectroscopies and imaging in the X-ray domain provide direct insight into the coupled motions of electrons and nuclei with resolution on the electronic length and time scale. The experimental realization of such techniques will strongly benefit from access to intense, coherent pairs of femtosecond X-ray pulses. We have observed phase-stable X-ray pulse pairs containing more thank 3 x 10e7 photons at 5.9 keV (2.1 Angstrom) with about 1 fs duration and 2-5 fs separation. The highly directional pulse pairs are manifested by interference fringes in the superfluorescent and seeded stimulated manganese K-alpha emission induced by an X-ray free-electron laser. The fringes constitute the time-frequency X-ray analogue of the Young double-slit interference allowing for frequency-domain X-ray measurements with attosecond time resolution.


title: FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labeling

abstract: The recently proposed FixMatch achieved state-of-the-art results on most semi-supervised learning (SSL) benchmarks. However, like other modern SSL algorithms, FixMatch uses a pre-defined constant threshold for all classes to select unlabeled data that contribute to the training, thus failing to consider different learning status and learning difficulties of different classes. To address this issue, we propose Curriculum Pseudo Labeling (CPL), a curriculum learning approach to leverage unlabeled data according to the model's learning status. The core of CPL is to flexibly adjust thresholds for different classes at each time step to let pass informative unlabeled data and their pseudo labels. CPL does not introduce additional parameters or computations (forward or backward propagation). We apply CPL to FixMatch and call our improved algorithm FlexMatch. FlexMatch achieves state-of-the-art performance on a variety of SSL benchmarks, with especially strong performances when the labeled data are extremely limited or when the task is challenging. For example, FlexMatch achieves 13.96% and 18.96% error rate reduction over FixMatch on CIFAR-100 and STL-10 datasets respectively, when there are only 4 labels per class. CPL also significantly boosts the convergence speed, e.g., FlexMatch can use only 1/5 training time of FixMatch to achieve even better performance. Furthermore, we show that CPL can be easily adapted to other SSL algorithms and remarkably improve their performances. We open-source our code at https://github.com/TorchSSL/TorchSSL.


abstract: Attributed graph clustering, which learns node representation from node attribute and topological graph for clustering, is a fundamental but challenging task for graph analysis. Recently, methods based on graph contrastive learning (GCL) have obtained impressive clustering performance on this task. Yet, we observe that existing GCL-based methods 1) fail to benefit from imprecise clustering labels; 2) require a post-processing operation to get clustering labels; 3) cannot solve out-of-sample (OOS) problem. To address these issues, we propose a novel attributed graph clustering network, namely Self-supervised Contrastive Attributed Graph Clustering (SCAGC). In SCAGC, by leveraging inaccurate clustering labels, a self-supervised contrastive loss, which aims to maximize the similarities of intra-cluster nodes while minimizing the similarities of inter-cluster nodes, are designed for node representation learning. Meanwhile, a clustering module is built to directly output clustering labels by contrasting the representation of different clusters. Thus, for the OOS nodes, SCAGC can directly calculate their clustering labels. Extensive experimental results on four benchmark datasets have shown that SCAGC consistently outperforms 11 competitive clustering methods.


title: Knowledge-driven Active Learning

abstract: The deployment of Deep Learning (DL) models is still precluded in those contexts where the amount of supervised data is limited. To answer this issue, active learning strategies aim at minimizing the amount of labelled data required to train a DL model. Most active strategies are based on uncertain sample selection, and even often restricted to samples lying close to the decision boundary. These techniques are theoretically sound, but an understanding of the selected samples based on their content is not straightforward, further driving non-experts to consider DL as a black-box. For the first time, here we propose to take into consideration common domain-knowledge and enable non-expert users to train a model with fewer samples. In our Knowledge-driven Active Learning (KAL) framework, rule-based knowledge is converted into logic constraints and their violation is checked as a natural guide for sample selection. We show that even simple relationships among data and output classes offer a way to spot predictions for which the model need supervision. We empirically show that KAL (i) outperforms many active learning strategies, particularly in those contexts where domain knowledge is rich, (ii) it discovers data distribution lying far from the initial training data, (iii) it ensures domain experts that the provided knowledge is acquired by the model, (iv) it is suitable for regression and object recognition tasks unlike uncertainty-based strategies, and (v) its computational demand is low.


title: PG$^2$Net: Personalized and Group Preferences Guided Network for Next Place Prediction

abstract: Predicting the next place to visit is a key in human mobility behavior modeling, which plays a significant role in various fields, such as epidemic control, urban planning, traffic management, and travel recommendation. To achieve this, one typical solution is designing modules based on RNN to capture their preferences to various locations. Although these RNN-based methods can effectively learn individual's hidden personalized preferences to her visited places, the interactions among users can only be weakly learned through the representations of locations. Targeting this, we propose an end-to-end framework named personalized and group preference guided network (PG$^2$Net), considering the users' preferences to various places at both individual and collective levels. Specifically, PG$^2$Net concatenates Bi-LSTM and attention mechanism to capture each user's long-term mobility tendency. To learn population's group preferences, we utilize spatial and temporal information of the visitations to construct a spatio-temporal dependency module. We adopt a graph embedding method to map users' trajectory into a hidden space, capturing their sequential relation. In addition, we devise an auxiliary loss to learn the vectorial representation of her next location. Experiment results on two Foursquare check-in datasets and one mobile phone dataset indicate the advantages of our model compared to the state-of-the-art baselines. Source codes are available at https://github.com/urbanmobility/PG2Net.


title: A Broad-Spectrum Diffractive Network via Ensemble Learning

abstract: We proposed a broad-spectrum diffractive deep neural network (BS-D2NN) framework, which incorporates multi-wavelength channels of input lightfields and performs a parallel phase-only modulation utilizing a layered passive mask architecture. A complementary multi-channel base learner cluster is formed in a homogeneous ensemble framework based on the diffractive dispersion during lightwave modulation. In addition, both the optical Sum operation and the Hybrid (optical-electronic) Maxout operation are performed for motivating the BS-D2NN to learn and construct a mapping between input lightfields and truth labels under heterochromatic ambient lighting. The BS-D2NN can be trained using deep learning algorithms so as to perform a kind of wavelength-insensitive high-accuracy object classification.


title: Explainable Student Performance Prediction With Personalized Attention for Explaining Why A Student Fails

abstract: As student failure rates continue to increase in higher education, predicting student performance in the following semester has become a significant demand. Personalized student performance prediction helps educators gain a comprehensive view of student status and effectively intervene in advance. However, existing works scarcely consider the explainability of student performance prediction, which educators are most concerned about. In this paper, we propose a novel Explainable Student performance prediction method with Personalized Attention (ESPA) by utilizing relationships in student profiles and prior knowledge of related courses. The designed Bidirectional Long Short-Term Memory (BiLSTM) architecture extracts the semantic information in the paths with specific patterns. As for leveraging similar paths' internal relations, a local and global-level attention mechanism is proposed to distinguish the influence of different students or courses for making predictions. Hence, valid reasoning on paths can be applied to predict the performance of students. The ESPA consistently outperforms the other state-of-the-art models for student performance prediction, and the results are intuitively explainable. This work can help educators better understand the different impacts of behavior on students' studies.


title: Robust statistical tools for identifying multiple stellar populations in globular clusters in the presence of measurement errors. A case study: NGC 2808

abstract: The finding of multiple stellar populations (MP), defined by patterns in the stellar element abundances, is nowadays considered a distinctive feature of globular clusters. However, while data availability and quality improved in last decades, this is not always true for the techniques adopted to their analysis, rising problems of objectivity of the claims and reproducibility. Using NGC 2808 as test case we show the use of well established statistical clustering methods. We focus the analysis to the RGB phase, where two data sets are available from recent literature for low- and high-resolution spectroscopy. We adopt both hierarchical clustering and partition methods. We explicitly address the usually neglected problem of measurement errors. The results of the clustering algorithms were subjected to silhouette width analysis to compare the performance of the split into different number of MP. For both data sets the results are at odd with those reported in the literature. Two MP are detected for both data sets, while the literature reports five and four MP from high- and low-resolution spectroscopy respectively. The silhouette analysis suggests that the population sub-structure is reliable for high-resolution spectroscopy data, while the actual existence of MP is questionable for the low-resolution spectroscopy data. The discrepancy with literature claims is explainable due to the difference of methods adopted to MP characterisation. By means of Monte Carlo simulations and multimodality statistical tests we show that the often adopted study of the histogram of the differences in some key elements is prone to multiple false positive findings. The adoption of statistically grounded methods, which adopt all the available information to subset the data and explicitly address the problem of data uncertainty, is of paramount importance to present more robust and reproducible researches.


title: From Multimodal to Unimodal Attention in Transformers using Knowledge Distillation

abstract: Multimodal Deep Learning has garnered much interest, and transformers have triggered novel approaches, thanks to the cross-attention mechanism. Here we propose an approach to deal with two key existing challenges: the high computational resource demanded and the issue of missing modalities. We introduce for the first time the concept of knowledge distillation in transformers to use only one modality at inference time. We report a full study analyzing multiple student-teacher configurations, levels at which distillation is applied, and different methodologies. With the best configuration, we improved the state-of-the-art accuracy by 3%, we reduced the number of parameters by 2.5 times and the inference time by 22%. Such performance-computation tradeoff can be exploited in many applications and we aim at opening a new research area where the deployment of complex models with limited resources is demanded.


title: Training Deep Neural Networks with Joint Quantization and Pruning of Weights and Activations

abstract: Quantization and pruning are core techniques used to reduce the inference costs of deep neural networks. State-of-the-art quantization techniques are currently applied to both the weights and activations; however, pruning is most often applied to only the weights of the network. In this work, we jointly apply novel uniform quantization and unstructured pruning methods to both the weights and activations of deep neural networks during training. Using our methods, we empirically evaluate the currently accepted prune-then-quantize paradigm across a wide range of computer vision tasks and observe a non-commutative nature when applied to both the weights and activations of deep neural networks. Informed by these observations, we articulate the non-commutativity hypothesis: for a given deep neural network being trained for a specific task, there exists an exact training schedule in which quantization and pruning can be introduced to optimize network performance. We identify that this optimal ordering not only exists, but also varies across discriminative and generative tasks. Using the optimal training schedule within our training framework, we demonstrate increased performance per memory footprint over existing solutions.


title: Tree-based local explanations of machine learning model predictions, AraucanaXAI

abstract: Increasingly complex learning methods such as boosting, bagging and deep learning have made ML models more accurate, but harder to understand and interpret. A tradeoff between performance and intelligibility is often to be faced, especially in high-stakes applications like medicine. In the present article we propose a novel methodological approach for generating explanations of the predictions of a generic ML model, given a specific instance for which the prediction has been made, that can tackle both classification and regression tasks. Advantages of the proposed XAI approach include improved fidelity to the original model, the ability to deal with non-linear decision boundaries, and native support to both classification and regression problems


title: Hamiltonian Truncation Effective Theory

abstract: Hamiltonian truncation is a non-perturbative numerical method for calculating observables of a quantum field theory. The starting point for this method is to truncate the interacting Hamiltonian to a finite-dimensional space of states spanned by the eigenvectors of the free Hamiltonian $H_0$ with eigenvalues below some energy cutoff $E_\text{max}$. In this work, we show how to treat Hamiltonian truncation systematically using effective field theory methodology. We define the finite-dimensional effective Hamiltonian by integrating out the states above $E_\text{max}$. The effective Hamiltonian can be computed by matching a transition amplitude to the full theory, and gives corrections order by order as an expansion in powers of $1/E_\text{max}$. The effective Hamiltonian is non-local, with the non-locality controlled in an expansion in powers of $H_0/E_\text{max}$. The effective Hamiltonian is also non-Hermitian, and we discuss whether this is a necessary feature or an artifact of our definition. We apply our formalism to 2D $\lambda \phi^4$ theory, and compute the the leading $1/E_\text{max}^2$ corrections to the effective Hamiltonian. We show that these corrections non-trivially satisfy the crucial property of separation of scales. Numerical diagonalization of the effective Hamiltonian gives residual errors of order $1/E_\text{max}^3$, as expected by our power counting. We also present the power counting for 3D $\lambda \phi^4$ theory and perform calculations that demonstrate the separation of scales in this theory.


title: Correlation and Combination of Sets of Parton Distributions

abstract: We study the correlation between different sets of parton distributions (PDFs). Specifically, viewing different PDF sets as distinct determinations, generally correlated, of the same underlying physical quantity, we examine the extent to which the correlation between them is due to the underlying data. We do this both for pairs of PDF sets determined using a given fixed methodology, and between sets determined using different methodologies. We show that correlations have a sizable component that is not due to the underlying data, because the data do not determine the PDF uniquely. We show that the data-driven correlations can be used to assess the efficiency of methodologies used for PDF determination. We also show that the use of data-driven correlations for the combination of different PDFs into a joint set can lead to inconsistent results, and thus that the statistical combination used in constructing the widely used PDF4LHC15 PDF set remains the most reliable method.


title: Mirror diffusion of cosmic rays in highly compressible turbulence near supernova remnants

abstract: Recent gamma-ray observations reveal inhomogeneous diffusion of cosmic rays (CRs) in the interstellar medium (ISM). This is expected as the diffusion of CRs depends on the properties of turbulence, which can vary widely in the multi-phase ISM. We focus on the mirror diffusion arising in highly compressible turbulence in molecular clouds (MCs) around supernova remnants (SNRs), where the magnetic mirroring effect results in significant suppression of diffusion of CRs near CR sources. Significant energy loss via proton-proton interactions due to slow diffusion flattens the low-energy CR spectrum, while the high-energy CR spectrum is steepened due to the strong dependence of mirror diffusion on CR energy. The resulting broken power law spectrum of CRs matches well the gamma-ray spectrum observed from SNR/MC systems, e.g., IC443 and W44.


title: Bubble instability of mIIA on $\mathrm{AdS}_4\times S^6$

abstract: We consider compactifications of massive IIA supergravity on a six-sphere. This setup is known to give rise to non-supersymmetric AdS$_4$ vacua preserving SO$(7)$ as well as G$_2$ residual symmetry. Both solutions have a round $S^6$ metric and are supported by the Romans' mass and internal $F_6$ flux. While the SO$(7)$ invariant vacuum is known to be perturbatively unstable, the G$_2$ invariant one has been found to have a fully stable Kaluza-Klein spectrum. Moreover, it has been shown to be protected against brane-jet instabilities. Motivated by these results, we study possible bubbling solutions connected to the G$_2$ vacuum, representing non-perturbative instabilities of the latter. We indeed find an instability channel represented by the nucleation of a bubble of nothing dressed up with a homogeneous D2 brane charge distribution in the internal space. Our solution generalizes to the case where $S^6$ is replaced by any six-dimensional nearly-K\"ahler manifold.


title: Kink-antikink scattering in a quantum vacuum

abstract: We study kink-antikink scattering in the sine-Gordon model in the presence of interactions with an additional scalar field, $\psi$, that is in its quantum vacuum. In contrast to the classical scattering, now there is quantum radiation of $\psi$ quanta and the kink-antikink may form bound states that resemble breathers of the sine-Gordon model. We quantify the rate of radiation and map the parameters for which bound states are formed. Even these bound states radiate and decay, and eventually there is a transition into long-lived oscillons.


title: Replacing the Notion of Spacetime Distance by the Notion of Correlation

abstract: Spacetime is conventionally viewed as a stage on which actors, in the form of fields, move. Here, we explore what may lie beyond this picture. The starting point is the observation that quantum fluctuations of fields are the more strongly correlated the shorter their spacetime distance. As a consequence, the notion of spacetime distance, including the metric as its infinitesimal version, can be replaced by the notion of correlation strength. This suggests a new picture in which abstract (2-point and multi-point) correlators are the primary structure. In general, these abstract correlators can only be described as information theoretic structures and, in principle, they need not bear any relationship to quantum fields or spacetimes. These correlators may allow approximations, however, so that, in certain regimes, they can be mathematically approximately represented as the 2-point and multi-point functions of quantum fields living on a spacetime. In this way, the standard picture of a curved spacetime with fields whose correlators arise from Feynman rules would merely be a convenient approximate picture, while the underlying picture is that of a spacetime-less and field-less information-theoretic structure of abstract correlations.


title: The Tail of Late-forming Dwarf Galaxies in $\Lambda$CDM

abstract: We use a robust analytical model together with a high-resolution hydrodynamical cosmological simulation to demonstrate that in a $\Lambda$ cold dark matter ($\Lambda$CDM) universe, a small fraction of dwarf galaxies inhabiting dark matter (DM) halos in the mass range $3\times 10^{9} \lesssim M_{200} / M_{\odot} \lesssim 10^{10}$ form unusually late ($z<3$) compared to the bulk population of galaxies. These galaxies originate from the interplay between the stochastic growth of DM halos and the existence of a time-dependent DM halo mass below which galaxies do not form. The formation epoch of the simulated late-forming galaxies traces remarkably well the time when their host DM halos first exceeded a nontrivial (but well-understood) time-dependent critical mass, thus making late-forming dwarfs attractive cosmological probes with constraining power over the past growth history of their host halos. The agreement between our model and the simulation results demonstrates that the population of simulated late-forming dwarfs is a robust cosmological outcome and largely independent of the specific galaxy formation model included in the simulations provided: (1) the universe underwent cosmic reionization before $z_{\rm re} \sim 8$; (2) star formation proceeds in gas that self-gravitates; and (3) galaxy formation is largely restricted to atomic-cooling halos before $z_{\rm re}$. The scarcity of massive late-forming dwarfs expected in $\Lambda$CDM implies that the great majority of bright, metal-poor, and actively star-forming dwarfs observed in our local universe--the most obvious candidates for these late-forming galaxies--cannot be undergoing their formation for the first time at the present day in a $\Lambda$CDM universe.


title: Edge physics at the deconfined transition between a quantum spin Hall insulator and a superconductor

abstract: We study the edge physics of the deconfined quantum phase transition (DQCP) between a spontaneous quantum spin Hall (QSH) insulator and a spin-singlet superconductor (SC). Although the bulk of this transition is in the same universality class as the paradigmatic deconfined Neel to valence-bond-solid transition, the boundary physics has a richer structure due to proximity to a quantum spin Hall state. We use the parton trick to write down an effective field theory for the QSH-SC transition in the presence of a boundary. We calculate various edge properties in an $N\to\infty$ limit. We show that the boundary Luttinger liquid in the QSH state survives at the phase transition, but only as "fractional" degrees of freedom that carry charge but not spin. The physical fermion remains gapless on the edge at the critical point, with a universal jump in the fermion scaling dimension as the system approaches the transition from the QSH side. The critical point could be viewed as a gapless analogue of the quantum spin Hall state but with the full $SU(2)$ spin rotation symmetry, which cannot be realized if the bulk is gapped.